Wooing swing voters over partygate could make or break the Tories at next election