Ignore the polls. Rejoining the EU is a deluded fantasy