Boris Johnson warned Tories losing support over surge in cross-Channel migrants