Migrant crisis puts Tories in peril