Half of voters believe Brexit has made it harder to solve the Channel migrants crisis, poll says