Villagers fly off beds in a player built village

I created a flat world and built a village. Naturally, the villagers would go to sleep at night, but whenever they would lay down in the bed they would shoot off in a different direction, still laying down, and would teleport through walls.