Villagers don't sleep in beds sometimes

Villagers are just not staying in their beds. Just like players, if you enter a bed moving, it'll shove you into the wall or just not make you centered. I was able to find a villager sleeping outside of his bed. Other ones in the same village were having the same issue!