Villagers do not appear at where they are supposed to be

I have a villager chamber/breeder. In there are at least 20 villagers, but from point to point, all the villagers do not appear at where they are supposed to be and instead will glitch into the chamber. Also, the villagers tend to fly out of their beds when I accidently knock them.