villagers sleep flying

when my villagers go to sleep at night they fly out of their houses and lay in random places. i have a double fence around my house so nothing can get in or out and they still teleport outside it. because they’re outside the fence they keep getting killed by zombies and so i see new baby villagers every day cycle when there’s no possible way the adults can be killed and all my beds should stay filled.