Villagers Phase through Walls to Enter/Exit Houses

When I block off all the doors in a village at night to keep villagers safe, some villagers are able to enter and exit small houses through the walls when it turns from night to day and vice versa. I have so far only been able to replicate this in savanna villages, but it's possible it occurs in other biomes.