Villager AI not always working correctly

Steps to Reproduce (with attached world):

1. Go to the center of the village and observe from the sky in a way that allows you to view all doors at once;
2. Set time to night and wait for all villagers to enter their houses;
3. If nothing weird happens, set time to day, wait for the villagers to leave their houses  and repeat the process.

Observed Results:
Some villagers stop right in front of their houses, wander around a bit (sometimes they even enter a random house that's not theirs) and then finally go to sleep.

Expected Results:
All villagers enter their houses and sleep when the time comes.

Screenshots/Videos attached: No

Notes: I've noticed that they can also enter random houses during the day, at random times.