Villagers outside the house when I enter the realm world

Villagers inside a two-story house, locked inside.
When I open the world and enter, I find 2 or 3 villagers inexplicably outside the house, or on the roof.
It's been like this for a few days, every time I enter I have to make them go back in and go back up to their floors.
Frustrating. Please fix it. Thanks.