Realm doesn't load after sending villagers through nether portal

After villager breeder sends some villagers to the nether(without second player in the nether), chunks don't get loaded around nether portal and realm gets stuck on building terrain when re-entering the overworld. Players trying to log in the overworld around the portal get building terrain too.