Villagers cause high amounts of ping on single player worlds

I traded with most of my villagers and then decided to move them to another place so i removed their workstations and beds and after a while the game started to have high amounts of ping, this is cause by the villagers, because i duplicated the world and killed all of the villagers and the ping went back to normal and it fixes when they can reach a workstation and a bed.