Villagers crashing the game

Villagers seem to have made the game so laggy it leads to thw game crashing everytime. If i manage to run away quick enough then it may sometimes stay running but if i make my way back to my town with the villagers then the game will just crash