Horrible lag after switching worlds

Game runs fine when first launched, but after leaving and re-entering worlds around 5 times the game stutters with regular, crippling lag spikes. Restarting the game fixes it, so it's not urgent... Still pretty annoying though!