Framerate drop

So when I play in my survival world with my friends, we’ve lived in a village but every time we come to our base, our frame rates drop from 60 FPS to lower than 30 fps. This has really bothered me for a while now because everything is slow and just kind of annoying.