Framerate drops in Featured Servers (Switch)

I play on Nintendo Switch and when I play on Single player in my 250MB world I have perfect performance with no framedrops, when playing Features Servers like Hive my framerate drops down to 10. Turning off all graphics settings doesn't help in any way or deleting cached data. I have no clue why but I'd like help on how to fix this. Thanks