Game lag with friends/Solo

Whenever i get in a game with friends or just bymyself it just lags, we have to wait 1 full minute to open chests,inventory or even menu sometimes, sometimes it would cool down but it would only last for 20seconds before lagging again idk if this is a bug tho..