Ram usage over 32 gb ram

The ram usage was over 32 gb ram for two players. All we did was explore the world, i noticed the massive ram usage once i was close to a desert with a ocean. The futher i walked into the desert the more lag i noticed. Like if the server wasnt unloading Entites.