Game freezing/crashing whenever there are multiple players on a realms server, specifically affects the Xbox version of Bedrock

Whenever my friends attempt to join our realm server, they can only last about 5-10 minutes when there are more than 4 people online. This is unlikely to have affected many other people, but we noticed it while we have been playing in the new update.