Minecraft Kicking all multiplayers out then crashing xbox game

Minecraft Bedrock runs fine most of the time, Except when It'll kick us out of the main player's world while we play with the main player, cause it'll kick us out and say "Disconnected from server" and main player's game will just freeze and not let it do anything except return to xbox home or turn off the console.