Minecraft PE device gets kicked off of local Xbox one Lan game

I'm playing with my partner on our home LAN network.

He is running the game on his Xbox One and I am joining his world via my Samasung Galaxy Note 8.

 

We've successfully played together before on two android devices. But when I play in his world on the Xbox One I am regularly experiencing a LAG spike followed by dissconection. I can re-join,  but it doesn't always work. Sometimes I am immediately dissconected again.

 

Just before it happens, I find that I can place or destroy blocks, but the sounds stop. When I return, those block were never placed. 

 

The Xbox is occasionally logging out of the game as well. 

 

This never happens on our Android devices.

 

Could a realm solve the problem?