Nintendo Switch to Windows 10 crossplay does not work half the time

Whenever me and my friend decide to play on our multiplayer Survival world, he is always unable to join the world. This has been going on for almost two weeks at this point and is really starting to make us angry. The reason it does not allow him to join is because when joining through the join tab, the game will send him into an infinite connecting screen. This has lead to him and me having to restart the world, game and even device. We would very much like this issue fixed or at least some sort of an explanation. If a username is required, my Xbox account name is SuperLuigiMan95 and my friends is LimeyEeveeSoda. I hope this issue can be resolved as we have been having a lot of fun in our world.

Thank you and have a nice day/night.