Nintendo Switch cannot connect to cross platform world

When I try to connect to a world of my Xbox friend, it keeps telling me that it cannot connect to world. I've tried multiple networks for my switch to make sure that the wifi was not the issue. I was able to connect to the world the first time ever loading into it, however, ever since it has popped up with the same message.