Crossplay with Nintendo Switch and Xbox One not working.

I just finished setting up my Switch for crossplay but I for some reason, can't join in on the Xbox One's servers via my nieces and nephews on their world on the Xbox One, either can they join my worlds on the Switch; both consoles say "Unable to connect to world".