Unable to connect to friends mcpe world

I just finished setting up my Switch for crossplay but for some reason, can't join in on the molbile's servers via my brother on their world on the phone, he can they join my worlds on the Switch; but when i try to connet to his world, it says "Unable to connect to world".