Can't join friend's world.

Hello, whenever i try to join my friend's world through xbox account, it returns with 'Unable to connect to world'. He can join my world and i can join anyone else's, everyone else can also join his world.