Can't join friends.

Whenever I try to join my friends worlds, it goes to a screen "Unable to connect to world.", sometimes I can join after we both reopen our minecrafts, and like now, I just go to the "Unable to connect to world screen." I don't have anyone blocked in the world either.