Can't connect to multiplayer worlds

1. I log in to Minecraft
2. I click on my friends world
3. It show me a screen saying "connecting to multiplayer world"
4. It "loads" for a while, then says "unable to connect to world"

 

I am able to play in my own world, but not my friends.