Won't Connect to the World

When me and my friend try to join each other we're stuck on the loading screen. We can see each other on our friends list except when we click on it, we are stuck on a loading screen for 5 minutes and then says unable to connect to world