Joining friend's worlds issue

Whenever I try to join my friends on Minecraft pocket edition it almost always says unable to connect to world, my internet and mobile data is fine, we restart our phones and still fail to connect.  I believe it's something that has to do with Minecraft itself since I see my other friends struggle with the same issue at times. Please help.