I keep trying to join my friends world but cant

I will try to join my friends world however most of the time we can't join we both have good internet and we can always play together on a realm but almost never can just play on one of our worlds