Unable To Connect To World/Realm

When trying to join a friends world or a realm I'm in it will load for a bit before saying "Unable to connect to world/realm". It's been happening for about a year, and I've tried everything I can think of.