Whenever I try to join a friend’s world, it always sends me the error message “Unable to Connect to World”

Everything I try it won’t let me join a friends world. They can join mine, and we can join servers together, but I get sent the error message “unable to connect to world” when I try their world.