Error when trying to connect to a friend's multiplayer game

For a few months I have been experiencing an error when wanting to join a friend's party through microsoft accounts, the funny thing is that it only happens with friends who live near my house, when wanting to join, skip the message "Unable to connect to world."