Glitch making it so me and friends can't log on to each other's world

After the 1.17 update, me and my friend ( SAVAGE SABER368 ) can't log on to each other's worlds anymore. We can join our mutual friends' world just fine and even play together on it but whenever we try to join each other's world "Unable to connect to world" pops up. Both of us have played together without issue in 1.16 and even in the first few days of 1.17 but about a week ago the issue started. Our 3rd friend can also join our worlds without any problems.We are friends on MC and xbox and we have all mp setting enabled. We have unfriended and refriended each other multiple times. Please fix this bug