Unable to play on worlds with friends but able to play on The Hive

So my friend tries to join my world and it loads for up to 10 minutes then say s"unable to connect to world. The same thing happened when I try to go onto his worlds. We can play on servers like The Hive perfectly fine but worlds don't work. We have tried on both his computer and his switch but neither has worked. We both have uninstalled and reinstalled Minecraft but still nothing.