Unable to join a friends world after an invite

I can't join my friends world after he sent me an invite. I can't get onto the world with my windows 10(laptop) or Android(phone) but i can get on, on the Xbox. I have tried restarting both my phone and laptop but it didnt work. I signed out of both Xbox live accounts and back in, but that didnt work either. I have been trying to join this world for 3 day. It isn't the Wi-Fi as the Xbox is connected to the same Wi-Fi. Everytime i try to join it says unable to connect to world, but I don't know why this would be.