Unable to Connect to World

My son (literal and Xbox family) is on Xbox One, I am on Win 10.
Whenever I accept an invite from him, it says "Unable to Connect to World."
No errors. No explanation. Just an "ok" button that sends me back to the main menu.