Invites to friends on local hosted multiplayer world expire per session

I invited my son to play on a world hosted on my laptop and he could access it between sessions.  Now if he quits I have to send a fresh invite even though we are both friends on Xbox and in game