Unable to join sons realm after accepting his invite.

My son is able to connect to my realm, but when I accept his invite it says it downloads the terrain and just before it starts give me an error that says 'Unable to join the realm at this time, try again later'. This has been going on since we both downloaded the new Nether update. Any help will be appreciated.