Realms and friends' worlds do not load for a couple of minutes after startup

When starting up Minecraft Bedrock on Windows 10, oftentimes I have the issue of Realms not loading for a period of time. This seems to happen when it takes a few seconds to log into my account, but recently also started happening when it was immediately logged in. 

It has nothing to do with my internet connection either, it just does not attempt to reload until a couple of minutes (2-10) later.