Unable to connect to my own realm

When I try to connect to my realm (that I own) and no one is in the realm, I cannot join. I get an error stating, “unable to connect to realm. Please try again later.” However when someone else is in the realm, they are able to to next and then I am as well. Please help.