Connection Lost randomly while on realms

While playing on a realm it will disconnect me with an error saying "An existing connection was forcibly closed by the remote host." I've messed with all my anti-virus/firewalls and my router. Nothing has fixed this problem, and I am stumped. It isn't triggered by something I do in game, its just random. Sometimes it lets me play for 30 mins before disconnecting or not even 1 min.