Unable to take armor / offhand off

Often times while on a realm server, there is a glitch that when i have an item in my offhand I cannot unequip it. In my case this has happened with boots and arrows on my armor/offhand slot. I'd imagine this would happen to the other pieces of armor if I didn't wear boots or hold arrows. If I had to guess I'd say the order the items get stuck would be offhand, boots, legs, chest, then head