Armor does not come off

Every time I try and take off my armour it does not come off, I was playing Minecraft and my friend told me to fight the wither without armour so I went to take it off but I could not (Does not have binding on it)