Horses show open button before fully tamed

The open button on my horse was showing but the horse wasn't fully tamed as it was kicking me off. The open button was function-less as it didn't do anything when clicked multiple times. The horse eventually showed hearts as a sign it was fully tamed and I could open the GUI to equip the saddle and armor.