I can't ride horses

I fed a horse some apples. After it showed me hearts, I right-clicked on it so I could ride it. It wouldn't let me on. I know, don't hold saddles or food while trying to jump on, but I wasn't. So what's up with that?