Can't open horse inventory

Sometimes when I try to open my horse's inventory, it just doesn't work and when I get out of the horse I can't open my inventory no more until I save/quit and come back to the world.