I can't leave bed.

When I get in a bed I can't hit leave bed to get out of it, really anoying in multiplayer. Instead the button does nothing.

I would expect hitting leave bed to take me out of bed. I have experienced this on survival on realms and single player.