F11 Fullscreen locked on (Mac)

Load up a world, press F11 to exit fullscreen, and Minecraft gets smaller and fills the top-right, but does not actually exit the fullscreen mode. This could be a Minecraft bug, a Java one, or a Mac OS one.