Pressing Inventory key does not close lectern or written book UIs

Pressing E usually closes interfaces like chests, furnaces, crafting tables, anvils, etc. However, the lectern (or written book UIs) cannot be closed like this, and you have to manually click "Done" or "Take Book" to close it. I expected E to do the same thing as the Esc key, which closes this UI (acting as if I had pressed "Done").