Cant use TAB to close inventory

Having the inventory bound to TAB allows me to open it but pressing it again won't allow me to close my inventory. it instead seems to highlight the crafting recipes book on the menu instead of closing.