Can't seem to chuck away any items directly from my inventory

It works when I'm using a furnace or a chest but when I step away from it, I can't chuck anything away, be it a stack or a single item. In order to do that, I have to close the inventory completely.