Cursor not showing when in window

So basically, when I am in a window, chest, anvil, inventory, etc. My cursor does not show. The only way to tell where my cursor is at is the green fill in when hovering over a square. Is there a setting or is it just a bug?