Camera moves in the direction of the cursor when closing UI's on macOS

Whenever I close my inventory, chest, crafting, or menu, while moving my cursor, the camera would jump to the direction of the cursor.

To reproduce, open your inventory and close it while moving your cursor.

Edit: I've only seen this issue on Macs.