Punching when opening inventory

Your character will punch when opening the inventory, which also means that if you're holding a block it will place it when doing so and that can be very annoying. I've attached a video for reference (pay attention to the hand)