Items in the off-hand slot cannot be removed by tapping on an item in the Creative inventory unless the item has a + icon next to it

Summary:
When an item is equipped in the off-hand slot, you cannot remove it by tapping on it and then tapping on an item in the Creative inventory unless the item has a + icon next to it.

Steps to Reproduce:

1. Be in Creative mode
2. Equip a shield in the off-hand slot
3. Tap on the shield and then tap on an item without a + icon next to it in the Creative inventory
4. Notice that the shield is not removed
5. Tap on the shield again and now tap on an item with a + icon next to it

Observed Results:
The shield can only be removed when you tap on an item with a + icon next to it.

Expected Results:
The shield should be removed when tapping on any item in the Creative inventory.

Video:
Untitled video - Made with Clipchamp (1).mp4

[Update by [MCQA] v-weszaj]
This issue also affects the crafting grids in crafting table and player's inventory.