Shift-clicking items into a chest causes overflow of stack to switch between hotbar + inventory

For example: you have a chest almost full with dirt. (32 more dirt could fit in)
You shift click a 64-Dirt stack from your hotbar into the chest.
The 32 dirt will appear in the chest, the overflow gets "shift-clicked" into your inventory.
When you have it in the inventory and shift click, it appears in hotbar