Shift-click doesn't work collectly when trading with villager and wandering trader

1. Right-click a villager or wandering trader to open trading window.
2. Take emelald(or other item) from inventory(berfore.png)
3. After shift-clicking apples, I got apples but my emelald doesn't decrease(after.png)