Can't shift click items into villagers AI interface

When trying to shift click item, which the villager want to trade, it is not possible.

For ex.: Villager wants 24 wheat and gives 1 emerald, I do have enaugh wheat in my inventory, I click on it while holding shift and nothing, it is not even moving to/from hotbar, it just stays wherever in the inventory it is, while shift clicking.