UI Buttons take a long time to act

I don't know how to explain this properly but this is it,

In the new touch controls (crosshair, touch) mode,
When you press a button, it takes like a millisecond for the button to act

For example:
If you press the place button while holding a block,
It takes a millisecond for it to actually place a block
In short, the button does not act immediately