Villager gui bugs out and i cannot trade with them.

I have a villager trading hall to get enchanted books. I go to the villager and select a trade and I already notice one problem, the villager doesn't do the accepting sound for when you put an item in the trade slot. I then proceed to get the emerald from the villager, but then the item that I put in the trade slot goes back into my inventory where it last was, and the emerald disappears. I have no idea on how to recreate this because it seems to happen randomly. This is extremely annoying.