Villager Trading Menu Instantly Closes Upon Opening

Whenever I want to trade with a villager the menu will instantly close and I cannot interact with them. It does not matter if I have an axe in my hand or nothing the outcome is still the same. However it does not happen to every villager. For me it affected about 2/3 of the villagers.