Can only click on nitwits once

I can only click on 'nitwits' (Villagers with Profession:5 set) once. The first time it shows up a trading GUI (I can't trade anything, though), but when I close it and try to right click on him again, the GUI won't open.

To reproduce, run this command: /summon minecraft:villager ~ ~ ~

{Profession:5}