Trading with a fletcher villager with Hero Of The Village effect causes server to crash

Trading with a fletcher villager (sticks for emerald) causes the server to crash with the exception: java.lang.IllegalStateException: Removing entity while ticking!
This happens only if having Hero Of The Village active effect.
Reproduced three times on the server, crashes every time.
After drinking milk and getting rid of the effect - no more crashes.