Pillagers don't wear hats correctly (Villagers do)

Pictured are villagers and pillagers with items in their head slot. I've modeled this item to look like a hat.
The villagers wear it as you'd expect, while all the pillagers wear it as if they had the smaller head model of a zombie/player/etc.