Iron Golems attacking me after they killed me 1 time

An Iron Golem naturally spawned in the village. And when I went by him he started attacking me, I did hiot a villager before he spawned. So I took my armour off and let him attack & kill me to get it over with. After I respawned he attacked me again. Trying to kill me. I thought if an Iron Golem kills you 1 time and you dont hit a villager or Iron Golem after that they no longer get hostile after you?