Iron Golem Agro Mechanics

Iron golems will not stop attacking me. I have traded with the villagers, I have traveled quite distances from them and worst of all new golems spawn in agro which they still won't stop attacking me. I basically have an iron farm without actually using a design