Iron Golems not attacking Enderman while atop fences

I was playing around with some mobs, and I wanted to test something. I crafted a fence, spawned an Iron Golem, and an Enderman on a fence by accident. I noticed that the Iron Golem wasn't attacking the Enderman, even though he was in reach. They just looked at each other.