Enderman turns invisible for a moment after attacking it

I was trying to clear some endermen out of a cave, but then I discovered that if you attack an Enderman, it turns invisible for a moment.

What I expected to happen was...:
When I attacked the enderman, it should have stayed wherever it was or teleported away.

What actually happened was...:
It turned invisible for a moment, and then it was back.

Steps to Reproduce:
1. Spawn/Find an Enderman
2. Attack it a few times. It doesn't actually teleport, instead it turns invisible for a moment and then appears again.