Endermen don't atack when you hit them

When I hit, or want to fight an endermen for enderpearls they don try to hit me back sometimes, and most of times they disappear, or they forget about me and don't try to hit me back, they even teleport away from me.