Endermen sometimes give up or disappear while fighting players

Recently, I've been observed that when I start a fight with a Enderman, sometimes (almost everytime) he give up or just disappear, and I have got problems in getting ender pearls.

I was fighting in END, and my sword doesn't have fire aspect for they teleport until be out of range or take natural damage.