Enderman constantly teleport and despawn in the nether

Fighting enderman in the nether to get perals in nearly useless. Once you hit one, they just teleport away to who knows where and despawn, even though I'm on sim distance 6. You can watch them teleport away and see a new one spaw in to take its place almost every time.