Once you clear the first amount of pillagers that spawned at the outpost, the rest of the pillager's would be able to despawn when moved further enough.

 Is this intended? When ever you go and find a new generated pillager outpost, the pillager's that were spawned in the outpost first never despawn if I move further away, but Once you killed them and wait for more pillager's to spawn, they can despawn if you move away far enough.

Reproduce:

1. create new world
2. Locate for a new pillager outpost
3. wait for the pillager's to come outside the outpost and watch them path find their way back the the first floor.