Raid never finishes if raid mobs aren't killed by player

if a player starts a raid on a village and happens to despawn the pillagers or get them killed by other non player means no new raid mobs spawn and the raid never finishes unless you destroy the village or restart the server. Sometimes unloading and reloading the area makes the raid continue sometimes not.