Raid Defeat Bar doesn't disappear

After defeated, I destroyed all beds and removed all villagers in A village.

However, the raid bar didn't disappear and I got out of the A village.

After that, I get bad omen effect and go to B village, but raid doesn't start.