Pillager raids ends with neither victory or defeat

I created a base in a desert village, locking in all villagers and creating a wall around the entire village. This stopped the pillagers from entering and with cactus they died sooner or later. 
However, I have done two raids in this village, and both times the raid has mysteriously ended with no sign of defeat or victory. The first time it happened at round 6 and the last time it happened at round 7. I was within the village the entire time, didnt leave once.