[MCM-1190] Raid not completing in Traveling Trader

Partner Rank: 2

Verification build: 1.16.100.57,1.16.100.58
Regression build: all of them until 1.16.100.56

Summary: Raid not completing in Traveling Trader

Impact: This results in Traveling Trader map being incompletable, affecting millions of players worlds.

Repro:

Download traveling trader
start the world
press the start button
open the chest
walk forward through the doors
wait
teleport to 1872 70 -155
(must be in adventure/survival) follow the villager completing the quest (just /give yourself the items)
when he walks to the castle teleport to fred 1941 67 -295 give yourself /effect @p regeneration 99999 10 true so you dont die
press the code pink, red, green, blue
follow fred to the castle
wait for them to have a conversation and walk back to town with them
raid should start

Observed result: The raid cancels itself repeatedly for no reason

Expected result: The raid should run as normal and be able to be completed without having to start it over and over