Villagers Despawning

 

EDIT: They actually went into my nether portal

 

When I accidentally started a raid in my main village, I decided to switch to peaceful mode very briefly to end the raid prematurely as to not lose any villagers (less than a second; I thought the clarification may help but I'm not sure) before switching back to normal mode. I had about 7 or 8 villagers before this and now only one remains.