Villagers disappeared

I was in a rowboat with a villager, next to a bunch of villagers I had fenced off. Out of nowhere I was suddenly no longer in the boat, the boat was gone, and all of the villagers were gone. It was during the day, it was instantaneous, just one moment I was in a boat with a villager in the boat and in the fenced off area, and then the next moment boat and villagers were all gone.