Raiders are sometimes passive when they are following the leader

When you start a raid at a village, the raiders are sometimes passive when you approach them. This occurs if the raiders cannot pathfind to the village. For example, if a river or other body of water is between a village and the raiders if they are on a solid block, then they seem passive.