pillager patrol bug

when I'm playing hardcore I found a patrols captain while sheering some sheep that make scared and run from that places but when I come back to that locations the patrols captain and patrols are gone