Are they supposed to spawn in caves?

So, this is a follow up to my last bug report, but I was trying to find these pillagers when I ended up getting an x-ray pack out of annoyance. Only to find out that they apparently spawn UNDERGROUND IN CAVES?! Please, if this is a purposeful feature fix it.