Villagers, ocelots, stray cats and rabbits don't randomly look around
Basically, most passive mobs have a behavior that makes them walk for a bit and then turn their head, and when they turn their heads, their bodies do to. For some reason this behavior of randomly looking around does not apply to villagers, ocelots, stray cats and rabbits.