Zombies with "CanBreakDoors" NBT rarely use their breaking doors ability

Zombies with the "CanBreakDoors" NBT often do not make use of their ability, instead either just wandering around a house with a villager inside, or sometimes even just standing in front of the door without doing anything.

Command used to spawn Zombies:

/summon zombie ~ ~ ~ {CanBreakDoors:1}