Allays distinguish dropped/mined scaffolding from chain-broken scaffolding and won’t pick up one or the other

Allays don't pick up scaffolding blocks that broke themselves by destroying a tower they were connected to.

How to reproduce: Build a tower of scaffolding and destroy the bottom block so the tower collapses. The Allay only picks up the one block that you manually broke and ignores the other ones that fell down completely.

Shouldn't the Allay pick up all the scaffolding blocks?