Scaffoldings don't work as they should in off-hand

When I wanted to use scaffoldings, I put them in my off-hand. When I place one, then aim at the block below to place another on top, the scaffoldings would place in the direction I was looking and not on top of the other. Aiming the side seems like the only way to place them on top