piston powered form too far away by redstone block

If a piston is placed below a redstone block with one space between, the piston will extend. If the block is broken, the piston will stay extended. If the piston is placed before the redstone block, this will not happen. However, if the piston in this configuration is powered, when the power is shut off it will stay extended.