Piston extension without power

When I place a piston and then I place two redstone blocks vertically above the piston and then I destroy the redstone blocks starting from the bottom one the piston doesn't retract.