Extended piston pushing redstone block stays extended when power is gone

If you place a redstone block on a sticky piston then trigger the piston with a lever the piston will stay until the redstone block is destroyed, even if you flip the lever or destroy it.

Just redstone on the piston doesn't trigger it but once it's extended it doesn't stop.