Pistons always extended when torch is present

If you set up a piston (mine was sticky, with a redstone block under it) to be powered from a torch (mine was powered from above), then it will always be extended, even when the torch is in an off state. Upon removing the torch, the block is no longer extended.