Piston locks it's self up when pushing a redstoneblock with a piece of redstone next to it

When you have a piston that pointing up that has a 'block of redstone' on it and you put a piece of redstone next to the 'block of redstone' it will trigger the piston and it will stay stuck, but the piece of redstone will deactivate.