Redstone block wont stop powering stickypiston

Whenever you have a sticky piston that pushes a redstone block vertically when the piston is powered by another source and the source is turned off the piston stays powered by the very block it has pushed upward.