piston stays out in some redstone block situations

If a piston is extended horizontally with redstone block behind it, and one on top of that redstone block, if you break the bottom then the top, piston will stay extended without anything powering it. (See pictures)