The sticky piston cannot pull back the redstone block when facing up.

I make a simple redstone contraptions but I found a bug. When I place a sticky piston facing up and try to push a redstone block, it can push but cannot pull back when no redstone signal. I also try other facing but it not happen. I'm not a redstone player and play few redstone. I'm not sure it's a feature or a bug.