Double Piston Glitch

If I place a piston just the right way near powered Redstone, it will place a piston with two of the pusher things. If I break the piston base, one of the pushers will stay but is completely unbreakable, I can only get rid of it by reloading the world or placing another piston going the same direction.