Classic Jeb Door Broken

When I place the lever at a distance from the Classic Jeb Door and turn the power off, the middle pistons don't retract until the side pistons retract, making the whole thing not work. When I took away the repeaters and extra redstone, I see that the middle pistons don't retract at all. However, this bug only happens when the lever is at a distance from the Classic Jeb Door.