Redstone stays on when powered off

I was making Redstone lamps that only power on at night. When it became day time, the lamps never turned off. Even when I cut the power source, the Redstone stayed powered. I have to cut power on a lot of places to get the whole thing to power off.