Redstone Lamp light stays on when powered off

Whenever I power a Redstone Lamp, if I turn it off, by pure random it will have the light stay on in my world. The only way to fix this is to remove the lamp and place a Glowstone block above it and remove it. Just to note the location I am at for in case it's location based, I am above layer 128. Also, I use a lever to turn on and off the redstone lamps.