redstone being powered without power source

When powering a redstone line next to a block with a redstone torch on it and powering the same block with a repeater, the redstone line becomes powered even if you remove the power source.