Comparator stays powered after performing command from a Command Block

I tested the /testfor command and i found it was great!
I powered the command block with a button but when the button wasn't pressed anymore the command block had still a redstone output.

It only went off when I destroyed the commandblock!

I don't know if that has to be so or if it's a bug.
Please correct me if it has to be so!