Observer block causes power oscilation

After building contraption like on the attached screenshot power level of redstone near observer block will start oscillating. Moving red torch one block closer to observer block cancels the effect.
Swapping input/output direction of observer block allows to move red torch even one block closer.