Redstone doesn't work properly with observers

When I have redstone on top of an observer and power the redstone from above the redstone below the observer does not get powered, but if you power the redstone below then the redstone on top of the observer gets powered.