Dispencer facing down

I placed a dispenser pointing downward one block North and two blocks up to be directly above the player when pushing button. The dispenser would only dispense items East. I tested all other orientations and the dispenser would work properly.
I also tried it on a local map (my redstone test world), and recieved the same result.