Rails (all kinds) can only be placed N-S direction

When I place down any kind of rail, it always faces north south. I can fix this by placing another to the east or west of it, but when creating simple hopper contraptions I need to be able to place it East-west immediately.