In creative mode, flying down is stopped when brushing up against ladders or vines.

I believe this is really a conflict between ladders and the mechanics of flying. Considering you can stop on a ladder while crouching, and flying down is ALSO by crouching. The ladders and vines are taking hold of the player, thus making flying down in jungles, or flying down 1 block holes with ladders in them near impossible.