Unable to fly down in VR

While playing Minecraft on Windows 10 in VR in survival, I am able to fly by double clicking the right thumbpad (jump). When I have activated flying, I am unable to fly down or deactivate flying. I have tried using the keyboard with no success.