Totem of undying held in off hand does not work when falling from a great height in the end

While raiding an end city we were taking the dragon head off a ship where we found an elytra. I fell while holding a totem of undying and had to respawn.

What I expected to happen was...:
I expected to not die.

What actually happened was...:
I died and had to respawn

Steps to Reproduce:
1. Go to end city with an elytra ship
2. Clear the ship and go to bow to remove dragon head with silk touch pick axe
3. Stand on dragon head and mine
4. Fall to death