Dying from fall damage will standing on scaffolding

I was building up with scaffolding and I built to the side of it and I stepped on the scaffolding block on the side looked around for 5 or so seconds and died from fall damage all of a sudden and I didn't even fall I died on the scaffolding block

Then it happened soon after again and it said I basically died 2 times =/