Fall damage bug

So, I'm building a tower in minecraft and suddenly I take a lot of damage when I'm building up even though there is no mobs nearby and I'm still on the tower. But I still take fall damage randomly. I hope that you guys can find a fix to this.