Very bad glith

When you are playing with a friend and your not hosting and you down a ladder or and other thing that works the same wayyou carry the fall damage and you take double the fall dammage when you joinsomeone else if i fall from 2 block i take 2 heart if i fall from 3 blocks with full diamond i take half my health