SMP - Boats are "out of sync"

Noticed that if you travel by boat in SMP the client is not in sync with the server.

Reproduce by just travelling for some time by boat then jump out of the boat, you will notice that end up in a different spot than the client thinks, usually much further behind.

We were 4 players experiencing the same behaviour.