Lag when placing or destroying blocks in Multiplayer

On servers when I put or destroy blocks my 23 fps which is usually low for 2 and back to normal.
example:
I'm building a line of 30 blocks. in Singleplayer I took in 10 seconds
In multiplayer (tested on 3 servers with ping between 50-200ms) I took 19 seconds
With a margin of error of 2 seconds