Flying and building

When trying to fly my character will stop and go super slow then speed up then barely move at all and just seems super laggy, I thought it might be my connection but this is the only game that this happens too me.