Spontaneous Block Breaking

I was breaking the potatoes and carrot crops on my minecraft server. Then all of a sudden some of the tilled soil just breaks and I didnt even mine it. Like I hit it. When I was breaking the carrots or potatoes really fast.