Kicks us all out

Every time we are just mining away or do anything the server randomly crashes and does a small rollback for like a few seconds and we get the message can not connect for a good 2 minutes before we can login again.. This sometimes happens 3/4 times in a row and sometimes only once a hour or less.
I think it got something to do with breaking a certain block (like banners crash the server)