Cant last in a Server for more then a couple minutes

It's only me on the server. If I'm doing anything (or not doing anything for that matter) I will get disconnected between 3-10 mins. It doesn't immediately disconnect me either, it will start lagging at first, then disconnect me. In the server log it says "2013-01-24 21:15:18 [INFO] HDlowrider lost connection: disconnect.genericReason"
On the client it changes it up most of the time but this time it showed: "Internal Exception: java.net.SocketException: Connection Reset"

EDIT: CPU usage is around 9%-15%