Packet Loss

When I open and sign into minecraft and get to the start screen I get about 1-5% packet loss. But when I try to join a multiplayer server it sky rockets to 40-50% which is really really bad. Please help.

P.S ALL other multiplayer games work fine with zero packet loss or lag.