Extremely Low FPS during Multiplayer

My Minecraft World will work fine when playing on my own, and sometimes fine when 1 other person joins, but when i have 3 or more players in my World with me, my FPS becomes 2-5 constant. The other players in my game do not experience this FPS drop, only i do as i am the Host. this has been going on for 2 months now