Mc not using enough memory

I have allocated 5gb of ram to mc and the game decides to run at about 6-20 fps when my max fps is at 150. and in the debug screen, it says only using about 6% of the memory. I tried switching resource packs, i have turned down my settings (render distance, smooth lighting ect.) My computer have 12gb of ram.