Minecraft doesn't allocate enough memory

After a period of time Minecraft crashes frequently with Minecraft is not allocated enough memory. I have a x64 bit operating system with 4GB of RAM. I put my computer at the lowest possible settings and and still the same result. Even when loading chunks in a forest, jungle, and taiga biomes. Playing Multiplayer causes Java to stop working