Massive lags with 512x texturepack

Now that 512x packs work, I tried to use one but I experienced massive lags while 256x packs don't cause any lag. I allocated 8GB of RAM to Java and Minecraft.

Btw Minecraft uses the full 8.406.560 KB of RAM when using this texturepack.