Elder Gaurdian Wont Spawn?

I followed the ocean explorer map that I got from a cartographer and I went inside of the under water temple when on peaceful but when I turn it to easy or hard mode the elder guardian is gone and I cannot complete the achievement and there is no sponge room?