Elder Guardians gone after switching to peaceful and back

After switching from normal to peaceful and back while being near an ocean dungeon, Elder Guardians seem not to spawn again in that dungeon.

I didn't manage to kill any Elder Guardians before turning to peaceful.