Guardians not spawning at temple

For some reason, Guardians are not spawning at a temple, I have a guardian farm there but it doesn't affect the entire temple. I did kill all three Elder Guardians if that affects anything.