Underwater Monument guardians able to give fatigue through blocks

I have found a small island near an underwater monument.

I cannot mine on that island almost at all because I keep getting hit with Mining Fatigue even though I am underground with many solid blocks of dirt, stone and sand between me and the guardians. The Wiki suggests that you should be safe from the guardians ray if there are solid blocks between you.