Phantoms not attacking after 3 days

In my Java 1.21.4/vanilla game, after not sleeping for more than three days, phantoms spawn but do not attack. I noticed this one day ago after trying to work my phantom membrane farm. They appeared and dived toward me but turned away every time. I stayed up for several days and nights to test this. Every time they got closer but always turned away. I had up to 5-6 hovering over but not attacking.