Bees angry with me without reasons!

Ok. Idk how the bees behaviour works. I destroyed little nests in Peaceful mode to change their position and after a long time playing, I turned to Normal difficulty.. The bees weren't angry. But after sometime all the bees around started to attack me. Then they went normal, and then turned into attack mode.

I'm losing my bees! And I don't think it's because I destroyed two nests on Peaceful Mode.. because I experimented in other worlds and didn't happen