Raid starting without bad omen

After completing a raid I returned to my base with a villager trading hall, where another raid almost began, even without the bad omen effect. I went and drank some milk so see if it was a visual big but after returning, but another raid almost stared up. I then set my spawn and drowned myself to see if that would resolve the issue, but after getting my loot back and returning to my base it still started a raid.