Can't delete realm club on Xbox one

I made a realm a long time ago on Xbox one, but stopped using it. The club that was automatically created for it cannot be deleted off my profile, I can't transfer ownership or remove myself from it. I deleted the realm, uninstalled the game but still the club is associated with my Xbox user. Please remove it from my profile.