Changing Microsoft account password doesn't automatically sign you out of that account

Someone has access to my Minecraft account (not my Microsoft account), so I tried changing the password thinking that would fix it, but apparently the Minecraft Launcher doesn't sign you out if you change the Microsoft account password.

Hope that made sense!