Nether Portal takes me to different location

My nether portal is glitching and will occasionally bring me back home but other times it teleports me into the middle of a cave. It's the same portal and not be built anywhere else. I'm on a multiplayer server  running 1.18