Netherportal random spawning issue

I recently built a netherportal on my minecraft realm and enclosed it for pigmen security. Once going through and coming back I realised I hadn't spawned back at my base but in a remote location nearby. I decided to completely destroy the enclosed area and rebuilt the netherportal to test again, it kept spawning me in remote area nearby. No matter what I do it won't spawn me back at my base. I have attached screenshots below to provide visualization. First time I have came across this issue, so if there is a way of rectifying it please don't write hate comments, just inform me please.