Nether portal glitch

When you enter a portal you go to the nether right? Well when your in the nether and the portal gets destroyed, cant go back but if you die and re enter the portal, it brings you somewhere else. Usually close to the portal or far from the portal. It’s just so annoying that sometimes I don’t even wanna play on my world anymore unless there is a fix to it somehow. Just please fix this glitch, so annoying. Cant send video due to it being to big but here is the link to the video. https://gyazo.com/3de07b2b19cc46971e223003f9cd6edb