Nether portal not linking

When I build a portal in the over world and go through it everything works fine but coming back it builds a random portal in a field when I brake it and go back to my portal it dose the same thing again