The spawn anchor it not work correctly

Putting the spawn anchor and setting the spawn works fine, but when going in and out of the world and wall being in the nether I appear in the overworld, I have to remove it and put it back to fix it.