Villagers don't change professions when you destroy their workstation

I destroyed the cartographer's workstation and placed a different one and instead of changing profession he stuck to cartographer and when right clicked the trading GUI would open and then close immediately