Wandering Traders and Trader Llamas despawn when named with name tag

In my survival world, I randomly found a wandering trader spawn by my house. I immediately then named them with name tags. I built a little cave for the wandering trader to live in but when I came to put the wandering trader and the trader llamas in the little cave, they despawned.