Can't trade with villagers that have a custom name after dying

My spawn point is set close to a group of custom villagers. When I die and respawn, I can't trade right click on them to trade with them, and I can break the block behind them. Moving far away and coming back allows me to trade with them again.