Cartographers don't unlock correctly in the End/Nether

Cartographers, if they are in the end or nether, refuse to give maps to water temples or wood mansions. They get stuck at the map trade. I have traded with two of them for a long time without any of them unlocking past the blank map trade.