Villagers don't always link up to job blocks, or turn back to unemployed when job block is destroyed

I've been re-rolling librarians in my trading hall (meaning they haven't been traded with before so don't have trades locked) and sometimes when I destroy the lecturn, the librarian isn't turning back into unemployed properly. Other times when I place the lecturn they aren't linking up to it and remaining unemployed.