Nitwits won't take jobs

So I did and completed a raid at a once active Village. All the villagers died but one that was just outside of the village that was stuck on the cliff side of a cave entrance. The Village had the abandoned village effect after the raid I think because all villages perished but one. I found him after the raid and brought him to my house with a mine cart and gave him a bed he accepted but I am unable to give him a job, I placed most of the block that should give a job and he still wont accept any jobs I give him.