Unsigned books written in 1.9-pre1 or earlier don't upgrade properly

Upgrading worlds with unsigned written books directly from 1.9-pre1 or earlier to 18w20a or later results in the text having visible raw formatting.

See the attached screenshots for further detail. The first is from 1.9-pre1, and the second is from 1.16.5.