A restoration method using dual generate adversarial networks for Chinese ancient characters

Abstract

Ancient books that record the history of different periods are precious for human civilization. But the protection of them is facing serious problems such as aging. It is significant to repair the damaged characters in ancient books and restore their original textures. The requirement of the restoration of the damaged character is keeping the stroke shape correct and the font style consistent. In order to solve these problems, this paper proposes a new restoration method based on generative adversarial networks. We use the shape restoration network to complete the stroke shape recovery and the font style recovery. The texture repair network is responsible for reconstructing texture details. In order to improve the accuracy of the generator in the shape restoration network, we use the adversarial feature loss (AFL), which can update the generator and discriminator synchronously to replace the traditional perceptual loss. Meanwhile, the font style loss is proposed to maintain the stylistic consistency for the whole character. Our model is evaluated on the datasets Yi and Qing, and shows that it outperforms current state-of-the-art techniques quantitatively and qualitatively. In particular, the Structural Similarity has increased by 8.0% and 6.7% respectively on the two datasets.