Chinese Character Style Transfer Based on the Fusion of Multi-scale Content and Style Features

Abstract

Style transfer has received much attention, and Chinese character style transfer is an important application. In the previous Chinese character style transfer methods, most of the methods separately establish a mapping from source font to target Chinese character for each specific target font. It is impossible to extend a single model to other styles. The model training is based on the amount of Chinese character data from a single font, and the demand of the character is greater. In fact, different font style transfer tasks have certain commonalities. Therefore, we use multiple fonts in the data set and combine these fonts into multiple sets of Chinese character style transfer tasks. These tasks will be trained at the same time, instead of that only one font style transfer task training is achieved at a time like the previous work. In order to achieve the purpose of extracting and fusing the content features and style feature, we propose a style transfer network composed of content encoder, style encoder, feature fusion module, and decoder, based on the fusion of multi-scale content and style features. Through the experimental results, it can be found that, using our method, training the style transfer of multiple fonts at the same time can help any one of them to generate better results with only a few samples.