Confidence-based Syntax encoding network for better ancient Chinese understanding

Abstract

While neural-based models continue to make rapid strides, syntax remains a foundational element in the domain of Natural Language Processing (NLP), particularly in the context of Chinese language understanding. However, there exists a significant gap in research that integrates syntactic information for the understanding of ancient Chinese, primarily due to the lack of high-quality syntactic annotations. This paper explores the untapped potential of syntax to enhance ancient Chinese understanding, leveraging the “not-so-perfect” noisy syntax trees generated by unsupervised derivations and modern Chinese syntax parsers. To achieve this, we introduce a novel syntax encoding component: the confidence-based syntax encoding network (cSEN). This component is tailored to mitigate the side-effects arising from the noise associated with unsupervised syntax derivations and the incompatibility between ancient and modern Chinese. We validate the importance of syntax information and the efficacy of our cSEN through experimental tasks, specifically ancient poetry theme classification and ancient–modern Chinese translation. Our findings suggest that proper implementation of syntactic information can effectively enhance model understanding of ancient Chinese. The introduced cSEN proves vital in noise-rich environments, potentially revolutionizing the way information professionals approach and utilize ancient Chinese texts.