HSAN-capsule: A novel text classification model

Abstract

Most text classification methods fail to fully consider the important role of the hierarchical structure of the text in determining the text category, and cannot well extract enough text sequence information. To address this problem, a novel model based on hierarchical self-attention mechanism capsule network was proposed for text classification, which was composed of two components, i.e., the hierarchical self-attention network and capsule network. First input the text data processed by word embedding into the hierarchical self-attention network for feature extraction, model the text from the two levels of words and sentences to extract the hierarchical features of the text; then the results are passed into the capsule network in order to refine the relationship between the part of the text and the whole, and further extract richer text semantic information. The experimental results on 5 text classification datasets show that compared with other baseline models, the model in this paper has achieved better classification results.