Textual emotion classification using MPNet and cascading broad learning

Abstract

As one of the most important tasks of natural language processing, textual emotion classification (TEC) aims to recognize and detect all emotions contained in texts. However, most existing methods are implemented using deep learning approaches, which may suffer from long training time and low convergence. Motivated by these challenges, in this paper, we provide a new solution for TEC by using cascading broad learning (CBL) and sentence embedding using a masked and permuted pre-trained language model (MPNet), named CBLMP. Texts are input into MPNet to generate sentence embedding containing emotional semantic information. CBL is adopted to improve the ability of feature extraction in texts and to enhance model performance for general broad learning, by cascading feature nodes and cascading enhancement nodes, respectively. The L-curve model is adopted to ensure the balance between under-regularization and over-regularization for regularization parameter optimization. Extensive experiments have been carried out on datasets of SMP2020-EWECT and SemEval-2019 Task 3, and the results show that CBLMP outperforms the baseline methods in TEC.