Aspect-level sentiment analysis model fused with GPT and multi-layer attention

Abstract

With the popularization of the Internet and the rapid development of artificial intelligence, the requirements for the accuracy of sentiment analysis on text data have been continuously improved, and aspect-level sentiment analysis has emerged as the times require. This paper analyzes and combines the research results of aspect-level sentiment analysis in recent years and proposes an aspect-level sentiment analysis model integrating GPT and multi-layer attention. (GPT and Multi-Layer Attention Network, GPT-MAN). The model first combines GPT and aspect coding to obtain a new word vector representation method, and then inputs the word vector with rich semantics into the network with a multi-layer attention mechanism, Sentiment Analysis Accuracy. In the experiment, the GPT-MAN model is analyzed from the selection of word embedding model and the optimization of hyperparameters using the datasets of Restaurant, Laptop and Twitter, and the effectiveness of this method is verified. And in comparison, with different models, the accuracy of the model in the three datasets increased by 2.57, 3.34, and 1.19 percentage points, respectively.