Abstract

In the text sentiment classification task, some words are seemingly unrelated to the classification task, but they have a direct impact on the performance of classification model. For example, in the sentences “I have terminal cancer” and “Cancer is a very common disease”, it can be clearly found that the word “cancer” has two different sentiment tendencies in the daily life domain and the medical domain. In the daily life domain, the word “cancer” shows an extremely negative sentiment tendency. While in the medical domain, the word “cancer” is just a simple term with a relatively neutral sentiment tendency. Although current deep learning models have already achieved good performance through their powerful feature learning capabilities, there are serious deficiencies in dealing with the above problem. Therefore, from a new perspective, this paper proposes the Graph Domain Adversarial Transfer Network (GDATN) based on the idea of adversarial learning, which uses the labeled source domain data to predict the sentiment label of unlabeled target domain data. Firstly, GDATN extracts feature representations through the Bidirectional Long Short-Term Memory (BiLSTM) Network and Graph Attention Network (GAT) successively. Then, GDATN introduces the domain classifier to capture the domain-shared text feature representation with the Gradient Reversal Layer (GRL). In addition, an auxiliary task named the projection mechanism is constructed to further capture the domain-specific text feature representation in response to the text domain problem. Extensive experimental results on two benchmark datasets show that GDATN proposed in this paper outperforms the other six benchmark sentiment classification models, and GDATN has a better stability on different cross-domain pairs.

Highlights

  • As a fundamental task in Natural Language Processing (NLP), text sentiment classification attracts the attention from a large number of researchers, which provides sufficient technical support for other NLP tasks, such as entity relationship extraction, machine translation, recommendation system

  • Experimental results on SST and Amazon benchmark datasets show that Graph Domain Adversarial Transfer Network (GDATN) proposed in this paper is superior to current research results, and can effectively solve the problem mentioned above in text sentiment classification

  • MAIN RESULTS As shown in the following tables, the experimental results on two datasets demonstrate that GDATN proposed in this paper outperforms other benchmark models, further demonstrating the validity and robustness of GDATN in the cross-domain sentiment classification task

Read more

Summary

INTRODUCTION

As a fundamental task in Natural Language Processing (NLP), text sentiment classification attracts the attention from a large number of researchers, which provides sufficient technical support for other NLP tasks, such as entity relationship extraction, machine translation, recommendation system. GRAPH DOMAIN ADVERSARIAL TRANSFER NETWORK To address the text domain problem, this paper automatically explores hidden relationships between words through the idea of adversarial learning to obtain better feature representations of shared relationships between domains in order to improve the performance of sentiment classification model and alleviate the problem of over-reliance on domain supervision through the domain adaptation approach. This paper provides a domain classifier for each word in a sentence to discriminate which domain the sentence belongs to, and uses a gradient reversal layer to perform the domain adversarial learning for the relationship vector of each word to achieve the goal of learning finegrained domain-shared feature representations to improve the performance of classification model This operation allows the algorithm to have a better generalization capability across different datasets, enhancing the accuracy of sentiment classification task.

FEATURE EXTRACTION LAYER
GRADIENT REVERSAL LAYER
AUXILIARY TASK
EXPERIMENTS
MODEL TRAINING
CONCLUSION AND FUTURE WORK
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call