Semi-supervised Aspect-level Sentiment Classification Model based on Variational Autoencoder

Abstract

Aspect-level sentiment classification aims to predict the sentiment of a text in different aspects and it is a fine-grained sentiment analysis task. Recent work exploits an Attention-based Long Short-Term Memory Network to perform aspect-level sentiment classification. Most previous work are based on supervised learning that needs a large number of labeled samples, but the problem is that only a limited subset of data samples are labeled in practical applications. To solve this problem, we propose a novel Semi-supervised Aspect Level Sentiment Classification Model based on Variational Autoencoder (AL-SSVAE) for semi-supervised learning in the aspect-level sentiment classification. The AL-SSVAE model inputs a given aspect to an encoder a decoder based on a variational autoencoder (VAE), and it also has an aspect level sentiment classifier. It enables the attention mechanism to deal with different parts of a text when different aspects are taken as input as previous methods. Due to that the sentiment polarity of a word is usually sensitive to the given aspect, a single vector for a word is problematic. Therefore, we propose the aspect-specific word embedding learning from a topical word embeddings model to express a word and also append the corresponding sentiment vector into the word input vector. We compare our AL-SSVAE model with several recent aspect-level sentiment classification models on the SemEval 2016 dataset. The experimental results indicate that the proposed model is able to capture more accurate semantics and sentiment for the given aspect and obtain better performance on the task of the aspect level sentiment classification. Moreover, the AL-SSVAE model is able to learn with the semi-supervised mode in the aspect level sentiment classification, which enables it to learn efficiently using less labeled data.