Aspect-based Sentiment Analysis for Arabic Reviews Using Deep Learning

Abstract

Sentiment analysis is a branch of machine learning that concerns about finding and classifying the polarity for given text. Because of the availability of huge amount of opinionated data that need to be analyzed and interpreted, a lot of recent machine learning research is focused on sentiment analysis applications. it gained a lot of interest due to the. Many sentiment analysis systems are modeled by using different machine learning techniques, but recently, deep learning, by using Artificial Neural Network (ANN) architecture, has showed significant improvements with high tendency to reveal the underlying semantic meaning in the input text. However, the output of these models could not be explained and the efficiency could not be analyzed because ANN models are considered as a black box and the success of these models comes at the cost of interpretability. The main objective of the presented work is developing Arabic sentiment analysis system that understands semantics in input reviews without using any linguistic resources. The first proposed model is Deep Attention-based Review Level Sentiment Analysis model (DARLSA) that use binary classifier to detect reviews’ polarities. Different scenarios and architectures were examined to test the ability of the proposed model to extract salient words out of the input. The results proved the ability of the proposed model to understand a given review by highlighting the most informative words to the class label. The model detected Arabic natural language linguistic features, such as intensification and negation styles, efficiently. Also, the effect of applying transfer learning technique on the problem of Arabic sentiment analysis is experimented on review level model. The second proposed architecture is Deep Attention-based Aspect Level Sentiment Analysis model (DAALSA) for classifying reviews polarity with respect to an aspect into three classes, positive, negative and neutral. Different models were proposed to test the effect of using different attention scoring functions on the classification performance. The results distinguished one model with superior performance compared to other proposed models. To obtain intuitive explanation of the trained models, both models are enhanced with visualization option. The final review representation is a distributed dense vector generated after passing through multi-layers neural network. Heatmap representation is used to visualize the final review representation. In addition, the attention layer’s scoring vector is visualized as well.