Abstract

This paper describes our participation in the SemEval-2016 task 5, Aspect Based Sentiment Analysis (ABSA). We participated in two slots in the sentence level ABSA (Subtask 1) namely: aspect category extraction (Slot 1) and sentiment polarity extraction (Slot 3) in English Restaurants and Laptops reviews. For Slot 1, we applied different models for each domain. In the restaurants domain, we used an ensemble classifier for each aspect which is a combination of a Convolutional Neural Network (CNN) classifier initialized with pretrained word vectors, and a Support Vector Machine (SVM) classifier based on the bag of words model. For the Laptops domain, we used only one CNN classifier that predicts the aspects based on a probability threshold. For Slot 3, we incorporated domain and aspect knowledge in one ensemble CNN classifier initialized with fine-tuned word vectors and used it in both domains. In the Restaurants domain, our system achieved the 2 nd and the 3 rd places in Slot 1 and Slot 3 respectively. However, we ranked the 8 th in Slot 1 and the 5 th in Slot 3 in the Laptops domain. Our extended experiments show our system could have ranked 2 nd in the Laptops domain in Slot 1 and Slot 3, had we followed the same approach we followed in the Restaurants domain in slot 1 and trained each domain separately in Slot 3.

Highlights

  • Due to the increasing numbers of user generated reviews written every day within e-commerce websites, a great interest has been shown in the sentiment analysis research community to build intelligent systems that can accurately tackle the task of sentiment analysis in these reviews.In this context, the SemEval-2016 Aspect Based Sentiment Analysis (ABSA), task 51, Subtask 1 addresses a number of research problems related to this topic, including building systems that are able to extract aspect categories (Slot 1) and determine the sentiment polarity towards each aspect in each sentence (Slot-3) which were the two slots in which we participated.The best results for Slot 1 in SemEval-2015 ( Pontiki et al, 2015), were achieved by the NLANGP team (Toh and Su, 2015)

  • For the restaurants domain we treated the problem as a multi-class classification problem using an ensemble binary classifier for each aspect which is a combination of a Support Vector Machine (SVM) (Cortes and Vapnik, 1995) classifier and a Convolutional Neural Network (CNN)

  • For the aspect category extraction task (Slot 1), our Restaurants Aspect Extraction Model (RAEM) model achieved the 2nd place out of 30 teams in the restaurants domain, with an F-Score of 72.886 which is only 0.145 less than what was achieved by the best performer

Read more

Summary

Introduction

Due to the increasing numbers of user generated reviews written every day within e-commerce websites, a great interest has been shown in the sentiment analysis research community to build intelligent systems that can accurately tackle the task of sentiment analysis in these reviews. The team tackled the problem by modeling it as a multi-class classification problem with binary classifiers for each aspect They used a neural network with one hidden layer and features based on word n-grams, brown and k-means word clusters from Amazon and Yelp datasets and parsing features. This year, when addressing Slot 1, we participated with a system that can extract aspects in English reviews in the two domains that the task provided test sets for, namely: restaurants (REST) and laptops (LAPT). For the restaurants domain we treated the problem as a multi-class classification problem using an ensemble binary classifier for each aspect which is a combination of a Support Vector Machine (SVM) (Cortes and Vapnik, 1995) classifier and a Convolutional Neural Network (CNN).

System Details
Convolutional Neural Network architecture
Evaluation and Results
Official Participations
Extended Experiments
Conclusions
Full Text
Paper version not known

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.