Leveraging Part-of-Speech Tagging for Sentiment Analysis in Short Texts and Regular Texts

Abstract

Sentiment analysis has been approached from a spectrum of methodologies, including statistical learning using labelled corpus and rule-based approach where rules may be constructed based on the observations on the lexicons as well as the output from natural language processing tools. In this paper, the experiments to transform labelled datasets by using NLP tools and subsequently performing sentiment analysis via statistical learning algorithms are detailed. In addition to the common data pre-processing prior to sentiment analysis, we represent the tokens in the datasets using Part-Of-Speech (POS) tags. The aim of the experiments is to investigate the impact of POS tags on sentiment analysis, particularly on both short texts and regular texts. The experimental results on short texts show that the combination of adjective and adverb predicts the sentiment of short texts the best. While noun is generally deemed to be neutral in sentiment polarity, the experimental results show that it helps to increase the accuracy of sentiment analysis on regular texts. Besides, the role of negation analysis in the datasets has also been investigated and reported based on the experimental results obtained.