Sentiment Classification Task Research Articles

Joint modeling of causal phrases-sentiments-aspects using Hierarchical Pitman Yor Process

Traditional sentiment-aware topic models assume that topic or sentiment transition occurs from either a sentence to the next sentence or from a word to the next word. Such models cannot capture a topic or sentiment transition at phrase boundaries. Further, most of the models adopt a sentiment lexicon to initialize sentiment priors and this approach induces coverage problems. To overcome the above-cited limitations, we have proposed a topic model that extracts aspects, sentiments, and causal phrases simultaneously by leveraging Hierarchical Pitman Yor Process (HPYP) that is modified using a sentiment component, a word-tagger to guide the causal phrase generation and a sentiment prior initialized through a sequential model to address coverage problems. We have evaluated our model on six datasets and found that the proposed model outperforms the baselines in terms of perplexity by 14%, topical coherence by 20%, topic diversity by 5%, sentiment classification task’s accuracy by 4% and, precision, recall and F1 score by 2%. Ablation studies assert that sequence model based sentiment prior initialization results in increasing the accuracy of sentiment classification by 2%.

SENTIMENT ANALYSIS OF WEIBO COMMENTS BASED ON CONVOLUTIONAL NEURAL NETWORK

Sentiment analysis of social media comments plays a crucial role in understanding public opinion and sentiment trends. This study focuses on sentiment analysis of Weibo comments, a popular microblogging platform in China, using a (CNN) approach. We propose a novel methodology that leverages the inherent structural dependencies among comments and users in the Weibo network to capture nuanced sentiment patterns. By representing Weibo comments as a graph, with users and comments as nodes and their interactions as edges, we exploit the relational information to enhance sentiment classification accuracy. Furthermore, we employ attention mechanisms to prioritize influential users and comments in the sentiment analysis process. Through extensive experiments on real Weibo datasets, our proposed CNN-based sentiment analysis framework demonstrates superior performance compared to traditional methods, achieving high accuracy in sentiment classification tasks. This research contributes to advancing sentiment analysis techniques in social media platforms and provides valuable insights for understanding public sentiment dynamics in online communities like Weibo.

Augmenting Sentiment Analysis Prediction in Binary Text Classification through Advanced Natural Language Processing Models and Classifiers

Sentiment analysis is a critical component in natural language processing applications, particularly for text classification. By employing state-of-the-art techniques such as ensemble methods, transfer learning and deep learning architectures, our methodology significantly enhances the robustness and precision of sentiment predictions. We systematically investigate the impact of various NLP models, including recurrent neural networks and transformer-based architectures, on sentiment classification tasks. Furthermore, we introduce a novel ensemble method that combines the strengths of multiple classifiers to improve the predictive ability of the system. The results demonstrate the potential of integrating state-of-the-art Natural Language Processing (NLP) models with ensemble classifiers to advance sentiment analysis. This lays the foundation for a more advanced comprehension of textual sentiments in diverse applications.

A dual contrastive learning-based graph convolutional network with syntax label enhancement for aspect-based sentiment classification

Introduction: Aspect-based sentiment classification is a fine-grained sentiment classification task. State-of-the-art approaches in this field leverage graph neural networks to integrate sentence syntax dependency. However, current methods fail to exploit the data augmentation in encoding and ignore the syntactic relation in sentiment delivery.Methods: In this work, we propose a novel graph neural network-based architecture with dual contrastive learning and syntax label enhancement. Specifically, a contrastive learning-based contextual encoder is designed, integrating sentiment information for semantics learning. Moreover, a weighted label-enhanced syntactic graph neural network is established to use both the syntactic relation and syntax dependency, which optimizes the syntactic weight between words. A syntactic triplet between words is generated. A syntax label-based contrastive learning scheme is developed to map the triplets into a unified feature space for syntactic information learning.Results: Experiments on five publicly available datasets show that our model substantially outperforms the baseline methods.Discussion: As such, the proposed method shows its effectiveness in aspect-based sentiment classification tasks.

Aspect-Based Sentiment Analysis with Explicit Sentiment Augmentations

Aspect-based sentiment analysis (ABSA), a fine-grained sentiment classification task, has received much attention recently. Many works investigate sentiment information through opinion words, such as "good'' and "bad''. However, implicit sentiment data widely exists in the ABSA dataset, whose sentiment polarity is hard to determine due to the lack of distinct opinion words. To deal with implicit sentiment, this paper proposes an ABSA method that integrates explicit sentiment augmentations (ABSA-ESA) to add more sentiment clues. We propose an ABSA-specific explicit sentiment generation method to create such augmentations. Specifically, we post-train T5 by rule-based data and employ three strategies to constrain the sentiment polarity and aspect term of the generated augmentations. We employ Syntax Distance Weighting and Unlikelihood Contrastive Regularization in the training procedure to guide the model to generate the explicit opinion words with the same polarity as the input sentence. Meanwhile, we utilize the Constrained Beam Search to ensure the augmentations are aspect-related. We test ABSA-ESA on two ABSA benchmarks. The results show that ABSA-ESA outperforms the SOTA baselines on implicit and explicit sentiment accuracy.

Sentiment Classification of Robot Hotel Content using NBC and SVM Algorithm

Sentiment analysis plays a pivotal role in comprehending public sentiment, notably within digital communication, where copious amounts of textual data are generated daily. This study delves into the efficacy of sentiment classification models, namely the Naive Bayes Classifier (NBC) and Support Vector Machine (SVM), within the imbalanced datasets commonly encountered in sentiment analysis tasks. Employing a comparative analysis methodology, a dataset comprising robot hotel reviews from online platforms is the basis for evaluation. Both NBC and SVM models undergo training and assessment, with and without the Synthetic Minority Over-sampling Technique (SMOTE), to rectify the class imbalance. Performance evaluation relies on critical metrics, including accuracy, recall, precision, f-measure, and Area Under Curve (AUC) to gauge model effectiveness. Findings demonstrate SVM's superiority over NBC in terms of accuracy (SVM: 76.88%, NBC: 67.43%), precision (SVM: 92.03%, NBC: 86.87%), recall (SVM: 58.88%, NBC: 41.00%), f-measure (SVM: 71.78%, NBC: 55.63%), and AUC (SVM: 0.907, NBC: 0.961). Incorporating SMOTE significantly enhances both models' performance, particularly in addressing class imbalance concerns. Although NBC exhibits a more balanced performance across precision and recall metrics, SVM demonstrates heightened accuracy and predictive capability in sentiment classification tasks. These findings underscore the pivotal role of algorithm selection and preprocessing techniques in optimizing sentiment analysis performance, thereby providing invaluable insights for practitioners and researchers alike.

CAT: Continual Adapter Tuning for aspect sentiment classification

Humans can continually acquire, improve, and transfer knowledge throughout their lifespan so that they can accurately identify sentiment polarities of the data attributed to different domains. However, the continual learning of incrementally available aspect sentiment classification (ASC) tasks from different domains with non-stationary data distributions remains a long-standing challenge for learning-based models due to the catastrophic forgetting problem, which is the tendency to completely and abruptly forget previously learned knowledge upon learning new knowledge. In this work, we present Continual Adapter Tuning (CAT), a parameter-efficient framework that not only avoids catastrophic forgetting but also enables knowledge transfer from learned ASC tasks to new ASC tasks. To avoid catastrophic forgetting, we only learn and store a task-specific adapter for each ASC task while freezing the backbone pre-trained model. To promote new task learning, we propose a continual adapter initialization technique to transfer knowledge from preceding tasks. Besides, we also develop a novel label-aware contrastive learning to simultaneously learn the features of input samples and the parameters of classifiers in the same space so that we can efficiently classify a sample with the help of label semantics. To eliminate the need for task IDs in testing, we propose a simple yet efficient majority sentiment polarity voting strategy to obtain final sentiment polarities according to the polarities predicted by all reasoning paths in the adapter architecture. Experimental results show the high effectiveness of our CAT by achieving new state-of-the-art performance.

Improving sentiment analysis using text network features within different machine learning algorithms

Sentiment analysis poses a significant challenge due to the inherent subjectivity of natural language and the prevalence of unstandardized dialects in social networks. Regrettably, existing literature lacks a dedicated focus on network representation learning for sentiment classification. This paper addresses this gap by investigating ten machine learning algorithms, including support vector machine (SVM), random forest (RF), logistic regression (LR), and Naive Bayes (NB). Our approach integrates text network analysis and sentiment analysis to propose a comprehensive solution. We begin by applying text preprocessing techniques and converting a text corpus into a text network using word co-occurrence. Subsequently, we employ network analysis techniques to extract features based on network topology and node attributes. These network-derived features serve as inputs for sentiment prediction on Yelp reviews. Through the incorporation of diverse text network features and various machine learning algorithms, we achieve significant enhancements in sentiment classification performance. Our evaluation demonstrates an improved area under curve (AUC) of 83% on the Yelp reviews corpus, underscoring the efficacy of integrating network features to enhance sentiment classifiers. This research underscores the critical role of network representation and its potential impact on sentiment analysis, highlighting the prospect of harnessing network features for sentiment classification tasks.

Sentiment analysis of tweets using text and graph multi-views learning

With the surge of deep learning framework, various studies have attempted to address the challenges of sentiment analysis of tweets (data sparsity, under-specificity, noise, and multilingual content) through text and network-based representation learning approaches. However, limited studies on combining the benefits of textual and structural (graph) representations for sentiment analysis of tweets have been carried out. This study proposes a multi-view learning framework (end-to-end and ensemble-based) that leverages both text-based and graph-based representation learning approaches to enrich the tweet representation for sentiment classification. The efficacy of the proposed framework is evaluated over three datasets using suitable baseline counterparts. From various experimental studies, it is observed that combining both textual and structural views can achieve better performance of sentiment classification tasks than its counterparts.

Sentiment interpretability analysis on Chinese texts employing multi-task and knowledge base.

With the rapid development of deep learning techniques, the applications have become increasingly widespread in various domains. However, traditional deep learning methods are often referred to as "black box" models with low interpretability of their results, posing challenges for their application in certain critical domains. In this study, we propose a comprehensive method for the interpretability analysis of sentiment models. The proposed method encompasses two main aspects: attention-based analysis and external knowledge integration. First, we train the model within sentiment classification and generation tasks to capture attention scores from multiple perspectives. This multi-angle approach reduces bias and provides a more comprehensive understanding of the underlying sentiment. Second, we incorporate an external knowledge base to improve evidence extraction. By leveraging character scores, we retrieve complete sentiment evidence phrases, addressing the challenge of incomplete evidence extraction in Chinese texts. Experimental results on a sentiment interpretability evaluation dataset demonstrate the effectiveness of our method. We observe a notable increase in accuracy by 1.3%, Macro-F1 by 13%, and MAP by 23%. Overall, our approach offers a robust solution for enhancing the interpretability of sentiment models by combining attention-based analysis and the integration of external knowledge.

Sentence-level sentiment classification based on multi-attention bidirectional gated spiking neural P systems

The GSNP model is a new recurrent-like network inspired by nonlinear spiking mechanisms in nonlinear spiking neural P systems. In this study, a novel sentiment classification model MA-BiGSNP is established by using bidirectional GSNP model combined with multi-attention mechanism. BiGSNP, which is created by two GSNP models with opposite directions, is used to capture semantic correlations between word contexts in a sentence. The multi-attention mechanism simulates the variety of relationships between sentences as well as the significance of words in sentences. To evaluate the effectiveness of the proposed MA-BiGSNP model, we perform comparative experiments and ablation experiments on five real datasets and twelve baseline models. The experimental results show that the proposed MA-BiGSNP model is effective for sentiment classification task.

Affective Region Recognition and Fusion Network for Target-Level Multimodal Sentiment Classification

With the development of multimodal sentiment analysis tasks, target-level/aspect-level multimodal sentiment analysis has received more attention, aiming to intelligently judge the sentiment orientation of target words using visual and textual information. Most existing methods mainly rely on combining the whole image and text while ignoring the implicit affective regions in the image. We introduce a novel affective region recognition and fusion network (ARFN) for target-level multimodal sentiment classification, which focuses more on the alignment of multimodal fusion of visual and textual. First, to produce a visual representation with sentiment elements, ARFN employs the Yolov5 algorithm to extract the object region of the image and selects the emotional area according to the strategy. Next, this method learns target-sensitive visual representations and text semantic representations through a multi-head attention mechanism and pre-trained models BERT, respectively. Moreover, ARFN fuses textual and visual representations through a multimodal interaction method to perform target-level multimodal sentiment classification tasks. We achieve state-of-the-art performance on two available multimodal Twitter datasets, and experimental results show the effectiveness of our approach.

A Comparative Sentiment Analysis of Airline Customer Reviews Using Bidirectional Encoder Representations from Transformers (BERT) and Its Variants

The applications of artificial intelligence (AI) and natural language processing (NLP) have significantly empowered the safety and operational efficiency within the aviation sector for safer and more efficient operations. Airlines derive informed decisions to enhance operational efficiency and strategic planning through extensive contextual analysis of customer reviews and feedback from social media, such as Twitter and Facebook. However, this form of analytical endeavor is labor-intensive and time-consuming. Extensive studies have investigated NLP algorithms for sentiment analysis based on textual customer feedback, thereby underscoring the necessity for an in-depth investigation of transformer architecture-based NLP models. In this study, we conducted an exploration of the large language model BERT and three of its derivatives using an airline sentiment tweet dataset for downstream tasks. We further honed this fine-tuning by adjusting the hyperparameters, thus improving the model’s consistency and precision of outcomes. With RoBERTa distinctly emerging as the most precise and overall effective model in both the binary (96.97%) and tri-class (86.89%) sentiment classification tasks and persisting in outperforming others in the balanced dataset for tri-class sentiment classification, our results validate the BERT models’ application in analyzing airline industry customer sentiment. In addition, this study identifies the scope for improvement in future studies, such as investigating more systematic and balanced datasets, applying other large language models, and using novel fine-tuning approaches. Our study serves as a pivotal benchmark for future exploration in customer sentiment analysis, with implications that extend from the airline industry to broader transportation sectors, where customer feedback plays a crucial role.

Base on contextual phrases with cross-correlation attention for aspect-level sentiment analysis

In recent years, sentiment analysis has emerged as a prominent area of research within the field of natural language processing. Particularly, aspect-level sentiment classification has gained significant attention for its focus on discerning and analyzing sentiment expressed towards specific aspects within sentences. Existing methods primarily rely on extracting keywords from sentence contexts to determine sentiment polarity, yielding satisfactory results. However, a notable limitation of these approaches is their inability to consider the crucial information contained within key phrases in sentences, which plays a vital role in sentiment analysis. To address this limitation, we propose a novel deformable convolutional network model designed to leverage the power of phrases for aspect-level sentiment analysis. By utilizing deformable convolutions with adaptive receptive fields, our model effectively extracts phrase representations at various contextual distances. Furthermore, a cross-correlation attention mechanism is incorporated to capture interdependencies between phrases and words in the context. To evaluate the effectiveness of our approach, we conduct comprehensive evaluations across widely used datasets, demonstrating the promising performance of our model in enhancing sentiment classification tasks. Our model outperforms the model based on CNN, which also leverages phrase extraction, by improving accuracy by 1.71%, 2.5%, and 1.89%, respectively, on the Laptop, Restaurant, and Twitter datasets. Additionally, it surpasses the performance of the latest models.

Multistream BertGCN for Sentiment Classification Based on Cross-Document Learning

Very recently, the BERT graph convolutional network (BertGCN) model has attracted much attention from researchers due to its good text classification performance. However, just using original documents in the corpus to construct the topology of graphs for GCN-based models may lose some effective information. In this paper, we focus on sentiment classification, an important branch of text classification, and propose the multistream BERT graph convolutional network (MS-BertGCN) for sentiment classification based on cross-document learning. In the proposed method, we first combine the documents in the training set based on within-class similarity. Then, each heterogeneous graph is constructed using a group of combinations of documents for the single-stream BertGCN model. Finally, we construct multistream-BertGCN (MS-BertGCN) based on multiple heterogeneous graphs constructed from different groups of combined documents. The experimental results show that our MS-BertGCN model outperforms state-of-the-art methods on sentiment classification tasks.

Imbalanced sentiment classification of online reviews based on SimBERT

The purpose of sentiment classification is to accomplish automatic judssssgment of the sentiment tendency of text. In the sentiment classification task of online reviews, traditional models focus on the optimization of algorithm performance, but ignore the imbalanced distribution of the number of sentiment classifications of online reviews, which causes serious degradation in the classification performance of the model in practical applications. The experiment was divided into two stages in the overall context. The first stage trains SimBERT using online review data so that SimBERT can fully learn the semantic features of online reviews. The second stage uses the trained SimBERT model to generate fake minority samples and mix them with the original samples to obtain a distributed balanced dataset. Then the mixed data set is input into the deep learning model to complete the sentiment classification task. Experimental results show that this method has excellent classification performance in the sentiment classification task of hotel online reviews compared with traditional deep learning models and models based on other imbalanced processing methods.

Advancement in Bangla Sentiment Analysis: A Comparative Study of Transformer-Based and Transfer Learning Models for E-commerce Sentiment Classification

Background: As a direct result of the Internet's expansion, the quantity of information shared by Internet users across its numerous platforms has increased. Sentiment analysis functions at a higher level when there are more available perspectives and opinions. However, the lack of labeled data significantly complicates sentiment analysis utilizing Bangla natural language processing (NLP). In recent years, nevertheless, due to the development of more effective deep learning models, Bangla sentiment analysis has improved significantly. Objective: This article presents a curated dataset for Bangla e-commerce sentiment analysis obtained solely from the "Daraz" platform. We aim to conduct sentiment analysis in Bangla for binary and understudied multiclass classification tasks. Methods: Transfer learning (LSTM, GRU) and Transformers (Bangla-BERT) approaches are compared for their effectiveness on our dataset. To enhance the overall performance of the models, we fine-tuned them. Results: The accuracy of Bangla-BERT was highest for both binary and multiclass sentiment classification tasks, with 94.5% accuracy for binary classification and 88.78% accuracy for multiclass sentiment classification. Conclusion: Our proposed method performs noticeably better classifying multiclass sentiments in Bangla than previous deep learning techniques. Keywords: Bangla-BERT, Deep Learning, E-commerce, NLP, Sentiment Analysis

A dependency-based hybrid deep learning framework for target-dependent sentiment classification

One of the main challenges in target-dependent sentiment classification (TDSC) is dealing with sentences that contain multiple targets with varying polarities. Traditional sentiment analysis has shown the effectiveness of language characteristics. Therefore, we propose a method to extract target semantic-related tokens from sentences in order to simplify the sentiment classification task. To achieve this, we establish six grammatical principles that utilize grammatical knowledge to filter the relevant descriptions of targets. Since a target is typically a noun and acts as a subject, we summarize the six rules to extract the contexts contained in the objects and subordinate clauses. We use dependency parsing to analyze the grammatical relations between the target and its context. We design a data pre-processing method called Text Filtering (TF) to automate this procedure. After executing the TF algorithm, we pass the target-related words to a simple classifier to predict their sentiment polarities. Rather than feeding these features directly to a network and letting it learn features on its own, our approach employs dependency relations to extract context linked to the target. This provides the network with meaningful and representative features, resulting in superior results. We conduct ablation studies to investigate the effectiveness of the proposed TF algorithm. In the restaurant hard dataset, our approach improves accuracy by 13.76% and macro-F1 by 14.65% compared to a CNN-based method where TF is not implemented.

Performance analysis of aspect-level sentiment classification task based on different deep learning models.

Aspect-level sentiment classification task (ASCT) is a natural language processing task that aims to correctly identify specific aspects and determine their sentiment polarity from a given target sentence. Deep learning models have been proven to be effective in aspect-based sentiment classification tasks, and the mainstream Aspect-level sentiment classification (ASC) models currently constructed generally assume that the training and test datasets are Gaussian distribution (e.g., the same language). Once the data distribution changes, the ASC model must be retrained on the new distribution data to achieve good performance. However, acquiring a large amount of labeled data again typically requires a lot of manpower and money, which seems unlikely, especially for the ASC task, as it requires aspect-level annotation. This article analyzes the performance of sequence-based models, graph-based convolutional neural networks, and pre-training language models on the aspect-level sentiment classification task using two sets of comment datasets in Chinese and English, from four perspectives: classification performance, performance with different aspect numbers, specific case performance, and computational cost. In this article, we design a state-of-the-art ASC-based classification method and conduct a systematic study on eight public standard English and Chinese datasets with various commonly used assessment measures that provide directions for cross-language migration. Finally, we discuss the limitations of the study as well as future research directions.

Review on positional significance of LSTM and CNN in the multilayer deep neural architecture for efficient sentiment classification

The deep learning revolution in the current decade has transformed the artificial intelligence industry. Eventually, deep learning techniques have become essential for many computational modeling tasks. Nevertheless, deep neural models provide a high degree of automation for natural language processing (NLP) applications. Deep neural models are extensively used to decode public reviews subjective to specific products, services, and other social activities. Further, to improve sentiment classification accuracy, several neural architectures have been developed. Convolutional neural networks (CNN) and Long-short term memory (LSTM) are the popular deep models employed in ensemble architectures for sentiment classification tasks. This review article extensively compares the competence of CNN and LSTM-based ensemble models to improve the sentiment accuracy for online review datasets. Further, this article also provides an empirical study on various ensemble models concerning the position of LSTM and CNN for efficient sentiment classification. This empirical study provides deep learning researchers with insights into building effective multilayer LSTM and CNN models for many sentiment analysis tasks.