Aspect-based Sentiment Analysis Research Articles

Aspect-aware semantic feature enhanced networks for multimodal aspect-based sentiment analysis

Aspect-aware semantic feature enhanced networks for multimodal aspect-based sentiment analysis

Enhancing aspect-based sentiment analysis through graph attention networks and supervised contrastive learning

Enhancing aspect-based sentiment analysis through graph attention networks and supervised contrastive learning

DEEP LEARNING APPROACH FOR ASPECT CATEGORY DETECTION: A BIBLIOMETRIC ANALYSIS

This article presents a quantitative and qualitative assessment of current research trends by conducting a bibliometric analysis of the sentiment analysis literature from 2020 to March 2024 using the Scopus database. Our focus is on the review of scientific documents, the arrangement of subject categories, the research trend in aspect category detection, the top 10 scholars that write the most number articles in aspect category detection and keyword trends. Our research shows that specialists in computer science, engineering, mathematics, medicine, decision science, material science, social sciences, business and management accounting, energy, and health are the most common topic groups in this industry. A study of keywords shows that terms like “BERT” and “deep learning” are frequently used together. This highlights the use of sophisticated models like BERT in this field and suggests a tendency to use innovative architecture to achieve better results. Conversely, although terms such as “sentiment analysis” and “aspect-based sentiment analysis” have modest frequency, their link strengths indicate a significant correlation with the main theme, emphasising the relationship between aspect category detection and sentiment analysis in research projects. we also provide the deep-learning technique used by the author for aspect category detection.

EASE: An enhanced active learning framework for aspect-based sentiment analysis based on sample diversity and data augmentation

Aspect-Based Sentiment Analysis (ABSA) has received considerable attention in recent studies. Powerful pre-trained models were proposed which can be fine-tuned for many Natural Language Processing (NLP) tasks, including ABSA. However, fine-tuning these models needs a relatively large amount of labeled data. In this research, we propose EASE; an active learning framework to minimize manual labeling effort. We extend the active learning technique by incorporating the concept of sample diversity where similar samples are not selected for labeling. Furthermore, we maximize the utility of these samples by incorporating data augmentation. EASE was evaluated on three benchmark ABSA datasets from three different domains. The results show that the reduction of the number of needed labeled samples ranges from 88% to 94% among the three datasets while maintaining accuracy. Our results show that active learning is an effective approach to reduce manual labeling effort while maintaining comparable performance. Moreover, it is possible to reduce the number of labeled data even further by incorporating sample diversity and data augmentation while maintaining performance.

Dual syntax aware graph attention networks with prompt for aspect-based sentiment analysis

Aspect-based sentiment analysis (ABSA) is a challenging task due to the presence of multiple aspect words with different sentiment polarities in a sentence. Recently, pre-trained language models like BERT have been widely used as context encoders in ABSA. Graph neural networks have also been employed to extract syntactic and semantic information from sentence parsing trees, resulting in superior results. However, dependency trees may establish irrelevant dependencies for sentences with irregular syntax and complex structures. Additionally, previous methods have not fully utilized recent developments in pre-trained language models. Therefore, we propose a Dual Syntax aware Graph attention networks with Prompt (DSGP) model to address these issues. Our model utilizes prompt templates to maximize the potential of pre-trained models and masked vector outputs of templates as supplementary aspect feature representations. We also leverage both dependency trees and constituent trees with graph attention networks to extract different types of syntactic information. The dependency tree captures syntactic correlation between words, while the constituent tree provides a high-level formation of the sentence. Finally, the output from the prompt and parsing trees is fused and fed into a standard classifier. Experimental results on four public datasets demonstrate the competitive performance of our model.

Understanding Public Opinion towards ESG and Green Finance with the Use of Explainable Artificial Intelligence

This study leverages explainable artificial intelligence (XAI) techniques to analyze public sentiment towards Environmental, Social, and Governance (ESG) factors, climate change, and green finance. It does so by developing a novel multi-task learning framework combining aspect-based sentiment analysis, co-reference resolution, and contrastive learning to extract nuanced insights from a large corpus of social media data. Our approach integrates state-of-the-art models, including the SenticNet API, for sentiment analysis and implements multiple XAI methods such as LIME, SHAP, and Permutation Importance to enhance interpretability. Results reveal predominantly positive sentiment towards environmental topics, with notable variations across ESG categories. The contrastive learning visualization demonstrates clear sentiment clustering while highlighting areas of uncertainty. This research contributes to the field by providing an interpretable, trustworthy AI system for ESG sentiment analysis, offering valuable insights for policymakers and business stakeholders navigating the complex landscape of sustainable finance and climate action. The methodology proposed in this paper advances the current state of AI in ESG and green finance in several ways. By combining aspect-based sentiment analysis, co-reference resolution, and contrastive learning, our approach provides a more comprehensive understanding of public sentiment towards ESG factors than traditional methods. The integration of multiple XAI techniques (LIME, SHAP, and Permutation Importance) offers a transparent view of the subtlety of the model’s decision-making process, which is crucial for building trust in AI-driven ESG assessments. Our approach enables a more accurate representation of public opinion, essential for informed decision-making in sustainable finance. This paper paves the way for more transparent and explainable AI applications in critical domains like ESG.

Exploring large language models for the generation of synthetic training samples for aspect-based sentiment analysis in low resource settings

Aspect-Based Sentiment Analysis (ABSA) is a fine-grained task in sentiment analysis, aiming to identify sentiment expressed towards specific aspects of an entity. This paper explores the use of Large Language Models (LLMs), specifically GPT-3.5-turbo and Llama-3-70B, for generating annotated data in Aspect-Based Sentiment Analysis (ABSA), aiming to address the scarcity of labeled datasets in the field. Two low-resource scenarios are considered, with 25 and 500 manually annotated examples available. In the 25-example scenario, adding synthetic examples generated through few-shot prompting resulted in F1 scores of 81.33 for Aspect Category Detection (ACD) and 71.71 for Aspect Category Sentiment Analysis (ACSA). For the 500-example scenario, synthetic data augmentation showed a notable gain only for the ACSA task, raising the F1 score from 84.54 to 86.70.

IFusionQuad: A novel framework for improved aspect-based sentiment quadruple analysis in dialogue contexts with advanced feature integration and contextual CloBlock

Aspect-based sentiment analysis (ABSA) represents a crucial field of natural language processing (NLP). It focuses on deriving detailed sentiment insights from textual content. Dialogue-level aspect-based sentiment quadruple extraction (DiaASQ) is specifically concerned with pinpointing target-aspect-opinion-emotion quadruples within conversations. DiaASQ is important in industries like e-commerce, social media analytics, and customer feedback. However, Current ABSA approaches predominantly focus on single-text scenarios, often overlooking the complexities involved in sentiment analysis within conversational contexts. To fill this gap, this paper presents the IFusionQuad model, which is specifically designed for the DiaASQ task. Our contributions include the innovative integration of CloBlock in ABSA, enhancing feature representation with context-aware weights. The InteractiveNet Fusion Module further advances dialogue understanding by aggregating dialogue-specific features such as threads, speakers, and replies. Components such as CloBlock, gating mechanism, and Biaffine attention effectively mitigate data noise issues, improving the relevance of feature extraction. Empirical evaluation on standard datasets demonstrates that the IFusionQuad model outperforms baseline methods, achieving substantial improvements in quadruple extraction. Specifically, our model shows a 6.59% increase in micro F1 and a 7.05% increase in identification F1 for Chinese datasets, and a 2.65% and 4.69% increase in micro F1 and identification F1, respectively, for English datasets. The results clearly demonstrate our IFusionQuad model’s efficacy, which consistently outperforms baseline models across all evaluation datasets on the DiaASQ task.

Aspect Based Sentiment Analysis Using Self-Attention Based LSTM Model with Word Embedding

Aspect Based Sentiment Analysis Using Self-Attention Based LSTM Model with Word Embedding

Dual edge-embedding graph convolutional network for unified aspect-based sentiment analysis

Aspect-based sentiment analysis (ABSA) mainly involves three elements, i.e., aspect, target, and sentiment. Most existing research focuses on aspect-sentiment or target-sentiment separately, while connection among the three elements is still underexploited. In order to extract three interrelated elements from a sentence simultaneously, we propose a unified end-to-end model, which is based on one aspect via a virtual edge attention mechanism and a graph convolutional network (GCN) to detect related targets and to analyze the corresponding sentiment polarity. The virtual edges are decided by the association intensity between the aspect and the words of the sentence. Instead of naively regarding all connecting edges as binary values, we design a novel GCN with a dual edge-embedding method to help information flow among each word in the sentence and between the aspect category and the sentence. Extensive experiments on two open datasets show that our model outperforms the state-of-the-art models in the aspect-target-sentiment triples detection task and its two subtasks.

Aspect Based Feature Extraction in Sentiment Analysis using Bi-GRU-LSTM Model

In Natural Language Processing (NLP), Sentiment Analysis (SA) is a fundamental process which predicts the sentiment expressed in sentences. In contrast to conventional sentiment analysis, Aspect-Based Sentiment Analysis (ABSA) employs a more nuanced approach to assess the sentiment of individual aspects or components within a document or sentence. Its objective is to identify the sentiment polarity, such as positive, neutral, or negative, associated with particular elements disclosed within a sentence. This research introduces a novel sentiment analysis technique that proves to be more efficient in sentiment analysis compared to current methods. The suggested sentiment analysis method undergoes three key phases: 1. Pre-processing 2. Extraction of aspect sentiment and 3. Sentiment analysis classification. The input text data undergoes pre-processing through the implementation of four typical text normalization techniques, which include stemming, stop word elimination, lemmatization, and tokenization. By employing these methods, the provided text data is prepared and fed into the aspect sentiment extraction phase. During the aspect sentiment extraction phase, features are obtained through a series of steps, including enhanced ATE (Aspect Term Extraction), assessment of word length, and determination of cosine similarity. By following these steps, the relevant features are extracted on the basis of aspects and sentiments involved in the text data. Further, a hybrid classification model is proposed to classify sentiments. In this work, two of the Deep Learning (DL) classifiers, Bi-directional Gated Recurrent Unit (Bi-GRU) and Long Short-Term memory (LSTM) are used in proposing a hybrid classification model which classifies the sentiments effectively and provides accurate final predicted results. Moreover, the performance of proposed sentiment analysis technique is analyzed experimentally to show its efficacy over other models.

Enhanced UrduAspectNet: Leveraging Biaffine Attention for superior Aspect-Based Sentiment Analysis

Urdu, with its rich linguistic complexity, poses significant challenges for computational sentiment analysis. This study presents an enhanced version of UrduAspectNet, specifically designed for Aspect-Based Sentiment Analysis (ABSA) in Urdu. We introduce key innovations including the incorporation of Biaffine Attention into the model architecture, which synergizes XLM-R embeddings, a bidirectional LSTM (BiLSTM), and dual Graph Convolutional Networks (GCNs). Additionally, we utilize dependency parsing to create the adjacency matrix for the GCNs, capturing syntactic dependencies to enhance relational representation. The improved model, termed Enhanced UrduAspectNet, integrates POS and lemma embeddings, processed through BiLSTM and GCN layers, with Biaffine Attention enhancing the extraction of intricate aspect and sentiment relationships. We also introduce the use of BIO tags for aspect term identification, improving the granularity of aspect extraction. Experimental results demonstrate significant improvements in both aspect extraction and sentiment classification accuracy. This research advances Urdu sentiment analysis and sets a precedent for leveraging sophisticated NLP techniques in underrepresented languages.

Implicit expression recognition enhanced table-filling for aspect sentiment triplet extraction

Aspect sentiment triplet extraction (ASTE) is a challenging task in aspect-based sentiment analysis (ABSA), involving the identification of aspect terms, opinion terms, and their corresponding sentiment polarities within comments to form triplets. The emergence of more realistic DMASTE datasets, featuring diverse domains, implicit aspect terms, and longer comments, poses challenges for existing methods. In particular, these methods struggle with recognizing implicit expressions effectively and capturing sufficient information. To overcome these hurdles, we propose an implicit expression recognition enhanced table-filling (IERET) method. This approach integrates modeling of overall implicit expression in sentences and employs a bidirectional information aggregation module to capture word pair information comprehensively. During the decoding process, a table-filling method accurately delineates aspect-opinion pair boundaries. Experimental results across in-domain, single-source cross-domain, and multi-source cross-domain on the DMASTE dataset demonstrate that our proposed IERET method achieves state-of-the-art performance.

IDSV-GCN: Integrating Dual Syntactic Views Graph Convolutional Network for aspect-based sentiment analysis

Aspect-based sentiment analysis (ABSA) aims to predict the sentiment polarity towards given aspects in a sentence. Recent research has highlighted that graph neural networks based on syntactic dependency trees effectively convey rich syntactic information and are suitable for ABSA tasks. Most existing work typically adopt either dependency type or minimum distance between nodes in the original syntactic tree to construct different views. However, existing work overlooks the high-dimensional local feature information in dependency relations, resulting in inadequate exploration of this view. Meanwhile, most work ignores that the minimum distance view and the dependency view can be complementary and integrated in syntactic analysis. Unfortunately, directly adding the two views introduces noise issues, leading to unsatisfactory results after their integration. To address these issues, this paper introduces an integrating dual syntactic views graph convolutional network (IDSV-GCN) model that seamlessly integrates dependency type view and minimum distance view, enabling comprehensive utilization of syntactic structure and information. To better address the computation of weights in the dependency type view, we innovatively propose a fusion attention mechanism. This approach effectively captures both global and local feature information. To more effectively integrate the two views and reduce the impact of noise, we employ a syntactic mask layer to filter out noise in the dependency type view and highlighting important dependency feature information. Then, we construct a minimum distance weight matrix based on the matrix obtained from the dependency type view. Finally, we merge the two matrices and feed them into the GCN to facilitate the model’s learning of syntactic information. Experimental results on three widely-used benchmark datasets demonstrate that our proposed IDSV-GCN model outperforms state-of-the-art methods.

Aspect based sentiment analysis of Twitter mobile phone reviews using LSTM and Convolutional Neural Network

The proliferation of online shopping has led to a surge in product reviews, providing valuable information to consumers. However, the overwhelming volume and subjective nature of these reviews make it difficult to assess product performance accurately. We propose a machine learning-based system that extracts sentiment from online reviews to address this challenge. Our system effectively identifies positive, negative, and neutral sentiments and classifies sentiment for specific product aspects. By offering concise and clear information, our system empowers consumers to make informed purchasing decisions and assists manufacturers in improving their products. Our proposed LSTMCNN model, trained on a dataset of 62,563 reviews, achieved impressive results with an accuracy of 95.84%, precision of 95.6% and recall of 95.8%. This significantly outperforms existing models, demonstrating the effectiveness of our approach. Moving forward, we aim to further enhance the accuracy of our system, track sentiment changes over time, and develop personalized product recommendations. These advancements will continue to increase the value and utility of online reviews in e-commerce.

FMCF: Few-shot Multimodal aspect-based sentiment analysis framework based on Contrastive Finetuning

FMCF: Few-shot Multimodal aspect-based sentiment analysis framework based on Contrastive Finetuning

Improving Cross-lingual Aspect-based Sentiment Analysis with Sememe Bridge

Improving Cross-lingual Aspect-based Sentiment Analysis with Sememe Bridge

TRF-BERT: A transformative approach to aspect-based sentiment analysis in the bengali language

tRF-BERT: A transformative approach to aspect-based sentiment analysis in the bengali language

Aspect based sentiment analysis of consumer reviews using unsupervised attention neural framework

Consumer reviews posted on e-commerce platforms offer an assessment of their opinion and sentiments about various aspects of a product or service. The aspects may belong to a specific category at subsystem and component level. The irrealis often associated with an opinion term, if not handled carefully, may distort the sentiment scores. This paper introduces a clustering and negative-sampling backed feed-forward Unsupervised Attention Deep Neural Framework for Opinion-Aspect-Category-Irrealis-Sentiment (UAN-OACIS) Quintuple extraction. This framework splits the five subtasks into two stages. In the first stage, aspects and opinions are extracted using word embedding-based multi-layer Attention Deep Neural Network (DNN) models; while the second stage projects corresponding categories, irrealis, and sentiment scores by creating a hash table and a couple of algorithms. We also propose a POS-Tag-based algorithm to make an irrealis dictionary to suggest sentiment modification percentage scores; and another algorithm to modify existing sentiment-lexicon based on domain-specific words. We compare UAN-OACIS with four unsupervised and two semi-supervised approaches at subtask level, and two supervised approaches at quadruples level excluding irrealis, and have got comparable results. Since no method is available for overall comparison at quintuple level, we additionally study the impact of irrealis on sentiment scores and observe substantial improvement compared to state-of-the-art lexicons methods.

An implicit aspect-based sentiment analysis method using supervised contrastive learning and knowledge embedding

Aspect-based sentiment analysis aims to analyze and understand people’s opinions from different aspects. Some comments do not contain explicit opinion words but still convey a clear human-perceived emotional orientation, which is known as implicit sentiment. Most previous research relies on contextual information from a text for implicit aspect-based sentiment analysis. However, little work has integrated external knowledge with contextual information. This paper proposes an implicit aspect-based sentiment analysis model combining supervised contrastive learning with knowledge-enhanced fine-tuning on BERT (BERT-SCL+KEFT). In the pre-training phase, the model utilizes supervised contrastive learning (SCL) on large-scale sentiment-annotated corpora to acquire sentiment knowledge. In the fine-tuning phase, the model uses a knowledge-enhanced fine-tuning (KEFT) method to capture explicit and implicit aspect-based sentiments. Specifically, the model utilizes knowledge embedding to embed external general knowledge information into textual entities by using knowledge graphs, enriching textual information. Finally, the model combines external knowledge and contextual features to predict the implicit sentiment in a text. The experimental results demonstrate that the proposed BERT-SCL+KEFT model outperforms other baselines on the general implicit sentiment analysis and implicit aspect-based sentiment analysis tasks. In addition, ablation experimental results show that the proposed BERT-SCL+KEFT model without the knowledge embedding module or supervised contrastive learning module significantly decreases performance, indicating the importance of these modules. All experiments validate that the proposed BERT-SCL+KEFT model effectively achieves implicit aspect-based sentiment classification.