Sentiment Classification Research Articles

Impact Of Sarcasm Detection on Sentiment Analysis Using Bi-LSTM and FastText

Sentiment analysis categorizes a collection of texts in a document as either positive or negative. However, sometimes it cannot give accurate results due to sarcastic sentences. Sarcasm involves the use of positive language to convey negative meanings, So sarcasm detection is needed for sentiment classification to provide better results. One method that can be used to perform Sentiment classification is Bidirectional Long Short-Term Memory (Bi-LSTM). However, text data cannot be processed by Bi-LSTM, so it requires word embedding to convert text data into vectors. In this study, the word embedding used is FastText because it can learn the form of words by considering subword information. The results showed that sentiment classification with sarcasm detection could improve evaluation results by 0.08 for precision, 0.07 for recall, 0.07 for F1-score, and 0.07 for accuracy. A paired sample t-test was conducted on precision, recall, F1-score, and accuracy to examine whether there is a difference between sentiment classification with and without sarcasm detection. The obtained p-values are 2.84.10-9, 4.63.10-7, and 2.40.10-8, 6.22.10-8, respectively. This indicates a difference between sentiment classification with and without sarcasm detection. Therefore, with a 95% confidence level, it can be concluded that sarcasm detection impacts sentiment classification.

Retraction notice: PMI-based polarity computation for SVM-NN-based sentiment classification from user-generated reviews

Retraction notice: PMI-based polarity computation for SVM-NN-based sentiment classification from user-generated reviews

A Machine Learning Approach for Sentiment Analysis Using Social Media Posts

Sentiment analysis on Twitter provides organizations and persons with quick and effective instrument to observe the public's perceptions of them and their competition. A modest number of assessment datasets have been produced in recent years to check the efficiency of sentiment analysis algorithms on Twitter. Researchers offer a review of eight publicly accessible as well as manually annotated assessment datasets for analyzing Twitter sentiment in this research. As a result of this evaluation, we demonstrate that is a widespread weakness of many when using these datasets performing at sentiment analysis the objective (entity) level is indeed the absence of different sentiment classifications across tweets as well as the objects contained in them.[1], As an example all of that "I love my iPhone but I despise my iPad." Could be marked with a made-by-mixing classify however the object iPhone contained within this Twitter post should be annotated with just a label with an optimism. To get around this restriction and enhance existing assessment We have datasets that provide STS-Gold a novel assessment of datasets in which tweets or objects (entities) remain tagged separately hence might show alternative opinion labels. Though research furthermore compares the various datasets on multiple characteristics such as an entire quantity of posts as well as vocabulary size and sparsity.[2] In addition, look at pair by pair relationships between these variables and how they relate to sentiment classifier performance on various data. In this study we used five different classifiers and compared them and, in our experiment, we found that the bagging ensemble classifier performed best among them and have an accuracy level of 94.2% for the GASP dataset and 91.3% for the STS-Gold dataset.

Sentiment Analysis Using Improved CT-BERT_CONVLayer Fusion Model for COVID-19 Vaccine Recommendation

COVID-19 has significantly impacted individuals, communities, and countries worldwide. These effects include health impacts, economics impacts, social impacts, educational, political and environmental impacts. The COVID-19 vaccine development was crucial for disease control and monitoring, yet the threat still looms large. Vaccine recommender systems can help the health practitioners in combating COVID-19 by providing the information and guidance on the benefits and risks of COVID-19 vaccines to individuals based on their preferences and medical history. In this paper, we have proposed sentiment analysis based recommender system for COVID-19 vaccines. We used Twitter data of 10,000 tweets about COVID-19 vaccines and applied pre-processing steps. We propose an ensemble of random forest with CT-BERT_CONVLayerFusion model, a novel algorithm, for classifying the tweets into seven different categories of sentiments. We also performed aspect-based review categorization which works on the queries given by a user. We compared the results of sentiment classification with the state-of-the-art with metrics including accuracy, recall, precision, and F1-score, and found out that our proposed approach outperformed all other state-of-the-art model by achieving maximum accuracy, recall, precision and F1-measure. Hence, such advanced methods can help somehow to fight COVID-19 as well as reducing the vaccine hesitancy by suggesting proper vaccines to patients based on the their specific concerns and questions.

Stream ETL framework for twitter-based sentiment analysis: Leveraging big data technologies

Twitter has emerged as a rich source of real-time data, providing valuable insights across various domains such as healthcare and business. Sentiment analysis is crucial in understanding public reactions and sentiments expressed on Twitter, empowering organizations to make informed decisions. However, efficiently analyzing sentiment from social media data, presents a challenge for real-time streaming. Conventional Extract-Transform-Load (ETL) methods, inadequate for this challenge, limit their applicability in processing vast volumes of Twitter data. Big data technologies like Kafka, Spark, Hadoop HDFS, Hive, and HBase have become indispensable in addressing this challenge. To address this, we propose a stream ETL framework for Twitter-based sentiment analysis, leveraging Kafka, Spark, Cassandra, HBase, Hive, and HDFS. Our framework enables data stream processing, bias detection and correction, sentiment-based analysis, and visualization of tweets’ geospatial distribution. We present a set of use case studies to illustrate the applicability of the proposed framework comprises of sentiment classification, and bias detection and correction capability. We also present a comparative study to demonstrate the performance of data streaming processing, analysis, and visualization that has been implemented using multiple big data technologies under different parameter settings. Experimental results demonstrate the framework scalability and trade-off factors of the data stream processing pipeline in the execution of big data processing tasks.

Sentiment Classification of Anxiety-Related Texts in Social Media via Fuzing Linguistic and Semantic Features

Sentiment Classification of Anxiety-Related Texts in Social Media via Fuzing Linguistic and Semantic Features

Enhanced UrduAspectNet: Leveraging Biaffine Attention for superior Aspect-Based Sentiment Analysis

Urdu, with its rich linguistic complexity, poses significant challenges for computational sentiment analysis. This study presents an enhanced version of UrduAspectNet, specifically designed for Aspect-Based Sentiment Analysis (ABSA) in Urdu. We introduce key innovations including the incorporation of Biaffine Attention into the model architecture, which synergizes XLM-R embeddings, a bidirectional LSTM (BiLSTM), and dual Graph Convolutional Networks (GCNs). Additionally, we utilize dependency parsing to create the adjacency matrix for the GCNs, capturing syntactic dependencies to enhance relational representation. The improved model, termed Enhanced UrduAspectNet, integrates POS and lemma embeddings, processed through BiLSTM and GCN layers, with Biaffine Attention enhancing the extraction of intricate aspect and sentiment relationships. We also introduce the use of BIO tags for aspect term identification, improving the granularity of aspect extraction. Experimental results demonstrate significant improvements in both aspect extraction and sentiment classification accuracy. This research advances Urdu sentiment analysis and sets a precedent for leveraging sophisticated NLP techniques in underrepresented languages.

Exploring large language models for the generation of synthetic training samples for aspect-based sentiment analysis in low resource settings

Aspect-Based Sentiment Analysis (ABSA) is a fine-grained task in sentiment analysis, aiming to identify sentiment expressed towards specific aspects of an entity. This paper explores the use of Large Language Models (LLMs), specifically GPT-3.5-turbo and Llama-3-70B, for generating annotated data in Aspect-Based Sentiment Analysis (ABSA), aiming to address the scarcity of labeled datasets in the field. Two low-resource scenarios are considered, with 25 and 500 manually annotated examples available. In the 25-example scenario, adding synthetic examples generated through few-shot prompting resulted in F1 scores of 81.33 for Aspect Category Detection (ACD) and 71.71 for Aspect Category Sentiment Analysis (ACSA). For the 500-example scenario, synthetic data augmentation showed a notable gain only for the ACSA task, raising the F1 score from 84.54 to 86.70.

Analisis Sentimen Naturalisasi Tim Nasional Indonesia U-23 di Era Shin Tae-yong Menggunakan Algoritma Naïve Bayes dan K-Nearest Neighbors

In the Shin Tae-yong era, the naturalization of players has become a controversial topic within the Indonesian U-23 national football team. This research aims to analyze public sentiment related to the naturalization of players in the team using two classification algorithms, namely Naive Bayes and K-Nearest Neighbor. Sentiment data is obtained from news sources, social media, and online discussion forums related to matches and team management decisions. First, data processing is carried out, including text cleaning, tokenization, and word weighting. Next, Naive Bayes and KNN models are trained using the processed dataset. The results of the sentiment analysis will provide valuable insight into the public's perception of the naturalization of players in the Indonesian U-23 national team under the control of Shin Tae-yong, as well as a comparison of the effectiveness between the Naive Bayes and KNN algorithms in sentiment classification. It is hoped that this research will provide a more in-depth view of the dynamics within the Indonesian national football team and its contribution to Indonesian football as a whole

Comparison of Machine Learning Algorithms in Public Sentiment Analysis of TAPERA Policy

The rapid development of information technology has changed the way people interact and express their opinions on public policies, including the People's Housing Savings (Tapera) policy in Indonesia. People now primarily express their views openly on social media platforms like Twitter, generating a substantial amount of text data for analysis to understand public sentiment. However, the main challenge in this sentiment analysis is determining the most effective machine learning algorithm for classifying public opinion with high accuracy. This study aims to compare the performance of three machine learning algorithms, namely Naïve Bayes, Support Vector Machine, and Random Forest, in analyzing public sentiment towards the Tapera policy. This study analyzes public comment data obtained from Twitter. We measure the accuracy of each algorithm to determine its optimal performance in sentiment classification. The research method consists of several stages, starting with data collection, text preprocessing to clean and prepare data, and then applying the three algorithms to analyze sentiment. The results showed that Naïve Bayes had the highest accuracy of 69.17%, followed by Support Vector Machine with an accuracy of 68.42%, and Random Forest with an accuracy of 66.17%. This shows that Naïve Bayes is the most effective algorithm to use in sentiment analysis of public comments related to the Tapera policy, especially in the context of complex text data from social media. The conclusion of this study is that Naïve Bayes is superior in classifying public sentiment towards the Tapera policy compared to Support Vector Machine and Random Forest. As a result, this study makes a significant contribution to selecting the most appropriate machine learning algorithm for public sentiment analysis towards public policy, which in turn can help the government understand and respond to public perceptions more effectively.

Optimisation of Sentiment Analysis for E-Commerce

Sentiment analysis is widely used today to make data-driven decisions in different industries, starting from marketing and including brand management, reputation monitoring, and customer satisfaction analysis. Its growing importance is closely linked with so-called ‘word-of-mouth’ communication, from reading online reviews to writing comments on social networks. Effective separation of sentiments ensures that companies' responses are timely and critical patterns are seen in big data sets. Statistical measures, information gain, correlation-based approaches, etc, have been employed for the feature selection. Still, the problem associated with text data mining is that they don’t convey the text's relative difficulty and additional features. To fill this gap, our research proposes a new feature selection technique through Ant Colony Optimization (ACO) and K Nearest Neighbour (KNN) performed on 28,000 customer reviews in different product categories. The results, therefore, showed an overall accuracy of 80.1%, with the Support Vector Machine (SVM) set at 80.5% on each selected feature, which was slightly higher than the Convolutional Neural Network (CNN), which scored a 78.41% accuracy. SVM remains on the mark of 83%, and for CNN, the rate achieved on the same was 80.8% when both were applied to the entire dataset. These facts rejected the infallibility of the simple and complex algorithms used singly in the sentiment classification, indicating that more sophisticated algorithms like ACO and KNN can provide business solutions to improve their service delivery based on customers’ feedback.

Comparative analysis of machine learning algorithms for sentiment classification in social media text

In the era of social media, sentiment analysis has become crucial for understanding public opinion. This study presents a comparative analysis of five machine learning algorithms for sentiment classification in social media text: Logistic Regression, Support Vector Machines (SVM), Random Forest, Naive Bayes, and Gradient Boosting. Using a dataset of 100,000 tweets collected over three months, we evaluated these algorithm's performance in classifying sentiments as positive, negative, or neutral. The data underwent extensive preprocessing, including cleaning, normalization, and addressing class imbalance using SMOTE. Our results show that Logistic Regression and SVM achieved the highest overall accuracy at 86.22%, demonstrating balanced performance across all sentiment classes. Random Forest followed closely with 82.59% accuracy, while Naive Bayes and Gradient Boosting showed lower but still noteworthy performance at 70.45% and 69.96% respectively. All models exhibited challenges in classifying negative sentiments, suggesting potential areas for improvement. The study provides insights into each algorithm's strengths and weaknesses, offering guidance for practitioners in selecting appropriate methods for sentiment analysis tasks. Our findings contribute to the ongoing research in applying machine learning to the complex task of sentiment analysis in the rapidly evolving landscape of social media communication.

A Strategic Study on the Planning of Accommodation Facilities in Tourist Attractions to Enhance Tourist Experience

In the context of the development of regional tourism, the planning pattern of accommodation facilities in tourist attractions plays a very important role in enhancing tourists’ experience perception, which is conducive to the enhancement of tourists’ goodwill towards tourist attractions. This paper is oriented to the theory of sustainable development, and selects GL city as the research case site to obtain the visitor evaluation data of accommodation facilities in tourist attractions. The evolution trend of tourist attraction accommodation facilities is analyzed by geographic concentration index, standard deviation ellipse, nearest neighbor index, combined with TF-IDF algorithm to extract high-frequency words of tourists’ experience on the planning of tourist attraction accommodation facilities, and coarse-grained tourism review text sentiment classification model is introduced to analyze the tourists’ sentiment evaluation of tourist attraction accommodation facilities. The geographic concentration index of accommodation facilities in tourist attractions increases from 20.19 to 53.72 from 1980 to 2023, and the relative frequency difference between “service” and “room” of hotel facilities in tourist attractions is 4.35 percentage points, while that of B&B is only 0.5 percentage points. The relative frequency of “service” and “room” of hotel facilities in tourist attractions differed by 4.35 percentage points, while that of B&Bs differed by only 0.77 percentage points, and more than 70% of the tourists had a positive attitude towards the experience of accommodation facilities in tourist attractions. Lodging facilities in tourist attractions need to enrich the sequence of lodging products, improve the layout of service and reception facilities, create relevant themed B&Bs, and enhance the service quality of lodging facilities by combining modern technology to further promote the sustainable development of lodging facilities planning.

A Comparative Analysis of MultinomialNB, SVM, and BERT on Garuda Indonesia Twitter Sentiment

This study investigates customer sentiment towards Garuda Indonesia Airlines (GIA) using sentiment analysis of Twitter data. The research aims to identify prevailing sentiments, uncover common themes in customer feedback, and provide recommendations for improving customer satisfaction and brand loyalty. A dataset of 1,250 tweets from March 2007 to July 2024 was collected and pre-processed, including cleaning, language detection, and tokenization. Sentiment analysis was conducted using three models: MultinomialNB, SVM, and BERT.The results indicate that BERT outperformed both MultinomialNB and SVM in sentiment classification accuracy, achieving 75.6%. This highlights the effectiveness of BERT in capturing contextual meaning within customer reviews. The findings of this research will contribute to a deeper understanding of customer sentiment towards GIA and inform strategies for enhancing customer experience and brand image.

An Optimal Multi-Modal Approach for Stock Market Price Forecasting with Fused Sentiment Analysis for Real Time Data

Abstract: This study presents an innovative fusion-based methodology that integrates real-time stock market technical indicators with news sentiment analysis from financial news feeds to enhance stock selection decisions. The proposed framework employs a Bidirectional Long Short-Term Memory (Bi-LSTM) model for forecasting stock prices and a Deep Neural Network (DNN) used in conjunction with transformer-based model for sentiment classification, both optimized through the incorporation of real-time datasets. To further refine feature selection, Artificial Bee Colony (ABC) and Firefly algorithms are utilized, significantly improving the accuracy of price trend predictions and sentiment analysis. Technical indicators from stock market data are processed using the Bi-LSTM model to predict future stock prices. Concurrently, sentiment data from the Economic Times is pre-processed through Term Frequency-Inverse Document Frequency (TF-IDF) vectorization and pre-trained transformer models to extract key sentiment scores. The ABC algorithm enhances textual feature selection, while the Firefly algorithm reduces skewness in the error distribution of technical indicators, thereby improving the alignment between forecasted and actual stock prices. The fusion mechanism integrates predicted price movements with sentiment analysis to provide actionable insights for stock selection. The decision-making framework classifies stocks based on the consistency between price movements and sentiment: stocks predicted to rise with positive sentiment are labelled as "Sure Selection"; rising prices with negative sentiment are categorized as "Dicey Selection"; declining prices with positive sentiment result in a "Risky Selection"; and negative sentiment with falling prices trigger an "Avoid Selection". The proposed approach achieved a prediction accuracy of 67.00% for the Bi-LSTM model, with a precision of 0.714, recall of 0.695, and an F1 score of 0.677, demonstrating the model's robustness. The mean absolute error (MAE) for the Bi-LSTM model was 4.30, indicating strong predictive performance. The combined use of ABC and Firefly algorithms optimizes both technical and sentiment features, significantly contributing to the overall performance of the prediction model. By fusing multiple data sources and employing advanced optimization techniques, this methodology offers a unique and effective solution for stock market prediction and decision-making

Sentiment Analysis on Twitter Social Media Regarding Covid-19 Vaccination with Naive Bayes Classifier (NBC) and Bidirectional Encoder Representations from Transformers (BERT)

Abstract. The Covid-19 vaccine is an important tool to stop the Covid-19 pandemic, however, there are pros and cons from the public regarding this Covid-19 vaccine. Purpose: These responses were conveyed by the public in many ways, one of which is through social media such as Twitter. Responses given by the public regarding the Covid-19 vaccination can be analyzed and categorized into responses with positive, neutral or negative sentiments. Methods: In this study, sentiment analysis was carried out regarding Covid-19 vaccination originating from Twitter using the Naïve Bayes Classifier (NBC) and Bidirectional Encoder Representations from Transformers (BERT) algorithms. The data used in this study is public tweet data regarding the Covid-19 vaccination with a total of 29,447 tweet data in English. Result: Sentiment analysis begins with data preprocessing on the dataset used for data normalization and data cleaning before classification. Then word vectorization was performed with TF-IDF and data classification was performed using the Naïve Bayes Classifier (NBC) and Bidirectional Encoder Representations from Transformers (BERT) algorithms. From the classification results, an accuracy value of 73% was obtained for the Naïve Bayes Classifier (NBC) algorithm and 83% for the Bidirectional Encoder Representations from Transformers (BERT) algorithm. Novelty: A direct comparison between classical models such as NBC and modern deep learning models such as BERT offers new insights into the advantages and disadvantages of both approaches in processing Twitter data. Additionally, this study proposes temporal sentiment analysis, which allows evaluating changes in public sentiment regarding vaccination over time. Another innovation is the implementation of a hybrid approach to data cleansing that combines traditional methods with the natural language processing capabilities of BERT, which more effectively addresses typical Twitter data issues such as slang and spelling errors. Finally, this research also expands sentiment classification to be multi-label, identifying more specific sentiment categories such as trust, fear, or doubt, which provides a deeper understanding of public opinion.

Data Balancing Approach Using Combine Sampling on Sentiment Analysis With K-Nearest Neighbor

One of the topics that has been discussed on twitter is the rules regarding the removal of masks. However, there's a chance that the data from Twitter contains unequal data classes. An unequal amount of data can cause the classification process to malfunction. Combining under- and oversampling techniques is known as combine sampling, and it is a data-balancing strategy. The research's data consists of Indonesian tweets using the hashtag "The Policy of Removing Masks." In this study, the classification approach was K-Nearest Neighbor, while the oversampling and undersampling techniques were SMOTE and Tomek Links. The purpose of this research is to classify sentiment using the K-Nearest Neighbor algorithm and to use combine sampling to balance the amount of training data in the two classes that are not yet balanced. 234 training data with a positive sentiment and 652 training data with a negative sentiment were obtained after the data was divided. Due to an imbalance in the quantity of training data between the two classes, the positive class's data is minor and the negative class's data is major. The quantity of training data are 613 in the positive class and 613 in the negative class obtained following the combine sampling. Following the balancing of data between the two classes, sentiment classification was performed, yielding accuracy of 60.4%, precision of 78.5%, and recall of 65%. The reason for the accuracy number of 60.4% is because machine learning misinterpreted a tweet regarding Indonesia's mask removal policy, leading to incorrect classification.

New feature attribution method for explainable aspect-based sentiment classification

Recently, the use of feature attribution methods in explainable artificial intelligence has attracted significant attention. While many proposed methods in this domain involve analyzing the impact on results by filtering out specific features. Although these methods can provide explanations, they often overlook a relevant factor: the deletion of features alters the structural information of the text, resulting in the loss of relations between features, thus leading to explanations that are not comprehensive and appropriate. To address these challenges, this study introduces a novel feature attribution method known as General Explainable Sentiment Classification (GESC). Unlike traditional approaches that delete features, GESC focuses on preserving the inherent relations by substituting the features with synonyms. Furthermore, the GESC method employs the binary tumbleweed algorithm (BTA) to identify the optimal feature combination. Moreover, designers have created an adaptive iterative technique to accommodate texts of varying lengths. The application of GESC to aspect-based sentiment classification demonstrates its practicability. The experimental results indicate that the BTA primarily improves the efficiency of finding the optimal combination of features compared with other algorithms. The GESC method provides more compelling explanations than conventional feature attribution approaches.

Tourist attraction reviews based on deep learning Sentiment Analysis System

In recent years, with the rapid development of information technology, online travel reviews have become a key source of information for tourists to understand destinations. In the face of massive and unstructured travel review data, this paper innovatively proposes a sentiment analysis system for tourist attraction reviews based on deep learning. The system cleverly uses the BERT pre-trained model, and combines Bi-LSTM and attention mechanism to significantly improve the accuracy of sentiment classification. In order to verify its effectiveness, this paper conducts experiments on the evaluation data of scenic spots in Hubei Province. The experimental results are very impressive through multi-dimensional indicators such as accuracy, precision, recall, and F1-score. The accuracy rate is as high as 93.5%, the accuracy rate is 94.1% for positive reviews, the accuracy rate for negative reviews is 92.8%, the recall rate is 92.1%, and the F1-score is 92.8%. This fully shows that the system can accurately identify the emotional tendency of tourist attraction reviews, provide a strong basis for scenic spot management, help it adjust service strategies in a timely manner, and also assist tourists to make more informed decisions, providing a reliable technical reference for the digital transformation and intelligent management of the tourism industry.

Sentiment Analysis of Nigerian Opinions Using Logistic Regression and Random Forest Algorithms: A Comparative Study

This study investigates the efficacy of Logistic Regression and Random Forest models in sentiment analysis using Nigerian-based datasets, namely "Gangs of Lagos" and "PeterObi Politics." Sentiment analysis, a vital component of Natural Language Processing (NLP), plays a crucial role in understanding public opinion and sentiment trends, particularly in the context of Nigerian socio-political discourse. Leveraging machine learning techniques, the study examines the performance of these models in predicting sentiment classes, including positive, negative, and neutral sentiments, within the datasets. The findings shed light on the strengths and limitations of Logistic Regression and Random Forest in discerning sentiment nuances prevalent in Nigerian language expressions with Logistic Regression outperforming Random Forest in both cases. This research contributes to the advancement of sentiment analysis methodologies tailored to Nigerian linguistic and cultural contexts, with implications for various applications, including social media monitoring, political analysis, and market research.