Sentiment Classification Method Research Articles

Text sentiment analysis and classification based on bidirectional long and short term memory networks

In this study, we explored the method of text sentiment analysis and classification using bi-directional long and short-term memory networks, which brings new ideas to the field of sentiment classification. In the text pre-processing stage, we processed chat phrases, non-alphanumeric characters, deactivated words, numbers, special characters, blanks, and addresses to convert the raw text data into numerical data that can be processed by the model. Subsequently, word frequency statistics were conducted for texts of different mood types to analyse the frequency of occurrence of different words in texts of different mood types. By introducing a bi-directional long and short-term memory network model for training, we observed the accuracy and loss value performance on the training and validation sets. The accuracy of the training set increases from the initial 94.6% to 99.5%, and the accuracy of the validation set gradually grows to 99.4%; at the same time, the loss value of the training set decreases from the initial value of 0.2075 to 0.0194, and the loss value of the validation set gradually increases from the initial value of 0.0538 to 0.0372. This indicates that the bi-directional long short-term memory network achieves a significant and stable performance improvement. The confusion matrix results for the test set show that our model achieves more than 99% prediction accuracy on the test set. This implies that our proposed method can efficiently classify textual sentiment with high prediction accuracy. This research result helps to improve the effectiveness of the application of sentiment analysis techniques in the fields of social media opinion monitoring and product review analysis, and provides a useful reference for further deepening the research on text sentiment analysis. In conclusion, this study achieves the optimisation of the text sentiment classification task by means of a bidirectional long and short-term memory network model, and achieves satisfactory results. In the future, the model performance and generalisation ability can be further improved by combining more corpus and optimising the model structure, so as to be better applied in real-world scenarios.

Text sentiment analysis and classification based on bidirectional Gated Recurrent Units (GRUs) model

This paper explores the importance of text sentiment analysis and classification in the field of natural language processing, and proposes a new approach to sentiment analysis and classification based on the bidirectional gated recurrent units (GRUs) model. The study firstly analyses the word cloud model of the text with six sentiment labels, and then carries out data preprocessing, including the steps of removing special symbols, punctuation marks, numbers, stop words and non-alphabetic parts. Subsequently, the data set is divided into training set and test set, and through model training and testing, it is found that the accuracy of the validation set is increased from 85% to 93% with training, which is an increase of 8%; at the same time, the loss value of the validation set decreases from 0.7 to 0.1 and tends to be stable, and the model is gradually close to the actual value, which can effectively classify the text emotions. The confusion matrix shows that the accuracy of the model on the test set reaches 94.8%, the precision is 95.9%, the recall is 99.1%, and the F1 score is 97.4%, which proves that the model has good generalisation ability and classification effect. Overall, the study demonstrated an effective method for text sentiment analysis and classification with satisfactory results.

An Efficient Aspect-based Sentiment Classification with Hybrid Word Embeddings and CNN Framework

Background: As the e-commerce product reviews and social media posts are increasing enormously, the size of the database for polarity/ sentiment detection is a challenging task, and again, predicting polarities associated with respect to aspect terms end to end in a sentence is a havoc in real-time applications. Human behavior is influenced by the various opinions generated in society. Public opinion influences our decisions most often. Businesses and establishments always need to collect the opinion of the society, which they try to obtain using customer feedback forms and questionnaires or surveys, which help them to be aware of the shortcomings if any, and to use suggestions to improve quality. It works in the same way for customers as well and the opinions of other customers about a particular product can come in handy when deciding to buy a product. Objectives: In this work, an efficient Aspect-based Sentiment Classification technique has been introduced with a hybrid, multiple-word embedding methods and implemented using the CNN framework on large databases. Methods: Most of the traditional models have a limitation on the dependency for one or more similar types of aspect words for sentiment classification problem. However, these conventional models such as TF-ID, Word 2Vec and Glove method consumes much more time for word embedding process and Aspect terms generation and further process of aspect level sentiment classification. Further, these models are facing problems of high true negative rate and misclassification rate on large aspect databases in sentiment classification. In this article, we have introduced an efficient Proposed ensemble word embedding model in the CNN network and defined Hybrid Word2 Vec method, Hybrid Glove word embedding method and Hybrid Random Forest model for sentiment classification. Results: Experiments on a widely used benchmark prove that the proposed word embedding method- based classification technique results in to higher true positive rate with minimal misclassifications and also supports better runtime and accuracy than the traditional word embedding-based aspect level classification approaches. Conclusion: In this article, a hybrid ensemble feature ranking-based classification model is proposed on the large aspect databases. In this work, advanced multiple-word embedding methods are implemented to improve the essential feature extraction problem in the aspect level sentiment process. These multiple-word embedding methods are applied to the sentiment databases in the CNN framework.

The impact of climate change news on the US stock market

PurposeThis paper aims to investigate the impact of climate change news on the dynamics of US stock indices.Design/methodology/approachThe empirical basis of the study was 3,209 news articles. Sentiment analysis was performed by a pre-trained bidirectional FinBERT neural network. Thematic modeling is based on the neural network, BERTopic.FindingsThe results show that news sentiment can influence the dynamics of stock indices. In addition, five main news topics (finance and politics natural disasters and consequences industrial sector and Innovations activism and culture coronavirus pandemic) were identified, which showed a significant impact on the financial market.Originality/valueFirst, we extend the theoretical concepts. This study applies signaling theory and overreaction theory to the US stock market in the context of climate change. Second, in addition to the news sentiment, the impact of major news topics on US stock market returns is examined. Third, we examine the impact of sentimental and thematic news variables on US stock market indicators of economic sectors. Previous works reveal the impact of climate change news on specific sectors of the economy. This paper includes stock indices of the economic sectors most related to the topic of climate change. Fourth, the research methodology consists of modern algorithms. An advanced textual analysis method for sentiment classification is applied: a pre-trained bidirectional FinBERT neural network. Modern thematic modeling is carried out using a model based on the neural network, BERTopic. The most extensive topics are “finance and politics of climate change” and “natural disasters and consequences.”

Object aroused emotion analysis network for image sentiment analysis

From cognitive psychology, objects are closely related to emotions, and inherently possess the ability to arouse human emotions. Hence, fully utilizing the relationships between objects and emotions can help achieve more accurate visual emotion recognition. In this paper, we propose a novel object aroused emotion analysis network to realize image sentiment classification by investigating the interactions between objects and emotions. To quantify the various emotion potencies of each object, a novel object emotion distribution module is proposed to explore the mapping among objects and emotions, and quantitatively demonstrate how various objects arouse different emotions. An object emotion-modeling mapping module is proposed to analyze the effect of objects and object combinations with emotion information on image sentiment; this module maps common objects to emotion dimensions and improves image sentiment classification with abundant object combination information. Then, we fuse the object-emotion mapping relation and multi-model features using BiGRU, thus realizing more accurate emotion recognition. Extensive experiments on widely used emotion datasets prove that our proposed method achieves excellent performance and outperforms most state-of-the-art image sentiment classification methods.

An Efficient Sentiment Classification Method with the Help of Neighbors and a Hybrid of RNN Models

Some texts that are challenging to recognize on their own may become more understandable in a neighborhood of related texts with similar contexts. Motivated by this intuition, a novel deep text sentiment classification (DTSC) model is proposed to improve the model’s performance by incorporating the neighborhood of related texts. Our framework uses a nonparametric approach to construct neighborhoods of related texts based on Jaccard similarities. Then, a new deep recurrent neural network architecture is proposed, comprising two distinct modules: bidirectional long short-term memory (Bi-LSTM) and gated recurrent unit (GRU). The proposed model aims to effectively capture informative features from the input text and its neighbors. The result of each module is processed through the maximum operation, which selects the most pertinent data. Finally, the extracted features are concatenated and subjected to classification to achieve accurate sentiment prediction. Previous studies have commonly employed a parametric approach to represent textual metadata. However, our approach utilizes a nonparametric approach, enabling our model to perform strongly even when the text vocabulary varies between training and testing. The proposed DTSC model has been evaluated on five real-world sentiment datasets, achieving 99.60% accuracy on the Binary_Getty (BG) dataset, 98.32% accuracy on the Binary_iStock (BIS) dataset, 96.13% accuracy on Twitter, 82.19% accuracy on the multi-view sentiment analysis (MVSA) dataset, and 87.60% accuracy on the IMDB dataset. These findings demonstrate that the proposed model outperforms established baseline techniques in terms of model evaluation criteria for text sentiment classification.

Text Sentiment Classification Method Based on Bilstm

In the booming age of digital communication and natural language processing(NLP), understanding user sentiments expressed in texts has become increasingly vital. This research addresses the challenge of classifying text sentiments into three distinct categories: positive, neutral, and negative. Recognizing the nuances of human emotion in textual content is paramount for enhancing user experiences and tailoring personalized digital interactions. This study trains a BiLSTM model, supplemented with optimization strategies to adaptively learn from a diverse dataset. Additionally, a large number of baseline experiments were conducted to compare its efficacy with traditional algorithms such as Logistic Regression. The BiLSTM model demonstrated a good accuracy of 78.21% on the test set. Conclusively, while the proposed model shows significant potential, further refinements could be made, emphasizing data augmentation and model regularization to achieve optimal performance.

Sentiment classification of time-sync comments: A semi-supervised hierarchical deep learning method

Time-sync comment (TSC) has emerged as a new type of textual comment for real-time user interactions on online video platforms. The sentiment classification of TSCs provides considerable potential for platforms to optimize operation strategies but inevitably faces great challenges due to the TSCs’ often uninformative and informal text. Considering the contextual dependency among TSCs posted within the same video clip, this study posits that contextual TSCs may benefit the sentiment classification of a target TSC. To address the challenges of leveraging contextual TSCs, such as their semantic representation and fusion, we propose a semi-supervised hierarchical deep learning method for the sentiment classification of TSCs. We design a hierarchical architecture to capture the semantics of TSCs at the word, comment, and context levels. Considering the varying importance of words and comments, we also design attention mechanisms to focus on important sentiment information and fuse semantic representations. Empirical evaluation shows that the proposed method outperforms benchmarked sentiment classification methods. This study advances our knowledge of contextual information indicative of TSC sentiment, and contributes to improving the service operation of online video platforms.

Analysis of the evolving factors of social media users’ emotions and behaviors: a longitudinal study from China’s COVID-19 opening policy period

The outbreak of the COVID-19 pandemic has triggered citizen panic and social crises worldwide. The Chinese government was the first to implement strict prevention and control policies. However, in December 2022, the Chinese government suddenly changed its prevention and control policies and completely opened up. This led to a large-scale infection of the epidemic in a short period of time, which will cause unknown social impacts. This study collected 500+ epidemic-related hotspots and 200,000+ data from November 1, 2022, to March 1, 2023. Using a sentiment classification method based on pre-trained neural network models, we conducted inductive analysis and a summary of high-frequency words of various emotions. This study focuses on the inflection point of the emotional evolution of social media users and the evolution of “hot topic searches” events and emotional behavioral factors after the sudden open policy. Our research results show that, first of all, the positive emotions of social media users are divided into 4 inflection points and 5 time periods, and the negative emotions are divided into 3 inflection points and 4 time periods. Behavioral factors are different at each stage of each emotion. And the evolution patterns of positive emotions and negative emotions are also different. Secondly, the evolution of behavioral elements deserves more attention. Continue to pay attention: The treatment of diseases, the recovery of personal health, the promotion of festive atmosphere, and the reduction of publicity on the harm of “new crown sequelae and second infections” are the behavioral concerns that affect users’ emotional changes. Finally, it is necessary to change the “hot topic searches” event by guiding the user’s behavioral focus to control the inflection point of the user’s emotion. This study helps governments and institutions understand the dynamic impact of epidemic policy changes on social media users, thereby promoting policy formulation and better coping with social crises.

Sentiment Analysis of Chinese Product Reviews Based on Fusion of DUAL-Channel BiLSTM and Self-Attention

Product reviews provide crucial information for both consumers and businesses, offering insights needed before purchasing a product or service. However, existing sentiment analysis methods, especially for Chinese language, struggle to effectively capture contextual information due to the complex semantics, multiple sentiment polarities, and long-term dependencies between words. In this paper, we propose a sentiment classification method based on the BiLSTM algorithm to address these challenges in natural language processing. Self-Attention-CNN BiLSTM (SAC-BiLSTM) leverages dual channels to extract features from both character-level embeddings and word-level embeddings. It combines BiLSTM and Self-Attention mechanisms for feature extraction and weight allocation, aiming to overcome the limitations in mining contextual information. Experiments were conducted on the onlineshopping10cats dataset, which is a standard corpus of e-commerce shopping reviews available in the ChineseNlpCorpus 2018. The experimental results demonstrate the effectiveness of our proposed algorithm, with Recall, Precision, and F1 scores reaching 0.9409, 0.9369, and 0.9404, respectively.

Hotel Comment Emotion Classification Based on the MF-DFA and Partial Differential Equation Classifier

Due to the significant value that hotel reviews hold for both consumers and businesses, the development of an accurate sentiment classification method is crucial. By effectively distinguishing the authenticity of reviews, consumers can make informed decisions, and businesses can gain insights into customer feedback to improve their services and enhance overall competitiveness. In this paper, we propose a partial differential equation model based on phase-field for sentiment analysis in the field of hotel comment texts. The comment texts are converted into word vectors using the Word2Vec tool, and then we utilize the multifractal detrended fluctuation analysis (MF-DFA) model to extract the generalized Hurst exponent of the word vector time series to achieve dimensionality reduction of the word vector data. The dimensionality reduced data are represented in a two-dimensional computational domain, and the modified Allen–Cahn (AC) function is used to evolve the phase values of the data to obtain a stable nonlinear boundary, thereby achieving automatic classification of hotel comment texts. The experimental results show that the proposed method can effectively classify positive and negative samples and achieve excellent results in classification indicators. We compared our proposed classifier with traditional machine learning models and the results indicate that our method possesses a better performance.

Dual BiGRU-CNN-based sentiment classification method combining global and local attention

Dual BiGRU-CNN-based sentiment classification method combining global and local attention

Improve the application of reinforcement learning and multi‐modal information in music sentiment analysis

AbstractIn order to improve the effect of music sentiment analysis, this paper proposes a music sentiment classification method based on lyrics and comments. This method combines lyrics and comment texts to mine richer sentiment information, and comprehensively considers the influence of the word frequency, sentiment strength and part of speech of sentiment words on sentiment classification when constructing sentiment vectors. Moreover, it matches the lyrics of the music and the substantive words in the comment with the emotional dictionary to obtain the emotional category and emotional weight of each substantive word, and calculates the statistical value of each emotional category. In addition, this paper combines reinforcement learning and multi‐modal information technology to construct a music emotion research model.

Sentiment Classification of Social Network Text Based on AT-BiLSTM Model in a Big Data Environment

To tackle the challenge of ineffective sentiment prediction using current sentiment classification methods, this paper introduces a method social network text sentiment classification. The method leverages a bidirectional short and long-term memory model (AT-BiLSTM), specifically designed for a big data environment. First, a vectorized representation of text is realized by introducing a pre-trained BERT model, and the classification results are dynamically adjusted according to the semantic information of the words. Then, the BiLSTM combined with the attention mechanism performs aspect-level sentiment analysis, and the corresponding model AT-BiLSTM is formulated. Finally, the BERT model randomly selects input tags for information masking and pre-trains the proposed model. The proposed method was evaluated against three alternative methods using an identical dataset. The results show that the novel method achieved the highest accuracy, recall, and F1-score, reaching 93.72%, 93.91%, and 92.38%, respectively. Consequently, the proposed method demonstrates superior performance compared to the other three methods evaluated.

Performance evolution for sentiment classification using machine learning algorithm

Machine Learning (ML) is an Artificial Intelligence (AI) approach that allows systems to adapt to their environment based on past experiences. Machine Learning (ML) and Natural Language Processing (NLP) techniques are commonly used in sentiment analysis and Information Retrieval Techniques (IRT). This study supports the use of ML approaches, such as K-Means, to produce accurate outcomes in clustering and classification approaches. The main objective of this research is to explore the methods for sentiment classification and Information Retrieval Techniques (IRT). So, a combination of different machine learning algorithms is used with a dataset from amazon unlocked mobile reviews and telecom tweets to achieve better accuracy as it is crucial to consider the previous predictions related to sentiment classification and IRT. The datasets consist of user reviews ratings and algorithms utilized consist of K-Means Clustering algorithm, Logistic Regression (LR), Random Forest (RF), and Decision Tree (DT) algorithms. The amalgamation of each algorithm with the K-Means resulted in high levels of accuracy. Specifically, the K-Means combined with Logistic Regression (LR) yielded an accuracy rate of 99.98%. Similarly, the K-Means integrated with Random Forest (RF) resulted in an accuracy of 99.906%. Lastly, when the K-Means was merged with the Decision Tree (DT) Algorithm, the accuracy obtained was 99.83%.We exhibited that we could foresee efficient, effective, and accurate outcomes.

UsbVisdaNet: User Behavior Visual Distillation and Attention Network for Multimodal Sentiment Classification.

In sentiment analysis, biased user reviews can have a detrimental impact on a company's evaluation. Therefore, identifying such users can be highly beneficial as their reviews are not based on reality but on their characteristics rooted in their psychology. Furthermore, biased users may be seen as instigators of other prejudiced information on social media. Thus, proposing a method to help detect polarized opinions in product reviews would offer significant advantages. This paper proposes a new method for sentiment classification of multimodal data, which is called UsbVisdaNet (User Behavior Visual Distillation and Attention Network). The method aims to identify biased user reviews by analyzing their psychological behaviors. It can identify both positive and negative users and improves sentiment classification results that may be skewed due to subjective biases in user opinions by leveraging user behavior information. Through ablation and comparison experiments, the effectiveness of UsbVisdaNet is demonstrated, achieving superior sentiment classification performance on the Yelp multimodal dataset. Our research pioneers the integration of user behavior features, text features, and image features at multiple hierarchical levels within this domain.

BERT-PG: a two-branch associative feature gated filtering network for aspect sentiment classification

Aspect sentiment classification is an important branch of sentiment classification that has gained increasing attention recently. Existing aspect sentiment classification methods typically use different network branches to encode context and aspect words separately, and then use an attention mechanism to capture their associations. This attention-based approach cannot completely ignore the contexts unrelated to the current aspect words, which brings noise interference. In this paper, a gated filtering network based on BERT is suggested as a solution to this issue. We employ BERT to encode the text semantics of contexts and sentence pairs consisting of context and aspect words respectively, and to extract lexical features as well as associative features of context and aspect words. Based on this, we designed a gating module that, unlike the attention mechanism, uses association features to precisely filter irrelevant contexts. Additionally, because the BERT network parameters are so big, there is a tendency to over-fitting during training. To effectively combat this problem, we developed a loss function with a threshold. We carried out extensive experiments using three benchmark datasets to verify the performance of our proposed model. The experimental results show that the method improves the accuracy by 0.5%, 1.39% and 2.57% on the Laptop, Restaurant and Twitter datasets respectively, and 1.564%, 2.36% and 4.144% on Macro-F1 respectively, compared to the recent RA-CNN (BERT), proving that our method is effective in improving the presentation of aspect sentiment classification in comparison to other cutting-edge sentiment classification methods.

A Survey on Sentiment Classification Methods and Challenges

Sentiment classification (SC) is an important natural language processing (NLP) task that aims to determine the sentiment or emotional tone in a given text. With the increasing pervasiveness of internet-based applications and social media, massive amounts of unstructured data are generated daily, elevating the opportunity and challenges associated with automated sentiment extraction for tasks such as customer feedback analysis, social media monitoring, and opinion mining. In this review paper, we provide an update on the state of the art in sentiment analysis, including an overview of and classification methods leveraging machine learning and deep learning methods.

A Two-Stage Voting-Boosting Technique for Ensemble Learning in Social Network Sentiment Classification

In recent years, social network sentiment classification has been extensively researched and applied in various fields, such as opinion monitoring, market analysis, and commodity feedback. The ensemble approach has achieved remarkable results in sentiment classification tasks due to its superior performance. The primary reason behind the success of ensemble methods is the enhanced diversity of the base classifiers. The boosting method employs a sequential ensemble structure to construct diverse data while also utilizing erroneous data by assigning higher weights to misclassified samples in the next training round. However, this method tends to use a sequential ensemble structure, resulting in a long computation time. Conversely, the voting method employs a concurrent ensemble structure to reduce computation time but neglects the utilization of erroneous data. To address this issue, this study combines the advantages of voting and boosting methods and proposes a new two-stage voting boosting (2SVB) concurrent ensemble learning method for social network sentiment classification. This novel method not only establishes a concurrent ensemble framework to decrease computation time but also optimizes the utilization of erroneous data and enhances ensemble performance. To optimize the utilization of erroneous data, a two-stage training approach is implemented. Stage-1 training is performed on the datasets by employing a 3-fold cross-segmentation approach. Stage-2 training is carried out on datasets that have been augmented with the erroneous data predicted by stage 1. To augment the diversity of base classifiers, the training stage employs five pre-trained deep learning (PDL) models with heterogeneous pre-training frameworks as base classifiers. To reduce the computation time, a two-stage concurrent ensemble framework was established. The experimental results demonstrate that the proposed method achieves an F1 score of 0.8942 on the coronavirus tweet sentiment dataset, surpassing other comparable ensemble methods.

A semi-supervised short text sentiment classification method based on improved Bert model from unlabelled data

Short text information has considerable commercial value and immeasurable social value. Natural language processing and short text sentiment analysis technology can organize and analyze short text information on the Internet. Natural language processing tasks such as sentiment classification have achieved satisfactory performance under a supervised learning framework. However, traditional supervised learning relies on large-scale and high-quality manual labels and obtaining high-quality label data costs a lot. Therefore, the strong dependence on label data hinders the application of the deep learning model to a large extent, which is the bottleneck of supervised learning. At the same time, short text datasets such as product reviews have an imbalance in the distribution of data samples. To solve the above problems, this paper proposes a method to predict label data according to semi-supervised learning mode and implements the MixMatchNL data enhancement method. Meanwhile, the Bert pre-training model is updated. The cross-entropy loss function in the model is improved to the Focal Loss function to alleviate the data imbalance in short text datasets. Experimental results based on public datasets indicate the proposed model has improved the accuracy of short text sentiment recognition compared with the previous update and other state-of-the-art models.