Sentiment Analysis Of Product Reviews Research Articles

Sentiment Analysis of Product Reviews Using Transformer Enhanced 1D-CNN and BiLSTM

Abstract The rapid growth of Internet-enabled applications, such as social media platforms, e-commerce sites, and blogs, has led to a surge in user-generated content. This vast amount of data has made sentiment analysis increasingly valuable. Modern Aspect-Based Sentiment Analysis (ABSA) offers a more detailed approach by identifying sentiment trends related to specific aspects within the text. However, the challenge lies in analyzing reviews that are often short, unstructured, and filled with slang and emotive language, making it difficult to gauge customer opinions accurately. To address these issues, we proposed an effective hybrid approach “RoBERTa-1D-CNN-BiLSTM” for ABSA. Initially, the pre-trained Robustly Optimized BERT approach (RoBERTa) and One Dimensional Convolutional Neural Network (1D-CNN) models are used to extract features at the aspect level from the context of the review, following which classification is performed using Bidirectional Long Short-Term Memory (BiLSTM). The approach is evaluated on three cross-domain standards datasets, yielding an accuracy of 92.33%. The results of the experiments show that it surpasses the current leading methods in sentiment analysis and product recommendation.

Comparison of Naïve Bayes and SVM in Sentiment Analysis of Product Reviews on Marketplaces

At this time more and more people are switching to shopping online in existing marketplaces such as Shopee. Marketplaces provide various advantages and disadvantages to customers such as lower costs and goods sent not according to orders. Product reviews from customers greatly affect the sales level of business people so that sentiment analysis is carried out. The importance of conducting sentiment analysis of product reviews in the marketplace is to add an overview of how the product is received by users. This research uses Naïve Bayes and SVM algorithms for sentiment analysis of beauty care product review datasets obtained from Shopee scraping results. This research implements k fold cross validation for data splitting process of 10 folds. The Naïve Bayes algorithm obtained the highest accuracy value of 85.53% on fold 2 and the lowest accuracy value of 77.16% on fold 3. While the SVM algorithm obtained the highest accuracy value of 88.58% on fold 2 and the lowest accuracy value of 82.99% on fold 7. With this it is stated that SVM can work better for sentiment analysis of beauty care product reviews on the Shopee marketplace because it gets a higher average accuracy value of 86.14% compared to the Naïve Bayes algorithm.

Analysis of TF-IDF and TF-RF Feature Extraction on Product Review Sentiment

Sentiment analysis of product reviews is critical in understanding customer views and satisfaction, especially in the context of e-commerce applications. A marketplace provides channels where users can submit reviews of the products they purchase. However, due to the large number of reviews in a marketplace, analyzing them is no longer feasible to be performed manually. This research proposes a machine learning implementation to perform sentiment analysis on product reviews. In this research, the product review dataset on Shopee marketplace is used for sentiment analysis by comparing TF-IDF and TF-RF feature extraction using the SVM algorithm with stages of dataset, labeling, feature extraction and accuracy results. The importance of the comparison between TF-IDF and TF-RF feature extraction in this research is related to the need to evaluate and determine which feature extraction method is most effective in increasing the accuracy of sentiment analysis. TF-IDF and TF-RF are two methods commonly used in text analysis, and a comparison of their performance can provide deep insight into the effectiveness of each in the context of product sentiment analysis.Thus, through this comparison, this research aims to determine the best approach that can provide the highest accuracy results, so that the results can serve as a guide for further research. Based on the evaluation, the highest accuracy value is achieved at 92.87% by using TF-IDF and SVM classifiers which outperformed previous research.

LLMs in e-commerce: A comparative analysis of GPT and LLaMA models in product review evaluation

E-commerce has witnessed remarkable growth, especially following the easing of COVID-19 restrictions. Many people, who were initially hesitant about online shopping, have now embraced it, while existing online shoppers increasingly prefer the convenience of e-commerce. This surge in e-commerce has prompted the implementation of automated customer service processes, incorporating innovations such as chatbots and AI-driven sales. Despite this growth, customer satisfaction remains vital for E-commerce sustainability. Data scientists have made progress in utilizing machine learning to assess satisfaction levels but struggled to understand emotions within product reviews’ context. The recent AI revolution, marked by the release of powerful Large Language Models (LLMs) to the public, has brought us closer than ever before to understanding customer sentiment. This study aims to illustrate the effectiveness of LLMs by conducting a comparative analysis of two cutting-edge LLMs, GPT-3.5 and LLaMA-2, along with two additional Natural Language Process (NLP) models, BERT and RoBERTa. We evaluate the performance of these models before and after fine-tuning them specifically for product review sentiment analysis. The primary objective of this research is to determine if these specific LLMs, could contribute to understanding customer satisfaction within the context of an e-commerce environment. By comparing the effectiveness of these models, we aim to uncover insights into the potential impact of LLMs on customer satisfaction analysis and enhance our understanding of their capabilities in this particular context.

An Integrated Framework for Automated Web Scraping and Sentiment Analysis of Product Reviews

An Integrated Framework for Automated Web Scraping and Sentiment Analysis of Product Reviews

URL-Based Sentiment Analysis of Product Reviews Using LSTM and GRU

With the fast growth of online content and social media platforms, the amount of user- generated data available in the form of product evaluations, social media postings, and online debates has rapidly expanded. It has become essential for organizations to comprehend client attitudes, make wise decisions, and improve their goods and services by analysing the sentiment indicated in this data. This paper aims to develop a sentiment analysis system for product reviews using URLs of particular item as data sources. It utilizes web scraping techniques to collect textual information from web pages. Natural Language Processing (NLP) techniques are applied for data pre-processing, including tokenization and stop word removal. Machine learning models like Support Vector Classifier (SVC), Random Forest, KNN, Logistic Regression, Naive Bayes and Deep learning models like LSTM and GRU are used for sentiment analysis. Performance measures such as recall, accuracy, and precision are employed to evaluate the models. High scores were consistently achieved by the LSTM and GRU models across all measures, demonstrating their potency in successfully capturing sequential relationships. With strong F-1 ratings of 91% and 90%, respectively, Long Short Term Memory (LSTM) and Gated Recurrent Units (GRU) regularly beat other models, demonstrating their outstanding precision-recall balance. Conversely, K-Nearest Neighbor (KNN) presents a significant trade-off, offering a blazing-fast training time of 0.01 seconds but demanding an extensive 102.34 seconds for prediction, resulting in a lower F-1 score of 47%. Support Vector Machine (SVM) and Logistic Regression achieve competitive F-1 scores of 85% and 84%, respectively, with relatively slow training and prediction times, striking a balance between performance and efficiency. Naive Bayes and Random Forest, while respectable in accuracy, fall slightly behind with F-1 scores of 71% and 80%, respectively, highlighting the significance of taking into account both performance and computing efficiency when choosing the best approach.Through this research, valuable insights are gained into the effectiveness and accuracy of different algorithms in sentiment analysis. The findings contribute to the understanding of sentiment analysis techniques and offer guidance for selecting the most suitable algorithm for URL-based sentiment analysis applications.

A HYBRID DEEP LEARNING APPROACH FOR SENTIMENT ANALYSIS IN PRODUCT REVIEWS

Product reviews play a crucial role in providing valuable insights to consumers and producers. Analyzing the vast amount of data generated around a product, such as posts, comments, and views, can be challenging for business intelligence purposes. Sentiment analysis of this content helps both consumers and producers gain a better understanding of the market status, enabling them to make informed decisions. In this study, we propose a novel hybrid approach based on deep neural networks (DNNs) for sentiment analysis in product reviews, focusing on the classification of sentiments expressed. Our approach utilizes the recursive neural network (RNN) algorithm for sentiment classification. To address the imbalanced distribution of positive and negative samples in social network data, we employ a resampling technique that balances the dataset by increasing samples from the minority class and decreasing samples from the majority class. We evaluate our approach using Amazon data, comprising four product categories: clothing, cars, luxury goods, and household appliances. Experimental results demonstrate that our proposed approach performs well in sentiment analysis for product reviews, particularly in the context of digital marketing. Furthermore, the attention-based RNN algorithm outperforms the baseline RNN by approximately 5%. Notably, the study reveals consumer sentiment variations across different products, particularly in relation to appearance and price aspects.

Analysis of Product Review Sentiment Analysis using Improved Machine Learning Techniques

Sentiment analysis has emerged as a crucial task in the era of big data and social media. Understanding the sentiments expressed in product reviews is vital for businesses to gauge customer satisfaction and make informed decisions. This research paper presents a design simulation and assessment of product review sentiment analysis using improved machine learning techniques. The aim is to develop a robust sentiment analysis model that outperforms existing approaches in accuracy and efficiency. We propose a novel methodology that combines advanced feature extraction, sentiment classification algorithms, and model optimization techniques. The introduction provides an overview of the importance of sentiment analysis in the context of product reviews and the challenges faced by conventional methods. It also outlines the objectives and scope of this research. The related works section presents a comprehensive review of existing literature and highlights the limitations of current approaches. The proposed methodology section describes the technical details of our enhanced machine learning approach and the reasoning behind the selected techniques. In the analysis of sample results, we evaluate the performance of our proposed model on a diverse dataset of product reviews. We present the accuracy, precision, recall, and F1-score metrics, along with a comparison to baseline models and state-of-the-art sentiment analysis systems. Furthermore, we discuss the model's robustness in handling various types of products and reviews.
 Our research demonstrates significant improvements in sentiment analysis accuracy compared to traditional methods. We introduce tables and graphs to illustrate the model's performance in different scenarios and identify its strengths and weaknesses. The paper concludes by discussing the implications of our findings, potential applications in industry, and directions for future research. Overall, this research contributes to the advancement of sentiment analysis techniques and provides a valuable resource for businesses aiming to enhance their understanding of customer sentiments through product reviews.

Feature based Sentiment Analysis of Product Reviews using Deep Learning Methods

Feature based Sentiment Analysis of Product Reviews using Deep Learning Methods

Explainable sentiment analysis for product reviews using causal graph embeddings

Explainable sentiment analysis for product reviews using causal graph embeddings

Bayesian game model based unsupervised sentiment analysis of product reviews

Sentiment Analysis is a task of computationally recognizing and contextualizing opinions stated in a text. We mainly assess whether the writer's attitude towards a specific topic, or a product, is positive, negative, or neutral. Numerous machine learning and fuzzy logic methods have been reconnoitered for sentiment analysis. Yet, the application of mathematical optimization techniques for sentiment tagging is still unexplored. This study presents a novel mathematical framework for sentiment analysis of reviews based on Game Theory. We identify whether the sentiment of a review is positive or negative. In the first step, we comprehend a review and derive context scores from review comments using the SentiWordNet lexicon. We comprehensively combine the computed context and rating scores using the Bayesian Game Model to deduce the sentiment of reviews. Experimental results on three benchmark review datasets, viz. Food, Mobile, and Electronics demonstrate that the proposed model yields state-of-the-art results. We also statistically validated the stability and correctness of the results. The proposed model ensures rational and consistent results. The utility of the game theory model for sentiment analysis creates a new paradigm for diverse NLP tasks.

Sentiment Analysis of Chinese E-Commerce Product Reviews Using ERNIE Word Embedding and Attention Mechanism

The development of e-commerce has ushered in a golden age. E-commerce product reviews are remarks initiated by online shopping users to evaluate the quality and service of the products they purchase; these reviews help consumers learn the reality of the product. The sentiment polarity of e-commerce product reviews is the best way to obtain customer feedback on products. Therefore, sentiment analysis of product reviews on e-commerce platforms is greatly significant. However, the challenges of sentiment analysis of Chinese e-commerce product reviews lie in dimension mapping, disambiguation of sentiment words, and polysemy of Chinese words. To solve the above problems, this paper proposes a sentiment analysis model ERNIE-BiLSTM-Att (EBLA). Here, the dynamic word vector generated using the Enhanced Representation through Knowledge Integration (ERNIE) word embedding model is input into the Bidirectional Long Short-term Memory (BiLSTM) to extract text features. Then, the Attention Mechanism (Att) is used to optimize the weight of the hidden layer. Finally, softmax is used as the output layer for sentiment classification. The experimental results on the JD.com Chinese e-commerce product review dataset show that the proposed model achieves more than 0.87 in precision, recall, and F1 values, which is superior to classic deep learning models proposed by other researchers; it has strong practicability in sentiment analysis of Chinese e-commerce product reviews.

Aspect-based Sentiment Analysis of Product Reviews using Multi-agent Deep Reinforcement Learning

Aspect-based Sentiment Analysis of Product Reviews using Multi-agent Deep Reinforcement Learning

Sentiment Analysis of Product Reviews to Identify Deceptive Rating Information in Social Media: A SentiDeceptive Approach

Sentiment Analysis of Product Reviews to Identify Deceptive Rating Information in Social Media: A SentiDeceptive Approach

Sentiment analysis of product reviews using weighted distance-based whale optimisation assisted deep belief network

Sentiment analysis of product reviews using weighted distance-based whale optimisation assisted deep belief network

Evaluating Annotated Dataset of Customer Reviews for Aspect Based Sentiment Analysis

Sentiment analysis of product reviews on e-commerce platforms aids in determining the preferences of customers. Aspect-based sentiment analysis (ABSA) assists in identifying the contributing aspects and their corresponding polarity, thereby allowing for a more detailed analysis of the customer’s inclination toward product aspects. This analysis helps in the transition from the traditional rating-based recommendation process to an improved aspect-based process. To automate ABSA, a labelled dataset is required to train a supervised machine learning model. As the availability of such dataset is limited due to the involvement of human efforts, an annotated dataset has been provided here for performing ABSA on customer reviews of mobile phones. The dataset comprising of product reviews of Apple-iPhone11 has been manually annotated with predefined aspect categories and aspect sentiments. The dataset’s accuracy has been validated using state-of-the-art machine learning techniques such as Naïve Bayes, Support Vector Machine, Logistic Regression, Random Forest, K-Nearest Neighbor and Multi Layer Perceptron, a sequential model built with Keras API. The MLP model built through Keras Sequential API for classifying review text into aspect categories produced the most accurate result with 67.45 percent accuracy. K- nearest neighbor performed the worst with only 49.92 percent accuracy. The Support Vector Machine had the highest accuracy for classifying review text into aspect sentiments with an accuracy of 79.46 percent. The model built with Keras API had the lowest 76.30 percent accuracy. The contribution is beneficial as a benchmark dataset for ABSA of mobile phone reviews.

Aspect-Based Sentiment Analysis on Amazon Product Reviews

The focus of this paper was on Amazon product reviews. The goal of this is to study is two (NLP) for evaluating Amazon product review sentiment analysis. Customers can learn about a product's quality by reading reviews. Several product review characteristics, such as quality, time of evaluation, material in terms of product lifespan and excellent client feedback from the past, will have an impact on product rankings. Manual interventions are required to analyse these reviews, which are not only time consuming but also prone to errors. As a result, automatic models and procedures are required to effectively manage product reviews. (NLP) is the most practical method for training a neural network in this era of artificial intelligence. First, the Naive Bayes classifier was used to analyse the sentiment of consumer in this study. The (SVM) has categorizeduser sentiments into binary categories. The goal of the approach is to forecast some of the most important characteristics of an amazon-based product reviews, and then analyse Customer attitudes about these aspects. The suggested model is validated using a large-scale real-world dataset gathered specifically for this purpose. The dataset is made up of thousands of manually annotated product reviews gathered from amazon. After passing the input via the network model, (TF) and (IDF) pre-processing methods were used to evaluate the feature. The outcomes precision, recall and F1 score are very promising

Developing and testing a tool to classify sentiment analysis

The era has faced with explosive growth in data generation. Data generation has undergone a renaissance change. This availability of data has led a paradigm shift in the Ecommerce sector; data is no longer a by-product of business activities, but are the asset to a company it helps in providing insights which are required in satisfying customers’ needs. This paper provides an overview of Sentiment Analysis of product reviews based on different algorithms and its efficiency in determining positive from negative reviews based on N-gram, Bigram with the application of Count-Vectorizer and TFIDF Matrix. Different classification models have been employed to check the prediction accuracy of the unlabeled text. Based on the above classification and tool has been developed which predicts the incoming reviews and classify its sentiment polarity.

RoBERTa-IAN for aspect-level sentiment analysis of product reviews

Accurately mining the emotional information contained in product reviews is of great significance to product sales. Existing research on sentiment analysis of product reviews often ignores the importance of modelling aspect words and context separately. Therefore, this paper proposes a sentiment analysis model for product reviews based on RoBERTa-IAN. Firstly, the context and aspect words of product reviews are transformed into low dimensional vectors through the RoBERTa pre-training model. Then, the low dimensional vector is used as the input of Bi-GRU model to extract semantic features and get the hidden representation. Finally, the attention matrices of context and aspect words are obtained by using the Interactive Attention Networks (IAN), which are used as the input of sentiment classification layer to analyse and classify the sentiment polarity of product reviews. The experimental results on the real commodity Chinese dataset show that the accuracy of RoBERTa-IAN has reached more than 90%.

Implementation of Deep Learning Based Sentiment Classification and Product Aspect Analysis

With the increase in E-Commerce businesses in the last decade,the sentiment analysis of product reviews has gained a lot of attention in linguistic research. In literature, the survey depicts the majority of the research done emphasizes on mere polarity identification of the reviews. The proposed system emphasized on classifying the sentiment polarity and the product aspect identification from the reviews. Proposed work experimented with traditional machine learning techniques as well as deep neural networks such as Convolutional Neural Network (CNN), Recurrent Neural Network (RNN) and Long Short Term Memory(LSTM) Networks. The proposed system gives a better understanding of these algorithms by comparing the outcomes. The Deep Learning approach in the proposed work successfully provides a mechanism which identifies the review polarity and intensity of the reviews and also analyses the short form words used by people in the reviews. The experimental results in this work, applied on amazon product dataset, shows that the LSTM model works the best for sentiment analysis and intensity of reviews with 93% accuracy. This research work also predicts polarity for short-form word reviews which is the common trend these days while writing the reviews.