The gaming industry produces vast amounts of user-generated feedback, making it challenging for developers to efficiently analyze and respond to real-time reviews. This study addresses the problem of classifying large-scale unstructured user feedback from Steam reviews. In this paper an approach that integrates traditional machine learning models and deep learning models is proposed. XGBoost is used to manage feature-rich datasets, reducing overfitting. Long-short-term memory (LSTM) and Bi-directional LSTM are used to enhance the accuracy and robustness of classification. Feature extraction techniques, such as sentiment analysis and topic modeling, are employed to enrich the dataset and improve model performance. The experimental results show that the XGBoost model achieved the highest performance with an accuracy of 0.9499 and a ROC-AUC score of 0.6113, demonstrating superior performance in distinguishing between positive and negative feedback. In comparison, deep learning models such as LSTM and Bi-directional LSTM showed lower ROC-AUC scores, indicating less effectiveness in handling the classification task. This approach offers game developers a reliable and scalable solution for classifying user sentiment, leading to better game improvements based on user reviews.
Read full abstract