TEXT CLASSIFICATION USING INDOBERT FINE-TUNING MODELING WITH CONVOLUTIONAL NEURAL NETWORK AND BI-LSTM

Abstract

The technological advancements in goods delivery facilities have been increasing year by year in tandem with the growing online trade, which necessitates delivery services to fulfill the transactional process between sellers and buyers. Since 2000, top brand awards have often conducted official survey analyses to provide comparisons of goods or services, one of which includes delivery services. However, the survey rankings based on public opinion are less accurate due to users of delivery services and service companies being unaware of the specific success factors and weaknesses in their services. The aim of this research is to analyze the comparison of text mining using the Indonesian language transformation method, IndoBert. The algorithm utilized to demonstrate analysis performance employs Convolutional Neural Network (CNN) and Bidirectional Long Short-Term Memory (Bi-LSTM). This method is utilized to determine the impact of opinion data from Twitter on the J&T Express expedition delivery service, incorporating both text preprocessing and data without text preprocessing. The IndoBert parameters vary in the learning rate section based on four factors: price, time, returns, and others. The research data consisted of 2525 comments from Twitter users regarding the delivery service spanning from January 1, 2021, to March 31, 2023. The testing showed that Bi-LSTM with text preprocessing performed 2% higher, achieving 79% at a learning rate of 1x10-6, compared to without text preprocessing at the same learning rate, which reached 77%. Additionally, CNN outperformed by 3% with a rate of 83%, compared to 80% without text preprocessing at a learning rate of 1x10-5. The highest accuracy, reaching 83%, was obtained by CNN with parameters set at 1x10-5, and the preprocessing technique was considered superior to Bi-LSTM.