Imbalance Problem Research Articles

Reservation and allocation model considering the user cost and the utilization of parking space

In order to alleviate the problem of imbalance between parking supply and demand by improving the utilization rate of parking resources, and considering the game relationship between user benefits and system benefits in parking allocation, the optimization objective function of maximum parking space utilization and minimum user cost in parking reservation mode is established from the two aspects which are system optimization and user optimization respectively. Then, the optimal allocation parking integer programming model (OPA) considering users' preferences is established. An Augmented Lagrangian-Alternating Direction Method of Multipliers Algorithm is designed to solve the optimal solution of the model. Finally, in order to test the validity of the model, the proposed model and the classical distribution model are compared and analyzed under different supply and demand conditions. The results show that the performance of the proposed model in three performance metrics which are parking utilization, average user cost and request acceptance rate is significantly better than that of the classical allocation model. The research results of this paper can provide theoretical reference for the management of parking reservation platform.

A multi-class fundus disease classification system based on an adaptive scale discriminator and hybrid loss

Fundus images are crucial in the observation and detection of ophthalmic diseases. However, detecting multiple ophthalmic diseases from fundus images using deep learning techniques is a complex and challenging task One challenge is the complexity of fundus disease structures, which leads to low detection accuracy. Another challenge is the class imbalance problem common in multi-label image classification, which increases the difficulty of algorithm training and evaluation. To address these issues, this study leverages deep learning to propose an ophthalmic disease classification system. We first employ ResNet50 as the backbone network to extract image features, and then use our designed multi-dimensional attention module and adaptive scale discriminator to enhance the network's ability to detect disease features. During training, we innovatively propose a hybrid loss function method to improve the detection capability on imbalanced data. Finally, we conducted experiments on the ODRI-5K dataset with the proposed classification system. In the test set, our method achieved an AUC of 98.53 and an F1-score of 89.73. This result fully demonstrates the excellent disease classification capability of our method. In summary, the multi-label fundus image disease classification system we proposed exhibits outstanding recognition capability, providing an effective solution for the diagnosis of multi-label fundus image diseases.

Impact of Runner Size, Gate Size, Polymer Viscosity, and Molding Process on Filling Imbalance in Geometrically Balanced Multi-Cavity Injection Molding.

The injection molding process is one of the most widely used methods for polymer processing in mass production. Three critical factors in this process include the type of polymer, injection molding machines, and processing molds. Polypropylene (PP) is a widely used semi-crystalline polymer due to its favorable flow characteristics, including a high melt flow index and the absence of a need for a mold temperature controller. Additionally, PP exhibits good elongation and toughness, making it suitable for applications such as box hinges. However, its tensile strength is a limitation; thus, glass fiber is added to enhance this property. It is important to note that the incorporation of glass fiber increases the viscosity of PP. Multi-cavity molds are commonly employed to achieve cost-effective and efficient mass production. The filling challenges associated with geometrically balanced layouts are well documented in the literature. These issues arise due to the varying shear rates of the melt in the runner. High shear rate melts lead to high melt temperatures, which decrease melt viscosity and facilitate easier flow. Consequently, this results in an imbalanced filling phenomenon. This study examines the impact of runner size, gate size, polymer viscosity, and molding process on the filling imbalanced problem in multi-cavity injection molds. Tensile bar injection molding was performed using conventional injection molding (CIM) and microcellular injection molding (MIM) techniques. The tensile properties of the imbalanced multi-cavity molds were analyzed. Flow length within the cavity served as an indicator of the filling imbalance. Additionally, computer simulations were conducted to assess the shear rate's effect on the runner's melt temperature. The results indicated that small runner and gate sizes exacerbate the filling imbalance. Conversely, glass fiber-filled polymer composites also contribute to increased filling imbalance. However, foamed polymers can mitigate the filling imbalance phenomenon.

DSTM: A transformer-based model with dynamic-static feature fusion in speech emotion recognition

With the support of multi-head attention, the Transformer shows remarkable results in speech emotion recognition. However, existing models still suffer from the inability to accurately locate important regions in semantic information at different time scales. To address this problem, we propose a Transformer-based network model for dynamic-static feature fusion, composed of a locally adaptive multi-head attention module and a global static attention module. The locally dynamic multi-head attention module adapts the attention window sizes and window centers of the different regions through speech samples and learnable parameters, enabling the model to adaptively discover and pay attention to valuable information embedded in speech. The global static attention module enables the model to use each element in the sequence fully and learn critical global feature information by establishing connections over the entire input sequence. We also use the data mixture training method to train our model and introduce the CENTER LOSS function to supervise the training of the model, which can better speed up the fitting speed of the model and alleviate the sample imbalance problem to a certain extent. This method achieved good performance on the IEMOCAP and MELD datasets, proving that our proposed model structure and method have better accuracy and robustness.

Imbalanced image classification algorithm based on fine-grained analysis

Fine-grained attribute analysis and data imbalance have always been research hotspots in the field of computer vision. Due to the complexity and diversity of fine-grained attribute images, traditional image classification methods have shortcomings in paying attention to fine-grained attributes of images and perform poorly when dealing with imbalanced data sets. To overcome these problems, this study proposes a fine-grained image threshold classification algorithm based on deep metric learning. By introducing a metric learning method, the focus on fine-grained attributes of images is enhanced. At the same time, by applying pairwise loss and proxy loss, the classification accuracy of the model is improved and the model convergence speed is accelerated. In order to deal with the problem of data imbalance, a classifier based on threshold analysis is designed. The classifier uses threshold analysis technology to achieve multi-level classification of fine-grained images, thereby improving the problem of low classification accuracy of a few categories in imbalanced data sets. Experimental results show that the proposed fine-grained image threshold classification algorithm based on deep metric learning is significantly superior to other methods in terms of classification accuracy.

A novel reinforcement learning agent for rotating machinery fault diagnosis with data augmentation

The problem of data imbalance and limited sample poses a prominent challenge to fault diagnosis in industry, especially in rotating machinery fault diagnosis due to the constraints of sampling and labeling. Reinforcement learning is known for its auto-optimized learning ability but it is severely limited by the quality and quantity of data it is able to collect. This paper applies the Equilibrium Deep Q-Network (Equilibrium-DQN) based agent with the Variational Autoencoder with Wasserstein Generative Adversarial Network and Gradient Penalty (VAE-WGAN-GP) for rotating machinery fault diagnosis. The Equilibrium-DQN possesses the property of leveraging multiple target networks to improve training stability and accuracy. The VAE-WGAN-GP excels in resolving data scarcity problems in fault diagnosis, especially in enriching labeled data with more typical samples while keeping the original data features. Herein, a novel framework is presented that integrates both data augmentation techniques with reinforcement learning agent for fault diagnosis. The proposed framework improves the weakness of insufficient samples in fault diagnosis and reveals its potential in complex industrial applications. The experiments, both on the test bench dataset and on the real locomotive dataset, confirm the advantage of the proposed framework.

Fault diagnosis of planetary gearboxes under small and imbalanced samples based on enhanced Siamese network with improved downsampling module

Due to the limitations of the operating conditions and equipment status, in practice, the normal data for planetary gearboxes are often sufficient, but the fault data are scarce and difficult to obtain, causing the fault diagnosis to face not only an imbalance problem but also a small sample problem. It leads to serious misdiagnosis and poor generalizability. To overcome above challenges, an enhanced Siamese network with improved downsampling module is proposed to reduce the negative impact of small and imbalanced datasets on fault diagnosis. Firstly, the Siamese network is combined with data enhancement to adaptively increase the fault training data with different small sample degrees. It can make the number of training data of each class get rid of small sample, while avoiding the excessive use of scarce fault data causing additional overfitting, so as to improve the generalization of the model. Among them, the data enhancement adopts the extreme noise expansion method proposed in this work, which can quickly generate samples that meet the requirements and help to improve the performance of the model in noisy environments. Secondly, adding the improved downsampling module to the Siamese network. The improved downsampling module introduces density-based spatial clustering of applications with noise (DBSCAN) and distribution ratio calculation, which can consider the distribution range and density of data when selecting. It can not only balance the training data, but also avoid serious information loss, and then reduce the probability of misdiagnosis. Finally, using six imbalanced planetary gearbox datasets with different small sample degrees for verification. The experimental results show that the proposed method can efficiently increase and balance the training data, which greatly improves the accuracy of fault diagnosis under the condition of small and imbalanced samples, especially when the small sample degree is very serious, the accuracy is improved by 57.76% on average.

A category incremental continuous learning model for imbalance arrhythmia detection

Abstract The development of efficient arrhythmia detection systems is crucial for physiological measurements and computer-aided diagnosis. Existing systems rely mainly on offline learning methods and lack the ability to assimilate new data or recognize emerging categories. To address these challenges, this study introduces an arrhythmia detection model that is resistant to data imbalance and has continuous learning capabilities, specifically for incremental learning of new ECG data categories. The system incorporates constraints derived from the new class data and implements a dynamic mechanism for updating connection weights, facilitating the incremental continual learning of classes. Confronted with the problem of models forgetting the original data and overfitting with the added data in continuous learning, we introduce a data balancing method by regularization to balance the model's memory and learning of the two types of data. Facing the data imbalance problem in continuous learning, we introduce a posteriori probability weighting strategy. This strategy assigns greater importance to high-value samples based on the model's posterior residual kernel density estimates. Comprehensive testing of the model using various datasets from the MIT-BIH database indicates superior performance in incremental learning tasks. The results reveal that the model not only excels in class incremental learning but also ensures effective balancing across different data classes.

From shallows to depths: unveiling hybrid synthetic data modeling for enhanced learning with privacy considerations in naturally imbalanced datasets

Data serves as the foundational element that drives model development and performance in machine learning and deep learning. The learning algorithms are as good as data on which they are trained on. Data constrained environments pose serious threat to the effectiveness of learning algorithms. Data limitations stem from a range of factors, including regulatory restrictions, privacy concerns, and the inherent scarcity of relevant data. This constrained availability of data often leads to class imbalance problem in the context of classification tasks. To address the challenges of limited data, the algorithmic generated data, also known as synthetic data, is gaining significant traction as a cost-effective, readily available, and secure alternative. Synthetic data generation techniques can be employed to enhance dataset size by augmenting data samples and to address class imbalance by increasing the number of minority class instances. These techniques generally fall into two main categories: distance-based shallow models and probability estimation-based deep generative models. Shallow interpolation-based models generate new data points within the local space between existing data points, while deep density estimation based models generate new data by learning the whole distribution of data. . In the context of smaller datasets, deep generative models often struggle to accurately estimate the probability distribution of whole data. To effectively represent the global data distribution, these deep models require initial starting data samples to guide their approximation. This paper examines the potential of integration of shallow and deep generative models in the data generation pipeline for effective synthetic data augmentation which furthers enhanced learning and generalization of downstream tasks. In this work, we present a hybrid approach of tabular data generation involving mixed type data attributes (continuous, discrete) and pay special attention to data imbalance and insufficient data problems. We introduce the Hybrid Data Balancing and Augmentation Approach for Mixed Tabular Data (HDBA-MTD), specifically designed to synthesize samples for underrepresented labels of output class and address issues of insufficient data instances. This approach enhances training data diversity, thereby paying special attention to the downstream classification and generalization performance. Experiments are carried out using benchmark datasets to assess the practicality of the presented hybrid model in real-world scenarios. This work has also attempted to quantify the privacy preservability for real data concerning ethical considerations and data security circumstances. The evaluation and analysis of these experiments show that the present hybrid model performs favorably compared to other current hybrid synthetic data generation methods.

Predicting Multiple Outcomes Associated with Frailty based on Imbalanced Multi-label Classification.

Frailty syndrome is prevalent among the elderly, often linked to chronic diseases and resulting in various adverse health outcomes. Existing research has predominantly focused on predicting individual frailty-related outcomes. However, this paper takes a novel approach by framing frailty as a multi-label learning problem, aiming to predict multiple adverse outcomes simultaneously. In the context of multi-label classification, dealing with imbalanced label distribution poses inherent challenges to multi-label prediction. To address this issue, our study proposes a hybrid resampling approach tailored for handling imbalance problems in the multi-label scenario. The proposed resampling technique and prediction tasks were applied to a high-dimensional real-life medical dataset comprising individuals aged 65years and above. Several multi-label algorithms were employed in the experiment, and their performance was evaluated using multi-label metrics. The results obtained through our proposed approach revealed that the best-performing prediction model achieved an average precision score of 83%. These findings underscore the effectiveness of our method in predicting multiple frailty outcomes from a complex and imbalanced multi-label dataset.

VGTS: Visually Guided Text Spotting for novel categories in historical manuscripts

In the field of historical manuscript research, scholars frequently encounter novel symbols in ancient texts, investing considerable effort in their identification and documentation. Although existing object detection methods achieve impressive performance on known categories, they struggle to recognize novel symbols without retraining. To address this limitation, we propose a Visually Guided Text Spotting (VGTS) approach that accurately spots novel characters using just one annotated support sample. The core of VGTS is a spatial alignment module consisting of a Dual Spatial Attention (DSA) block and a Geometric Matching (GM) block. The DSA block aims to identify, focus on, and learn discriminative spatial regions in the support and query images, mimicking the human visual spotting process. It first refines the support image by analyzing inter-channel relationships to identify critical areas, and then refines the query image by focusing on informative key points. The GM block, on the other hand, establishes the spatial correspondence between the two images, enabling accurate localization of the target character in the query image. To tackle the example imbalance problem in low-resource spotting tasks, we develop a novel torus loss function that enhances the discriminative power of the embedding space for distance metric learning. To further validate our approach, we introduce a new dataset featuring ancient Dongba hieroglyphics (DBH) associated with the Naxi minority of China. Extensive experiments on the DBH dataset and other public datasets, including Egyptian Hieroglyph (EGY), Historical Arabic Documents (HAD), Tripitaka Koreana in Han (TKH), and Notary Charters (NC), show that VGTS consistently surpasses state-of-the-art methods. The proposed framework exhibits great potential for application in historical manuscript text spotting, enabling scholars to efficiently identify and document novel symbols with minimal annotation effort.

Taking relations as known conditions: A tagging based method for relational triple extraction

Relational triple extraction refers to extracting entities and relations from natural texts, which is a crucial task in the construction of knowledge graph. Recently, tagging based methods have received increasing attention because of their simple and effective structural form. Among them, the two-step extraction method is easy to cause the problem of category imbalance. To address this issue, we propose a novel two-step extraction method, which first extracts subjects, generates a fixed-size embedding for each relation, and then regards these relations as known conditions to extract the objects directly with the identified subjects. In order to eliminate the influence of irrelevant relations when predicting objects, we use a relation-special attention mechanism and a gate unit to select appropriate relations. In addition, most current models do not account for two-way interaction between tasks, so we design a feature interactive network to achieve bidirectional interaction between subject and object extraction tasks and enhance their connection. Experimental results on NYT, WebNLG, NYT⋆ and WebNLG⋆ datasets show that our model is competitive among joint extraction models.

Credit risk assessment method driven by asymmetric loss function

Credit risk assessment is significantly hindered by the problem of class imbalance, and cost-sensitive methods represent an effective strategy to address this issue. However, most algorithms tend to approach the imbalance from a class perspective, overlooking the finer details at the sample level. Moreover, such methods are susceptible to interference from noise and outliers. In response to these challenges, this paper proposes an asymmetric cost-sensitive support vector machine (QTSVM) that combines the quadratic type squared error loss function (QTSELF) with support vector machine (SVM). It not only leverages the asymmetry of the loss function by applying varying penalties based on classification errors but also employs different processing measures for samples from different classes. Additionally, it enhances model robustness by imposing a tiny penalty on noise or outliers. The adaptive moment estimation (Adam) algorithm is employed to optimize QTSVM. Extensive experiments and statistical tests profoundly demonstrate the superior performance of QTSVM.

A [formula omitted]-means triangular synthesis large margin classifier with unified pinball loss for imbalanced data

Large Margin Distribution Machine (LDM) improves the Support Vector Machine (SVM) by integrating the marginal distribution of samples into the objective function, which exhibits excellent classification and generalization performance. However, most of the existing LDM-based models exhibit inherent flaws: (1) The assumption of a category uniform distribution, resulting in an inability to effectively address the issue of class imbalance. (2) The inheritance of the hinge loss in SVM, leading to inferior anti-noise performance. Given the shortcomings above, this paper constructs a novel K-means Triangular Synthesis (KTS) method for imbalanced data classification and introduces Unified Pinball (UP) loss to ensure robust performance, demonstrated as a novel KTS large margin classifier with UP Loss (KTS-UPLMC) model. Specifically, the KTS method utilizes the triangular synthesis and generates samples based on the cluster density, effectively mitigating the problems of introducing noise samples and strip-shaped sample distribution in the traditional synthetic minority oversampling technique, further alleviating the LDM’s classification line offset. In addition, the UP Loss considers quantile distance, improving the anti-noise performance of the model. Comparative experiments on artificial datasets and benchmark datasets validate the effectiveness and noise resistance of the proposed KTS-UPLMC in imbalanced data classification problems. Furthermore, the stability of the KTS-UPLMC is substantiated by the parameter sensitivity analysis experiment. In conclusion, the KTS method effectively addresses category imbalance, while the integration of the UP Loss enhances noise resistance.

Time-guided convolutional neural networks for spatiotemporal urban flood modelling

Urban flood modelling is key to understand flood risks and develop effective interventions in flood management. Deep learning (DL), known for its robust and automatic feature extraction capabilities, has been applied for urban flood predictions. However, the hybrid spatiotemporal structure of conventional DL-enabled urban flood models is limited in terms of accuracy and efficiency. To address this gap, this study develops a new DL model guided by time information. This model uses a classic CNN (Convolution Neural Network) architecture, Unet, as its backbone. Time information is integrated into inputs via an extra channel to specify the desired prediction time, facilitating the simulation of the spatiotemporal flood process. Additionally, a modified loss function is formulated to tackle the sample imbalance problem between flooded and non-flooded sites. The model performance is assessed in an urban area in Dalian, China with a total of 18 rainfall events of varying return periods. The model attains average precision and recall values of 0.90 and 0.81, respectively, across different time steps during various events. Furthermore, the model exhibits transferability in ungauged regions where a high influence of surrounding environments on local flood processes is identified by Grad-CAM (Gradient-weighted Class Activation Mapping) analysis. The results show that the new Unet model has great promise in efficiently providing accurate spatiotemporal flood simulations. The time-guided Unet model can serve as practical tools for rapid flood simulation in urban areas.

A multiscale approach for network intrusion detection based on variance–covariance subspace distance and EQL v2

As an important network defense approach, network intrusion detection is mainly used to identify anomaly traffic behavior. However, dominant network intrusion detection approaches are now struggling to identify the complex and variable means of attack, leading to high false alarm rate. Additionally, the feature redundancy and class imbalance problem in the intrusion detection dataset also constrain the performance of detection methods. This paper proposes a multiscale intrusion detection approach based on variance–covariance subspace distance and Equalization Loss v2 (EQL v2). Firstly, the variance–covariance subspace distance is used for feature selection on the preprocessed dataset to determine a set of representative feature subsets that can effectively approximate the original feature space. Secondly, the loss function, EQL v2, is adopted to balance the positive and negative gradients, addressing the class imbalance problem. Finally, a pyramid depthwise separable convolution model is proposed to capture the multiscale information of the traffic, and the convolutional layer in the depthwise convolution is replaced with self-supervised predictive convolutional attention block to compensate for the performance loss caused by the parameter reduction. Extensive experiments demonstrated that the proposed approach exhibits better performance on the three datasets of NSL-KDD, UNSW_NB15, and CIC-IDS-2017, with accuracy rates of 99.19%, 97.81%, and 99.83%, respectively, effectively improve the intrusion detection performance.

Analyzing Resampling Techniques for Addressing the Class Imbalance in NIDS using SVM with Random Forest Feature Selection

The purpose of Network Intrusion Detection Systems (NIDS) is to ensure and protect computer networks from harmful actions. A major concern in NIDS development is the class imbalance problem, i.e., normal traffic dominates the communication data plane more than intrusion attempts. Such a state of affairs can pose certain hazards to the effectiveness of detection algorithms, including those useful for detecting less frequent but still highly dangerous intrusions. This paper aims to utilize resampling techniques to tackle this problem of class imbalance in NIDS using a Support Vector Machine (SVM) classifier alongside utilizing features selected by Random Forest to improve the feature subset selection process. The analysis highlights the combativeness of each sampling method, offering insights into their efficiency and practicality for real-world applications. Four resampling techniques are analyzed. Such techniques include Synthetic Minority Over-sampling Technique (SMOTE), Random Under-sampling (RUS), Random Over-sampling (ROS) and SMOTE with two different combinations i.e., RUS SMOTE and RUS ROS. Feature selection was done using Random Forest, which was improved by Bayesian methods to create subsets of features with feature rankings determined by Cumulative Feature Importance Score (CFIS). The CIDDS-2017 dataset is used for the performance evaluation, and the metrics used include accuracy, precision, recall, F-measure and CPU time. The algorithm that performs best overall in the CFIS feature subsets is SMOTE, and the features that give the best result are selected at the 90% level with 25 features. This subset accomplishes a relative accuracy enhancement of 0.08% than the other approaches. The RUS+ROS technique is also fine but somehow slower than SMOTE. On the other hand, RUS+SMOTE shows relatively poor results although it consumes less time in terms of computational time compared to other methods, giving about 50% of the performance shown by the other methods. This paper's novelty is adapting the RUS method as a standalone test for screening new and potentially contaminated datasets. The standalone RUS method is more efficient in terms of computations; the algorithm returned the best result of 98.13% accuracy at 85% at the CFIS level of 34 features with a computation time of 137.812 s. It is also noted that SMOTE is considered to be proficient among all resampling techniques used for handling the problem of class imbalance in NIDS, vice 90% CFIS feature subset. Future research directions could include using these techniques in different data sets and other machine learning and deep learning methods together with ROC curve analysis to provide useful pointers to NIDS designers on how to select the right data mining tools and strategies for their projects.

Geopolitical Aspects of Demographic Processes: Development of Scientific Ideas of L. L. Rybakovsky

Demographic processes play a key role in the formation of the geopolitical picture of the world. Population size, its age structure, growth rates and migration flows have a significant impact on the economic power of states, their military potential and their ability to project power in the international arena. This article examines contemporary and historical views on the significance of demographic factors in the geopolitical competition of countries and the measurement of a state's national power. The study covers both contemporary and historical aspects of the issue. The paper provides a systematic review of the evolution of scientific views on the significance of demographic factors in the geopolitical context. Particular attention is paid to modern methodological approaches to measuring the national power of a state considering demographic indicators. The article offers a critical analysis of existing models for assessing geopolitical influence based on demographic factors and considers their applicability in the context of global demographic transformations. The study also addresses topical issues of the impact of demographic trends on the geopolitical strategies of states in the 21st century, including the problems of population aging, migration processes and demographic imbalances between developed and developing countries. Special attention is paid to the analysis of geopolitical aspects of demographic processes in the works of the outstanding Russian demographer L.L.Rybakovsky. The paper considers the key concepts of the scientist, including demographic security, the geopolitical significance of migration processes, the relationship between demography and spatial development of Russia, as well as the role of demographic policy as an instrument of geopolitical influence.

Research of multi-label text classification based on label attention and correlation networks.

Multi-Label Text Classification (MLTC) is a crucial task in natural language processing. Compared to single-label text classification, MLTC is more challenging due to its vast collection of labels which include extracting local semantic information, learning label correlations, and solving label data imbalance problems. This paper proposes a model of Label Attention and Correlation Networks (LACN) to address the challenges of classifying multi-label text and enhance classification performance. The proposed model employs the label attention mechanism for a more discriminative text representation and uses the correlation network based on label distribution to enhance the classification results. Also, a weight factor based on the number of samples and a modulation function based on prediction probability are combined to alleviate the label data imbalance effectively. Extensive experiments are conducted on the widely-used conventional datasets AAPD and RCV1-v2, and extreme datasets EUR-LEX and AmazonCat-13K. The results indicate that the proposed model can be used to deal with extreme multi-label data and achieve optimal or suboptimal results versus state-of-the-art methods. For the AAPD dataset, compared with the suboptimal method, it outperforms the second-best method by 2.05% ∼ 5.07% in precision@k and by 2.10% ∼ 3.24% in NDCG@k for k = 1, 3, 5. The superior outcomes demonstrate the effectiveness of LACN and its competitiveness in dealing with MLTC tasks.

Classification of Air Pollutant Index on Data with Outliers and Imbalance Class Problem

The problem of air pollution has become a global issue that has received attention from various countries. Jakarta, Indonesia's capital city, is unavoidable from the same problem. This study will use four parameters of substances PM10, SO2, CO, O3, and nitrogen dioxide to categorize Jakarta's air quality (NO2). The data used is daily data taken from the Air Quality Monitoring Station in Jakarta throughout 2020. The methods used include SVM, Random Forest, Logistic Regression, KNN, CART, and Stacking Algorithm. At the data preparation stage, we found missing values, outliers, and class imbalance problems. Before applying machine learning methods and evaluating accuracy, we used data pre-processing techniques such as the MissForest method, median substitution, and ADASYN. The results prove that the original dataset has a higher accuracy score (0.882 – 0.977) than the balanced dataset (0.829 – 0.976). According to the evaluation results, the Random Forest method has the highest accuracy score for original and balanced datasets. The overall result is better than the identical research, which produces 96.61% accuracy using a neural network. It shows that preprocessing steps such as missing values handling an imbalanced class handling is essential in classification performance.