Synthetic Minority Oversampling Technique Research Articles

B-HPD: Bagging-based hybrid approach for the early diagnosis of Parkinson’s disease1

Parkinson’s disease (PD) is a neurodegenerative condition that affects the neurological, behavioral, and physiological systems of the brain. According to the most recent WHO data, 0.51 percent of all fatalities in India are caused by PD. It is a widely recognized fact that about one million people in the United States suffer from PD, relative to nearly five million people worldwide. Approximately 90% of Parkinson’s patients have speech difficulties. As a result, it is crucial to identify PD early on so that appropriate treatment may be determined. For the early diagnosis of PD, we propose a Bagging-based hybrid (B-HPD) approach in this study. Seven classifiers such as Random Forest (RF), Decision Tree (DT), Logistic Regression (LR), Naïve Bayes (NB), K nearest neighbor (KNN), Random Under-sampling Boost (RUSBoost) and Support Vector Machine (SVM) are considered as base estimators for Bagging ensemble method and three oversampling techniques such as Synthetic Minority Oversampling Technique (SMOTE), Adaptive Synthetic (ADASYN) and SVMSmote are implemented under this research work. Feature Selection (FS) is also used for data preprocessing and further performance enhancement. We obtain the Parkinson’s Disease classification dataset (imbalanced) from the Kaggle repository. Finally, using two performance measures: Accuracy and Area under the curve (AUC), we compare the performance of the model with ALL features and with selected features. Our study suggests bagging with a base classifier: RF is showing the best performance in all the cases (with ALL features: 754, with FS: 500, with three Oversampling techniques) and may be used for PD diagnosis in the healthcare industry.

Feature group partitioning: an approach for depression severity prediction with class balancing using machine learning algorithms

In contemporary society, depression has emerged as a prominent mental disorder that exhibits exponential growth and exerts a substantial influence on premature mortality. Although numerous research applied machine learning methods to forecast signs of depression. Nevertheless, only a limited number of research have taken into account the severity level as a multiclass variable. Besides, maintaining the equality of data distribution among all the classes rarely happens in practical communities. So, the inevitable class imbalance for multiple variables is considered a substantial challenge in this domain. Furthermore, this research emphasizes the significance of addressing class imbalance issues in the context of multiple classes. We introduced a new approach Feature group partitioning (FGP) in the data preprocessing phase which effectively reduces the dimensionality of features to a minimum. This study utilized synthetic oversampling techniques, specifically Synthetic Minority Over-sampling Technique (SMOTE) and Adaptive Synthetic (ADASYN), for class balancing. The dataset used in this research was collected from university students by administering the Burn Depression Checklist (BDC). For methodological modifications, we implemented heterogeneous ensemble learning stacking, homogeneous ensemble bagging, and five distinct supervised machine learning algorithms. The issue of overfitting was mitigated by evaluating the accuracy of the training, validation, and testing datasets. To justify the effectiveness of the prediction models, balanced accuracy, sensitivity, specificity, precision, and f1-score indices are used. Overall, comprehensive analysis demonstrates the discrimination between the Conventional Depression Screening (CDS) and FGP approach. In summary, the results show that the stacking classifier for FGP with SMOTE approach yields the highest balanced accuracy, with a rate of 92.81%. The empirical evidence has demonstrated that the FGP approach, when combined with the SMOTE, able to produce better performance in predicting the severity of depression. Most importantly the optimization of the training time of the FGP approach for all of the classifiers is a significant achievement of this research.

Dealing imbalance dataset problem in sentiment analysis of recession in Indonesia

<span lang="EN-US">Global recession news dominates social media, particularly in Indonesia, with social news platforms on Twitter generating public responses and <br /> re-tweetings on the issue. Mining these opinions from Twitter using a sentiment analysis approach yields invaluable insights. The research stages included data collection, pre-processing, data labeling using the <br /> lexical-based method like valence aware dictionary and sentiment reasoner (VADER) and TextBlob, sampling techniques using synthetic minority oversampling technique (SMOTE) and random over sampling (ROS) before and after splitting data, and modeling using machine learning such as support vector machines (SVM), k-nearest neighbour (KNN), naive Bayes, and model evaluation. The problem is that almost 300,000 data collected from NodeXL are unbalanced. The findings show that models with balanced datasets show better model evaluation results. The sampling technique was carried out before and after splitting the data. The model evaluation results show that the Bernoulli-naive Bayes algorithm, with the VADER labeling technique, and the SMOTE sampling technique after splitting data, obtains the best accuracy of 84%, and using the ROS technique obtains an accuracy of 81%. On the other hand, with the SMOTE and ROS technique before splitting data on the SVM algorithm, it gets the best accuracy of 93% from before if only using SVM only reached 84%.</span>

Factor analysis influencing Mobile JKN user experience using sentiment analysis

<span lang="EN-US">Social security administration for health or Badan Penyelenggara Jaminan Sosial Kesehatan (BPJS Kesehatan), as a public legal entity, has a critical role in the health of the Indonesian population. BPJS Kesehatan introduced the Mobile national health insurance or </span><em><span lang="EN-US">jaminan kesehatan nasional</span></em><span lang="EN-US"> (JKN) application to enhance its services, enabling Indonesians to access it directly. Nevertheless, the rating of the Mobile JKN application on the Google Play Store has shown a gradual decline over time. Therefore, this study was conducted to analyze the factors influencing the user experience of the Mobile JKN application, utilizing the review data obtained from the Google Play Store. Sentiment analysis using the Naïve Bayes (NB) classification model and support vector machine (SVM) combined with synthetic minority oversampling technique (SMOTE) and slang word replacement. The results obtained an accuracy value of 93.33%, precision of 93.76%, recall of 93.33%, and F1-score of 93.43%. A further analysis was conducted using online service quality factors to obtain the main factors influencing the experience of Mobile JKN application users. The evaluation findings revealed that factors of security, ease of use, and timeliness are three fundamental aspects that should be given immediate attention by BPJS Kesehatan while improving the Mobile JKN application in the future.</span>

An efficient synthetic minority oversampling technique-based ensemble learning model to detect COVID-19 severity

The COVID-19 pandemic has highlighted the importance of accurately predicting disease severity to ensure timely intervention and effective allocation of healthcare resources, which can ultimately improve patient outcomes. This study aims to develop an efficient machine learning (ML) model based on patient demographic and clinical data. It utilizes advanced feature engineering techniques to reduce the dimensionality of dataset and address the issue of highly imbalanced data using synthetic minority oversampling technique (SMOTE). The study employs several ensemble learning models, including XGBoost, Random Forest, AdaBoost, voting ensemble, enhanced-weighted voting ensemble, and stack-based ensembles with support vector machine (SVM) and Gaussian Naïve Bayes as meta-learners, to develop the proposed model. The results indicate that the proposed model outperformed the top-performing models reported in previous studies. It achieved an accuracy of 0.978, sensitivity of 1.0, precision of 0.875, F1-score of 0.934, and receiver operating characteristic area under the curve (ROC-AUC) of 0.965. The study identified several features that significantly correlated with COVID-19 severity, which included respiratory rate (breaths per minute), c-reactive proteins, age, and total leukocyte count (TLC) count. The proposed approach presents a promising method for accurate COVID-19 severity prediction, which may prove valuable in assisting healthcare providers in making informed decisions about patient care.

Implementation of Ensemble Machine Learning Classifier and Synthetic Minority Oversampling Technique for Sentiment Analysis of Sustainable Development Goals in Indonesia

As part of the Sustainable Development Goals (SDGs), governments worldwide have committed to improving people's lives to improve the quality of life for all, including the 17 such goals that were agreed upon in 2015 to benefit the human race as a whole. It would be interesting to see how society responds to the SDGs after approximately half of them have been achieved. This public response was analyzed in terms of sentiment. Within the total number of internet users in Indonesia, there are 18.45 million Twitter users. The platform enables anyone to write about anything they are experiencing in their lives, such as what is happening in their environment, what is happening in their education system, what is happening in the food industry, how people feel, and many more. The platform enables anyone to write about anything they are experiencing in their lives, such as what is happening in their environment, what is happening in their education system, what is happening in the food industry, how people feel, and many more. To model the data collected, the researchers used Ensemble Machine Learning Classifiers (EMLC) to model the data by using a machine learning classifier that uses machine learning techniques. The best model in this study is EMLC-Stacking with a data splitting of 80:20 and using SMOTE, which obtains an accuracy of 91%. This accuracy results from a 5% increase compared to when not using SMOTE. From 15,698 tweets, this research found that 47% were positive sentiments, 28% were negative sentiments, and 25% were neutral sentiments. The results that we measured offer hope that there will be a positive trend in the journey of the SDGs until 2030 if these findings are true.

Scientific text citation analysis using CNN features and ensemble learning model.

Citation illustrates the link between citing and cited documents. Different aspects of achievements like the journal's impact factor, author's ranking, and peers' judgment are analyzed using citations. However, citations are given the same weight for determining these important metrics. However academics contend that not all citations can ever have equal weight. Predominantly, such rankings are based on quantitative measures and the qualitative aspect is completely ignored. For a fair evaluation, qualitative evaluation of citations is needed in addition to quantitative ones. Many existing works that use qualitative evaluation consider binary class and categorize citations as important or unimportant. This study considers multi-class tasks for citation sentiments on imbalanced data and presents a novel framework for sentiment analysis in in-text citations of research articles. In the proposed technique, features are retrieved using a convolutional neural network (CNN), and classification is performed using a voting classifier that combines Logistic Regression (LR) and Stochastic Gradient Descent (SGD). The class imbalance problem is handled by the synthetic minority oversampling technique (SMOTE). Extensive experiments are performed in comparison with the proposed approach using SMOTE-generated data and machine learning models by term frequency (TF), and term frequency-inverse document frequency (TF-IDF) to evaluate the efficacy of the proposed approach for citation analysis. It is found that the proposed voting classifier using CNN features achieves an accuracy, precision, recall, and F1 score of 0.99 for all. This work not only advances the field of sentiment analysis in academic citations but also underscores the importance of incorporating qualitative aspects in evaluating the impact and sentiments conveyed through citations.

Optimization of Early Detection of Tuberculosis Through Machine Learning Using Clinical Data: Development and Evaluation of Multilayer Perceptron and Extreme Learning Machine for Tuberculosis Classification

This research takes an innovative step in the fight against Tuberculosis (TB), one of Indonesia's prominent public health challenges, by developing and evaluating Multilayer Perceptron (MLP) and Extreme Learning Machine (ELM) models in machine learning for early detection of TB using clinical data. The main result of this study was the discovery that the MLP model, when applied without the Synthetic Minority Over-sampling Technique (SMOTE), achieved an impressive accuracy of 95.00%, signaling significant progress in TB early detection efforts. This discovery not only highlights the great potential of applying machine learning technology in improving the accuracy of TB diagnosis but also paves the way for the possible application of advanced technology in the health sector to deal with infectious diseases. This research illustrates how machine learning technology can be integrated into clinical practice to effectively detect TB cases at an early stage, thus enabling faster and more precise treatment, which can ultimately reduce the spread of the disease. This is particularly important given TB's significant impact on public health, especially in developing countries. The results also open up opportunities for further research into the application of machine learning techniques to other infectious diseases, promising a paradigm shift in the way we detect and manage various health conditions.

Political social media bot detection: Unveiling cutting-edge feature selection and engineering strategies in machine learning model development

Over time, social media bots (SMBs), specifically political SMBs, have played a crucial role in influencing and spreading misinformation, manipulating public opinion, and harassing and intimidating users of online social networks (OSNs). This article aims to study previous works on the detection and analysis of political SMB activities and address critical challenges that significantly impact the effectiveness of SMB detection models. These challenges include feature engineering, feature selection (FS), and model implementation. Over 33 features were extracted from the Twibot-20 dataset, including content, user information, network, behavior, and temporal features. Various FS techniques are explored and compared to select the optimal features, comprising basic, filter, wrapper, embedded, and hybrid. The optimal features are then employed to train multiple machine-learning algorithms. To balance the dataset, the synthetic minority oversampling technique coupled with edited nearest neighbors (Smote-ENN) is used. The results showed an improvement in model performance, from an initial Area Under the Curve (AUC) of 90.40 % and accuracy of 81.60 % using the original set to a score of 99.50 % for the test set and 100 % for the training set in all used metrics. Decision Trees, Random Forest, Gradient Boosting, Adaboost, XGB, and Extra Trees emerge as the most effective for detecting political SMBs.

Optimizing double-layered convolutional neural networks for efficient lung cancer classification through hyperparameter optimization and advanced image pre-processing techniques.

Lung cancer remains a leading cause of cancer-related mortality globally, with prognosis significantly dependent on early-stage detection. Traditional diagnostic methods, though effective, often face challenges regarding accuracy, early detection, and scalability, being invasive, time-consuming, and prone to ambiguous interpretations. This study proposes an advanced machine learning model designed to enhance lung cancer stage classification using CT scan images, aiming to overcome these limitations by offering a faster, non-invasive, and reliable diagnostic tool. Utilizing the IQ-OTHNCCD lung cancer dataset, comprising CT scans from various stages of lung cancer and healthy individuals, we performed extensive preprocessing including resizing, normalization, and Gaussian blurring. A Convolutional Neural Network (CNN) was then trained on this preprocessed data, and class imbalance was addressed using Synthetic Minority Over-sampling Technique (SMOTE). The model's performance was evaluated through metrics such as accuracy, precision, recall, F1-score, and ROC curve analysis. The results demonstrated a classification accuracy of 99.64%, with precision, recall, and F1-score values exceeding 98% across all categories. SMOTE significantly enhanced the model's ability to classify underrepresented classes, contributing to the robustness of the diagnostic tool. These findings underscore the potential of machine learning in transforming lung cancer diagnostics, providing high accuracy in stage classification, which could facilitate early detection and tailored treatment strategies, ultimately improving patient outcomes.

Analisis dan Optimalisasi Performa Algoritma Gaussian Naive Bayes pada Prediksi Metabolic Syndrome Menggunakan SMOTE

Metabolic syndrome is a complex global health problem, with symptoms such as abdominal obesity, insulin resistance, high blood pressure, high blood sugar, and abnormal blood lipids. With this global challenge, several studies have attempted to predict these diseases using machine learning methods. However, often, predictions about a disease result in data imbalance where minority classes are underrepresented. To balance the class proportions, the Synthetic Minority Over-sampling Technique (SMOTE) method replicates the minority class samples. In this research, the technique applied to predict is the Gaussian Naive Bayes (GNB) algorithm. The results show an increase in prediction accuracy by 0.2 from 0.81 to 0.83. This study confirms the critical role of the SMOTE oversampling method in machine learning using the Gaussian Naive Bayes (GNB) algorithm in Metabolic Syndrome prediction and its positive impact on diagnostic efficiency and public health.

Performance Evaluation of Hybrid Machine Learning Algorithms for Online Lending Credit Risk Prediction

ABSTRACT Peer-to-Peer systems are still in the early stages of development when it comes to the processing of credit and the appraisal of the risk associated with it. In this study, we used a hybrid convolutional neural network with logistic regression, a gradient-boosting decision tree, and a k-nearest neighbor to predict the credit risk in a P2P lending club. The lending clubs publicly available P2P loan data was used to train the model. In order to address the issue of data imbalance within the dataset, specifically between the non-defaulter and defaulter classes, the synthetic minority oversampling technique sampling approach is utilized. We developed the architecture of our hybrid model by removing the fully connected layer with the soft-max, which is the final layer of the fully connected CNN model and replaced by LR, GBDT, and k-NN algorithms. The experimental results show that the hybrid CNN-kNN model outperforms the CNN-GBDT and CNN-LR models based on the performance metrics accuracy, recall, F1-score, and area under the curve for both all input and important features. This shows that hybrid machine learning models effectively identify and categorize credit risk in peer-to-peer lending clubs, hence assisting in financial loss prevention.

DDoS Attack Detection in Edge-IIoT Network Using Ensemble Learning

Abstract As the number of IoT devices increases daily due to the rapid growth in technology, every device and network is vulnerable to attacks because it is exposed to the internet. Denial of Service (DoS) is a prevalent type of intrusion on the Internet of Things (IoT) network in which the server becomes down due to flooding requests. Distributed Denial of Service (DDoS) is a special type of DoS attack where the network of malicious computers called botnet consumes the target’s system resources by flooding the requests. Edge computing is closely related to Industrial Internet of Things (IIoT), and industry 4.0. Both of them are relatively emerging technologies so security is a crucial part of them. By incorporating our contributions to the current and innovative dataset Edge-IIoT, the proposed study presents a novel approach to detect DDoS attacks in an IIoT network in the domain of edge computing, whether the traffic is normal or malicious (DDoS traffic). This study explores various Ensemble Learning (EL) techniques to predict normal and malicious DDoS traffic along with the type of DDoS attack. The study applies various preprocessing techniques like Synthetic Minority Over Sampling Technique (SMOTE), label encoding, etc. to enhance the model’s performance and reveals how EL techniques performs better in terms of accuracy than the individual classifiers. Further, the performance of all EL techniques has been investigated in terms of all evaluation measures, including the elapsed time. This important addition not only broadens the focus of study in this area but also offers insightful comparisons of the efficiency and precision of various ensemble approaches as well as individual classifiers. The study achieved a maximum of 99.99% in all evaluation measures.

1D-CNN: Classification of normal delivery and cesarean section types using cardiotocography time-series signals

Abstract Cardiotocography (CTG) is considered the gold standard for monitoring fetal heart rate (FHR) during pregnancy and labor to estimate the danger of oxygen deprivation. Visual interpretation of CTG traces is complex and frequently results in high rates of false positives and false negatives, leading to unfavorable and unwanted outcomes such as fetal mortality or needless cesarean surgery. If the data are well-balanced, which is uncommon in medical datasets, machine learning techniques can be helpful in interpretation. This study is designed to determine classification performance under various data balance approaches. We propose a robust methodology for the automated extraction of features that use a deep learning model based on the one-dimensional convolutional neural network (1D-CNN). We used a public database containing 552 intrapartum CTG recordings. Due to the imbalance in the dataset, the experiments were conducted under a variety of conditions such as (i) an unbalanced dataset, (ii) undersampling, (iii) a weighted binary cross-entropy approach, and (iv) oversampling utilizing the synthetic minority oversampling technique (SMOTE). We found an excellent sensitivity (99.80% for the unbalanced dataset, 96.25% for the weighted binary cross-entropy approach, and 99.81% with SMOTE) except for the under sampling situation, in which the sensitivity was 85.71%. Moreover, the 1D-CNN model incorporating SMOTE yielded promising results in 88% specificity, 93.72% quality index (QI), and 95.10% area under the curve. The model exhibited excellent performance in terms of sensitivity in every scenario except for undersampling. The oversampling of training data with SMOTE yielded a decent level of specificity, demonstrating the model’s strong predictive capacity. In addition, the SMOTE scenario resulted in fewer training epochs, which is another accomplishment.

A novel generative adversarial network for improving crash severity modeling with imbalanced data

Traffic crash data is often greatly imbalanced with the majority of non-fatal crashes and only a small number of fatal crashes. Such data imbalance issue poses a challenge for crash severity modelling, especially for classifying and interpreting fatal crashes with very limited samples. To address the data imbalance issues, the data resampling techniques are commonly used methods to rebalance the number of samples among all categories of the dataset, such as under-sampling and over-sampling techniques. However, it is challenging for most traditional and existing deep learning-based resampling methods, e.g., synthetic minority oversampling technique (SMOTE) and Generative Adversarial Networks (GAN), to handle both continuous and discrete risk factors in traffic crash datasets, since they are built upon by smooth and continuous functions which are not applicable for processing discrete variables. Though some resampling methods are capable of handling both continuous and discrete variables, they may struggle with mode collapse issues associated with sparse discrete risk factors so that the diversity of the underlying data distribution can not be captured due to oversampling repetitive and similar samples. To address the aforementioned issues, the current study proposes a traffic crash data generation method based on the Conditional Tabular GAN (CTGAN) to rebalance crash datasets for improving performance of crash severity classification and interpretation. The designed experiments are conducted to evaluate contributions of the synthetic data for improving crash severity classification, the distribution consistency between synthetic and benchmark datasets, and the parameter recovery (i.e., the accuracy of parameter estimation and probability prediction) for various resampling strategies. A 4-year real-world dataset collected in Washington State, U.S., and Monte Carlo simulations are utilized for demonstrating the designed experiments. The results indicate that crash severity modeling using synthetic data generated by the mix-resampling of CTGAN and random under-sampling (CTGAN-RU) outperforms all baseline methods. In addition, the proposed deep generative method demonstrates the capability in maintaining distribution consistency and achieving accurate parameter recovery. This study can provide valuable insights for traffic safety researchers and engineers into crash severity modeling, especially when handling imbalanced crash data of various types.

Unmasking Banking Fraud: Unleashing the Power of Machine Learning and Explainable AI (XAI) on Imbalanced Data

Recognizing fraudulent activity in the banking system is essential due to the significant risks involved. When fraudulent transactions are vastly outnumbered by non-fraudulent ones, dealing with imbalanced datasets can be difficult. This study aims to determine the best model for detecting fraud by comparing four commonly used machine learning algorithms: Support Vector Machine (SVM), XGBoost, Decision Tree, and Logistic Regression. Additionally, we utilized the Synthetic Minority Over-sampling Technique (SMOTE) to address the issue of class imbalance. The XGBoost Classifier proved to be the most successful model for fraud detection, with an accuracy of 99.88%. We utilized SHAP and LIME analyses to provide greater clarity into the decision-making process of the XGBoost model and improve overall comprehension. This research shows that the XGBoost Classifier is highly effective in detecting banking fraud on imbalanced datasets, with an impressive accuracy score. The interpretability of the XGBoost Classifier model was further enhanced by applying SHAP and LIME analysis, which shed light on the significant features that contribute to fraud detection. The insights and findings presented here are valuable contributions to the ongoing efforts aimed at developing effective fraud detection systems for the banking industry.

Applying virtual sample generation and ensemble modeling for improving the spectral diagnosis of cancer

Cancer diagnosis plays a key role in facilitating treatment and improving survival rates of patients. The combination of near-infrared (NIR) spectroscopy with data-driven algorithms offers a rapid and cost-effective approach for such a task. Due to the limitations of objective cases, the number of tumor samples is usually smaller, and the resulting dataset exhibit the issues of class imbalance, which has a more serious impact on the performance of diagnostic models. To deal with class imbalance and improve the sensitivity, this work investigates the feasibility of NIR spectroscopy combined with virtual sample generation (VSG) as well as ensemble strategy for developing diagnostic models. Based on preliminary experiment, several learning algorithms such as discriminant analysis (DA) and partial least square-discriminant analysis (PLS-DA) are screened out as algorithms for constructing prediction models. Three algorithms of VSG including synthetic minority oversampling technique (SMOTE), Borderline-SMOTE and adaptive synthetic sampling (ADASYN) are used for experiment. A fixed sample subset composed of 27 cancer samples and 54 normal samples are hold out as the test set. Three training sets containing 5, 10, 25 minority class samples and 54 majority class samples are used for model development. The experimental result indicates that overall, with PLS-DA algorithm, all VSG approaches can significantly improve the sensitivity of cancer diagnosis for all cases of training sets with different minority samples, but ADASYN performs the best. It reveals that the integration of NIR, PLS-DA, and ADASYN is a promising tool package for developing diagnosis methods.

Synthetic aperture radar automatic target recognition based on cost‐sensitive awareness generative adversarial network for imbalanced data

AbstractIn military contexts, synthetic aperture radar (SAR) automatic target recognition (ATR) models frequently encounter the challenge of imbalanced data, resulting in a noticeable degradation in the recognition performance. Therefore, the authors propose a cost‐sensitive awareness generative adversarial network (CAGAN) model, aiming to improve the robustness of ATR models under imbalanced data. Firstly, the authors introduce a convolutional neural network (DCNN) to extract features. Then, the synthetic minority over‐sampling technique (SMOTE) is applied to achieve feature‐level balancing for the minority category. Finally, a CAGAN model is designed to perform the final classification task. In this process, the GAN‐based adversarial training mechanism enriches the diversity of training samples, making the ATR model more comprehensive in understanding different categories. In addition, the cost matrix increases the penalty for misclassification results and further improves the classification accuracy. Simultaneously, the cost‐sensitive awareness can accurately adjust the cost matrix through training data, thus reducing dependence on expert knowledge and improving the generalisation performance of the ATR model. This model is an end‐to‐end ATR scheme, which has been experimentally validated on the MSTAR and OpenSARship datasets. Compared to other methods, the proposed method exhibits strong robustness in dealing with various imbalanced scenarios and significant generalisation capability across different datasets.

Predictive modelling and identification of key risk factors for stroke using machine learning

Strokes are a leading global cause of mortality, underscoring the need for early detection and prevention strategies. However, addressing hidden risk factors and achieving accurate prediction become particularly challenging in the presence of imbalanced and missing data. This study encompasses three imputation techniques to deal with missing data. To tackle data imbalance, it employs the synthetic minority oversampling technique (SMOTE). The study initiates with a baseline model and subsequently employs an extensive range of advanced models. This study thoroughly evaluates the performance of these models by employing k-fold cross-validation on various imbalanced and balanced datasets. The findings reveal that age, body mass index (BMI), average glucose level, heart disease, hypertension, and marital status are the most influential features in predicting strokes. Furthermore, a Dense Stacking Ensemble (DSE) model is built upon previous advanced models after fine-tuning, with the best-performing model as a meta-classifier. The DSE model demonstrated over 96% accuracy across diverse datasets, with an AUC score of 83.94% on imbalanced imputed dataset and 98.92% on balanced one. This research underscores the remarkable performance of the DSE model, compared to the previous research on the same dataset. It highlights the model's potential for early stroke detection to improve patient outcomes.

Oversampling techniques for imbalanced data in regression

Our study addresses the challenge of imbalanced regression data in Machine Learning (ML) by introducing tailored methods for different data structures. We adapt K-Nearest Neighbor Oversampling-Regression (KNNOR-Reg), originally for imbalanced classification, to address imbalanced regression in low population datasets, evolving to KNNOR-Deep Regression (KNNOR-DeepReg) for high-population datasets. For tabular data, we also present the Auto-Inflater neural network, utilizing an exponential loss function for Autoencoders. For image datasets, we employ Multi-Level Autoencoders, consisting of Convolutional and Fully Connected Autoencoders. For such high-dimension data our approach outperforms the Synthetic Minority Oversampling Technique for Regression (SMOTER) algorithm for the IMDB-WIKI and AgeDB image datasets. For tabular data we conducted a comprehensive experiment using various models trained on both augmented and non-augmented datasets, followed by performance comparisons on test data. The outcomes revealed a positive impact of data augmentation, with a success rate of 83.75% for Light Gradient Boosting Method (LightGBM) and 71.57% for the 18 other regressors employed in the study. This success rate is determined by the frequency of instances where models performed better when augmented data was used compared to instances with no augmentation. Access to the comparative code can be found in GitHub.