Diabetes Dataset Research Articles

استكشاف تقنيات الذكاء الاصطناعي القابلة للتفسير: الأساليب والتحديات والتطبيقات

This research paper delves into the transformative domain of Explainable Artificial Intelligence (XAI) in response to the evolving complexities of artificial intelligence and machine learning. Navigating through XAI approaches, challenges, applications, and future directions, the paper emphasizes the delicate balance between model accuracy and interpretability. Challenges such as the trade-off between accuracy and interpretability, explaining black-box models, privacy concerns, and ethical considerations are comprehensively addressed. Real-world applications showcase XAI's potential in healthcare, finance, criminal justice, and education. The evaluation of XAI models, exemplified through a Random Forest Classifier in a diabetes dataset, underscores the practical implications. Looking ahead, the paper outlines future directions, emphasizing ensemble explanations, standardized evaluation metrics, and human-centric designs. It concludes by advocating for the widespread adoption of XAI, envisioning a future where AI systems are not only powerful but also transparent, fair, and accountable, fostering trust and understanding in the human-AI interaction. Keywords: Explainable Artificial Intelligence (XAI), machine learning, transparency, accountability, AI models, interpretability, challenges, XAI applications, model evaluation, bias detection, user comprehension, ethical alignment.

E-Diagnostic system for diabetes disease prediction on an IoMT environment-based hyper AdaBoost machine learning model

One of the most fatal and serious diseases that humans have encountered is diabetes, an illness affecting thousands of individuals yearly. In this era of digital systems, diabetes prediction based on machine learning (ML) is gaining high momentum. One of the benefits of treating patients early in the course of their noncommunicable diseases (NCDs) is that they can avoid costly therapies when the illness worsens later in life. Incidentally, diabetes is complicated by the dearth of medical professionals in underserved areas, such as distant rural communities. In these situations, the Internet of Medical Things and machine learning (ML) models can be used to offer healthcare practitioners the necessary prediction tools to more effectively and timely make decisions, thus assisting the early identification and diagnosis of NCDs. In this study, four conventional and hyper-AdaBoost ML models were trained and tested on the PIMA Indian Diabetes dataset. Patients with diabetes were classified on the basis of laboratory findings. Pre-processing tasks, such as the handling of imbalanced data and missing values, were performed prior to feature importance and normalisation activities. The algorithm with the best performance was examined using precision, accuracy, F1, recall and area under the curve metrics. Then, all ML models were hyper parametrically tuned via grid search to optimise their performance and reduce their error times. The decision process was also evaluated to further enhance the models. The AdaBoost-ET model performed even when features were not selected for binary classification. The model proposed in this study can predict diabetes with unprecedented high accuracy compared with the models in previous studies.

An Improved Ensemble Machine Learning Approach for Diabetes Diagnosis

Diabetes is recognized as one of the most detrimental diseases worldwide, characterized by elevated levels of blood glucose stemming from either insulin deficiency or decreased insulin efficacy. Early diagnosis of diabetes enables patients to initiate treatment promptly, thereby minimizing or eliminating the risk of severe complications. Although years of research in computational diagnosis have demonstrated that machine learning offers a robust methodology for predicting diabetes, existing models leave considerable room for improvement in terms of accuracy. This paper proposes an improved ensemble machine learning approach using multiple classifiers for diabetes diagnosis based on the Pima Indians Diabetes Dataset (PIDD). The proposed ensemble voting classifier amalgamates five machine learning algorithms: Decision Tree (DT), Logistic Regression (LR), K-Nearest Neighbor (KNN), Random Forests (RF), and XGBoost. We obtained the individual model accuracies and used the ensemble method to improve accuracy. The proposed approach uses a pre-processing stage of standardization and imputation and applies the Local Outlier Factor (LOF) to remove data anomalies. The model was evaluated using sensitivity, specificity, and accuracy criteria. With a reported accuracy of 81%, the proposed approach shows promise compared to prior classification techniques.

A Cloud-Connected Digital System for Type-1 Diabetes Prediction using Time Series LSTM Model

Abstract Millions of people worldwide suffer from diabetes, a medical condition that is spreading at an accelerating pace. Numerous studies show that risk factors that may arise from diabetes can be avoided if the disease is detected early. The health-care monitoring system has benefited greatly from early diabetes prediction made possible by the integration of Deep Learning (DL) and Machine Learning (ML) algorithms. The objective of many early studies was to increase the prediction model accuracy. However, DL algorithms often cannot fully exploit the potential of the available datasets because they are too small. This study includes a very accurate DL model as well as a novel system that integrates cloud services and allows users to directly enhance an existing data set, which can increase the accuracy of DL techniques. Therefore, the Long Short-Term Memory (LSTM) model with controller is chosen for efficient type-1 diabetes prediction. Experimental validation of the proposed Nonlinear Model Predictive Control (NMPC)_LSTM algorithm method is compared with other conventional DL algorithms. The proposed controller method achieves excellent blood glucose set point tracking and the proposed algorithms achieves 98.95% accuracy for the obtained data. It outperforms other existing methods with an increase in percentage accuracy compared to the Benchmark Pima Indian Diabetes Datasets (PIDD).

Application of C4.5 Algorithm Using Synthetic Minority Oversampling Technique (SMOTE) and Particle Swarm Optimization (PSO) for Diabetes Prediction

Abstract. Diabetes is the fourth or fifth leading cause of death in most developed countries and an epidemic in many developing countries. Early detection can be a preventive measure that uses a set of existing data to be processed through data mining with a classification process. Purpose: Investigate the efficacy of integrating the C4.5 algorithm with Synthetic Minority Oversampling Technique (SMOTE) and Particle Swarm Optimization (PSO) for improving the accuracy of diabetes prediction models. By employing SMOTE, the study aims to address the class imbalance issue inherent in diabetes datasets, which often contain significantly fewer instances of positive cases (diabetes) than negative cases (non-diabetes). Furthermore, by incorporating PSO, the research seeks to optimize the decision tree construction process within the C4.5 algorithm, enhancing its ability to discern complex patterns and relationships within the data. Methods/Study design/approach: This study proposes the use of the C4.5 classification algorithm by applying the synthetic minority oversampling technique (SMOTE) and particle swarm optimization (PSO) to overcome problems in the diabetes dataset, namely the Pima Indian Diabetes Database (PIDD). Result/Findings: From the research results, the accuracy obtained in applying the C4.5 algorithm without the preprocessing process is 75.97%, while the results of the SMOTE application of the C4.5 algorithm are 80%. Meanwhile, applying the C4.5 algorithm using SMOTE and PSO produces the highest accuracy, with 82.5%. This indicates an increase of 6.53% from the classification results using the C4.5 algorithm. Novelty/Originality/Value: This research contributes novelty by proposing a hybrid approach that combines the C4.5 decision tree algorithm with two advanced techniques, Synthetic Minority Oversampling Technique (SMOTE) and Particle Swarm Optimization (PSO), for the prediction of diabetes. While previous studies have explored the application of machine learning algorithms for diabetes prediction, few have examined the synergistic effects of integrating SMOTE and PSO with the C4.5 algorithm specifically.

Diabetes Disease Detection Classification Using Light Gradient Boosting (LightGBM) With Hyperparameter Tuning

Diabetes is a condition caused by an imbalance between the need for insulin in the body and insufficient insulin production by the pancreas, causing an increase in blood sugar concentration. This study aims to find the best classification performance on diabetes datasets with the LightGBM method. The dataset used consists of 768 rows and 9 columns, with target values of 0 and 1. In this study, resampling is applied to overcome data imbalance using SMOTE and perform hyperparameter optimization. Model evaluation is performed using confusion matrix and various metrics such as accuracy, recall, precision and f1-score. This research conducted several tests. In hyperparameter optimization tests using GridSearchCV and RandomSearchCV, the LightGBM method showed good performance. In tests that apply data resampling, the LightGBM method achieves the highest accuracy, namely the LightGBM method with GridSearchCV optimization with the highest accuracy reaching 84%, while LightGBM with RandomSearchCV optimization reaches 82% accuracy.

A heuristic‐based hybrid sampling method using a combination of SMOTE and ENN for imbalanced health data

AbstractHealth datasets often exhibit class imbalance, with healthy individuals being the majority class and patients being the minority class. As in many applications, machine learning methods are frequently used in the prediction and detection of diseases. The class imbalance presents a significant challenge for machine learning classifiers, particularly in their ability to accurately and effectively classify data from minority and majority classes. Therefore, data preprocessing is crucial before classifying the imbalanced data. In this study, we present GASMOTEPSO_ENN method that combines the synthetic minority oversampling technique (SMOTE) and edited nearest neighbour (ENN) algorithms using genetic algorithm (GA) and particle swarm optimization (PSO) heuristics as a preprocessing method to classify the imbalanced health datasets. In the experiments, chronic kidney disease (CKD), cerebral stroke prediction (CSP), and PIMA Indian diabetes (PID) datasets were utilized to assess the performance of the proposed method with metrics derived from the confusion matrix. The GASMOTEPSO_ENN method can classify the various diseases into different two classes of patients and healthy individuals with acceptable Matthews correlation coefficient (MCC) metric using the machine learning algorithms (Logistic regression (LR) 1.00 for CKD dataset, extreme gradient boosting (XGBoost) 0.94 for CSP dataset, and support vector machine (SVM) 0.87 for PID dataset). Moreover, the proposed method also performed well with other metrics in all datasets, and the analysis of the model results in relation to existing literature reveals that the proposed model demonstrably produces superior results.

An intelligent diabetes classification and perception framework based on ensemble and deep learning method.

Sugar in the blood can harm individuals and their vital organs, potentially leading to blindness, renal illness, as well as kidney and heart diseases. Globally, diabetic patients face an average annual mortality rate of 38%. This study employs Chi-square, mutual information, and sequential feature selection (SFS) to choose features for training multiple classifiers. These classifiers include an artificial neural network (ANN), a random forest (RF), a gradient boosting (GB) algorithm, Tab-Net, and a support vector machine (SVM). The goal is to predict the onset of diabetes at an earlier age. The classifier, developed based on the selected features, aims to enable early diagnosis of diabetes. The PIMA and early-risk diabetes datasets serve as test subjects for the developed system. The feature selection technique is then applied to focus on the most important and relevant features for model training. The experiment findings conclude that the ANN exhibited a spectacular performance in terms of accuracy on the PIMA dataset, achieving a remarkable accuracy rate of 99.35%. The second experiment, conducted on the early diabetes risk dataset using selected features, revealed that RF achieved an accuracy of 99.36%. Based on our experimental results, it can be concluded that our suggested method significantly outperformed baseline machine learning algorithms already employed for diabetes prediction on both datasets.

Prediksi Diabetes Menggunakan Algoritma Naive Bayes Menggunakan Rapidminer

Diabetes, the fastest-growing life-threatening disease, presents significant global health challenges, with 3.8 million annual deaths and affecting 422 million individuals worldwide. This study employs RapidMiner, a popular data mining tool, to analyze a public diabetes dataset. Addressing common dataset challenges such as extraneous features, efficient feature selection, and algorithm implementation, the research introduces a novel approach utilizing the Naive Bayes algorithm. Despite inherent complexities, the Naive Bayes model achieves a commendable accuracy rate of 75.51%, showcasing its applicability in diabetic data analysis within the RapidMiner environment. This research sheds light on the potential of integrating RapidMiner and data mining techniques to advance our understanding and management of diabetes-related data, thereby contributing to improved healthcare outcomes and patient well-being.

Comparative analysis of machine learning algorithms for Diabetes Mellitus prediction

Type II Diabetes Mellitus (T2DM) has become an increasingly prevalent disease due to the rising number of the obese population. Even though this disorder is the leading cause of more severe health complications, studies have shown that T2DM is largely preventable if detected in an early phase. To improve current diagnosis and prognosis procedures, this study aims to examine three machine learning algorithmsK-Nearest Neighbor (KNN), Random Forest (RF), and Support Vector Classification (SVC)and their potential in making accurate predictions on the outcomes of the Pima Indians Diabetes Dataset (PIDD). After training and 5-fold cross validation, the results show that the RF algorithm has the highest accuracy at 75.25%, followed by SVC at 74.91% and KNN at 71.01%. In addition, feature importances were evaluated for all three models, yet we observed a drastic difference in the top-ranked features across different models, which implies that more training and larger datasets are necessary before realizing these computational approaches into practice. Nevertheless, the potential of these approaches highlighted in this study demonstrated that machine learning is a burgeoning strategy in clinical use and in solving real-world problems.

Modelling of Diabetic Cases for Effective Prevalence Classification

INTRODUCTION: This study compares and contrasts various machine learning algorithms for predicting diabetes. The study of current research work is to analyse the effectiveness of various machine learning algorithms for diabetes prediction.
 OBJECTIVES: To compare the efficacy of various machine learning algorithms for diabetic prediction.
 METHODS: For the same, a diabetic dataset was subjected to the application of various well-known machine learning algorithms. Unbalanced data was handled by pre-processing the dataset. The models were subsequently trained and assessed using different performance metrics namely F1-score, accuracy, sensitivity, and specificity.
 RESULTS: The experimental results show that the Decision Tree and ensemble model outperforms all other comparative models in terms of accuracy and other evaluation metrics.
 CONCLUSION: This study can help healthcare practitioners and researchers to choose the best machine learning model for diabetes prediction based on their specific needs and available data.

Predicting Diabetes Mellitus with Machine Learning Techniques

This study addresses the challenge of accurately identifying diabetes mellitus in individuals. Utilizing accessible online and real-world diagnostic data, we employ machine learning models, including Support Vector Machine, Random Forest, Naïve Bayes, eXtreme Gradient Boosting, and Deep Neural Network, on the PIMA Indian Diabetes and NHANES 1999-2016 datasets. Rigorous data pre-processing steps were conducted, handling null values, outliers, and imbalanced data together with data normalization. Our results reveal that the RF model achieves a 79% accuracy for binary classification on the PIMA Indian Diabetes dataset, using a 60:40 train-test split with BORUTA selected features. Meanwhile, the XGBoost model excels on the NHANES 1999-2016 dataset, achieving 92% accuracy for binary and 91% for multiclass classification respectively.

Using Generative AI to Improve the Performance and Interpretability of Rule-Based Diagnosis of Type 2 Diabetes Mellitus

Introduction: Type 2 diabetes mellitus is a major global health concern, but interpreting machine learning models for diagnosis remains challenging. This study investigates combining association rule mining with advanced natural language processing to improve both diagnostic accuracy and interpretability. This novel approach has not been explored before in using pretrained transformers for diabetes classification on tabular data. Methods: The study used the Pima Indians Diabetes dataset to investigate Type 2 diabetes mellitus. Python and Jupyter Notebook were employed for analysis, with the NiaARM framework for association rule mining. LightGBM and the dalex package were used for performance comparison and feature importance analysis, respectively. SHAP was used for local interpretability. OpenAI GPT version 3.5 was utilized for outcome prediction and interpretation. The source code is available on GitHub. Results: NiaARM generated 350 rules to predict diabetes. LightGBM performed better than the GPT-based model. A comparison of GPT and NiaARM rules showed disparities, prompting a similarity score analysis. LightGBM’s decision making leaned heavily on glucose, age, and BMI, as highlighted in feature importance rankings. Beeswarm plots demonstrated how feature values correlate with their influence on diagnosis outcomes. Discussion: Combining association rule mining with GPT for Type 2 diabetes mellitus classification yields limited effectiveness. Enhancements like preprocessing and hyperparameter tuning are required. Interpretation challenges and GPT’s dependency on provided rules indicate the necessity for prompt engineering and similarity score methods. Variations in feature importance rankings underscore the complexity of T2DM. Concerns regarding GPT’s reliability emphasize the importance of iterative approaches for improving prediction accuracy.

Comparative Analysis of Diabetic Prediction Using Machine Learning Algorithms

Diabetes mellitus (DM) is a severe worldwide health problem, and its prevalence is quickly growing. It is a spectrum of metabolic illnesses definite by continually increased blood glucose levels. Undiagnosed diabetes can lead to a variety of difficulties, including retinopathy, nephropathy, neuropathy, and other vascular abnormalities. In this context, machine learning (ML) technologies may be mainly useful for early disease identification, diagnosis, and therapy monitoring. The core idea of this study is to detect the strong ML algorithm to forecast it. For this numerous ML algorithms were chosen i.e., support vector machine (SVM), Naïve Bayes (NB), K nearest neighbor (KNN), random forest (RF), logistic regression (LR), and decision tree (DT), according to this work. Two, Pima Indian diabetic (PID) and Germany diabetes datasets were used and the research was implemented using Waikato environment for knowledge analysis (WEKA) 3.8.6 tool. This research discussed performance matrices and error rates of classifiers for both datasets. The outcomes showed that for the PID database (PIDD), SVM works improved with an accuracy of 74% whereas for Germany RF and KNN work improved with 98.7% accuracy. This study can helps healthcare facilities and researchers in understanding the value and application of ML algorithms in predicting diabetes at an initial stage

Analyzing the behavior of different classification algorithms in diabetes prediction

<span lang="EN-US">Diabetes is one of the deadliest diseases in the world that can lead to stroke, blindness, organ failure, and amputation of lower limbs. Researches state that diabetes can be controlled if it is detected at an early stage. Scientists are becoming more interested in classification algorithms in diagnosing diseases. In this study, we have analyzed the performance of five classification algorithms namely naïve Bayes, support vector machine, multi layer perceptron artificial neural network, decision tree, and random forest using diabetes dataset that contains the information of 2000 female patients. Various metrics were applied in evaluating the performance of the classifiers such as precision, area under the curve (AUC), accuracy, receiver operating characteristic (ROC) curve, f-measure, and recall. Experimental results show that random forest is better than any other classifier in predicting diabetes with a 90.75% accuracy rate.</span>

Hybrid Crow Search and RBFNN: A Novel Approach to Medical Data Classification

The Radial Basis Function Neural Network (RBFNN) is frequently employed in artificial neural networks for diverse classification tasks, yet it encounters certain limitations, including issues related to network latency and local minima. To tackle these challenges, researchers have explored various algorithms to enhance learning performance and alleviate local minima problems. This study introduces a novel approach that integrates the Crow Search Algorithm (CSA) with RBFNN to augment the learning process and address the local minima issue associated with RBFNN. The study evaluates the performance of this innovative model by comparing it to state-of-the-art models like Flower-pollination-RBNN (FP-NN), Artificial Neural Network (ANN), and the conventional RBFNN. To assess the efficacy of the proposed model, the study employs specific datasets, such as the Breast Cancer and Thyroid Disease datasets from the UCI Machine Repository. The simulation results illustrate that the proposed model surpasses other models in terms of accuracy, exhibiting lower Mean Squared Error (MSE) and Mean Absolute Error (MAE) values. Specifically, for the Breast Cancer dataset, the proposed model attains an accuracy of 99.9693%, MSE of 0.000307024, and MAE of 0.00789449. Likewise, for the Thyroid Disease dataset, the proposed model achieves an accuracy of 99.9535%, along with MSE of 0.000464932 and MAE of 0.0057098. For the diabetes dataset, the proposed model demonstrates an accuracy of 98.8073%, MSE of 0.003024, and MAE of 0.009449. In summary, this analysis underscores the enhanced accuracy and effectiveness of the proposed model when compared to traditional approaches.

Toward reliable diabetes prediction: Innovations in data engineering and machine learning applications.

Diabetes is a metabolic disorder that causes the risk of stroke, heart disease, kidney failure, and other long-term complications because diabetes generates excess sugar in the blood. Machine learning (ML) models can aid in diagnosing diabetes at the primary stage. So, we need an efficient ML model to diagnose diabetes accurately. In this paper, an effective data preprocessing pipeline has been implemented to process the data and random oversampling to balance the data, handling the imbalance distributions of the observational data more sophisticatedly. We used four different diabetes datasets to conduct our experiments. Several ML algorithms were used to determine the best models to predict diabetes faultlessly. The performance analysis demonstrates that among all ML algorithms, random forest surpasses the current works with an accuracy rate of 86% and 98.48% for Dataset 1 and Dataset 2; extreme gradient boosting and decision tree surpass with an accuracy rate of 99.27% and 100% for Dataset 3 and Dataset 4, respectively. Our proposal can increase accuracy by 12.15% compared to the model without preprocessing. This excellent research finding indicates that the proposed models might be employed to produce more accurate diabetes predictions to supplement current preventative interventions to reduce the incidence of diabetes and its associated costs.

Predicting Diabetes Disease Occurrence Using Logistic Regression: An Early Detection Approach

Diabetes disease is prevalent worldwide, and predicting its progression is crucial. Several model have beenproposed to predict such disease. Those models only determine the disease label, leaving the likelihood of developing the diseaseunclear. Proposing a model for predicting the progression of disease becomes essential. Therefore, this article proposes a logisticregression model to anticipate the likelihood of Diabetes syndrome incidence. The model exploit capabilities of logistic regressionby using sigmoid function. The model's performance was evaluated using the Pima Indians Diabetes dataset and demonstratedhigh accuracy, sensitivity, and specificity. The prediction accuracy rate was 77.6%, with a sensitivity of 72.4%, specificity of79.6%, Type I Error of 27.6%, and Type II Error of 20.4%. Furthermore, the model indicates the feasibility of using laboratorytests, such as Pregnancies, Glucose, Blood Pressure, BMI, and DiabetesPedigreeFunction, to predict disease progress. Theproposed model can aid patients and physicians in understanding the disease's progression and implementing timely interventions

On the Improvements of the Performance of Bayes-Net Classification for Diagnosis of Diabetes: A Cross-validation Approach

Introduction: This study intends to support medical professionals in the early and precise detection and diagnosis of type1 and type2 Diabetes. Many complexities occur if Diabetes is unidentified and remains untreated. 9.3% of individuals worldwide have Diabetes as of 2019, according to data from the World Health Organization. The anticipated increase would be close to 11% of the global population by 2045. Diabetes mellitus is a chronic, one of the deadliest diseases that causes Body blood glucose levels to be above average level knowing a blood sugar. Diabetes can be type1 (T1D) and type2(T2D). An autoimmune condition called Type 1 diabetes is frequently found in young children. Adults are frequently diagnosed with type 2 diabetes, which is not autoimmune. A branch of artificial intelligence called machine learning has the potential to be successful in the field of predictions. Method: This research aims to design a machine learning model to predict Diabetes in a patient. The collective performance of the four algorithms is evaluated on various measures like accuracy, precision, sensitivity, and specificity. T Result: For experiments, a standard PIMA Indian diabetes dataset is used. According to the results, Bayes-Net performs better than other algorithms, with an accuracy rate of 87.72%. Conclusion: Diabetes Mellitus may harm kidneys, nerves, eyes, and other organs if it is not diagnosed in time. Therefore, early diagnosis and treatment could save countless lives. The process is tedious because patients visit a diagnostic facility and see a doctor, but various machine learning and deep learning approaches solve this clinical problem earlier.

A novel machine learning approach for diagnosing diabetes with a self-explainable interface

This study introduces the first-ever self-explanatory interface for diagnosing diabetes patients using machine learning. We propose four classification models (Decision Tree (DT), K-nearest Neighbor (KNN), Support Vector Classification (SVC), and Extreme Gradient Boosting (XGB)) based on the publicly available diabetes dataset. To elucidate the inner workings of these models, we employed the machine learning interpretation method known as Shapley Additive Explanations (SHAP). All the models exhibited commendable accuracy in diagnosing patients with diabetes, with the XGB model showing a slight edge over the others. Utilising SHAP, we delved into the XGB model, providing in-depth insights into the reasoning behind its predictions at a granular level. Subsequently, we integrated the XGB model and SHAP’s local explanations into an interface to predict diabetes in patients. This interface serves a critical role as it diagnoses patients and offers transparent explanations for the decisions made, providing users with a heightened awareness of their current health conditions. Given the high-stakes nature of the medical field, this developed interface can be further enhanced by including more extensive clinical data, ultimately aiding medical professionals in their decision-making processes.