Predict Diabetes Using Voting Classifier and Hyper Tuning Technique

Abstract

Today, diabetes is one of the most common chronic diseases in the world due to the people’s sedentary lifestyle which led to many health issues like heart attack, kidney frailer and blindness. Additionally, most of the people are unrealizable about the early-stage diabetes symptoms to prevent it. The above reasons were encouraging to develop a diabetes prediction system using machine learning techniques. The Pima Indian Diabetes Dataset (PIDD) was utilized for this framework as it is common and appropriate dataset in .CSV format. While there were not any duplicate or null values, however, some zero values were replaced, four outlier records were removed and data standardization were performed in the dataset. In addition, this project methodology divided into two phases of model selection. In the first phase, two different hyper parameter techniques (Randomized Search and TPOT(autoML)) were used to increase the accuracy level for each algorithm. Then six different algorithms (Logistic Regression, Decision Tree, Random Forest, K-nearest neighbor, Support Vector Machine and Naïve Bayes) were applied. In the second phase, the four best performed algorithms (with best estimated parameters for each of them) were chosen and used as an input for the voting classifier, because it applies to find the best algorithm between a group of multiple options. The result was satisfying, and Random Forest was achieved 98.69% in second stage, while its accuracy level was 81.04% in the previous one and it utilized to predict diabetes via a simple graphic user interface.