Machine Learning Algorithms Decision Tree Research Articles

An effective integrated machine learning approach for detecting diabetic retinopathy

Abstract Millions of people across the world are suffering from diabetic retinopathy. This disease majorly affects the retina of the eye, and if not identified priorly causes permanent blindness. Hence, detecting diabetic retinopathy at an early stage is very important to safeguard people from blindness. Several machine learning (ML) algorithms are implemented on the dataset of diabetic retinopathy available in the UCI ML repository to detect the symptoms of diabetic retinopathy. But, most of those algorithms are implemented individually. Hence, this article proposes an effective integrated ML approach that uses the support vector machine (SVM), principal component analysis (PCA), and moth-flame optimization techniques. Initially, the ML algorithms decision tree (DT), SVM, random forest (RF), and Naïve Bayes (NB) are applied to the diabetic retinopathy dataset. Among these, the SVM algorithm is outperformed with an average of 76.96% performance. Later, all the aforementioned ML algorithms are implemented by integrating the PCA technique to reduce the dimensions of the dataset. After integrating PCA, it is noticed that the performance of the algorithms NB, RF, and SVM is reduced dramatically; on the contrary, the performance of DT is increased. To improve the performance of ML algorithms, the moth-flame optimization technique is integrated with SVM and PCA. This proposed approach is outperformed with an average of 85.61% performance among all the other considered ML algorithms, and the classification of class labels is achieved correctly.

Breast Cancer Prediction Using Classification Techniques of Machine Learning

Abstract: Data analytics play vital roles in diagnosis and treatment in the health care sector. To enable practitioner decisionmaking, huge volumes of data should be processed with machine learning techniques to produce tools for prediction and classification Breast Cancer reports 1 million cases per year. We have proposed a prediction model, which is specifically designed for prediction of Breast Cancer using Machine learning algorithms Decision tree classifier, Naïve Bayes, SVM and KNearest Neighbour algorithms. The model predicts the type of tumour, the tumour can be benign (noncancerous) or malignant (cancerous) . The model uses supervised learning which is a machine learning concept where we provide dependent and independent columns to machine. It uses classification technique which predicts the type of tumour. Keywords: Cancer, Machine learning, Prediction, Data Visualization, SVM, Naïve Bayes, Classification.

Performance Analysis of Machine Learning and Deep Learning Architectures on Early Stroke Detection Using Carotid Artery Ultrasound Images.

Atherosclerotic plaque deposit in the carotid artery is used as an early estimate to identify the presence of cardiovascular diseases. Ultrasound images of the carotid artery are used to provide the extent of stenosis by examining the intima-media thickness and plaque diameter. A total of 361 images were classified using machine learning and deep learning approaches to recognize whether the person is symptomatic or asymptomatic. CART decision tree, random forest, and logistic regression machine learning algorithms, convolutional neural network (CNN), Mobilenet, and Capsulenet deep learning algorithms were applied in 202 normal images and 159 images with carotid plaque. Random forest provided a competitive accuracy of 91.41% and Capsulenet transfer learning approach gave 96.7% accuracy in classifying the carotid artery ultrasound image database.

A Multiple Classification Model for the Prediction of Work-Related Musculoskeletal Disorder

In recent times, musculoskeletal disorders (MSD) represent one of the most common and expensive occupational health problems in both developed and developing countries. Work-related musculoskeletal disorders (WRMSD) are impairments that are mostly caused by the workplace and immediate environment. A two-step predictive model is introduced here using KNN and Decision tree machine learning algorithms. This model for predicting WRMSD enables for early detection and correction of upper and lower back disorders, carpal tunnel syndrome and other WRMSD disorders associated with office workers. Key informant interview technique, observation of previous methods, online repository and published related works were used in data gathering. In training the model, 80% of the dataset was used while 20% was used for testing the model to prevent overfitting using python programming language. JavaScript, Hypertext preprocessor (PHP), Hypertext Markup Language (HTML), Cascading Stylesheet (CSS) and MySQL were also used to develop the front and backend of the application. The result revealed that the proposed model had 90.44% accuracy, 92.71% Recall (sensitivity), 97.16% precision, and 94.88% F1-Score. The proposed model, however, makes it easy for multiple classifications in other to predict both present and future risk of WRMSD. Performance is estimated to have high accuracy, recall, precision and f1 score in comparison to other existing algorithms.

Machine Learning Model Generation With Copula-Based Synthetic Dataset for Local Differentially Private Numerical Data

With the development of IoT technology, personal data are being collected in many places. These data can be used to create new services, but consideration must be given to the individual’s privacy. We can safely collect personal data while adding noise by applying differential privacy. However, because such data are very noisy, the accuracy of machine learning trained by the data greatly decreased. In this study, our objective is to build a highly accurate machine learning model using these data. We focus on the decision tree machine learning algorithm, and, instead of applying it as is, we use a preprocessing technique wherein pseudodata are generated using a copula while removing the effect of noise added by differential privacy. In detail, the proposed novel protocol consists of three steps: generating a covariance matrix from the differentially private numerical data, generating a discrete cumulative distribution function from differentially private numerical data, and generating copula-based numerical samples. Simulation results using synthetic and real datasets verify the utility of the proposed method not only for the decision tree algorithm but also for other machine learning algorithms such as deep neural networks. This method will help create machine learning models, such as recommendation systems, using differential privacy data.

Predicting the dimensional variation of geometries produced through FDM 3D printing employing supervised machine learning

One of the most popular techniques of Additive Manufacturing (AM) being used currently is Fused Deposition Modelling (FDM). FDM is currently a nascent technology and has significant scope for improvement, particularly when it comes to the dimensional accuracy of the printed parts. The dimensional accuracy of the parts governs the usability of the product. These products when used in assemblies need to have very tight tolerances. These tolerances play a vital role in the quality of the finished product. For FDM to become commercially viable, the ability to predict this dimensional variation caused by different print parameters is essential, it would result in improved quality of the fabricated product and saving of time and resources. In this research, we studied the impact of significant parameters on the dimensional accuracy for different geometries such as cylindrical shafts, holes and rectangular slots. Predicting the dimensional variation is accomplished by using Decision Tree Machine Learning Algorithm. This algorithm's result is most suitable and provides accurate predictions; furthermore, the effectiveness of the model developed is validated by the R2 score of 0.67, the model can be further developed to establish industry-friendly functionality.

Machine Learning Distinguishes Familiar from Unfamiliar Pairs of Subjects Performing an Eye Contact Task: A Systemic Physiology Augmented Functional Near-Infrared Spectroscopy Hyperscanning Study.

Eye contact is an important aspect of human communication and social interactions. Changes in brain and systemic physiological activity associated with interactions between humans can be measured with systemic physiology augmented functional near-infrared spectroscopy (SPA-fNIRS) hyperscanning, enabling inter-brain and inter-body synchronisation to be determined. In a previous study, we found that pairs of subjects that are socially connected show higher brain and body synchrony. To enable a deeper understanding, our aim was to build and automatically detect the best set of features to distinguish between two different groups (familiar and unfamiliar pairs). We defined several features based on the Spearman correlation and wavelet transform coherence (WTC) of biosignals measured on 23 pairs of subjects (13 familiar and 10 unfamiliar pairs) during eye contact for 10 min. Additional custom features that identify the maximum brain-to-body coupling instants between pairs were generated. After testing on combinations of different feature extraction methods, four subsets of features with the strongest discrimination power were taken into account to train a decision tree (DT) machine learning (ML) algorithm. We have obtained 95.65% classification accuracy using a leave-one-out cross-validation. The coupling features which represent the two maximum mean values resulting from the sum of 7 time-dependent WTC signals (oxyhaemoglobin concentration of the right prefrontal region, total haemoglobin concentration of the left and right prefrontal region, heart rate, electrodermal activity on the left and right wrist, and skin temperature on the right wrist) played an essential role in the classification accuracy. Training the DT-ML algorithm with combined brain and systemic physiology data provided higher accuracy than training it only with brain or systemic data alone. The results demonstrate the power of the SPA-fNIRS hyperscanning approach and the potential in applying ML to investigate the strength of social bonds in a wide range of social interaction contexts.

Identifying Coronary Artery Lesions by Feature Analysis of Radial Pulse Wave: A Case-Control Study.

Background Cardiovascular diseases have been always the most common cause of morbidity and mortality worldwide. Health monitoring of high-risk and suspected patients is essential. Currently, invasive coronary angiography is still the most direct and accurate method of determining the severity of coronary artery lesions, but it may not be the optimal clinical choice for suspected patients who had clinical symptoms of coronary heart disease (CHD) such as chest pain but no coronary artery lesion. Modern medical research indicates that radial pulse waves contain substantial pathophysiologic information about the cardiovascular and circulation systems; therefore, analysis of these waves could be a noninvasive technique for assessing cardiovascular disease. Objective The objective of this study was to analyze the radial pulse wave to construct models for assessing the extent of coronary artery lesions based on pulse features and investigate the latent value of noninvasive detection technology based on pulse wave in the evaluation of cardiovascular disease, so as to promote the development of wearable devices and mobile medicine. Method This study included 529 patients suspected of CHD who had undergone coronary angiography. Patients were sorted into a control group with no lesions, a 1 or 2 lesion group, and a multiple (3 or more) lesion group as determined by coronary angiography. The linear time-domain features and the nonlinear multiscale entropy features of their radial pulse wave signals were compared, and these features were used to construct models for identifying the range of coronary artery lesions using the k-nearest neighbor (KNN), decision tree (DT), and random forest (RF) machine learning algorithms. The average precision of these algorithms was then compared. Results (1) Compared with the control group, the group with 1 or 2 lesions had increases in their radial pulse wave time-domain features H2/H1, H3/H1, and W2 (P < 0.05), whereas the group with multiple lesions had decreases in MSE1, MSE2, MSE3, MSE4, and MSE5 (P < 0.05). (2) Compared with the 1 or 2 lesion group, the multiple lesion group had increases in T1/T (P < 0.05) and decreases in T and W1 (P < 0.05). (3) The RF model for identifying numbers of coronary artery lesions had a higher average precision than the models built with KNN or DT. Furthermore, average precision of the model was highest (80.98%) if both time-domain features and multiscale entropy features of radial pulse signals were used to construct the model. Conclusion Pulse wave signal can identify the range of coronary artery lesions with acceptable accuracy; this result is promising valuable for assessing the severity of coronary artery lesions. The technique could be used to development of mobile medical treatments or remote home monitoring systems for patients suspected or those at high risk of coronary atherosclerotic heart disease.

A Novel Hybrid Model For Automated Analysis Of Cardiotocograms Using Machine Learning Algorithms

In this study, a new hybrid model was presented for the prediction of fetal state from fetal heart rate (FHR) and the uterine contraction (UC) signals obtained from cardiotocogram (CTG) recordings.&nbsp;CTG monitoring of FHR and uterine contractions during pregnancy and delivery provides information on the physiological status of the fetus to identify hypoxia. Accurate information from these records can be used to estimate the pathological condition of the fetus. Thus, it allows early intervention by reporting any irreversible negative condition in the fetus. In this study, due to the importance of this subject, a new hybrid model was developed which can perform high rate accurate diagnosis using Machine Learning (ML) algorithms. In the hybrid model, 4 different ML algorithms (k Nearest Neighbors (k-NN), Decision Tree (DT), Naive Bayes (NB) and Support Vector Machine (SVM)) were used. While the diagnosis without the hybrid model was low, the improved hybrid model increased the accuracy by 34%. As a result of this hybrid model, 100% success was achieved for classification, test success,&nbsp;Accuracy,&nbsp;Sensitivity and&nbsp;Specificity with NB and DT ML algorithms.

The Effects of Normalization and Standardization an Internet of Things Attack Detection

It is a known fact that we live in the computer age and that many devices in the world have access to the internet. So how secure are these devices? Is there any guarantee that user information is not accessed from intruder? After the concept of the Internet of Things came into our lives, many things such as seeing the food in our home refrigerator, connecting to the Internet from the car and, and video chatting from our smart watch entered our lives. The number of malicious software is also increasing with these new connections. Researchers are increasingly emphasizing the importance of network security and intensifying their studies. Data preprocessing is very important when designing a secure system. In this study, the importance of normalization and standardization in data preprocessing is examined to make machine learning approaches more successful for detecting attacks on IoT devices. The study was carried out in Logistic Regression, Decision Tree, and Stochastic Gradient Descent machine learning algorithms using the Bot-IoT dataset. Bot-IoT dataset is a popular dataset that is widely used in security studies on IoT devices. Normalization and standardization processes were applied to Bot-IoT dataset separately, so data preprocessing was performed, then selected machine learning algorithms were trained with these -normalized / standardized- datasets. As a result of the trainings made with machine learning algorithms, the values of Accuracy, Precision, Recall and F1 Score rates were examined. And as a result of the study, it was seen that the standardization increased the accuracy rate up to 99.96% in Logistic Regression.

A Proposal of Implementation of Sitting Posture Monitoring System for Wheelchair Utilizing Machine Learning Methods.

This paper presents a posture recognition system aimed at detecting sitting postures of a wheelchair user. The main goals of the proposed system are to identify and inform irregular and improper posture to prevent sitting-related health issues such as pressure ulcers, with the potential that it could also be used for individuals without mobility issues. In the proposed monitoring system, an array of 16 screen printed pressure sensor units was employed to obtain pressure data, which are sampled and processed in real-time using read-out electronics. The posture recognition was performed for four sitting positions: right-, left-, forward- and backward leaning based on k-nearest neighbors (k-NN), support vector machines (SVM), random forest (RF), decision tree (DT) and LightGBM machine learning algorithms. As a result, a posture classification accuracy of up to 99.03 percent can be achieved. Experimental studies illustrate that the system can provide real-time pressure distribution value in the form of a pressure map on a standard PC and also on a raspberry pi system equipped with a touchscreen monitor. The stored pressure distribution data can later be shared with healthcare professionals so that abnormalities in sitting patterns can be identified by employing a post-processing unit. The proposed system could be used for risk assessments related to pressure ulcers. It may be served as a benchmark by recording and identifying individuals’ sitting patterns and the possibility of being realized as a lightweight portable health monitoring device.

A machine learning approach for classifying bird and insect radar echoes with S-band Polarimetric Weather Radar

AbstractThe S-bandWSR-88D weather radar is sensitive enough to observe biological scatterers like birds and insects. However, their non-spherical shapes and frequent collocation in the radar resolution volume create challenges in identifying their echoes. We propose a method of extracting bird (or insect) features by coherently averaging dual polarization measurements from multiple radar scans, containing bird (insect) migration. Additional features are also computed to capture aspect and range dependence, and the variation of these echoes over local regions. Next, ridge classifier and decision tree machine learning algorithms are trained, first only with the averaged dual pol inputs and then different combinations of the remaining features are added. The performance of all models for both methods, are analyzed using metrics computed from the test data. Further studies on different patterns of birds/insects, including roosting birds, bird migration and insect migration cases, are used to further investigate the generality of our models. Overall, the ridge classifier using only dual polarization variables was found to perform consistently well across all these tests. Our recommendation is that this classifier can be used operationally on the US Next-Generation Radars (NEXRAD), as a first step in classifying biological echoes. It would be used in conjunction with the existing Hydrometeor Classification Algorithm (HCA), where the HCA would first separate biological from non-biological echoes, then our algorithm would be applied to further separate biological echoes into birds and insects. To the best of our knowledge, this study is the first to train a machine learning classifier that is capable of detecting diverse patterns of bird and insect echoes, based on dual polarization variables at each range gate.

Performance comparison of machine learning algorithms for data aggregation in social internet of things

Social Internet of Things (SIoT) is a paradigm of IoT where in objects are able to build social relationship among each other based on user preferences there by creating social platform. To establish relationship, diversified IoT devices interact and setup a connection between them. The relationship is built by considering same features, attribute, device type etc. The data generated by the heterogeneous devices of SIoT devices are huge and it has to be efficiently used. There exist few works related to data aggregation in SIoT in the literature. Hence, in this work a method is proposed to aggregate the SIoT data and conditions used to classify the relationship between the devices. The performance of Decision Tree (DT), K-Nearest Neighbors (KNN), Naive Bayes (NB) and Artificial Neural Network (ANN) machine learning algorithms are tested on the dataset. The experimental results show that DT and ANN algorithms performs well compared to other ML algorithms.

Carry along or not? Decision-making on carrying standard avalanche safety gear among ski tourers in a German touring region

Ski touring is a winter sport activity that enjoys increasing popularity. Recreationists practice it exclusively without using ski lifts in the backcountry, where conditions continuously and rapidly change, and avalanche danger exists. Ski tourers can increase their own and others’ avalanche survival chances, among others, by carrying standard avalanche safety equipment (i.e., transceiver, probe, and shovel). Recent studies among backcountry recreationists identify various aspects to influence the decision to ‘carry or not’ this equipment by testing each factor individually for its statistical significance for the decision. This explorative study, in contrast, applies a new methodological approach and considers ‘carry or not’ as a decision process. The analysis bases on the behavioral decision theory and uses the machine learning algorithm decision tree to illustrate the decision process and examine the relative importance of each influencing feature. Therefore, we conduct a researcher-administered survey (n = 359) among ski tourers in a German touring region. According to their carrying behavior, this study classifies ski tourers into three different types: weather-oriented, complex, and conformist. Conformists always carry the avalanche equipment and are known in research. Weather-oriented ski tourers, who predominantly base their decision on environmental conditions (i.e., avalanche danger level and weather), are as new as the complex type, which relies on various features. In contrast to previous findings, personal traits play a subordinate role in the decision process of any type. Furthermore, we interpret environmental aspects in decision-making as decision heuristics that awareness-raising measures and education programs need to address.

Improving the Efficiency by Novel Feature Extraction Technique Using Decision Tree Algorithm Comparing with SVM Classifier Algorithm for Predicting Heart Disease

Aim: The objective of the research work is to use the two machine learning algorithms Decision Tree(DT) and Support vector machine(SVM) for detection of heart disease on earlier stages and give more accurate prediction. Materials and methods: Prediction of heart disease is performed using two machine learning classifier algorithms namely, Decision Tree and Support Vector Machine methods. Decision tree is the predictive modeling approach used in machine learning, it is a type of supervised machine learning. Support-vector machines are directed learning models with related learning calculations that break down information for order and relapse investigation. The significance value for calculating Accuracy was found to be 0.005. Result and discussion: During the process of testing 10 iterations have been taken for each of the classification algorithms respectively. The experimental results shows that the decision tree algorithm with mean accuracy of 80.257% is compared with the SVM classifier algorithm of mean accuracy 75.337% Conclusion: Based on the results achieved the Decision Tree classification algorithm better prediction of heart disease than the SVM classifier algorithm.

Textual analysis of traitor-based dataset through semi supervised machine learning

Insider threats are one of the most challenging and growing security threats which the government agencies, organizations, and institutions face. In such scenarios, malicious (red) activities are performed by the authorized individuals within the company. Because of which, an insider threat has become a taxing and difficult task to identify among other attacks. Along with other monitoring parameters; email logs play a vital role in many research areas such as stalking Insider Threat involving Collaborating Traitors, Textual Analysis, and Social Media exploration. This paper presents a semi-supervised machine learning framework which embraces the pre-processing and classification techniques together for unlabeled dataset i.e. emails. Enron Corporation dataset has been used for experiments and TWOS for evaluation of the proposed framework. Initially, dataset is transformed into vector form using Term Frequency–Inverse Document Frequency (TF–IDF). Thereafter, K-Means is used to classify emails based on message content. Finally, Machine Learning algorithm Decision Tree (DT) is applied to classify the malicious activities. The proposed framework has also been tested with other algorithms such as Logistic Regression (LR), Naive Bayes (NB), KNN, Support Vector Machine (SVM), Random Forest (RF) and Neural Network (NN). However, Decision Tree (DT) combined with pre-processing steps has given the desired results with 99.96% Accuracy and 0.994 AUC for identification of malicious content.

Predictive model construction for prediction of soil fertility using decision tree machine learning algorithm

Agriculture sector is recognized as the backbone of the Indian economy that plays a crucial role in the growth of the nation’s economy. It imparts on weather and other environmental aspects. Some of the factors on which agriculture is reliant are Soil, climate, flooding, fertilizers, temperature, precipitation, crops, insecticides, and herb. The soil fertility is dependent on these factors and hence difficult to predict. However, the Agriculture sector in India is facing the severe problem of increasing crop productivity. Farmers lack the essential knowledge of nutrient content of the soil, selection of crop best suited for the soil and they also lack efficient methods for predicting crop well in advance so that appropriate methods have been used to improve crop productivity. This paper presents different Supervised Machine Learning Algorithms such as Decision tree, K-Nearest Neighbor (KNN), Support Vector Machine (SVM) to predict the fertility of soil based on macro-nutrients and micro-nutrients status found in the dataset. Supervised Machine Learning algorithms are applied on the training dataset and are tested with the test dataset, and the implementation of these algorithms is done using R Tool. The performance analysis of these algorithms is done using different evaluation metrics like mean absolute error, cross-validation, and accuracy. Result analysis shows that the Decision tree is produced the best accuracy of 99% with a very less mean square error (MSE) rate.

Disease Prediction Using Machine Learning

Big data has a significant part in a number of businesses, but it is largely essential to the rapidly growing healthcare industry. It plays an important role by offering a large set of data points, constructing a robust system which allows for better and more accurate results in disease detection. Originally, the forecasts are made on the information accessible, but the absence of imperfect information contributes to a decrease in the caliber of precision. Besides incomplete data different qualities of particular regional diseases, which change based on their areas of origin can weaken the prediction models further. In this paper we use data mining techniques such as association rule mining, classification, clustering and finally the Decision Tree Machine learning algorithm to analyze the different kinds of general body-based illnesses. We implemented and assessed the efficacy of the Decision Tree algorithm over real-life clinical information.

Identifying metal binding amino acids based on backbone geometries as a tool for metalloprotein engineering.

Metal cofactors within proteins perform a versatile set of essential cellular functions. In order to take advantage of the diverse functionality of metalloproteins, researchers have been working to design or modify metal binding sites in proteins to rationally tune the function or activity of the metal cofactor. This study has performed an analysis on the backbone atom geometries of metal-binding amino acids among 10 different metal binding sites within the entire protein data bank. A set of 13 geometric parameters (features) was identified that is capable of predicting the presence of a metal cofactor in the protein structure with overall accuracies of up to 97% given only the relative positions of their backbone atoms. The decision tree machine-learning algorithm used can quickly analyze an entire protein structure for the presence of sets of primary metal coordination spheres upon mutagenesis, independent of their original amino acid identities. The methodology was designed for application in the field of metalloprotein engineering. A cluster analysis using the data set was also performed and demonstrated that the features chosen are useful for identifying clusters of structurally similar metal-binding sites.

Spam email detection using machine learning algorithm

Nowadays the communication between the organizations or any individuals became easier by use of Electronic mail method. The internet users are increasing rapidly day by day and also spams are increasing with the emails. It was an easy task for the spammers to create an email account and making a fake profile. Therefore, detecting of these spam mails that were fraud is of most important. This paper aims to develop a proposed approach of data science for spam email detection (SMD) using machine learning algorithm. A hybrid bagging approach is used in this proposed method for the detection of spam emails which implements the two, Naïve Bayes and J48 (i.e. decision tree) machine learning algorithms. Each of these algorithms is applied as an input with a data set which is partitioned in to different sets using the data science. Emails classification can be accomplished depends on the patterns of repetitive keywords and several additional parameters like Cc (carbon copy) or Bcc (Blind carbon copy), domain, header etc. that are present in their structure. Whenever the machine learning algorithm is applied for the email classification every one of those parameters are considered as a features. This proposed approach of data science for spam mail detection using machine learning algorithm achieved a 88.12% of overall accuracy with the hybrid bagged approach implementation.