Tree J48 Research Articles

Bone-A-Fide Breakthrough: Machine Learning Cracks the Code on Osteoporosis Treatment Using the Irish Hip Fracture Database

Abstract Background Osteoporosis is a metabolic bone disorder characterised by decreased bone mineral density and mass. Due to its asymptomatic nature, it often remains undiagnosed and untreated until a fracture occurs. Traditionally, treatment decisions for osteoporosis are based on clinical appropriateness while balancing the treatment's risks and benefits. Machine learning (ML) is revolutionising healthcare domains through pattern recognition of previously “unseen” observations. Presently, its application in osteoporosis is limited to early diagnosis. More research is needed to examine its role in guiding osteoporosis treatment. This study aims to identify new predictive attributes for osteoporosis treatment using ML techniques on data from the Irish Hip Fracture Database (IHFD). Methods Datasets from January to March 2023 in University Hospital Waterford were sourced from the IHFD. Osteoporosis treatment decisions were obtained from discharge letters. Preliminary data cleaning was performed in Excel with zero-variance and near-zero predictor. Attributes excluded. The dataset was entered into the WEKA 3.8.6 environment for ML processing. Results The initial dataset containing 141 instances and 32 attributes was refined using the Correlation Feature Selection and Ranker Search Method, identifying key osteoporosis treatment predictors. The highest correlation attributes are pre-fracture total score, pre-fracture indoor score, and age. Moderately positive correlations are discharge destination, pre-fracture outdoor and shopping score, ASA grade, Length-of-stay, admission code, Admission 4AT score, Frailty scale, and fracture type. The implemented J48 Tree ML-trained model revealed Correctly Classified Instances and Incorrectly Classified Instances of 98.24% and 1.7%, respectively, indicating a high prediction accuracy rate. Conclusion This study demonstrates the potential of ML in enhancing osteoporosis treatment decision-making by leveraging datasets from the IHFD. Integrating ML algorithms with traditional approaches can provide a comprehensive, nuanced and personal approach to osteoporosis treatment and patient care. The study opens avenues for future research in applying big data and advanced analytics in healthcare, underscoring the evolving landscape of medical decision-making.

Classification of Firewall Log Files with Different Algorithms and Performance Analysis of These Algorithms

Classifying firewall log files allows analysing potential threats and deciding on appropriate rules to prevent them. Therefore, in this study, firewall log files are classified using different classification algorithms and the performance of the algorithms are evaluated using performance metrics. The dataset was prepared using the log files of a firewall. It was filtered to make it free from any personal data and consisted of 12 attributes in total and from these attributes the action attribute was selected as the class. In the performance evaluation, Simple Cart and NB tree algorithms made the best predictions, achieving an accuracy rate of 99.84%. Decision Stump had the worst prediction performance, achieving an accuracy rate of 79.68%. As the total number of instances belonging to each of the classes in the dataset was not equal, the Matthews correlation coefficient was also used as a performance metric in the evaluations. The Simple Cart, BF tree, FT tree, J48 and NB Tree algorithms achieved the highest average values. However, although the reset-both class was not predicted successfully by the others, the Simple Cart algorithm made the best predictions for it. The values of other performance metrics used in this study also support this conclusion. Therefore, the Simple Cart algorithm is recommended for use in classifying firewall log files. However, there is a need to develop a prefiltering and parsing approach to process different log files as each firewall brand creates and maintains log files in its own format. Therefore, in this study, a novel prefiltering and parsing approach has been proposed to process log files with different structures and create structured datasets using them.

MADESANT: malware detection and severity analysis in industrial environments

Malware remains a persistent threat to industrial operations, causing disruptions and financial losses. Traditional malware detection approaches struggle with the increasing complexity of false positives and negatives. However, existing Intrusion Detection Systems (IDSs) often lack the capability to assess the severity of detected malware, crucial for effective threat mitigation. This paper presents a novel model, MAlware DEtection and Severity Analysis for eNcrypted Traffic (MADESANT), designed to detect and analyze malware severity in encrypted traffic data. MADESANT combines Deep Learning (DL)-based intrusion detection with Machine Learning (ML)-based severity analysis, specifically customized for the minutiae of IoT systems and assets. Notably, MADESANT introduces a cascading model integrating a Cascading Forward Back Propagation Neural Network (CFBPNN) with the J48 tree to systematically assess risk factors in network traffic. Our assessment, conducted on diverse encrypted datasets including UNSW-NB15, IoT23, and XIIoTID, highlights the remarkable efficacy of MADESANT. Impressively, it achieves a flawless 0% false positive rate in detecting binary attack instances, surpassing benchmarks set by conventional models. Additionally, MADESANT excels in accurately estimate malware severity, providing invaluable insights into the factors contributing to the risk. To further validate its efficiency, we compared MADESANT against prevalent Neural Network models like FeedForward and Recurrent Neural Networks, with MADESANT emerging as the superior choice. The experimentation encompasses both the entire dataset and subsets generated through meticulous risk factor analysis. These results underscore MADESANT’s prowess in not only identifying malware but also in evaluating its potential impact, signifying a significant leap forward in industrial cybersecurity.

An optimal method for diagnosing heart disease using combination of grasshopper evalutionary algorithm and support vector machines

Due to the importance of accurate diagnosis and prompt treatment of this condition, the medical world is searching for a solution for its early detection and efficient treatment. Heart disease is one of the leading causes of death in modern society. With the development of computer science today, this issue can be resolved using computers. Data mining is one of the solutions for diagnosing this illness. One of the cutting-edge disciplines, data mining, can aid in better decision-making in many areas of medicine, including disease diagnosis and treatment. In order to improve diagnosis accuracy, a combination method using the evolutionary algorithms locust and support vector machine has been tested in this study. Use should be made of heart disease. Because of the hybrid nature of this approach, normalization is actually carried out in three steps: first, by using pre-processing operations to remove unknown and outlier data from the data set; second, by using the locust evolutionary algorithm to choose the best features from the available features; and third, by classifying the data set using a support vector machine. The accuracy criterion for the proposed method compared to Niobizin methods, neural networks, and J48 trees improved by 18 %, 30 %, and 24 %, respectively, after implementing it on the data set and comparing it with other algorithms used in the field of heart disease diagnosis.

Real Estate Price Prediction: A Comprehensive Review

Abstract: The document below outlines the execution of a price prediction project for housing and real estate markets. A multitude of algorithms have been employed to enhance the accuracy of predictions. Various researchers have undertaken this project and implemented algorithms such as hedonic regression, artificial neural networks, AdaBoost, and J48 tree, which are deemed as the optimal models for price prediction. These models serve as the foundation, and with the aid of sophisticated data mining tools, algorithms like random forest, gradient boosted trees, multilayer perceptron, and ensemble learning models are utilized to achieve a higher rate of prediction accuracy. The results and evaluation of these models, facilitated by machine learning and advanced data mining tools like Weka and Rapid Miner, significantly impact price prediction.

Real Estate Price Prediction: A Comprehensive Review

Abstract: The document below outlines the execution of a price prediction project for housing and real estate markets. A multitude of algorithms have been employed to enhance the accuracy of predictions. Various researchers have undertaken this project and implemented algorithms such as hedonic regression, artificial neural networks, AdaBoost, and J48 tree, which are deemed as the optimal models for price prediction. These models serve as the foundation, and with the aid of sophisticated data mining tools, algorithms like random forest, gradient boosted trees, multilayer perceptron, and ensemble learning models are utilized to achieve a higher rate of prediction accuracy. The results and evaluation of these models, facilitated by machine learning and advanced data mining tools like Weka and Rapid Miner, significantly impact price prediction

A Review on Prediction of Heart Disease based on Machine Learning and Datamining Techniques

Heart is the important organ in human body which supplies blood to all organs of the body. The abnormal situation of heart is considered as heart disease. According to WHO data cardiovascular, respiratory and neonatal conditions are the top three causes of Deaths in the World. In the year 2019 Heart diseases occupies 16%(9 million) of overall deaths happened in World. From two decades there is 4 times increase in the deaths with heart diseases this is because of change in life style, lack of physical activity, food habits, obesity ,stress, cholesterol ,high blood pressure and diabetes.so there is a need to work on prediction of heart diseases to save many lives because prediction is the only way to prevent the disease. In this paper we will discuss about existing algorithms and existing work done in different machine learning and datamining techniques, which are concentrated more on the classification and prediction. main objective is to evaluate the performance of these algorithms and identify the most accurate and efficient approach for diagnosing heart diseases.
 Some of the machine learning and data mining techniques are Artificial Neural Network(ANN),Decision Tree, Naive Bayes, SVM(Support Vector Machine),k-Nearest Neighbours (KNN),J48,SMO,Random forest and classification Tree.

J48 Tree Classification and Simple K-Means Clusterization on the Behavior of Academic Community in Accessing Internet for Bandwidth Management Plan

<p>Abstract The purpose of the research was to review the<br />improvements in internet usage behavior by the academic<br />community at a university which consisted of favorite website<br />variables, the amount of internet bandwidth capacity used and<br />the time spent accessing the website. The research was<br />conducted in a population of 200 lecturers and 5267 students.<br />Internet bandwidth mapping is carried out using two methods of<br />the J48 tree classification algorithm and simple K-Means<br />clustering contained in the WEKA software. The results of this<br />study are for the purpose of mapping internet bandwidth,<br />determining internet service provider load balancing,<br />classification and clustering of favorite websites based on time<br />duration which can affect the use of existing internet bandwidth<br />capacity systems.</p>

The application of fluorescence spectroscopy and machine learning as non-destructive approach to distinguish two different varieties of greenhouse tomatoes

AbstractThe application of interdisciplinary non-invasive diagnostic methods combining fluorescence spectroscopy with multiple machine learning algorithms as tools for rapid application in tomato breeding programs is essential when crossing specific genotypes or parental samples to obtain representatives with better performance. Non-destructive distinguishing tomato species is of great importance for the preservation of product quality. This study aimed at combining fluorescence spectroscopic data and machine learning algorithms for distinguishing greenhouse tomatoes. The models for the discrimination of greenhouse tomato samples were built based on selected spectroscopic data using different machine learning algorithms from the groups of Meta, Functions, Bayes, Trees, Rules, and Lazy. The confusion matrices with accuracy for each sample, average accuracy, time taken to build the model, Kappa statistic, mean absolute error, root mean squared error and relative absolute error were determined. The greenhouse tomato samples were discriminated with an accuracy reaching 100% for the models built using Multi-Class Classifier (Meta), Logistic (Function), Bayes Net (Bayes), PART (Rules), and J48 (Trees). In the case of these algorithms, Kappa statistic was 1.0 and mean absolute error, root mean squared error and relative absolute error were equal to 0.

Comparative analysis of weka-based classification algorithms on medical diagnosis datasets.

With the advent of 5G and the era of Big Data, the rapid development of medical information technology around the world, the massive application of electronic medical records and cases, and the digitization of medical equipment and instruments, a large amount of data has accumulated in the database system of hospitals, which includes clinical diagnosis data and hospital management data. This study aimed to examine the classification effects of different machine learning algorithms on medical datasets so as to better explore the value of machine learning methods in aiding medical diagnosis. The classification datasets of four different medical fields in the University of California Irvine machine learning database were used as the research object. Also, six categories of classification models based on the Bayesian theorem idea, integrated learning idea, and rule-based and tree-based idea were constructed using the Weka platform. The between-group experiments showed that the Random Forest algorithm achieved the best results on the Indian liver disease patient dataset (ILPD), delivery cardiotocography (CADG), and lymphatic tractography (LYMP) datasets, followed by Bagging and partition and regression tree. In the within-group algorithm comparison experiments, the Bagging algorithm achieved better results than other algorithms based on the integration idea for 11 metrics on all datasets, mainly focusing on 2 binary datasets. Logit Boost had only 7 metrics with significant performance, and the best algorithm was Rotation Forest, with 28 metrics achieving optimal values. Among the algorithms based on tree ideas, the logistic model tree algorithm achieved optimal results on all metrics on the mammographic dataset (MAGR). The classification performance of BFTree, J48, and Random Tree was poor on each dataset. The best algorithm was Random Forest on the ILPD, CADG, and LYMP datasets with 27 metrics reaching the optimum. Machine learning algorithms have good application value in disease prediction and can provide a reference basis for disease diagnosis.

Machine Vision Approach for Identification of Four Variant Pakistani Rice Using Multi-Features Dataset

Crops are the most important and beneficial food source in Pakistan. The demand for food has been an increase in Pakistan due to population growth. Pakistan produced 7,410 million tons of rice according to the financial year survey 2020 (FYS-2020). Pakistani rice has been cultivated in 3,304 hectares of the agricultural land zone, and it is also export around the world. Rice is also increased by 0.6% Gross Domestic Product (GDP) of Pakistan (FYS-2020). The old and manual process of rice classification is more expensive and time-consuming. In this study, we describe a machine vision approach for rice identification. We use four different varieties of rice for the experimental process such as Pakei_Kaynat, Kaynat_Kauchei, and Kauchei_Super_Banaspati and Tootaa_Kauchei (P1, P2, P3, and P4). The 100 images dataset have been used for practical work and total calculated of 400 (4 x 100) image of rice. The different process has been deploying on available datasets such as introduction, preprocessing methodology, and result discussion. A quality enhancement technique has been implementing for clarifying between rice color and shape sampling, and it is also converted color image in gray scale level. Every image has been employing six different non-overlapping regions of interest (ROI’s) and calculated a total of 2400 (6 x 400) ROI’s. Binary (B), Histogram (H) and Texture (T) features have been implemented and extract 43 features on each ROI’s and total calculated 103,200 (2400 x 43) machine learning (ML) features. Best First Search (BFS) Algorithm was used for feature optimization. Different ML classifiers are implementing for experimental process namely; Function Multi-Layer-Perception, Function SMO, Random Tree, J48 Tree, Meta Classifier via Regression and Meta Bagging. The Function Multi-Layer-Perception overall accuracy (OA) has describe better accuracy result is 99.8333%.

Active Actions in the Extraction of Urban Objects for Information Quality and Knowledge Recommendation with Machine Learning.

Due to the increasing urban development, it has become important for municipalities to permanently understand land use and ecological processes, and make cities smart and sustainable by implementing technological tools for land monitoring. An important problem is the absence of technologies that certify the quality of information for the creation of strategies. In this context, expressive volumes of data are used, requiring great effort to understand their structures, and then access information with the desired quality. This study are designed to provide an initial response to the need for mapping zones in the city of Itajaí (SC), Brazil. The solution proposes to aid object recognition employing object-based classifiers OneR, NaiveBayes, J48, IBk, and Hoeffding Tree algorithms used together with GeoDMA, and a first approach in the use of Region-based Convolutional Neural Network (R-CNN) and the YOLO algorithm. All this is to characterize vegetation zones, exposed soil zones, asphalt, and buildings within an urban and rural area. Through the implemented model for active identification of geospatial objects with similarity levels, it was possible to apply the data crossover after detecting the best classifier with accuracy (85%) and the kappa agreement coefficient (76%). The case study presents the dynamics of urban and rural expansion, where expressive volumes of data are obtained and submitted to different methods of cataloging and preparation to subsidize rapid control actions. Finally, the research describes a practical and systematic approach, evaluating the extraction of information to the recommendation of knowledge with greater scientific relevance. Allowing the methods presented to apply the calibration of values for each object, to achieve results with greater accuracy, which is proposed to help improve conservation and management decisions related to the zones within the city, leaving as a legacy the construction of a minimum technological infrastructure to support the decision.

EnHAT — Synergy of a tree-based Ensemble with Hoeffding Adaptive Tree for dynamic data streams mining

The goal of this paper is to improve the predictive accuracy of data streaming algorithms without increasing the processing time of the incoming data. We propose the EnHAT (Ensemble Combined with Hoeffding Adaptive Tree) algorithm, which combines the state-of-the-art Hoeffding Adaptive Tree (HAT) algorithm with an ensemble of J48 decision trees induced from sequential chunks of the data stream. The slack time of HAT adaptation to a new window of incoming records is utilized in parallel for building a decision-tree ensemble. In our experiments on 4 benchmark streaming datasets and 4 synthetic datasets with different types of concept drift, EnHAT has reached the highest predictive accuracy in 23 out of 26 cases compared to an ensemble of J48 trees, HAT, and a single J48 model induced from the last sliding window. Thus, we can conclude that the ensemble/HAT synergy yields better prediction results than each one of the two approaches on its own. The higher accuracy does not come at the expense of any additional computational effort beyond the model induction times of the combined algorithms.

Dynamic Ransomware Detection for Windows Platform Using Machine Learning Classifiers

In this world of growing technological advancements, ransomware attacks are also on the rise. This threat often affects the finance of individuals, organizations, and financial sectors. In order to effectively detect and block these ransomware threats, the dynamic analysis strategy was proposed and carried out as the approach of this research. This paper aims to detect ransomware attacks with dynamic analysis and classify the attacks using various machine learning classifiers namely: Random Forest, Naïve Bayes, J48, Decision Table and Hoeffding Tree. The TON IoT Datasets from the University of New South Wales' (UNSW) were used to capture ransomware attack features on Windows 7. During the experiment, a testbed was configured with numerous virtual Windows 7 machines and a single attacker host to carry out the ransomware attack. A total of 77 classification features are selected based on the changes before and after the attack. Random Forest and J48 classifiers outperformed other classifiers with the highest accuracy results of 99.74%. The confusion matrix highlights that both Random Forest and J48 classifiers are able to accurately classify the ransomware attacks with the AUC value of 0.997 respectively.  Our experimental result also suggests that dynamic analysis with machine learning classifier is an effective solution to detect ransomware with the accuracy percentage exceeds 98%.

Brain Tumor Classification Based on Hybrid Optimized Multi-features Analysis Using Magnetic Resonance Imaging Dataset

ABSTRACT Brain tumors are deadly but become deadliest because of delayed and inefficient diagnosis process. Large variations in tumor types also instigate additional complexity. Machine vision brain tumor diagnosis addresses the problem. This research’s objective was to develop a brain tumor classification model based on machine vision techniques using brain Magnetic Resonance Imaging (MRI). For this purpose, a novel hybrid-brain-tumor-classification (HBTC) framework was designed and evaluated for the classification of cystic (cyst), glioma, meningioma (menin), and metastatic (meta) brain tumors. The proposed framework lessens the inherent complexities and boosts performance of the brain tumor diagnosis process. The brain MRI dataset was input to the HBTC framework, pre-processed, segmented to localize the tumor region. From the segmented dataset Co-occurrence matrix (COM), run-length matrix (RLM), and gradient features were extracted. After the application of hybrid multi-features, the nine most optimized features were selected and input to the framework’s classifiers, namely multilayer perception (MLP), J48, meta bagging (MB), and random tree (RT) to classify cyst, glioma, menin, and meta tumors. Maximum brain tumor classification performance achieved by the HBTC framework was 98.8%. The components and performance of the proposed framework show that it is a novel and robust classification framework.

A federated approach to Android malware classification through Perm-Maps

In the last decades, mobile-based apps have been increasingly used in several application fields for many purposes involving a high number of human activities. Unfortunately, in addition to this, the number of cyber-attacks related to mobile platforms is increasing day-by-day. However, although advances in Artificial Intelligence science have allowed addressing many aspects of the problem, malware classification tasks are still challenging. For this reason, the following paper aims to propose new special features, called permission maps (Perm-Maps), which combine information related to the Android permissions and their corresponding severity levels. Such features have proven to be very effective in classifying different malware families through the usage of a convolutional neural network. Also, the advantages introduced by the Perm-Maps have been enhanced by a training process based on a federated logic. Experimental results show that the proposed approach achieves up to a 3% improvement in average accuracy with respect to J48 trees and Naive Bayes classifier, and up to 16% compared to multi-layer perceptron classifier. Furthermore, the combined use of Perm-Maps and federated logic allows dealing with unbalanced training datasets with low computational efforts.

Fish survival prediction in an aquatic environment using random forest model

In the real world, it is very difficult for fish farmers to select the perfect fish species for aquaculture in a specific aquatic environment. The main goal of this research is to build a machine learning that can predict the perfect fish species in an aquatic environment. In this paper, we have utilized a model using random forest (RF). To validate the model, we have used a dataset of aquatic environment for 11 different fishes. To predict the fish species, we utilized the different characteristics of aquatic environment including pH, temperature, and turbidity. As a performance metrics, we measured accuracy, true positive (TP) rate, and kappa statistics. Experimental results demonstrate that the proposed RF-based prediction model shows accuracy 88.48%, kappa statistic 87.11% and TP rate 88.5% for the tested dataset. In addition, we compare the proposed model with the state-of-art models J48, RF, k-nearest neighbor (k-NN), and classification and regression trees (CART). The proposed model outperforms than the existing models by exhibiting the higher accuracy score, TP rate and kappa statistics.

A Hybrid Approach for the Analysis of Feature Selection using Information Gain and BAT Techniques on The Anomaly Detection

Every day, millions of people in many institutions communicate with each other on the Internet. The past two decades have witnessed unprecedented levels of Internet use by people around the world. Almost alongside these rapid developments in the internet space, an ever increasing incidence of attacks carried out on the internet has been consistently reported every minute. In such a difficult environment, Anomaly Detection Systems (ADS) play an important role in monitoring and analyzing daily internet activities for security breaches and threats. However, the analytical data routinely generated from computer networks are usually of enormous size and of little use. This creates a major challenge for ADSs, who must examine all the functionality of a certain dataset to identify intrusive patterns. The selection of features is an important factor in modeling anomaly-based intrusion detection systems. An irrelevant characteristic can lead to overfitting which in turn negatively affects the modeling power of classification algorithms. The objective of this study is to analyze and select the most discriminating input characteristics for the construction of efficient and computationally efficient schemes for an ADS. In the first step, a heuristic algorithm called IG-BA is proposed for dimensionality reduction by selecting the optimal subset based on the concept of entropy. Then, the relevant and meaningful features are selected, before implementing Number of Classifiers which includes: (1) An irrelevant feature can lead to overfitting which in turn negatively affects the modeling power of the classification algorithms. Experiment was done on CICIDS-2017 dataset by applying (1) Random Forest (RF), (2) Bayes Network (BN), (3) Naive Bayes (NB), (4) J48 and (5) Random Tree (RT) with results showing better detection precision and faster execution time. The proposed heuristic algorithm outperforms the existing ones as it is more accurate in detection as well as faster. However, Random Forest algorithm emerges as the best classifier for feature selection technique and scores over others by virtue of its accuracy in optimal selection of features.

Rockburst Hazard Prediction in Underground Projects Using Two Intelligent Classification Techniques: A Comparative Study

Rockburst is a complex phenomenon of dynamic instability in the underground excavation of rock. Owing to the complex and unclear rockburst mechanism, it is difficult to accurately predict and reasonably assess the rockburst potential. With the increasing availability of case histories from rock engineering and the advancement of data science, the data mining algorithms provide a good way to predict complex phenomena, like rockburst potential. This paper investigates the potential of J48 and random tree algorithms to predict the rockburst classification ranks using 165 cases, with four parameters, namely maximum tangential stress of surrounding rock, uniaxial compressive strength, uniaxial tensile strength, and strain energy storage index. A comparison of developed models’ performances reveals that the random tree gives more reliable predictions than J48 and other empirical models (Russenes criterion, rock brittleness coefficient criterion, and artificial neural networks). Similar comparisons with convolutional neural network resulted at par performance in modeling the rockburst hazard data.

Application of Data Mining Techniques on Tourist Expenses in Malaysia

Tourism plays an important role in Malaysia’s economic development as it can boost business opportunity in its surrounding economic. By apply data mining on tourism data for predicting the area of business opportunity is a good choice. Data mining is the process that takes data as input and produces outputs knowledge. Due to the population of travelling in Asia country has increased in these few years. Many entrepreneurs start their owns business but there are some problems such as wrongly invest in the business fields and bad services quality which affected their business income. The objective of this paper is to use data mining technology to meet the business needs and customer needs of tourism enterprises and find the most effective data mining technology. Besides that, this paper implementation of 4 data mining classification techniques was experimented for extracting important insights from the tourism data set. The aims were to find out the best performing algorithm among the compared on the results to improve the business opportunities in the fields related to tourism. The results of the 4 classifiers correctly classifier the attributes were JRIP (84.09%), Random Tree (83.66%), J48 (85.50%), and REP Tree (82.47%). All the results will be analyzed and discussed in this paper.