Tree-based Machine Learning Algorithms Research Articles

An investigation using resampling techniques and explainable machine learning to minimize fire losses in residential buildings

Urban residential fires seriously threaten public safety, causing significant property damage and severely impacting urban sustainability. To enhance the understanding of urban residential fire risks, a framework that combines tree-based machine learning algorithms and resampling techniques is proposed to predict damage and casualties in residential building fires. All algorithms achieved similar results on the original dataset, with 86 % and 93 % accuracy and the highest average F1 scores of 61 % and 51 %, respectively. Various resampling techniques addressed the issue of data imbalance, with the combination of random undersampling and SMOTE achieving the best model performance, elevating the average F1 scores to 75 % and 77 %, representing improvements of 14 % and 26 % over the original dataset, respectively. Furthermore, the internal mechanisms of the model were explored using the explainable Shapley additive explanations, which identified the key features influencing model outputs. Additionally, the study revealed significant heterogeneity in different regions, sources of ignition, causes of fires, types of residences, locations of fire origin, and types of households. This research not only improves emergency response strategies for urban residential fires but also provides tailored fire safety policies to reduce risks in various urban environments effectively.

Machine learning approach as an early warning system to prevent foodborne Salmonella outbreaks in northwestern Italy

Salmonellosis, one of the most common foodborne infections in Europe, is monitored by food safety surveillance programmes, resulting in the generation of extensive databases. By leveraging tree-based machine learning (ML) algorithms, we exploited data from food safety audits to predict spatiotemporal patterns of salmonellosis in northwestern Italy. Data on human cases confirmed in 2015–2018 (n = 1969) and food surveillance data collected in 2014–2018 were used to develop ML algorithms. We integrated the monthly municipal human incidence with 27 potential predictors, including the observed prevalence of Salmonella in food. We applied the tree regression, random forest and gradient boosting algorithms considering different scenarios and evaluated their predictivity in terms of the mean absolute percentage error (MAPE) and R2. Using a similar dataset from the year 2019, spatiotemporal predictions and their relative sensitivities and specificities were obtained. Random forest and gradient boosting (R2 = 0.55, MAPE = 7.5%) outperformed the tree regression algorithm (R2 = 0.42, MAPE = 8.8%). Salmonella prevalence in food; spatial features; and monitoring efforts in ready-to-eat milk, fruits and vegetables, and pig meat products contributed the most to the models’ predictivity, reducing the variance by 90.5%. Conversely, the number of positive samples obtained for specific food matrices minimally influenced the predictions (2.9%). Spatiotemporal predictions for 2019 showed sensitivity and specificity levels of 46.5% (due to the lack of some infection hotspots) and 78.5%, respectively. This study demonstrates the added value of integrating data from human and veterinary health services to develop predictive models of human salmonellosis occurrence, providing early warnings useful for mitigating foodborne disease impacts on public health.

Predictive modeling of shallow tunnel behavior: Leveraging machine learning for maximum convergence displacement estimation

Accurate prediction of maximum convergence in unsupported, shallow tunnel construction is crucial for optimizing the lining and ensuring tunnel safety. Machine learning (ML) algorithms, especially through boosting techniques, enable effective solution of complex engineering problems and demonstrate their capabilities in problem solving and optimization. In this study, the FLAC 3D package was used to create a robust and validated database of 954 datasets. Five tree-based ML algorithms, including extreme gradient boosting (XGBoost), adaptive boosting (AdaBoost), gradient boosting machine (GBM), histogram-based gradient boosting (HGB) and categorical boosting (CatBoost), were used to predict the maximum convergence displacement for unsupported shallow tunnels. For the test dataset, XGBoost outperformed the other models with an excellent coefficient of determination of 0.9633, a minimum mean absolute error of 0.0021 and a low root mean squared error of 0.00725. HGB followed closely behind, and GBM and CatBoost showed strong performances, while Adaboost was less effective. The superior performance of XGBoost highlights its effectiveness in predicting maximum convergence in shallow tunnels. An in-depth sensitivity analysis within the XGBoost model showed the significant influence of soil elastic modulus on the maximum convergence displacement in unsupported tunnels. The remarkable results achieved by the XGBoost algorithm on our complex tunnel convergence predictions illustrate the profound ability of ML to tackle complicated geotechnical challenges. This interdisciplinary collaboration demonstrates the potential of advanced algorithms to improve safety and efficiency in construction, underlining the crucial role of technology in tackling complex problems and establishing a new paradigm for innovation in the field.

Machine learning predicts long-term mortality after acute myocardial infarction using systolic time intervals and routinely collected clinical data

BackgroundPrecise estimation of cardiac patients’ current and future comorbidities is an important factor in prioritizing continuous physiological monitoring and new therapies. Machine learning (ML) models have shown satisfactory performance in short-term mortality prediction of patients with heart disease, while their utility in long-term predictions is limited. This study aims to investigate the performance of tree-based ML models on long-term mortality prediction and the effect of two recently introduced biomarkers on long-term mortality. MethodsThis study utilized publicly available data from the Collaboration Center of Health Information Application (CCHIA) at the Ministry of Health and Welfare, Taiwan, China. The data pertained to patients admitted to the cardiac care unit for acute myocardial infarction (AMI) between November 2003 and September 2004. Included in the dataset were patients over 20 years old diagnosed with type 1 AMI. Exclusion criteria encompassed patients with missing data for brachial pre-ejection period (bPEP) and brachial ejection time (bET), as well as those with atrial fibrillation or extremity amputations, resulting in a final cohort of 139 AMI patients. We collected and analyzed mortality data up to December 2018. All patients had provided informed consent, in accordance with the Declaration of Helsinki. Medical records were used to gather demographic and clinical data, including age, gender, body mass index (BMI), percutaneous coronary intervention (PCI) status, and comorbidities such as hypertension, dyslipidemia, ST-segment elevation myocardial infarction (STEMI), and non-ST segment elevation myocardial infarction (NSTEMI). Using medical and demographic records as well as two recently introduced biomarkers, bPEP and bET, collected from 139 patients with acute myocardial infarction, we investigated the performance of advanced ensemble tree-based ML algorithms (random forest, AdaBoost, and XGBoost) to predict all-cause mortality within 14 years. A nested cross-validation was performed to evaluate and compare the performance of our developed models precisely with that of the conventional logistic regression (LR) as the baseline method. ResultsThe developed ML models achieved significantly better performance compared to the baseline LR (C-Statistic, 0.80 for random forest, 0.79 for AdaBoost, and 0.78 for XGBoost, vs. 0.77 for LR) (PRF< 0.001, PAdaBoost< 0.001, PXGBoost< 0.05). Adding bPEP and bET to our feature set significantly improved the algorithms’ performance, leading to an absolute increase in C-Statistic of up to 0.03 (C-Statistic, 0.83 for random forest, 0.82 for AdaBoost, and 0.80 for XGBoost, vs. 0.74 for LR) (PRF< 0.001, PAdaBoost< 0.001, PXGBoost< 0.05). ConclusionThe study indicates that incorporating new biomarkers into advanced machine learning models significantly improves long-term mortality prediction in cardiac patients. This advancement may enable better treatment prioritization for high-risk individuals.

Quantitative Precipitation Estimation Using Weather Radar Data and Machine Learning Algorithms for the Southern Region of Brazil

In addressing the challenges of quantitative precipitation estimation (QPE) using weather radar, the importance of enhancing the rainfall estimates for applications such as flash flood forecasting and hydropower generation management is recognized. This study employed dual-polarization weather radar data to refine the traditional Z–R relationship, which often needs higher accuracy in areas with complex meteorological phenomena. Utilizing tree-based machine learning algorithms, such as random forest and gradient boosting, this research analyzed polarimetric variables to capture the intricate patterns within the Z–R relationship. The results highlight machine learning’s potential to improve the precision of precipitation estimation, especially under challenging weather conditions. Integrating meteorological insights with advanced machine learning techniques is a remarkable achievement toward a more precise and adaptable precipitation estimation method.

Precipitation data merging via machine learning: Revisiting conceptual and technical aspects

The development of accurate precipitation products of high spatio-temporal coverage is crucial for a wide range of applications. In this context, precipitation data merging (PDM), which entails the blending of satellite-based estimates with ground-based measurements, holds a prominent position, while currently there is an increasing trend in the deployment of machine learning (ML) algorithms in such endeavors. In the light of recent advances in the field, this work discusses key aspects of the PDM problem associated with: a) the conceptual formulation of the problem, that is closely related to the training of ML models and their predictive capacity, b) the selection of products fused, that is associated with the latency of final product and operational applicability of the method, c) the efficiency of single-step and two-step merging approaches, with the former one treating the problem via only regression algorithms, and the latter one via the combined use of classification and regression algorithms. By formulating PDM as a spatio-temporal prediction problem, we define and assess two different training strategies for the ML models, termed as full and per time step strategy, which entail the building of a single or several ML models, respectively. Furthermore, the performance of the full training strategy, which allows the development of predictions in both spatial and temporal dimensions, is assessed in the context of single-step and two-step merging. In each of the three scenarios, three popular ensemble tree-based ML algorithms are employed, i.e., the random forest, gradient boosting and extreme gradient boosting algorithm, resulting in nine merged products. To provide empirical evidence, we employ a datacube composed by ground-based daily precipitation observations, satellite-based and reanalysis estimates, as well as auxiliary covariates, from 1009 uniformly distributed cells (representative of a sampling area of 25 × 25 km), over four countries around the world (Australia, USA, India and Italy). The large-scale experiment indicates that: (i) full training strategy is a competitive alternative to the per time step strategy, since it enables the development of methods with improved accuracy, with respect to performance metrics and reproduction of statistics, but also with higher predictive capability and operational applicability, (ii) two-step merging enables a much better reproduction of precipitation occurrence characteristics, as reflected in the improvement of relevant categorical metrics, the reproduction of probability and autocorrelation coefficient, (iii) no significant difference was noticed in the performance of different ML algorithms.

Pilot-Study to Explore Metabolic Signature of Type 2 Diabetes: A Pipeline of Tree-Based Machine Learning and Bioinformatics Techniques for Biomarkers Discovery.

This study aims to identify unique metabolomics biomarkers associated with Type 2 Diabetes (T2D) and develop an accurate diagnostics model using tree-based machine learning (ML) algorithms integrated with bioinformatics techniques. Univariate and multivariate analyses such as fold change, a receiver operating characteristic curve (ROC), and Partial Least-Squares Discriminant Analysis (PLS-DA) were used to identify biomarker metabolites that showed significant concentration in T2D patients. Three tree-based algorithms [eXtreme Gradient Boosting (XGBoost), Light Gradient Boosting Machine (LightGBM), and Adaptive Boosting (AdaBoost)] that demonstrated robustness in high-dimensional data analysis were used to create a diagnostic model for T2D. As a result of the biomarker discovery process validated with three different approaches, Pyruvate, D-Rhamnose, AMP, pipecolate, Tetradecenoic acid, Tetradecanoic acid, Dodecanediothioic acid, Prostaglandin E3/D3 (isobars), ADP and Hexadecenoic acid were determined as potential biomarkers for T2D. Our results showed that the XGBoost model [accuracy = 0.831, F1-score = 0.845, sensitivity = 0.882, specificity = 0.774, positive predictive value (PPV) = 0.811, negative-PV (NPV) = 0.857 and Area under the ROC curve (AUC) = 0.887] had the slight highest performance measures. ML integrated with bioinformatics techniques offers accurate and positive T2D candidate biomarker discovery. The XGBoost model can successfully distinguish T2D based on metabolites.

Vibration behavior prediction of submerged nanobeams with axially traveling supports: numerical, analytical, and machine learning approaches

This work surveyed the vibration behavior and stability analysis of an underwater moving flexible nanosize beam, implementing numerical and analytical methods as well as tree-based machine learning (ML) algorithms. Dynamic modeling is performed based on the nonlocal stress-strain gradient theory (NSSGT), incorporating variable environmental conditions, surface energy, and rotational inertia effects. The natural frequencies and instability threshold are computed numerically. The exact closed-form mathematical expression for the critical towing velocity of the nanosize beam is determined analytically. Also, decision tree regression and least-squares boosting tree (LSBT) regression algorithms are exploited to predict stability boundaries and the fundamental vibration frequency, and their efficiency is surveyed accordingly. Comparative studies and parametric investigations are conducted. The impressions of geometry, added mass coefficient, scale ratio parameter, surface layer characteristics, fluid mass ratio, humidity, temperature rise, and external magnetic field intensity on the nanosystem dynamics are examined and illuminated. It is detected that the results of the analytical method and ML-based approaches are consistent with those reported by the numerical technique and literature. The results asserted that the proposed ML algorithms have acceptable performance and excellent effectiveness in computational time and cost. It is comprehended that the dynamic features of submerged traveling nanobeams drastically depend on the rotational inertia effects and thickness-dependent scale effects. The stability of the immersed movable nanoscale beams is perceived to improve by increasing the scale ratio parameter and the added mass coefficient. From the perspective of the optimal design of engineering instrumentation tools, the outcomes of the current article can be applied as an inclusive benchmark.

Predicting maximum pitting corrosion depth in buried transmission pipelines: Insights from tree-based machine learning and identification of influential factors

Pitting corrosion is a primary type of external corrosion that poses a critical challenge in the oil and gas industry, potentially leading to severe environmental, health, and economic consequences if left unaddressed. Researchers have attempted to comprehend and forecast it through diverse methods, including machine learning and artificial intelligence. However, achieving a precise estimation of pitting growth while considering the influence of various environmental and operational factors remains a concern. This study aims to develop a model by employing tree-based machine learning algorithms, including Decision Tree, Random Forest, LightGBM, CatBoost, and XGBoost, to enhance the prediction accuracy of the maximum depth of pitting corrosion in buried transmission pipelines while also facilitating interpretability. The Random Forest model is found to be the best-performing model with a mean absolute error (MAE) of 0.588. Beyond prediction accuracy, the present analysis contributes practical insights for industry application. First, the model identifies pipes at high risk of severe pitting corrosion under challenging environmental conditions, enabling targeted preventive measures. Secondly, the model's interpretation, utilising game-theoretic Shapely values and permutation importance, informs strategic decisions on the burial of new pipes, ultimately extending their operational lifespan. These applications emphasise the potential of our findings to significantly improve the safety, reliability, and risk mitigation strategies in oil and gas pipeline operations.

Identifying key products to trigger new exports: an explainable machine learning approach

Tree-based machine learning algorithms provide the most precise assessment of the feasibility for a country to export a target product given its export basket. However, the high number of parameters involved prevents a straightforward interpretation of the results and, in turn, the explainability of policy indications. In this paper, we propose a procedure to statistically validate the importance of the products used in the feasibility assessment. In this way, we are able to identify which products, called explainers, significantly increase the probability to export a target product in the near future. The explainers naturally identify a low dimensional representation, the Feature Importance Product Space, that enhances the interpretability of the recommendations and provides out-of-sample forecasts of the export baskets of countries. Interestingly, we detect a positive correlation between the complexity of a product and the complexity of its explainers.

5-EPIFAT trial protocol: a multi-center, randomized, placebo-controlled trial of the efficacy of pharmacotherapy for fatigue using methylphenidate, bupropion, ginseng, and amantadine in advanced cancer patients on active treatment

BackgroundCancer-related fatigue (CRF) is still undertreated in most patients, as evidence for pharmacological treatments is limited and conflicting. Also, the efficacy of the pharmacological agents relative to each other is still unclear. Therefore, medications that may potentially contribute to improving CRF will be investigated in this head-to-head trial. Our main objective is to compare the efficacy of methylphenidate vs. bupropion vs. ginseng vs. amantadine vs. placebo in patients with advanced cancer.MethodsThe 5-EPIFAT study is a 5-arm, randomized, multi-blind, placebo-controlled, multicenter trial that will use a parallel-group design with an equal allocation ratio comparing the efficacy and safety of four medications (Methylphenidate vs. Bupropion vs. Ginseng vs. Amantadine) versus placebo for management of CRF. We will recruit 255 adult patients with advanced cancer who experience fatigue intensity ≥ 4 based on a 0–10 scale. The study period includes a 4-week intervention and a 4-week follow-up with repeated measurements over time. The primary outcome is the cancer-related fatigue level over time, which will be measured by the functional assessment of chronic illness therapy-fatigue (FACIT-F) scale. To evaluate safety, the secondary outcome is the symptomatic adverse events, which will be assessed using the Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events in cancer clinical trials (PRO-CTCAE). Also, a subgroup analysis based on a decision tree-based machine learning algorithm will be employed for the clinical prediction of different agents in homogeneous subgroups.DiscussionThe findings of the 5-EPIFAT trial could be helpful to guide clinical decision-making, personalization treatment approach, design of future trials, as well as the development of CRF management guidelines.Trial registrationIRCT.ir IRCT20150302021307N6. Registered on 13 May 2023.

Data correlation matrix-based spam URL detection using machine learning algorithms

In recent years, the widespread availability of internet access has brought both advantages and disadvantages. Users now enjoy numerous benefits, including unlimited access to vast amounts of information and seamless communication with others. However, this accessibility also exposes users to various threats, including malicious software and deceptive practices, leading to victimization of many individuals. Common issues encountered include spam emails, fake websites, and phishing attempts. Given the essential nature of internet usage in contemporary society, the development of systems to protect users from such malicious activities has become imperative. Accordingly, this study utilized eight prominent machine learning algorithms to identify spam URLs using a large dataset. Since the dataset only contained URL information and spam classification, additional feature extractions such as URL length and the number of digits were necessary. The inclusion of such features enhances decision-making processes within the framework of machine learning, resulting in more efficient detection. As the effectiveness of feature extraction significantly impacts the results of the methods, the study initially conducted feature extraction and trained models based on the weight of features. This paper proposes a data correlated matrix approach for spam URL detection using machine learning algorithms. The distinctive aspect of this study lies in the feature extraction process applied to the dataset, aimed at discerning the most impactful features, and subsequently training models while considering the weighting of these features. The entire dataset was used without any reduction in data. Experimental findings indicate that tree-based machine learning algorithms yield superior results. Among all applied methods, the Random Forest approach achieved the highest success rate, with a detection rate of 96.33% for the non-spam class. Additionally, a combined and weighted calculation method yielded an accuracy of 94.16% for both spam and non-spam data.

Forecasting East and West Coast Gasoline Prices with Tree-Based Machine Learning Algorithms

This study aims to forecast New York and Los Angeles gasoline spot prices on a daily frequency. The dataset includes gasoline prices and a big set of 128 other relevant variables spanning the period from 17 February 2004 to 26 March 2022. These variables were fed to three tree-based machine learning algorithms: decision trees, random forest, and XGBoost. Furthermore, a variable importance measure (VIM) technique was applied to identify and rank the most important explanatory variables. The optimal model, a trained random forest, achieves a mean absolute percent error (MAPE) in the out-of-sample of 3.23% for the New York and 3.78% for the Los Angeles gasoline spot prices. The first lag, AR (1), of gasoline is the most important variable in both markets; the top five variables are all energy-related. This paper can strengthen the understanding of price determinants and has the potential to inform strategic decisions and policy directions within the energy sector, making it a valuable asset for both industry practitioners and policymakers.

Fourier transform infrared spectroscopy and machine learning for Porphyromonas gingivalis detection in oral bacteria.

Porphyromonas gingivalis, a Gram-negative anaerobic bacillus, is the primary pathogen in periodontitis. Herein, we cultivated strains of oral bacteria, including P. gingivalis and the oral commensal bacteria Actinomyces viscosus and Streptococcus mutans, and recorded the infrared absorption spectra of the gases released by the cultured bacteria at a resolution of 0.5cm-1 within the wavenumber range of 500-7500cm-1. From these spectra, we identified the infrared wavenumbers associated with characteristic absorptions in the gases released by P. gingivalis using a decision tree-based machine learning algorithm. Finally, we compared the obtained absorbance spectra of ammonia (NH3) and carbon monoxide (CO) using the HITRAN database. We observed peaks at similar positions in the P. gingivalis gases, NH3, and CO spectra. Our results suggest that P. gingivalis releases higher amounts of NH3 and CO than A. viscosus and S. mutans. Thus, combining Fourier transform infrared spectroscopy with machine learning enabled us to extract the specific wavenumber range that differentiates P. gingivalis from a vast dataset of peak intensity ratios. Our method distinguishes the gases from P. gingivalis from those of other oral bacteria and provides an effective strategy for identifying P. gingivalis in oral bacteria. Our proposed methodology could be valuable in clinical settings as a simple, noninvasive pathogen diagnosis technique.

Application of regression decision tree and machine learning algorithms to examine students’ online learning preferences during COVID-19 pandemic

The emergence of the novel coronavirus (COVID-19) profoundly disrupted the field of education, ushering in an era of widespread online learning adoption. This research paper seeks to investigate the multifaceted factors influencing students' preferences for online learning. Employing data exploration techniques and machine learning algorithms, the study aimed to identify the pivotal variables affecting students' willingness and performance in online educational environments. The research encompassed data collection through designated questionnaires and the application of decision tree-based machine learning algorithms to analyze these diverse factors. Through this approach, seven specific prerequisites were derived, employing multiple linear regression analysis within the decision tree framework, to illuminate the relationships between these factors. Key aspects considered in these prerequisites included factors such as "internet connectivity issues," "COVID-19 pandemic-induced stress," "COVID-19 vaccination status," and "close relatives' COVID-19 infections". Foremost among the reasons for students' reluctance to embrace online learning was the presence of "internet difficulties," including issues like slow connections and frequent disruptions. From the results of this research, it can be concluded that basic computer and internet courses can be beneficial for encouraging online education. Findings of this study underscore the potential benefits of offering basic computer and internet courses as a means to encourage and facilitate effective online education, particularly in the context of the COVID-19 pandemic.

A comparative analysis of tree-based machine learning algorithms for predicting the mechanical properties of fibre-reinforced GGBS geopolymer concrete

A comparative analysis of tree-based machine learning algorithms for predicting the mechanical properties of fibre-reinforced GGBS geopolymer concrete

Dataset meta-level and statistical features affect machine learning performance

What dataset features affect machine learning (ML) performance has primarily been unknown in the current literature. This study examines the impact of tabular datasets' different meta-level and statistical features on the performance of various ML algorithms. The three meta-level features this study considered are the dataset size, the number of attributes and the ratio between the positive (class 1) and negative (class 0) class instances. It considered four statistical features for each dataset: mean, standard deviation, skewness and kurtosis. After applying the required scaling, this study averaged (uniform and weighted) each dataset’s different attributes to quantify its four statistical features. We analysed 200 open-access tabular datasets from the Kaggle (147) and UCI Machine Learning Repository (53) and developed ML classification models (through classification implementation and hyperparameter tuning) for each dataset. Then, this study developed multiple regression models to explore the impact of dataset features on ML performance. We found that kurtosis has a statistically significant negative effect on the accuracy of the three non-tree-based ML algorithms of the Support vector machine (SVM), Logistic regression (LR) and K-nearest neighbour (KNN) for their classical implementation with both uniform and weighted aggregations. This study observed similar findings in most cases for ML implementations through hyperparameter tuning, except for SVM with weighted aggregation. Meta-level and statistical features barely show any statistically significant impact on the accuracy of the two tree-based ML algorithms (Decision tree and Random forest), except for implementation through hyperparameter tuning for the weighted aggregation. When we excluded some datasets based on the imbalanced statistics and a significantly higher contribution of one attribute compared to others to the classification performance, we found a significant effect of the meta-level ratio feature and statistical mean and standard deviation features on SVM, LR and KNN accuracy in many cases. Our findings open a new research direction in understanding how dataset characteristics affect ML performance and will help researchers select appropriate ML algorithms for a possible optimal accuracy outcome.

Assessing the predictive value of morphological traits on primary lifestyle of birds through the extreme gradient boosting algorithm.

The relationship between morphological traits and ecological performance in birds is an important area of research, as it can help us to understand how birds are able to adapt and how they are affected by changes in their environment. Many studies have investigated the relationship between morphological traits and certain aspects of the performance and ecological niche of these animals. However, the relationship between morphological traits and the primary lifestyle of birds has not previously been explored. This paper aims to evaluate the predictive potential of morphological data to determine the primary lifestyle of birds through a tree-based machine learning algorithm. By doing this, it is also possible to evaluate these artificial categories that we used to split up birds and know whether they are suitable for dividing them in function of shared morphological characteristics or need a redefinition under more discriminant criteria. Supplementary dataset 1 of the AVONET project was used, which comprises the 11 morphological predictors used in this work and the classification according to the primary lifestyle for more than 95% of the existing bird species. For all morphological traits used, statistically significant univariate differences were found between primary lifestyles. The three fitted machine learning models showed high accuracy, in all cases above 78% and superior to the ones achieved through traditional approaches used as contrasts. The results obtained provide evidence that primary lifestyle can be predicted in birds based on morphological traits, as well as more insights about the relevance of functional traits for ecological modeling. This is another step forward in our mechanistic understanding of bird ecology, while exploring how birds have adapted to their environments and how they interact with their surroundings.

Confirming the statistically significant superiority of tree-based machine learning algorithms over their counterparts for tabular data.

Many individual studies in the literature observed the superiority of tree-based machine learning (ML) algorithms. However, the current body of literature lacks statistical validation of this superiority. This study addresses this gap by employing five ML algorithms on 200 open-access datasets from a wide range of research contexts to statistically confirm the superiority of tree-based ML algorithms over their counterparts. Specifically, it examines two tree-based ML (Decision tree and Random forest) and three non-tree-based ML (Support vector machine, Logistic regression and k-nearest neighbour) algorithms. Results from paired-sample t-tests show that both tree-based ML algorithms reveal better performance than each non-tree-based ML algorithm for the four ML performance measures (accuracy, precision, recall and F1 score) considered in this study, each at p<0.001 significance level. This performance superiority is consistent across both the model development and test phases. This study also used paired-sample t-tests for the subsets of the research datasets from disease prediction (66) and university-ranking (50) research contexts for further validation. The observed superiority of the tree-based ML algorithms remains valid for these subsets. Tree-based ML algorithms significantly outperformed non-tree-based algorithms for these two research contexts for all four performance measures. We discuss the research implications of these findings in detail in this article.

A Novel Comparison of Charotar Region Wheat Variety Classification Techniques using Purely Tree-based Data Mining Algorithms

Techniques for classifying data using data mining are now a day prevalent in agriculture. The method of classifying seeds involves grouping various seed varieties according to their morphological characteristics. To accomplish categorization of the typical Charotar region (generally comprising Anand and Kheda districts of the Gujarat State of India) Gujarat Wheat (GW) varieties (TRITICUM – AESTIVUM) viz. GW 273, GW 496, GW 322, LOK-1, and GDW 1255 (TRITICUM – DURUM), Weka Explorer was used. The features used are area, perimeter, solidity, aspect ratio, major and minor axis of seed kernel, Hue, Saturation, Value, and SF1 (empirical). Features reduction was done using Information Gain (IG) and its modified version Gain Ratio (GR). This paper compares performance of Tree based data mining algorithms in classifying wheat varieties. For classification we used purely tree-based machine learning algorithms viz. J48, Random Forest, Hoeffding Tree, Logistic Model Tree (LMT), and REPTree. LMT- logistics regression method gives higher accuracy 96.4% compared to other classifiers. Hoeffding Tree classifiers stood second with 96% accuracy. For validation 10-fold cross validation was used. By reducing the number of folds in cross validation performance of most algorithms decreased except J48. The percentage of correctly classified instance increased for all algorithms when features were selected by GR except for J48.