Adaptive Boosting Research Articles

Enhanced Predictive Ensemble Learning Models for Compressive Strength of Concrete Modified with Bentonite Clay

This study addresses the logistical challenges of testing bentonite plastic concrete in the field by developing predictive models for compressive strength (CS) using Python-based machine learning techniques. The models, including random forest, adaptive boosting, extreme gradient boosting, and gradient boosting regression tree, were enhanced with forensic-based investigation optimization. A dataset of 285 CS records was used to train and validate these models. SHAP analysis highlighted the impact of various inputs like gravel, bentonite, curing time, and cement on CS. Results show that the GBRT-FBIO model outperformed the others in CS prediction, indicating its superior effectiveness for material science applications.

The development of a C5.0 machine learning model in a limited data set to predict early mortality in patients with ARDS undergoing an initial session of prone positioning.

Acute Respiratory Distress Syndrome (ARDS) has a high morbidity and mortality. One therapy that can decrease mortality is ventilation in the prone position (PP). Patients undergoing PP are amongst the sickest, and there is a need for early identification of patients at particularly high risk of death. These patients may benefit from an in-depth review of treatment or consideration of rescue therapies. We report the development of a machine learning model trained to predict early mortality in patients undergoing prone positioning as part of the management of their ARDS. Prospectively collected clinical data were analysed retrospectively from a single tertiary ICU. The records of patients who underwent an initial session of prone positioning whilst receiving invasive mechanical ventilation were identified (n = 131). The decision to perform prone positioning was based on the criteria in the PROSEVA study. A C5.0 classifier algorithm with adaptive boosting was trained on data gathered before, during, and after initial proning. Data was split between training (85% of data) and testing (15% of data). Hyperparameter tuning was achieved through a grid-search using a maximal entropy configuration. Predictions for 7-day mortality after initial proning session were made on the training and testing data. The model demonstrated good performance in predicting 7-day mortality (AUROC: 0.89 training, 0.78 testing). Seven variables were used for prediction. Sensitivity was 0.80 and specificity was 0.67 on the testing data set. Patients predicted to survive had 13.3% mortality, while those predicted to die had 66.67% mortality. Among patients in whom the model predicted patient would survive to day 7 based on their response, mortality at day 7 was 13.3%. Conversely, if the model predicted the patient would not survive to day 7, mortality was 66.67%. This proof-of-concept study shows that with a limited data set, a C5.0 classifier can predict 7-day mortality from a number of variables, including the response to initial proning, and identify a cohort at significantly higher risk of death. This can help identify patients failing conventional therapies who may benefit from a thorough review of their management, including consideration of rescue treatments, such as extracorporeal membrane oxygenation. This study shows the potential of a machine learning model to identify ARDS patients at high risk of early mortality following PP. This information can guide clinicians in tailoring treatment strategies and considering rescue therapies. Further validation in larger cohorts is needed.

Predicting stroke severity of patients using interpretable machine learning algorithms.

Stroke is a significant global health concern, ranking as the second leading cause of death and placing a substantial financial burden on healthcare systems, particularly in low- and middle-income countries. Timely evaluation of stroke severity is crucial for predicting clinical outcomes, with standard assessment tools being the Rapid Arterial Occlusion Evaluation (RACE) and the National Institutes of Health Stroke Scale (NIHSS). This study aims to utilize Machine Learning (ML) algorithms to predict stroke severity using these two distinct scales. We conducted this study using two datasets collected from hospitals in Urmia, Iran, corresponding to stroke severity assessments based on RACE and NIHSS. Seven ML algorithms were applied, including K-Nearest Neighbor (KNN), Decision Tree (DT), Random Forest (RF), Adaptive Boosting (AdaBoost), Extreme Gradient Boosting (XGBoost), Support Vector Machine (SVM), and Artificial Neural Network (ANN). Hyperparameter tuning was performed using grid search to optimize model performance, and SHapley Additive Explanations (SHAP) were used to interpret the contribution of individual features. Among the models, the RF achieved the highest performance, with accuracies of 92.68% for the RACE dataset and 91.19% for the NIHSS dataset. The Area Under the Curve (AUC) was 92.02% and 97.86% for the RACE and NIHSS datasets, respectively. The SHAP analysis identified triglyceride levels, length of hospital stay, and age as critical predictors of stroke severity. This study is the first to apply ML models to the RACE and NIHSS scales for predicting stroke severity. The use of SHAP enhances the interpretability of the models, increasing clinicians' trust in these ML algorithms. The best-performing ML model can be a valuable tool for assisting medical professionals in predicting stroke severity in clinical settings.

Stacked ensemble machine learning approach for electroencephalography based major depressive disorder classification using temporal statistics

Major depressive disorder (MDD) is a serious and widespread mental health condition that remains challenging to diagnose accurately. Traditional psychological assessments, which can be subjective and sometimes unreliable, emphasize the need for more objective diagnostic tools. In this study, we present a machine learning (ML) model designed to diagnose depression by analysing statistical time-domain features extracted from Electroencephalography (EEG) data. The model is built using a stacked ensemble ML approach, incorporating nine-base estimators with various meta-classifiers. Through multiple trials, the model achieved an accuracy of 98.01%, with precision and recall rates of 97.78% and 96.61%, respectively with Adaptive Boosting (AdaBoost) as the meta-classifer. We also investigated the effects of data sampling and the number of base classifiers on the model’s performance. The findings demonstrate that the stacked ensemble approach significantly enhances the accuracy of diagnosing MDD and that the proposed model outperforms the methods used in previous studies. This model offers a promising tool for psychologists and medical professionals to diagnose depression more reliably, potentially leading to better treatment outcomes for those affected by the disorder.

Using data-driven models to simulate the performance of surfactants in reducing heavy oil viscosity.

There is a substantial body of literature exploring the challenges associated with exploring and exploiting these underground resources. Unconventional resources, particularly heavy oil reservoirs, are critical for meeting ever-increasing global energy demand. By injecting surfactants into heavy oil, chemically enhanced oil recovery (EOR) may enable emulsification, which may reduce the viscosity of heavy oil and facilitate extraction and transportation. In this work, a large experimental dataset, containing 2020 data points, was extracted from the literature for modeling oil-in-water (O/W) emulsion viscosity using machine learning (ML) methods. The algorithms used pressure, temperature, salinity, surfactant concentration, type of surfactant, shear rate, and crude oil density as inputs. For this purpose, five ML algorithms were selected and optimized, including adaptive boosting (AB), convolutional neural network (CNN), ensemble learning (EL), artificial neural network (ANN), and decision tree (DT). A combined simulated annealing (CSA) method was utilized to optimize all algorithms. With AARE, R2, MAE, MSE, and RMSE values of 8.982, 0.996, 0.004, 0.0002, and 0.0132, respectively, the ANN predictor exhibited higher accuracy in predicting O/W emulsion viscosity for total data (train and test subsets combined). A Monte-Carlo sensitivity analysis was also performed to determine the impact of input features on the model output. By using the proposed ML predictor, expensive and time-consuming experiments can be eliminated and emulsion viscosity predictions can be expedited without the need for costly experiment.

Developing an efficient explainable artificial intelligence approach for accurate reverse osmosis desalination plant performance prediction: application of SHAP analysis

In recent decades, securing drinkable water sources has become a pressing concern for populations in various regions worldwide. Therefore, to address the growing need for potable water, contemporary water purification technologies can be employed to convert saline sources into drinkable supplies. Therefore, the prediction of important parameters of desalination plants is a key task for designing and implementing these facilities. In this regard, artificial intelligence techniques have proven to be powerful assets in this field. These methods offer an expedited and effective means of estimating effective parameters, thus catalyzing their implementation in real-world scenarios. In this study, the predictive accuracy of six different machine learning models, including Natural Gradient-based Boosting (NGBoost), Adaptive Boosting (AdaBoost), Categorical Boosting (CatBoost), Support vector regression (SVR), Gaussian Process Regression (GPR), and Extremely Randomized Tree (ERT) was evaluated for modelling the parameter of permeate flow as a key element in system efficiency, energy consumption, and water quality using six various input combinations of feed water salt concentration, condenser inlet temperature, feed flow rate, and evaporator inlet temperature. The next phase of this research employed the SHAP interpretability method to illustrate the impact of individual variables on the model's output. Moreover, the predictive performance of the developed frameworks was evaluated using a set of five dependable statistical measures: RMSE, NS, MAE, MAPE and R 2. These indicators were utilized to provide a robust means of gauging the precision of the model's forecasts. A comparative analysis of the outcomes, as measured by the RMSE criteria, revealed that the SVR technique (RMSE = 0.125 L/(h·m2)) exhibited superior performance compared to NGBoost (RMSE = 0.163 L/(h·m2)), AdaBoost (RMSE = 0.219 L/(h·m2)), CatBoost (RMSE = 0.149 L/(h·m2)), GPR (RMSE = 0.156 L/(h·m2)), and ERT (RMSE = 0.167 L/(h·m2)) methodologies in predicting permeate flow rates. The modelling outcomes obtained during the evaluation stage demonstrated the efficacy of the SVR algorithm in enhancing the precision of permeate flow forecasts, utilizing relevant input variables.

A Comprehensive Approach to Fault Classification of Helicopter Engines with Adaboost Ensemble Model

This work is based on the PHM North America 2024 Conference Data Challenge’s datasets of Helicopter turbine engine performance measurements. These datasets were large and moderately imbalanced. For dealing with these challenges, we demonstrate significant tools covering feature engineering, augmentation and selection, model exploration, visualizations, model explainability and confidence margin estimation. This work was performed in its entirety using MATLAB. All these tools will be generally applicable to data-driven modeling and prediction of health to real life applications. Initially, we explored the 742k observations in the training set, noting a 60-40 split between healthy and faulty labels, and identified two major operational clusters within the data. We enhanced the dataset by removing duplicates and engineered new features based on domain knowledge, expanding the feature set to 242 dimensions. However for the torque margin estimation, we trained a regression model on a limited subset (18 features), which includes engineered features using domain knowledge, quadratic terms and linear interaction between all the terms. For the final submission, we utilized a stepwise linear regression model to optimize feature selection. This approach achieved a perfect regression score on test data, validated by a consistent torque margin residual range of +/- 0.5%. The model's RMSE and MAE metrics were optimal for employing a normal distribution probability density function. For , we reduced the feature set to 58 using dimensionality reduction techniques and balanced the data with upsampling and down-weighing the minority class. We employed ASHA (Asynchronous Successive Halving Algorithm) in conjunction with AutoML to efficiently determine the most suitable model family, significantly saving compute time. Subsequently, we trained ensemble models, including bagged tree and AdaBoost (Adaptive Boosting), which minimized false negatives and positives, achieving robust classification performance. This was particularly critical given the high penalty for false negatives in the data challenge. The MathWorks team score on Testing Data was 0.9686 at the close of competition. This was further improved to 0.9867. Our approach demonstrates the effectiveness of combining strategic data processing, feature engineering, and model selection to enhance predictive accuracy in complex operational datasets.

Multi-classification prediction of PM2.5 concentration based on improved adaptive boosting rotation forest

Developing efficient, stable, and user-friendly methods and technologies for predicting air quality has contributed to environmental research and management. Most traditional machine learning (ML) models often struggle to efficiently process extensive air quality data and grapple with the challenge of imbalanced data distributions. To this end, we introduced a novel multi-strategy collaborative approach that incorporates weighted feature selection, an adaptive enhanced rotation forest algorithm, and Bayesian Optimization for parameter tuning. Moreover, to improve the transparency in black box ML models, the novel Shapley Additive Explanations (SHAP) method was applied to interpret the outputs and analyze the importance of individual variables. Through experiments on real air quality datasets, we have verified the accuracy of our proposed method in classifying air quality levels. Notably, our model demonstrated an average test set accuracy improvement of approximately 10 % in cities like Beijing, Tianjin, Shijiazhuang, and Baoding after hyperparameter optimization using Bayesian methods. Furthermore, compared to alternative algorithms, our model showed an improvement of 1–2 % in evaluation metrics. By introducing novel methodologies and tools, our research contributes significantly to the advancement of air quality classification technology and holds profound implications for informing environmental policy decisions.

Improving the Performance of Screening MM/PBSA in Protein-Ligand Interactions via Machine Learning

Abstract Accurately estimating protein-ligand binding free energy is crucial for drug design and biophysics, yet remains a challenging task. In this study, we applied the screening molecular mechanics/Poisson Boltzmann surface area (MM/PBSA) method in combination with various machine learning techniques to compute the binding free energies of protein-ligand interactions. Our results demonstrate that machine learning outperforms direct screening MM/PBSA calculations in predicting protein-ligand binding free energies. Notably, the random forest (RF) method exhibited the best predictive performance, with a Pearson correlation coefficient (r p ) of 0.702 and a mean absolute error (MAE) of 1.379 kcal/mol. Furthermore, we analyzed feature importance rankings in the gradient boosting (GB), adaptive boosting (AdaBoost), and RF methods, and found that feature selection significantly impacted predictive performance. In particular, molecular weight (MW) and van der Waals (VDW) energies played a decisive role in the prediction. Overall, this study highlights the potential of combining machine learning methods with screening MM/PBSA for accurately predicting binding free energies in biosystems.

Machine Learning-Based Prediction for Incident Hypertension Based on Regular Health Checkup Data: Derivation and Validation in 2 Independent Nationwide Cohorts in South Korea and Japan.

Worldwide, cardiovascular diseases are the primary cause of death, with hypertension as a key contributor. In 2019, cardiovascular diseases led to 17.9 million deaths, predicted to reach 23 million by 2030. This study presents a new method to predict hypertension using demographic data, using 6 machine learning models for enhanced reliability and applicability. The goal is to harness artificial intelligence for early and accurate hypertension diagnosis across diverse populations. Data from 2 national cohort studies, National Health Insurance Service-National Sample Cohort (South Korea, n=244,814), conducted between 2002 and 2013 were used to train and test machine learning models designed to anticipate incident hypertension within 5 years of a health checkup involving those aged ≥20 years, and Japanese Medical Data Center cohort (Japan, n=1,296,649) were used for extra validation. An ensemble from 6 diverse machine learning models was used to identify the 5 most salient features contributing to hypertension by presenting a feature importance analysis to confirm the contribution of each future. The Adaptive Boosting and logistic regression ensemble showed superior balanced accuracy (0.812, sensitivity 0.806, specificity 0.818, and area under the receiver operating characteristic curve 0.901). The 5 key hypertension indicators were age, diastolic blood pressure, BMI, systolic blood pressure, and fasting blood glucose. The Japanese Medical Data Center cohort dataset (extra validation set) corroborated these findings (balanced accuracy 0.741 and area under the receiver operating characteristic curve 0.824). The ensemble model was integrated into a public web portal for predicting hypertension onset based on health checkup data. Comparative evaluation of our machine learning models against classical statistical models across 2 distinct studies emphasized the former's enhanced stability, generalizability, and reproducibility in predicting hypertension onset.

Smart Health Monitoring Approach to Diagnose Attention-Deficit Hyperactivity Disorderbased on Real-Time Activity and Heart Rate Variability using Boosting Models

Introduction: Attention-Deficit Hyperactivity Disorder (ADHD) is a prevalent chronic mental health condition that significantly impacts the psychological and physical wellbeing of millions of adolescents. Early detection and accurate diagnosis are crucial for effective treatment and mitigating the disorder's adverse effects. Despite extensive research efforts, current methods often fall short in simultaneously accounting for daily motor activity and heart rate variability in ADHD detection. Method: Addressing these gaps, this paper introduces a histogram-based gradient-boosting classifier for analyzing real-time activity and heart-rate variability data to automate ADHD diagnosis. By extracting twelve key features from the data and selecting the most significant ones with the extra tree model, we evaluate these features using various classifiers, including histogram-based gradient boosting, light gradient boosting machine, extreme gradient boosting, gradient boosting, and adaptive boosting. Results: The histogram-based gradient-boosting model, validated through ten-fold crossvalidation, outperforms other classifiers with an accuracy of 99.12%, an F1 measure of 99.12%, and a sensitivity of 99.13%. Additionally, it achieves a specificity of 99.1%, an AUC of 0.9995, and a minimal FDR of 0.88%. These results demonstrate that the proposed approach offers a highly effective and precise solution for automated ADHD diagnosis. Conclusion: The implications of these findings suggest that integrating real-time activity and heart-rate variability data into diagnostic processes can significantly enhance the accuracy and efficiency of ADHD assessment, potentially leading to earlier and more reliable diagnoses, improved patient outcomes, and more tailored treatment strategies.

Application of tongue image characteristics and oral-gut microbiota in predicting pre-diabetes and type 2 diabetes with machine learning

BackgroundThis study aimed to characterize the oral and gut microbiota in prediabetes mellitus (Pre-DM) and type 2 diabetes mellitus (T2DM) patients while exploring the association between tongue manifestations and the oral-gut microbiota axis in diabetes progression.MethodsParticipants included 30 Pre-DM patients, 37 individuals with T2DM, and 28 healthy controls. Tongue images and oral/fecal samples were analyzed using image processing and 16S rRNA sequencing. Machine learning techniques, including support vector machine (SVM), random forest, gradient boosting, adaptive boosting, and K-nearest neighbors, were applied to integrate tongue image data with microbiota profiles to construct predictive models for Pre-DM and T2DM classification.ResultsSignificant shifts in tongue characteristics were identified during the progression from Pre-DM to T2DM. Elevated Firmicutes levels along the oral-gut axis were associated with white greasy fur, indicative of underlying metabolic changes. An SVM-based predictive model demonstrated an accuracy of 78.9%, with an AUC of 86.9%. Notably, tongue image parameters (TB-a, perALL) and specific microbiota (Escherichia, Porphyromonas-A) emerged as prominent diagnostic markers for Pre-DM and T2DM.ConclusionThe integration of tongue diagnosis with microbiome analysis reveals distinct tongue features and microbial markers. This approach significantly improves the diagnostic capability for Pre-DM and T2DM.

Bayesian additive regression trees for predicting childhood asthma in the CHILD cohort study

BackgroundAsthma is a heterogeneous disease that affects millions of children and adults. There is a lack of objective gold standard diagnosis that spans the ages; instead, diagnoses are made by clinician assessment based on a cluster of signs, symptoms and objective tests dependent on age. Yet, there is a clear morbidity associated with chronic asthma symptoms. Machine learning has become a popular tool to improve asthma diagnosis and classification. There is a paucity of literature on the use of Bayesian machine learning algorithms to predict asthma diagnosis in children. This paper develops a prediction model using the Bayesian additive regression trees (BART) and compares its performance to various machine learning algorithms in predicting the diagnosis of childhood asthma.MethodsClinically relevant variables collected at or before 3 years of age from 2794 participants in the CHILD Cohort Study were used to predict physician-diagnosed asthma at age 5. BART and six other commonly used machine learning algorithms, namely adaptive boosting, logistic regression, decision tree, neural network, random forest, and support vector machine were trained. Measures of performance including sensitivity, specificity, and area under the receiver operating characteristic (ROC) curve were calculated. The confidence intervals were calculated using Bootstrapping samples. Important predictors and interaction effects associated with asthma were also identified using BART.ResultsBART, logistic regression and random forest showed the highest area under the ROC curve compared to other machine learning algorithms. Based on BART, recurrent wheeze, respiratory infection and food sensitization at 3 years of age were the most important predictors. The three most important interaction effects were found to be interaction terms of respiratory infection at 3 years and recurrent wheezing at 3 years, maternal asthma and paternal asthma, and maternal wheezing and inhalant sensitization of child at 3 years.ConclusionsBART demonstrated promising prediction performance when compared to other machine learning algorithms. Future research could validate the BART in an external cohort to evaluate its reliability and generalizability.

Machine learning-based prediction of seismic response of elevated steel tanks

Seismic response analysis assesses structural safety and integrity during earthquakes and guides design for optimal performance, compliance with regulations, and risk mitigation. This study proposes a novel approach utilizing machine learning (ML) techniques to predict the seismic response of elevated steel tanks accurately. ML is a powerful tool that can handle complexity, improve accuracy, provide data-driven insights, and optimize designs for predicting seismic responses of structures. Moreover, this study evaluates various ML models containing Random Forest, Support Vector Regression, Adaptive Boosting, LightGBM, Histogram-based Gradient Boosting, XGBoost, CatBoost, Bagging Regression, and Decision Trees to identify the most effective predictive model. In general, the developed ML-based predictive models provide a promising tool for engineers involved in the seismic design and retrofitting of elevated steel tanks, aiding in optimizing designs and enhancing structural safety and resilience against seismic hazards. As a result, the HGB model obtained the most suitable performance compared to other developed models with higher R2 and lower RMSE. In addition, a sensitivity analysis was performed based on SHAP values, and it was found that the height of the liquid and the intensity measure were the most influential variables in the seismic response of the tank.

Prediction of fracture toughness of concrete using the machine learning approach

In the process of structural design, it is useful to estimate the fracture toughness of concrete samples. This research showcases the effectiveness of utilizing machine learning methods to determine the fracture toughness of concrete. Taking into account variables such as mix design, machine learning techniques can accurately predict the mode I fracture toughness of concrete. Dimensionless stress intensity factor of concrete prediction using twelve different machine learning techniques namely, Linear regression (LR), Extreme Gradient-Boosting (XGboost), K-Nearest Neighbors (KNN), Random Forest (RF), Category Boosting (CB), Decision Tree (DT), Extra Trees (ET), Light Gradient-Boosting (LightGB), Adaptive boosting (AdaBoost), Bagging (BA), Gaussian Process (GP), Artificial Neural Network (ANN) and Support Vector Machine (SVM). The result of utilizing the training adaptive moment estimation algorithm has been developed to create an outstanding machine learning-based system. After carefully analyzing comparisons between the predictions produced by different models and experimental findings, it has been discovered that the models demonstrate an impressive accuracy rate of about 90 percent when it comes to forecasting concrete fracture toughness. The research findings emphasize that the ANN model exhibited superior accuracy in its predictions (R2 value of 0.90, RMSE of 0.1517, and MAE of 0.1238). Upon conducting a thorough examination of the ANN method’s sensitivity, the cement parameter holds utmost significance in accurately estimating concrete’s fracture toughness using the available dataset. So, the ANN model can be used as a valuable method to provide practical assistance in predicting the fracture toughness of concrete. When evaluating the effective parameters, the cement and metakaolin dosage and the notch height to specimen height ratio have the greatest effect on the fracture resistance, while the coarse aggregate content is minimal. This result is consistent with the experimental data.

Precision medicine in hepatology: harnessing IoT and machine learning for personalized liver disease stage prediction

<span>In this research, we used a dataset from Siksha ‘O’ Anusandhan (S’O’A) University Medical Laboratory containing 6,780 samples collected manually and through internet of things (IoT) sensor sources from 6,780 patients to perform a thorough investigation into liver disease stage prediction. The dataset was carefully cleaned before being sent to the machine learning pipeline. We utilised a range of machine learning models, such as Naïve Bayes (NB), sequential minimal optimisation (SMO), K-STAR, random forest (RF), and multi-class classification (MCC), using Python to predict the stages of liver disease. The results of our simulations demonstrated how well the SMO model performed in comparison to other models. We then expanded our analysis using different machine learning boosting models with SMO as the base model: adaptive boosting (AdaBoost), gradient boost, extreme gradient boosting (XGBoost), CatBoost, and light gradient boosting model (LightGBM). Surprisingly, gradient boost proved to be the most successful, producing an astounding 96% accuracy. A closer look at the data showed that when AdaBoost was combined with the SMO base model, the accuracy results were 94.10%, XGBoost 90%, CatBoost 92%, and LightGBM 94%. These results highlight the effectiveness of proposed model i.e. gradient boosting in improving the prediction of liver disease stage and provide insightful information for improving clinical decision support systems in the field of medical diagnostics.</span>

AI-driven data fusion modeling for enhanced prediction of mixed-mode I/III fracture toughness

This research evaluates the use of artificial intelligence to enhance the accuracy of predictions for mixed-mode I/III fracture toughness in polymethyl methacrylate . Traditionally, assessing fracture toughness relies heavily on destructive testing methods, specifically using edge-notch disc bend specimens subjected to three-point bending tests. These established methods are not only expensive and time-consuming but also frequently limited by the availability of data. To address these challenges, this study introduces a data fusion source modeling approach. This approach integrates primary fracture toughness test data with secondary predictive data derived from the maximum tangential stress criterion and the local strain energy density criterion. By employing adaptive boosting and general regression neural network algorithms, the models developed in this research demonstrate a marked improvement in predictive performance compared to traditional primary source models. Additionally, a feature importance analysis using Shapley Additive exPlanations values reveals that the mode mixity parameter, specimen thickness, and radius are critical factors influencing fracture toughness. The study highlights that while mode mixity emerges as the most significant factor, a reduction in specimen thickness generally leads to decreased fracture toughness, whereas an increase in radius has a more complex, often negative, effect. The results of this study indicate that AI-powered models using data fusion can overcome limitations related to data scarcity, enabling more accurate predictions in fracture mechanics. Furthermore, this approach provides a pathway for utilizing AI in other engineering domains where data sets are limited.

Policy-driven innovations in fraud prevention: Developing an ARFLGB-XGBoost early warning model to mitigate online romance scams in telecommunication networks

To address the escalating online romance scams within telecom fraud, we developed an Adaptive Random Forest Light Gradient Boosting (ARFLGB)-XGBoost early warning system. Our method involves compiling detailed Online Romance Scams (ORS) incident data into a 24-variable dataset, categorized to analyze feature importance with Random Forest and LightGBM models. An innovative adaptive algorithm, the Adaptive Random Forest Light Gradient Boosting, optimizes these features for integration with XGBoost, enhancing early Online romance scams threat detection. Our model showed significant performance improvements over traditional models, with accuracy gains of 3.9%, a 12.5% increase in precision, recall improvement by 5%, an F1 score increase by 5.6%, and a 5.2% increase in Area Under the Curve (AUC). This research highlights the essential role of advanced fraud detection in preserving communication network integrity, contributing to a stable economy and public safety, with implications for policymakers and industry in advancing secure communication infrastructure.

Machine learning discrimination of Gleason scores below GG3 and above GG4 for HSPC patients diagnosis

This study aims to develop machine learning (ML)-assisted models for analyzing datasets related to Gleason scores in prostate cancer, conducting statistical analyses on the datasets, and identifying meaningful features. We retrospectively collected data from 717 hormone-sensitive prostate cancer (HSPC) patients at Yunnan Cancer Hospital. Of these, data from 526 patients were used for modeling. Seven auxiliary models were established using Logistic Regression (LR), Support Vector Machine (SVM), Random Forest (RF), Decision Tree (DT), Extreme gradient boosting tree (XGBoost), Adaptive Boosting (Adaboost), and artificial neural network (ANN) based on 21 clinical biochemical indicators and features. Evaluation metrics included accuracy (ACC), precision (PRE), specificity (SPE), sensitivity (SEN) or regression rate(Recall), and f1 score. Evaluation metrics for the models primarily included ACC, PRE, SPE, SEN or Recall, f1 score, and area under the curve(AUC). Evaluation metrics were visualized using confusion matrices and ROC curves. Among the ensemble learning methods, RF, XGBoost, and Adaboost performed the best. RF achieved a training dataset score of 0.769 (95% CI: 0.759—0.835) and a testing dataset score of 0.755 (95% CI: 0.660—0.760) (AUC: 0.786, 95%CI: 0.722—0.803), while XGBoost achieved a training dataset score of 0.755 (95% CI: 95%CI: 0.711—0.809) and a testing dataset score of 0.745 (95% CI: 0.660—0.764) (AUC: 0.777, 95% CI: 0.726—0.798). Adaboost scored 0.789 on the training dataset (95% CI: 0.782—0.857) and 0.774 on the testing dataset (95% CI: 0.651—0.774) (AUC: 0.799, 95% CI: 0.703—0.802). In terms of feature importance (FI) in ensemble learning, Bone metastases at first visit, prostatic volume, age, and T1-T2 have significant proportions in RF’s FI. fPSA, TPSA, and tumor burden have significant proportions in Adaboost’s FI, while f/TPSA, LDH, and testosterone have the highest proportions in XGBoost. Our findings indicate that ensemble learning methods demonstrate good performance in classifying HSPC patient data, with TNM staging and fPSA being important classification indicators. These discoveries provide valuable references for distinguishing different Gleason scores, facilitating more accurate patient assessments and personalized treatment plans.

ANPS: machine learning based server for identification of anti-nutritional proteins in plants.

Anti-nutrient factors are inherently present in almost all major crops, which impede the absorption of crucial vitamins and minerals upon human consumption. The commonly found anti-nutrients in food crops are saponins, tannins, lectins, and phytates etc. Currently, there is a lack of computational server for identification of proteins that encode for anti-nutritional factors in plants. Consequently, this study represents a computational approach aimed at distinguishing between proteins encoding anti-nutritional factors and those providing essential nutrients. In this work, machine learning algorithms have been employed to identify plant specific anti-nutrient factor proteins from protein sequences by using compositional features. Achieving a five-fold cross-validation training performance of 94.34% AUC-ROC and 94.13% AUC-PR with extreme gradient boosting surpasses the performance of other methods such as support vector machine, random forest, and adaptive boosting. These results suggest the proposed approach is highly reliable in predicting plant-specific anti-nutritional factor proteins. The resulting prediction models have led to the development of an online server named ANPS, freely available at https://nipb-bi.icar.gov.in .