XGB Model Research Articles

Improving soil moisture prediction with deep learning and machine learning models

Reliable soil moisture (SM) data is critical for effective water resources management, yet its accurate measurement and prediction remain challenging. This study was conducted to develop a deep learning regression network for sub-hourly SM prediction and compare its performance with traditional machine learning models, including the eXtreme gradient boosting (XGB), light gradient-boosting (LGB), cat boosting (CB), random forest (RF), k-nearest neighbors (kNN), and long short-term memory (LSTM) models. Sub-hourly SM, electrical conductivity (EC), soil temperature (ST), and weather parameters were collected during research experiments conducted for two years (2020–2021 and 2021–2022) at the Tropical Research and Education Center (TREC), University of Florida. A network of SM sensors and a weather station were installed at the experimental site with 24 plots of green beans and sweet corn under full and three deficit irrigation treatments with three replications. Model performance metrics such as coefficient of determination (r2) and global performance indicator (GPI) were used to evaluate the performance of the models. Results showed that all MLs and DL models performed more than satisfactorily in simulating SM of green beans and sweet corn plots. The testing average r2 and GPI of MLs were 0.83 and 0.02 (green beans) and 0.85 and 0.02 (sweet corn). However, XGB and LGB models outperformed the remaining ML and DL models. The testing r2 and GPI of XGB were 0.86 and 0.014 for green beans, whereas 0.88 and 0.015 for sweet corn. The r2 and GPI values for the LGB were 0.85 and 0.014 for green beans, while 0.88 and 0.015 for sweet corn. Even though DL model took longer and resources to be trained, its performance was not as accurate as that of XGB and LGB models. However, the performance of DL was better than the LSTM model. The r2 and RMSE of the LSTM model were 0.68 and 0.02cm 3 cm-3 for green beans and 0.75 and 0.02cm 3 cm-3 for sweet corn, respectively. Whereas the r2 and RMSE of DL were 0.84 and 0.015cm 3 cm-3 (green beans) and 0.85 and 0.02 cm 3 cm-3 (sweet corn). The ML and DL models performed better in simulating SM of sweet corn plots than green beans. Overall, these results confirmed that the ML and DL models could be alternative tools for SM prediction for agricultural fields, with potential applications for irrigation scheduling and water resources management.

Hybrid XGB model for predicting unconfined compressive strength of solid waste-cement-stabilized cohesive soil

The utilization of cement has been found to have negative environmental impacts. In order to reduce the quantity of cement used and improve the mechanical properties of solid waste-cement-stabilized cohesive soil, the incorporation of solid waste as additives has been investigated. Unconfined compressive strength is a crucial parameter in geotechnical engineering. However, existing empirical formulas have limited accuracy and applicability when it comes to the unconfined compressive strength of solid waste-cement-stabilized cohesive soil. The machine learning model can be used to provide accurate and comprehensive predictions by considering the nonlinear relationships between independent and dependent variables. This study aims to propose a machine learning model tuned by optimization algorithms with high generalization performance in accurately predicting the unconfined compressive strength. Firstly, a database containing 474 specimens was developed. Secondly, eight machine learning models were established, composed five single models and three hybrid models, to train and test the database. Six performance indicators were employed to evaluate the generalization ability of these models. Finally, the optimal model was selected for analysis of the importance of the feature variables using shapley additive explanations, which were compared with those of the existing empirical model. The research findings indicated that, the extreme gradient boosting model tuned with tree-structured parzen estimators exhibited the highest predictive accuracy and generalization ability. The curing age, cement content, plastic limit, and water content were identified as the most critical factors influencing the unconfined compressive strength. Among the chemical components in solid waste, the aluminum oxide content and silicon dioxide content were found to significantly influence the unconfined compressive strength, while the impact of calcium oxide content was relatively minor. Furthermore, the optimal solid waste content was found to be around 10 %. This study made a significant contribution to the effective utilization of waste resources in the context of sustainable construction practices.

Prediction and optimization framework of shear strength of reinforced concrete flanged shear wall based on machine learning and non-dominated sorting genetic algorithm-II

Reinforced concrete (RC) flanged shear wall has good lateral strength and stiffness, which has been widely used in building structures. Due to the coupling effect of many factors such as wall section shape, shear span ratio, so the shear performance evaluation of flanged wall is still very limited. This paper proposed a prediction framework for the shear capacity of RC flanged shear walls. A database containing 14 input variables, 1 output variable and 153 samples was constructed to evaluate the prediction accuracy of 11 existing design methods. The Pearson coefficient was used to preliminarily analyze the correlation between variables. The grid search was used to optimize the hyperparameters of 4 machine learning models, and six statistical indicators ( R2, R, RMSE, SD, MAE, and MAPE) were used to comprehensively compare the prediction results of the ML models to determine the best model. On this basis, SHapley Additive exPlanations (SHAP) was used to enhance the interpretability of the prediction models, and the mechanism of the input variables on the shear capacity was quantified. A graphical user interface (GUI) was proposed to guide the engineering design. A multi-objective model (MOO) was established to analyze the trade-off between shear performance and cost, thereby determining the best optimal scheme. The results show that the prediction accuracy of the ML models is better than the existing design methods. The XGB model has the best prediction performance, with R2, R, RMSE are 0.99, 0.99, 118.96, respectively. The SHAP method can effectively enhance the interpretability of the ML models, and tw, lw and f ′c are the key parameters affecting the shear capacity of the flanged shear wall.

A new approach to estimate total nitrogen concentration in a seasonal lake based on multi-source data methodology

Nitrogen, a key limiter in lake eutrophication, presents serious threats to both human health and ecological balance. Despite its non-optically active nature, this study introduces an advanced retrieval approach for total nitrogen, utilizing a synthesis of multi-source data and sophisticated machine learning algorithms to markedly boost estimation precision. This innovative method integrates environmental variables, such as water temperature, depth, and flow rate with spectral reflectance, significantly enhancing the predictive accuracy of our machine learning models with high stability. The models tested, including Support Vector Machine (SVM), Random Forest (RF), Extreme Gradient Boosting (XGB), Multilayer Perceptron (MLP), and Convolutional Neural Networks (CNN), with XGB outperforming others by achieving robust metrics: an R2 of 0.78, a Mean Absolute Error (MAE) of 0.21 mg/L, and a Mean Absolute Percentage Error (MAPE) of 16.04 %. Applying the optimized XGB model, we documented fluctuations in nitrogen concentrations within Poyang Lake across different hydrological phases in 2021, revealing the lowest nitrogen levels during the flood season and the highest in low water periods, with high concentrations at the inlets of the North Branch of the Ganjiang River and the Raohe River estuaries. Monte Carlo simulations reveal that the model is not much sensitive to input feature errors, validating its stability. The approach proposed in this study may help more precise total nitrogen retrieval in other similar lake waters.

Prediction of Glass Transition Temperature of Polymers Using Simple Machine Learning.

Polymer materials have garnered significant attention due to their exceptional mechanical properties and diverse industrial applications. Understanding the glass transition temperature (Tg) of polymers is critical to prevent operational failures at specific temperatures. Traditional methods for measuring Tg, such as differential scanning calorimetry (DSC) and dynamic mechanical analysis, while accurate, are often time-consuming, costly, and susceptible to inaccuracies due to random and uncertain factors. To address these limitations, the aim of the present study is to investigate the potential of Simplified Molecular Input Line Entry System (SMILES) as descriptors in simple machine learning models to predict Tg efficiently and reliably. Five models were utilized: k-nearest neighbors (KNNs), support vector regression (SVR), extreme gradient boosting (XGBoost), artificial neural network (ANN), and recurrent neural network (RNN). SMILES descriptors were converted into numerical data using either One Hot Encoding (OHE) or Natural Language Processing (NLP). The study found that SMILES inputs with fewer than 200 characters were inadequate for accurately describing compound structures, while inputs exceeding 200 characters diminished model performance due to the curse of dimensionality. The ANN model achieved the highest R2 value of 0.79; however, the XGB model, with an R2 value of 0.774, exhibited the highest stability and shorter training times compared to other models, making it the preferred choice for Tg prediction. The efficiency of the OHE method over NLP was demonstrated by faster training times across the KNN, SVR, XGB, and ANN models. Validation of new polymer data showed the XGB model's robustness, with an average prediction deviation of 9.76 from actual Tg values. These findings underscore the importance of optimizing SMILES conversion methods and model parameters to enhance prediction reliability. Future research should focus on improving model accuracy and generalizability by incorporating additional features and advanced techniques. This study contributes to the development of efficient and reliable predictive models for polymer properties, facilitating the design and application of new polymer materials.

Utilizing multiclassifier radiomics analysis of ultrasound to predict high axillary lymph node tumour burden in node-positive breast cancer patients: a multicentre study

Background The tumor burden within the axillary lymph nodes (ALNs) constitutes a pivotal factor in breast cancer, serving as the primary determinant for treatment decisions and exhibiting a close correlation with prognosis. Objective This study aimed to investigate the potential of ultrasound-based radiomics and clinical characteristics in non-invasively distinguishing between low tumor burden (1-2 positive nodes) and high tumor burden (more than 2 positive nodes) in patients with node-positive breast cancer. Methods A total of 215 patients with node-positive breast cancer, who underwent preoperative ultrasound examinations, were enrolled in this study. Among these patients, 144 cases were allocated to the training set, 37 cases to the validation set, and 34 cases to the testing set. Postoperative histopathology was used to determine the status of ALN tumor burden. The region of interest for breast cancer was delineated on the ultrasound image. Nine models were developed to predict high ALN tumor burden, employing a combination of three feature screening methods and three machine learning classifiers. Ultimately, the optimal model was selected and tested on both the validation and testing sets. In addition, clinical characteristics were screened to develop a clinical model. Furthermore, Shapley additive explanations (SHAP) values were utilized to provide explanations for the machine learning model. Results During the validation and testing sets, the models demonstrated area under the curve (AUC) values ranging from 0.577 to 0.733 and 0.583 to 0.719, and accuracies ranging from 64.9% to 75.7% and 64.7% to 70.6%, respectively. Ultimately, the Boruta_XGB model, comprising five radiomics features, was selected as the final model. The AUC values of this model for distinguishing low from high tumor burden were 0.828, 0.715, and 0.719 in the training, validation, and testing sets, respectively, demonstrating its superiority over the clinical model. Conclusions The developed radiomics models exhibited a significant level of predictive performance. The Boruta_XGB radiomics model outperformed other radiomics models in this study.

Predicting compressive strength of hollow concrete prisms using machine learning techniques and explainable artificial intelligence (XAI)

The design of masonry structures requires accurate estimation of compressive strength (CS) of hollow concrete masonry prisms. Generally, the CS of masonry prisms is determined by destructive laboratory testing which results in time and resource wastage. Thus, this study aims to provide machine learning-based predictive models for CS of hollow concrete masonry blocks using different algorithms including Multi Expression Programming (MEP), Random Forest Regression (RFR), and Extreme Gradient Boosting (XGB) etc. A dataset of 159 experimental results was collected from published literature for this purpose. The collected dataset consisted of four input parameters including strength of masonry units (fb), height-to-thickness ratio (h/t), strength of mortar (fm), and ratio of fm/fb and only one output parameter i.e., CS. Out of all the algorithms employed in current study, only MEP and GEP expressed their output in the form of an empirical equation. The accuracy of developed models was assessed using root mean squared error (RMSE), objective function (OF), and R2 etc. Among all algorithms assessed, XGB turned out to be the most accurate having R2 = 0.99 and least OF value of 0.0063 followed by AdaBoost, RFR, and other algorithms. The developed XGB model was also used to conduct different explainable artificial intelligence (XAI) analysis including sensitivity and shapley analysis and the results showed that strength of masonry unit (fb) is the most significant variable in predicting CS. Thus, the ML-based predictive models presented in this study can be utilized practically for determining CS of hollow concrete masonry prisms without requiring expensive and time-consuming laboratory testing.

Applying Machine Learning for Prescriptive Support: A Use Case with Unfractionated Heparin in Intensive Care Units.

Continuous unfractionated heparin is widely used in intensive care, yet its complex pharmacokinetic properties complicate the determination of appropriate doses. To address this challenge, we developed machine learning models to predict over- and under-dosing, based on anti-Xa results, using a monocentric retrospective dataset. The random forest model achieved a mean AUROC of 0.80 [0.77-0.83], while the XGB model reached a mean AUROC of 0.80 [0.76-0.83]. Feature importance was employed to enhance the interpretability of the model, a critical factor for clinician acceptance. After prospective validation, machine learning models such as those developed in this study could be implemented within a computerized physician order entry (CPOE) as a clinical decision support system (CDSS).

Machine learning model to predict rate constants for sonochemical degradation of organic pollutants

In this study, machine learning (ML) algorithms were employed to predict the pseudo-1st-order reaction rate constants for the sonochemical degradation of aqueous organic pollutants under various conditions. A total of 618 sets of data, including ultrasonic, solution, and pollutant characteristics, were collected from 89 previous studies. Considering the difference between the electrical power (Pele) and calorimetric power (Pcal), the collected data were divided into two groups: data with Pele and data with Pcal. Eight input variables, including frequency, power density, pH, temperature, initial concentration, solubility, vapor pressure, and octanol–water partition coefficient (Kow), and one target variable of the degradation rate constant, were selected for ML. Statistical analysis was conducted, and outliers were determined separately for the two groups. ML models, including random forest (RF), extreme gradient boosting (XGB), and light gradient boosting machine (LGB), were used to predict the pseudo-1st-order reaction rate constants for the removal of aqueous pollutants. The prediction performance of the ML models was evaluated using different metrics, including the root mean squared error (RMSE), mean absolute error (MAE), and R squared (R2). A significantly higher prediction performance was obtained using data without outliers and augmented data. Consequently, all the applied ML models could be used to predict the sonochemical degradation of aqueous pollutants, and the XGB model showed the highest accuracy in predicting the rate constants. In addition, the power density and frequency were the most influential factors among the eight input variables in prediction with the Shapley additive explanation (SHAP) values method. The degradation rate constants of the two pollutants over a wide frequency range (20–1,000 kHz) were predicted using the trained ML model (XGB) and the prediction results were analyzed.

Discovery of an End-to-End Pattern for Contaminant-Oriented Advanced Oxidation Processes Catalyzed by Biochar with Explainable Machine Learning.

The utilization of biochar-catalyzed peroxymonosulfate in advanced oxidation processes (BC-PMS AOPs) is widely acknowledged as an effective and economical method for mitigating emerging contaminants (ECs). Especially, state-of-the-art machine learning (ML) technology has been employed to accurately predict the reaction rate constants of EC degradation in BC-PMS AOPs, primarily focusing on three aspects: performance prediction, operating condition optimization, and mechanism interpretation. However, its real application in specific degradation optimization targeting different ECs is seldom considered, hindering the realization of contaminant-oriented BC-PMS AOPs. Herein, we propose a hierarchical ML pipeline to achieve an end-to-end (E2E) pattern for addressing this issue. First, the overall XGB model, trained with the comprehensive data set, can perform well in predicting the reaction constants of EC degradation in BC-PMS AOPs, additionally providing the basis for further analysis of various ECs. Then, the submodels trained with different EC clusters can offer specific strategies for the selection of the optimum option for BC-PMS AOPs of specific ECs with different HOMO-LUMO gaps, thus forming an E2E operating pattern for BC-PMS AOPs. This study not only increases our understanding of contaminant-oriented optimization of AOPs but also successfully bridges the gap between ML model development and its environmental application.

Comparison of five methods for improving the accuracy of SRTM3 DEM and TanDEM-X DEM in the Qinghai-Tibet Plateau using ICESat-2 data

ABSTRACT The accuracy of digital elevation models (DEMs) is crucial for practical applications in complex terrain. In this study, various correction models were employed to evaluate and correct the 90 m SRTM3 DEM and TanDEM-X DEM data in the Qinghai-Tibet Plateau region. A simple and universal three-dimensional data co-registration method was utilized for horizontal alignment. The study demonstrated a significant reduction in horizontal discrepancies between datasets after data co-registration. By comparing the performance of five different correction methods, it was found that the RF model exhibited excellent accuracy and robustness, making it particularly suitable for applications that require high precision. The XGB and BPNN models offer a good balance between accuracy and time efficiency, making them suitable for research scenarios that are less sensitive to precision requirements. In contrast, the MLR and IDW methods performed poorly and are not recommended for high-precision applications. Furthermore, the corrected DEMs showed improved resistance to the influence of high slopes, enhancing their applicability in complex terrain areas. This study provides an important reference for the correction of high-quality DEMs in the Qinghai-Tibet Plateau region and offers valuable insights for DEM research in similar areas.

Application of machine learning approaches to predict ammonium nitrogen transport in different soil types and evaluate the contribution of control factors

The loss of nitrogen in soil damages the environment. Clarifying the mechanism of ammonium nitrogen (NH4+-N) transport in soil and increasing the fixation of NH4+-N after N application are effective methods for improving N use efficiency. However, the main factors are not easily identified because of the complicated transport and retardation factors in different soils. This study employed machine learning (ML) to identify the main influencing factors that contribute to the retardation factor (Rf) of NH4+-N in soil. First, NH4+-N transport in the soil was investigated using column experiments and a transport model. The Rf (1.29 – 17.42) was calculated and used as a proxy for the efficacy of NH4+-N transport. Second, the physicochemical parameters of the soil were determined and screened using lasso and ridge regressions as inputs for the ML model. Third, six machine learning models were evaluated: Adaptive Boosting, Extreme Gradient Boosting (XGB), Random Forest, Gradient Boosting Regression, Multilayer Perceptron, and Support Vector Regression. The optimal ML model of the XGB model with a low mean absolute error (0.81), mean squared error (0.50), and high test r2 (0.97) was obtained by random sampling and five-fold cross-validation. Finally, SHapely Additive exPlanations, entropy-based feature importance, and permutation characteristic importance were used for global interpretation. The cation exchange capacity (CEC), total organic carbon (TOC), and Kaolin had the greatest effects on NH4+-N transport in the soil. The accumulated local effect offered a fundamental insight: When CEC > 6 cmol+ kg−1, and TOC > 40 g kg−1, the maximum resistance to NH4+-N transport within the soil was observed. This study provides a novel approach for predicting the impact of the soil environment on NH4+-N transport and guiding the establishment of an early-warning system of nutrient loss.

Artificial Intelligence-Empowered Doppler Weather Profile for Low-Earth-Orbit Satellites.

Low-Earth-orbit (LEO) satellites are widely acknowledged as a promising infrastructure solution for global Internet of Things (IoT) services. However, the Doppler effect presents a significant challenge in the context of long-range (LoRa) modulation uplink connectivity. This study comprehensively examines the operational efficiency of LEO satellites concerning the Doppler weather effect, with state-of-the-art artificial intelligence techniques. Two LEO satellite constellations-Globalstar and the International Space Station (ISS)-were detected and tracked using ground radars in Perth and Brisbane, Australia, for 24 h starting 1 January 2024. The study involves modelling the constellation, calculating latency, and frequency offset and designing a hybrid Iterative Input Selection-Long Short-Term Memory Network (IIS-LSTM) integrated model to predict the Doppler weather profile for LEO satellites. The IIS algorithm selects relevant input variables for the model, while the LSTM algorithm learns and predicts patterns. This model is compared with Convolutional Neural Network and Extreme Gradient Boosting (XGBoost) models. The results show that the packet delivery rate is above 91% for the sensitive spread factor 12 with a bandwidth of 11.5 MHz for Globalstar and 145.8 MHz for ISS NAUKA. The carrier frequency for ISS orbiting at 402.3 km is 631 MHz and 500 MHz for Globalstar at 1414 km altitude, aiding in combating packet losses. The ISS-LSTM model achieved an accuracy of 97.51% and a loss of 1.17% with signal-to-noise ratios (SNRs) ranging from 0-30 dB. The XGB model has the fastest testing time, attaining ≈0.0997 s for higher SNRs and an accuracy of 87%. However, in lower SNR, it proves to be computationally expensive. IIS-LSTM attains a better computation time for lower SNRs at ≈0.4651 s, followed by XGB at ≈0.5990 and CNN at ≈0.6120 s. The study calls for further research on LoRa Doppler analysis, considering atmospheric attenuation, and relevant space parameters for future work.

Intelligent evaluation of interference effects between tall buildings based on wind tunnel experiments and explainable machine learning

The interference effects of taller high-rise buildings significantly impact the nearby shorter high-rise buildings in dense urban areas, potentially leading to severe wind-induced disasters. This study aims to develop a universal intelligent assessment method to predict the aerodynamic forces and wind-induced responses of buildings, considering various interfering and coupling factors. A database containing 61440 samples is established through a series of synchronous pressure measurement wind tunnel tests. The aerodynamic forces and wind-induced responses were predicted using six machine learning models under varying wind fields, interfering building locations, interfering building sizes, and dynamic characteristics of the principal building. The performance of the models was enhanced through Bayesian hyperparameter optimization and evaluated using the R2 and NRMSE. Additionally, the SHapley Additive exPlanations (SHAP) method was applied to evaluate the impact of each factor on the aerodynamic force and wind-induced response coefficients. Eight specific cases were examined using local SHAP explanations to explore the influence of seven input variables on maximum wind-induced response coefficients. Results indicated that the XGB model exhibited superior predictive performance, with R2 exceeding 0.99 in both training and testing sets. The SHAP analysis revealed significant impacts from wind direction angle, reduced wind speed, and damping ratio on wind-induced response. Consequently, irrelevant or minimally impactful input variables were removed from the XGB models. The R2 and NRMSE variation rate with reduced inputs for the optimized XGB model was less than 0.45 %. The graphical user interface (GUI) was designed can effectively guide intelligent urban planning and building design.

Preventive machine learning models incorporating health checkup data and hair mineral analysis for low bone mass identification

Machine learning (ML) models have been increasingly employed to predict osteoporosis. However, the incorporation of hair minerals into ML models remains unexplored. This study aimed to develop ML models for predicting low bone mass (LBM) using health checkup data and hair mineral analysis. A total of 1206 postmenopausal women and 820 men aged 50 years or older at a health promotion center were included in this study. LBM was defined as a T-score below − 1 at the lumbar, femur neck, or total hip area. The proportion of individuals with LBM was 59.4% (n = 1205). The features used in the models comprised 50 health checkup items and 22 hair minerals. The ML algorithms employed were Extreme Gradient Boosting (XGB), Random Forest (RF), Gradient Boosting (GB), and Adaptive Boosting (AdaBoost). The subjects were divided into training and test datasets with an 80:20 ratio. The area under the receiver operating characteristic curve (AUROC), accuracy, sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV) and an F1 score were evaluated to measure the performances of the models. Through 50 repetitions, the mean (standard deviation) AUROC for LBM was 0.744 (± 0.021) for XGB, the highest among the models, followed by 0.737 (± 0.023) for AdaBoost, and 0.733 (± 0.023) for GB, and 0.732 (± 0.021) for RF. The XGB model had an accuracy of 68.7%, sensitivity of 80.7%, specificity of 51.1%, PPV of 70.9%, NPV of 64.3%, and an F1 score of 0.754. However, these performance metrics did not demonstrate notable differences among the models. The XGB model identified sulfur, sodium, mercury, copper, magnesium, arsenic, and phosphate as crucial hair mineral features. The study findings emphasize the significance of employing ML algorithms for predicting LBM. Integrating health checkup data and hair mineral analysis into these models may provide valuable insights into identifying individuals at risk of LBM.

A study of "left against medical advice" emergency department patients: an optimized explainable artificial intelligence framework.

The issue of left against medical advice (LAMA) patients is common in today's emergency departments (EDs). This issue represents a medico-legal risk and may result in potential readmission, mortality, or revenue loss. Thus, understanding the factors that cause patients to "leave against medical advice" is vital to mitigate and potentially eliminate these adverse outcomes. This paper proposes a framework for studying the factors that affect LAMA in EDs. The framework integrates machine learning, metaheuristic optimization, and model interpretation techniques. Metaheuristic optimization is used for hyperparameter optimization-one of the main challenges of machine learning model development. Adaptive tabu simulated annealing (ATSA) metaheuristic algorithm is utilized for optimizing the parameters of extreme gradient boosting (XGB). The optimized XGB models are used to predict the LAMA outcomes for patients under treatment in ED. The designed algorithms are trained and tested using four data groups which are created using feature selection. The model with the best predictive performance is then interpreted using the SHaply Additive exPlanations (SHAP) method. The results show that best model has an area under the curve (AUC) and sensitivity of 76% and 82%, respectively. The best model was explained using SHAP method.

Predicting natural vibration period of concrete frame structures having masonry infill using machine learning techniques

The natural period of vibration is one of the most significant factors used in the seismic design of buildings. Although the building design codes and previous studies provide some empirical methods to compute the natural period of vibration (T), their marginal accuracy and inability to incorporate the effect of masonry infill on vibration period significantly limits their use. Thus, researchers are constantly trying to find new and accurate methods to calculate T of concrete structures. To this end, this study presents the novel approach to predict T of reinforced concrete framed buildings (RC buildings) using Multi Expression Programming (MEP), Extreme Gradient Boosting (XGB), and Gene Expression Programming (GEP) machine learning algorithms. For this purpose, an extensive dataset of 569 points was gathered from previously published studies and split into training and testing sets for training and testing the algorithms respectively by using several error evaluation metrices like coefficient of determination (R2), Root Mean Squared Error (RMSE), and Objective Function (OF) etc. The results of error evaluation showed that XGB is the most accurate algorithm having the least OF value of 0.012 compared to 0.037 of MEP and 0.048 of GEP. Additionally, several explanatory analyses like sensitivity and shapley analysis were conducted on the XGB model which showed that number of storeys and opening ratio are the most contributing variables to prediction period of vibration. Thus, the models developed in this study can be practically utilized for determining natural vibration period of reinforced concrete frames with masonry infill.

Ensemble Extreme Gradient Boosting based models to predict the bearing capacity of micropile group

In most cases in which non-allowable settlement or losing of bearing capacity has been encountered in geotechnical engineering, employing micropile usually leads to satisfactory outcomes. Considering the costly and time consuming of utilizing the experimental tests in order to determine the bearing capacity of micropile-cap footings, utilizing artificial intelligence based approaches is a reasonable process in this regard. Nevertheless, because the q/cu is almost complex, forecasting phenomena is challenable. In this regard, powerful approaches were developed employing the hybrid Extreme Gradient Boosting (XGBoost) model on the database to precise estimation of the output. For this purpose, 780 rows of data has been collected in order to construct a powerful dataset from various existing valid literatures. Besides, four recently published optimizing approaches containing Black Widow Optimization Algorithm (BWOA), Artificial Hummingbird Algorithm (AHA), Arithmetic Optimization Algorithm (AOA) and Fire Hawk Optimization (FHO) have been employed to reach the high fitness of internal parameters of the XGBoost model. By simulating XGBoost optimized models, it was revealed that the developed AHA−XGB model can be more accurate than that of the other models in predicting the q/cu. Scatter index, sensitivity and uncertainty analysis were conducted to identified the importance of various input parameters was created.

Predicting recurrent gestational diabetes mellitus using artificial intelligence models: a retrospective cohort study.

We aimed to develop novel artificial intelligence (AI) models based on early pregnancy features to forecast the likelihood of recurrent gestational diabetes mellitus (GDM) before 14weeks of gestation in subsequent pregnancies. This study involved a cohort of 588 women who had two consecutive singleton deliveries and were diagnosed with GDM during the index pregnancy. The least absolute shrinkage and selection operator (LASSO) regression analysis were used for feature selection. 5 AI algorithms, namely support vector machine (SVM), extreme gradient boosting (XGB), light gradient boosting (LGB), decision tree classifier (DTC), and random forest (RF) classifier, and traditional multivariate logistic regression (LR) model, were employed to construct predictive models for recurrent GDM. 326 (55.4%) experienced GDM recurrence in subsequent pregnancy. In the training set (67% of the study sample), 13 features were selected for AI models construction. In the testing set (33% of the study sample), the AI models (LGB, RF, and XGB) exhibited outstanding discrimination, with AUROC values of 0.942, 0.936, and 0.924, respectively. The traditional LR model showed moderate discrimination (AUROC = 0.696). LGB, RF, and XGB models also demonstrated excellent calibration, while other models indicated a lack of fit. All AI models showed superior overall net benefits, with LGB, RF, and XGB outperforming the others. The proposed LGB model demonstrated exceptional accuracy, excellent calibration, and superior overall net benefits. These advancements have the potential to assist healthcare professionals in advising women with a history of GDM and in developing preventive strategies to mitigate the adverse effects on maternal and fetal well-being.

Prediction of PFAS bioaccumulation in different plant tissues with machine learning models based on molecular fingerprints

Due to the wastewater irrigation or biosolid application, per- and polyfluoroalkyl substances (PFASs) have been widely detected in agriculture soil and hence crops or vegetables. Consumption of contaminated crops and vegetables is considered as an important route of human exposure to PFASs. Machine learning (ML) models have been developed to predict PFAS uptake by plants with majority focus on roots. However, ML models for predicting accumulation of PFASs in above ground edible tissues have yet to be investigated. In this study, 811 data points covering 22 PFASs represented by molecular fingerprints and 5 plant categories (namely the root class, leaf class, cereals, legumes, and fruits) were used for model development. The Extreme Gradient Boosting (XGB) model demonstrated the most favorable performance to predict the bioaccumulation factors (BAFs) in all the 4 plant tissues (namely root, leaf, stem, and fruit) achieving coefficients of determination R2 as 0.82–0.93. Feature importance analysis showed that the top influential factors for BAFs varied among different plant tissues, indicating that model developed for root concentration prediction may not be feasible for above ground parts. The XGB model's performance was further demonstrated by comparing with data from pot experiments measuring BAFs of 12 PFASs in lettuce. The correlation between predicted and measured results was favorable for BAFs in both lettuce roots and leaves with R2 values of 0.76 and 0.81. This study developed a robust approach to comprehensively understand the uptake of PFASs in both plant roots and above ground parts, offering key insights into PFAS risk assessment and food safety.