Ensemble Machine Learning Framework Research Articles

Reconstruction of PM2.5 Concentrations in East Asia on the Basis of a Wide–Deep Ensemble Machine Learning Framework and Estimation of the Potential Exposure Level from 1981 to 2020

Satellite observations are widely used to estimate the concentrations of surface air pollutants, but the temporal coverage of these datasets is relatively short. To overcome this limitation, we propose a wide–deep ensemble machine learning framework to reconstruct the fine particulate matter (PM2.5) dataset of east Asia (EA) over the past four decades (1981–2020). The results indicate that the framework effectively leveraged the advantages of satellite observations (higher accuracy) and model-based estimations (longer temporal coverage) of surface air pollutants. The reconstructed PM2.5 concentrations agreed well with the ground measurements, with coefficient of determination (R2) and root-mean-square error (RMSE) values of 0.99 and 1.38 μg·m−3, respectively, which outperformed the satellite-based PM2.5 estimates. As more ground measurements were incorporated into the model for training, the average RMSE in Japan and the Korean Peninsula decreased to 0.83 and 1.50 μg·m−3, respectively. Simultaneously, on the basis of the reconstructed datasets, we investigated the exposure level to PM2.5 in EA from 1981 to 2020. Since 2000, the increase in anthropogenic emissions has substantially worsened the air quality in EA, and nearly 50% of the population resided in areas where the annual average PM2.5 concentrations exceeded 50 μg·m−3 from 2009–2010. Despite the implementation of various mitigation strategies by local authorities to lower the ambient PM2.5 concentrations, the entire exposure level in EA is still implausible to meet the WHO air quality guidelines. In addition, population aging and climate change have the potential to increase PM2.5 exposure risk in the future. For policy-makers in EA, it is essential to consider the effects of these factors and develop more effective mitigation strategies that aim to lessen the health impact associated with PM2.5 exposure.

An ensemble machine learning framework with explainable artificial intelligence for predicting haemoglobin anaemia considering haematological markers

Anaemia is a disorder marked by low blood levels of haemoglobin (HGB), affecting people of all ages and ethnicities and is a major global public health concern. Anaemia must be diagnosed as soon as possible to enable prompt treatment and intervention, which can reduce complications and enhance patient outcomes. With the ability to improve diagnostic precision and expedite patient care procedures, machine learning (ML) has become a potent instrument in the healthcare industry. Hence, we examine the use of ML approaches to predict haemoglobin-like anaemia in this research article. Based on a heterogeneous dataset of blood markars, we investigate the performance of many machine learning techniques such as Logistic Regression, CatBoost, XgBoost Decision Trees, KNN and others. The algorithms are further ensembled using a customized stacking approach. The ML models' judgments are interpreted using explainable artificial intelligence (XAI) methods. The xgboost and the stacking classifier obtained an accuracy, precision and recall of 99% each. Our research shows how ML models can help with the early diagnosis and treatment of anaemia, which will ultimately lead to better patient outcomes and healthcare results. Overall, the research shows how ML emphasizes the value of interdisciplinary cooperation in solving challenging medical problems.

Prediction of the internal corrosion rate for oil and gas pipelines and influence factor analysis with interpretable ensemble learning

Corrosion is one of the major threats to the safety and reliability of oil and gas pipelines, making accurate prediction of corrosion rate crucial for pipeline maintenance and repairment. Traditional prediction methods often ignore more critical factors and lack interpretability, which hinders the practical application. Here, an interpretable ensemble machine learning framework is proposed, not only improving prediction performance, but also enhancing interpretability for predicting the internal corrosion rate of oil and gas pipelines. In this work, ExtraTreeRegression model has demonstrated superior prediction accuracy relative to the other five machine learning models, and the determination coefficient of the ExtraTreeRegression model achieves 0.93 after feature engineering. Then, Shapley Additive exPlanations (SHAP) values is utilized to visually interpret the model locally and globally to help account for the contributions of the input features. Furthermore, the accumulated local effect (ALE) successfully explains how the features affect the internal corrosion rate of oil and gas pipelines. By collecting corrosion data of oil and gas pipeline and performing feature engineering and data preprocessing, we construct a comprehensive and reliable prediction model with interpretability. Experimental results demonstrate that the proposed interpretable ensemble machine learning approach outperforms other models in both accuracy and interpretability, providing valuable insights for pipeline management decisions.

Ensemble machine learning framework for predicting maternal health risk during pregnancy

Maternal health risks can cause a range of complications for women during pregnancy. High blood pressure, abnormal glucose levels, depression, anxiety, and other maternal health conditions can all lead to pregnancy complications. Proper identification and monitoring of risk factors can assist to reduce pregnancy complications. The primary goal of this research is to use real-world datasets to identify and predict Maternal Health Risk (MHR) factors. As a result, we developed and implemented the Quad-Ensemble Machine Learning framework to predict Maternal Health Risk Classification (QEML-MHRC). The methodology used a vacxsriety of Machine Learning (ML) models, which then integrated with four ensemble ML techniques to improve prediction. The dataset collected from various maternity hospitals and clinics subjected to nineteen training and testing tests. According to the exploratory data analysis, the most significant risk factors for pregnant women include high blood pressure, low blood pressure, and high blood sugar levels. The study proposed a novel approach to dealing with high-risk factors linked to maternal health. Dealing with class-specific performance elaborated further to properly understand the distinction between high, low, and medium risks. All tests yielded outstanding results when predicting the amount of risk during pregnancy. In terms of class performance, the dataset associated with the “HR” class outperformed the others, predicting 90% correctly. GBT with ensemble stacking outperformed and demonstrated remarkable performance for all evaluation measure (0.86) across all classes in the dataset. The key success of the models used in this work is the ability to measure model performance using a class-wise distribution. The proposed approach can help medical experts assess maternal health risks, saving lives and preventing complications throughout pregnancy. The prediction approach presented in this study can detect high-risk pregnancies early on, allowing for timely intervention and treatment. This study’s development and findings have the potential to raise public awareness of maternal health issues.

A multi-view ensemble machine learning approach for 3D modeling using geological and geophysical data

Geophysical data are often integrated into geological data for 3D modeling of underground spaces. However, the existing single-view approach means it is difficult to adequately fuse the valid information between the two types of data, and the complexity of lithological decoding and classification is high. To address this issue, a multi-view ensemble machine learning (ML) framework is proposed. Initially, the original dataset of lithology prediction is constructed by aligning geological and geophysical data with different spatial scales. Next, the dataset is divided into three datasets of structural strength, density, and moisture content according to the lithology properties of the geophysical data. The proposed framework is then used to capture the lithologic characteristics under different views to achieve the prediction of lithologic labels. In this process, a self-attentive mechanism is used to adaptively fuse the valid information under each view. To validate the proposed framework, it is applied to a project in Jiaxing, Zhejiang Province, China. Compared with existing ML methods, the proposed multi-view ensemble ML framework improves modeling accuracy and constructs models with low uncertainty. The framework can be extended to other multi-source data fusion tasks across geoscience domains.

Predicting the Environmental Suitability and Identifying Climate and Sociodemographic Correlates of Guinea Worm (Dracunculus medinensis) in Chad.

A comprehensive understanding of the spatial distribution and correlates of infection are key for the planning of disease control programs and assessing the feasibility of elimination and/or eradication. In this work, we used species distribution modeling to predict the environmental suitability of the Guinea worm (Dracunculus medinensis) and identify important climatic and sociodemographic risk factors. Using Guinea worm surveillance data collected by the Chad Guinea Worm Eradication Program (CGWEP) from 2010 to 2022 in combination with remotely sensed climate and sociodemographic correlates of infection within an ensemble machine learning framework, we mapped the environmental suitability of Guinea worm infection in Chad. The same analytical framework was also used to ascertain the contribution and influence of the identified climatic risk factors. Spatial distribution maps showed predominant clustering around the southern regions and along the Chari River. We also identified areas predicted to be environmentally suitable for infection. Of note are districts near the western border with Cameroon and southeastern border with Central African Republic. Key environmental correlates of infection as identified by the model were proximity to permanent rivers and inland lakes, farmlands, land surface temperature, and precipitation. This work provides a comprehensive model of the spatial distribution of Guinea worm infections in Chad 2010-2022 and sheds light on potential environmental correlates of infection. As the CGWEP moves toward elimination, the methods and results in this study will inform surveillance activities and help optimize the allocation of intervention resources.

Early depression detection using ensemble machine learning framework

Early depression detection using ensemble machine learning framework

Estimating the volume of penumbra in rodents using DTI and stack-based ensemble machine learning framework

BackgroundThis study investigates the potential of diffusion tensor imaging (DTI) in identifying penumbral volume (PV) compared to the standard gadolinium-required perfusion–diffusion mismatch (PDM), utilizing a stack-based ensemble machine learning (ML) approach with enhanced explainability.MethodsSixteen male rats were subjected to middle cerebral artery occlusion. The penumbra was identified using PDM at 30 and 90 min after occlusion. We used 11 DTI-derived metrics and 14 distance-based features to train five voxel-wise ML models. The model predictions were integrated using stack-based ensemble techniques. ML-estimated and PDM-defined PVs were compared to evaluate model performance through volume similarity assessment, the Pearson correlation analysis, and Bland–Altman analysis. Feature importance was determined for explainability.ResultsIn the test rats, the ML-estimated median PV was 106.4 mL (interquartile range 44.6–157.3 mL), whereas the PDM-defined median PV was 102.0 mL (52.1–144.9 mL). These PVs had a volume similarity of 0.88 (0.79–0.96), a Pearson correlation coefficient of 0.93 (p < 0.001), and a Bland–Altman bias of 2.5 mL (2.4% of the mean PDM-defined PV), with 95% limits of agreement ranging from -44.9 to 49.9 mL. Among the features used for PV prediction, the mean diffusivity was the most important feature.ConclusionsOur study confirmed that PV can be estimated using DTI metrics with a stack-based ensemble ML approach, yielding results comparable to the volume defined by the standard PDM. The model explainability enhanced its clinical relevance. Human studies are warranted to validate our findings.Relevance statementThe proposed DTI-based ML model can estimate PV without the need for contrast agent administration, offering a valuable option for patients with kidney dysfunction. It also can serve as an alternative if perfusion map interpretation fails in the clinical setting.Key points• Penumbral volume can be estimated by DTI combined with stack-based ensemble ML.• Mean diffusivity was the most important feature used for predicting penumbral volume.• The proposed approach can be beneficial for patients with kidney dysfunction.Graphical

Design an optimization based ensemble machine learning framework for detecting rice leaf diseases

Design an optimization based ensemble machine learning framework for detecting rice leaf diseases

ESPDHot: An Effective Machine Learning-Based Approach for Predicting Protein-DNA Interaction Hotspots.

Protein-DNA interactions are pivotal to various cellular processes. Precise identification of the hotspot residues for protein-DNA interactions holds great significance for revealing the intricate mechanisms in protein-DNA recognition and for providing essential guidance for protein engineering. Aiming at protein-DNA interaction hotspots, this work introduces an effective prediction method, ESPDHot based on a stacked ensemble machine learning framework. Here, the interface residue whose mutation leads to a binding free energy change (ΔΔG) exceeding 2 kcal/mol is defined as a hotspot. To tackle the imbalanced data set issue, the adaptive synthetic sampling (ADASYN), an oversampling technique, is adopted to synthetically generate new minority samples, thereby rectifying data imbalance. As for molecular characteristics, besides traditional features, we introduce three new characteristic types including residue interface preference proposed by us, residue fluctuation dynamics characteristics, and coevolutionary features. Combining the Boruta method with our previously developed Random Grouping strategy, we obtained an optimal set of features. Finally, a stacking classifier is constructed to output prediction results, which integrates three classical predictors, Support Vector Machine (SVM), XGBoost, and Artificial Neural Network (ANN) as the first layer, and Logistic Regression (LR) algorithm as the second one. Notably, ESPDHot outperforms the current state-of-the-art predictors, achieving superior performance on the independent test data set, with F1, MCC, and AUC reaching 0.571, 0.516, and 0.870, respectively.

Tapioca: a platform for predicting de novo protein-protein interactions in dynamic contexts.

Protein-protein interactions (PPIs) drive cellular processes and responses to environmental cues, reflecting the cellular state. Here we develop Tapioca, an ensemble machine learning framework for studying global PPIs in dynamic contexts. Tapioca predicts de novo interactions by integrating mass spectrometry interactome data from thermal/ion denaturation or cofractionation workflows with protein properties and tissue-specific functional networks. Focusing on the thermal proximity coaggregation method, we improved the experimental workflow. Finely tuned thermal denaturation afforded increased throughput, while cell lysis optimization enhanced protein detection from different subcellular compartments. The Tapioca workflow was next leveraged to investigate viral infection dynamics. Temporal PPIs were characterized during the reactivation from latency of the oncogenic Kaposi's sarcoma-associated herpesvirus. Together with functional assays, NUCKS was identified as a proviral hub protein, and a broader role was uncovered by integrating PPI networks from alpha- and betaherpesvirus infections. Altogether, Tapioca provides a web-accessible platform for predicting PPIs in dynamic contexts.

An explainable AI-enabled granular ensemble machine learning framework to demystify fertilizer price movements

This paper proposes a novel explainable artificial intelligence (AI) driven ensemble machine learning (ML) framework for predicting fertilizer price movements and assessing the contributions of the technical and macroeconomic indicators. We integrate the Boruta algorithm, Maximal Overlap Discrete Wavelet Transformation (MODWT), Random Forest (RF), and explainable AI. The predictive analytics exercise utilises the residual of the previous stage as an additional indicator for arriving at the subsequent stage forecasts. We observe a significant influence of the residual in providing forecasts for time series with higher frequencies. The explainable AI is used at the global and local levels to explain the impacts of the indicators on fertilizer price movements. We have used monthly urea and diammonium phosphate (DAP) prices for nearly the last 30 years for predictive analytics. The explainable AI identifies the more significant impacts of the technical indicators compared to macroeconomic counterparts in forecasting urea and DAP prices at the global level. Also, the price movements of urea and DAP are similar at the global level. On the contrary, macroeconomic indicators influence more at the local level. The CBOE volatility index for urea, geopolitical risk, and commodity industrial input for DAP significantly influence the price movements at the local level.

A novel ensemble machine learning framework for early stage diabetes mellitus prediction

Diabetes Mellitus is a harmful condition characterized by elevated blood sugar levels resulting from insufficient insulin production in the body. This disorder gives rise to various health complications affecting the kidneys, heart, nerves, and eyes. If left unidentified and untreated, it can even prove fatal. Therefore, early detection and prediction of chronic diseases are imperative, and advancements in technology have led to a shift towards personalized healthcare. Machine learning offers a viable solution for predicting the likelihood of developing the disease with satisfactory accuracy.The objective of this research is to create a machine learning-based model for accurately predicting early-stage diabetes mellitus. The study employs PCA for dimensionality reduction and the ensemble bagging decision tree classification, thereby, achieving a remarkable accuracy level concerning the disease. The proposed model is evaluated using a publicly available dataset of 520 instances. The dataset utilized in this research includes information such as Polyuria, Polydipsia, sudden_weight_loss and weakness etc. The model achieves an impressive accuracy of 93.26%, precision of 96.9%, recall of 94.1%, and F-Score of 95.4%. Comparative analysis against other existing techniques demonstrates its superior performance in predicting such chronic conditions.

Ensemble machine learning framework for daylight modelling of various building layouts

AbstractThe application of machine learning (ML) modelling in daylight prediction has been a promising approach for reliable and effective visual comfort assessment. Although many advancements have been made, no standardized ML modelling framework exists in daylight assessment. In this study, 625 different building layouts were generated to model useful daylight illuminance (UDI). Two state-of-the-art ML algorithms, eXtreme Gradient Boosting (XGBoost) and random forest (RF), were employed to analyze UDI in four categories: UDI-f (fell short), UDI-s (supplementary), UDI-a (autonomous), and UDI-e (exceeded). A feature (internal finish) was introduced to the framework to better reflect real-world representation. The results show that XGBoost models predict UDI with a maximum accuracy of R2 = 0.992. Compared to RF, the XGBoost ML models can significantly reduce prediction errors. Future research directions have been specified to advance the proposed framework by introducing new features and exploring new ML architectures to standardize ML applications in daylight prediction.

Prediction of organophosphorus pesticide adsorption by biochar using ensemble learning algorithms.

Machine learning (ML) models have become a potent tool for advancing environmentally conscious research in materials science, allowing the prediction of wastewater treatment efficacy using eco-materials. In this study, we showcase the potential of an advanced decision tree-based ensemble learning algorithm to model the eviction of emerging organophosphate-based pesticidal pollutants in aqueous systems. The model is trained using laboratory-based biochar adsorption data, and it establishes the relationship between independent experimental factors and the % organophosphate pesticide adsorption efficiency as the output parameter. We classified the experimental dataset into input and output parameters to build the model. The input parameters included pyrolysis temperature, solution pH, surface area, pore volume, and initial pesticide concentration. Grid search optimization in Python was employed to train the model using sets of input-output patterns. The results indicated that the XGBoost-based ensemble ML framework provides the best forecast for pesticide adsorption on the biochar matrix, achieving high scores for the regularization coefficient (R2train = 0.998, R2test = 0.981). The concentration of the organophosphorus compound and the morphology of biochar significantly influenced the pesticide adsorption behavior. These findings demonstrate the potential of using ensemble learning algorithms for the balanced design of carbon-enriched biomaterials to remove emerging micropollutants from water effectively.

Sensor-based indoor air temperature prediction using deep ensemble machine learning: An Australian urban environment case study

Accurate prediction of indoor temperature is critical for climate change adaptation and occupant health. The aim of this study is to investigate an improved deep ensemble machine learning framework (DEML), by adjusting the model architecture with several machine learning (ML) and deep learning (DL) approaches to forecast the sensor-based indoor temperature in the Australian urban environment. We collected ambient station-based temperatures, satellite-based outdoor climate characteristics, and low-cost sensor-based indoor environmental metrics from 96 devices from August 2019 to November 2022, and established DEML with a rolling windows approach to assess the prediction stability over time. The DEML model was compared with several benchmark models, including Random Forest (RF), Support Vector Machine (SVM), eXtreme Gradient Boosting (XGboost), Long-short term memory (LSTM), and Super Learner model (SL). A total of 13,715 days [median: 341 days; IQR (the interquartile range): 221–977 days] of low-cost sensor-based indoor temperature were included in 25 commercial and residential buildings across eight cities. The prediction performance of DEML was superior to the other five benchmark models in most of the sensors [coefficients of determination (R2) of 0.861–0.990 and root mean square error (RMSE) of 0.125–0.886 °C], followed by RF and SL algorithms. DEML consistently achieved high accuracy across different climate zones, seasons, and building types, which could be used as a crucial tool for optimizing energy use, maintaining occupant comfort and health, and adapting to the impacts of climate change.

Interpretable ensemble machine learning framework to predict wear rate of modified ZA-27 alloy

This study investigates the impact of adding manganese (Mn) to ZA-27 alloy on microstructure and tribological properties. The Mn content varied from 0.2% to 1%. Volumetric wear rates were measured under different operating conditions. XRD and SEM were employed for phase identification and surface analysis. Ensemble Machine Learning (EML) regression models, including bagging, decision trees, random forest, ada boost, gradient boosting, and extreme gradient boost, were used to predict wear properties. Results indicate that the lowest wear rate occurred at 0.5% Mn content. Different wear mechanisms were observed for varying Mn contents. Among the EML models, extreme gradient boost showed superior performance with R2 values of 0.999 and 0.985 in training and testing, respectively.

An ensemble machine learning framework for Airbnb rental price modeling without using amenity-driven features

Purpose The prediction of Airbnb listing prices predominantly uses a set of amenity-driven features. Choosing an appropriate set of features from thousands of available amenity-driven features makes the prediction task difficult. This paper aims to propose a scalable, robust framework to predict listing prices of Airbnb units without using amenity-driven features. Design/methodology/approach The authors propose an artificial intelligence (AI)-based framework to predict Airbnb listing prices. The authors consider 75 thousand Airbnb listings from the five US cities with more than 1.9 million observations. The proposed framework integrates (i) feature screening, (ii) stacking that combines gradient boosting, bagging, random forest, (iii) particle swarm optimization and (iv) explainable AI to accomplish the research objective. Findings The key findings have three aspects – prediction accuracy, homogeneity and identification of best and least predictable cities. The proposed framework yields predictions of supreme precision. The predictability of listing prices varies significantly across cities. The listing prices are the best predictable for Boston and the least predictable for Chicago. Practical implications The framework and findings of the research can be leveraged by the hosts to determine rental prices and augment the service offerings by emphasizing key features, respectively. Originality/value Although individual components are known, the way they have been integrated into the proposed framework to derive a high-quality forecast of Airbnb listing prices is unique. It is scalable. The Airbnb listing price modeling literature rarely witnesses such a framework.

A cost-effective machine learning-based method for preeclampsia risk assessment and driver genes discovery

BackgroundThe placenta, as a unique exchange organ between mother and fetus, is essential for successful human pregnancy and fetal health. Preeclampsia (PE) caused by placental dysfunction contributes to both maternal and infant morbidity and mortality. Accurate identification of PE patients plays a vital role in the formulation of treatment plans. However, the traditional clinical methods of PE have a high misdiagnosis rate.ResultsHere, we first designed a computational biology method that used single-cell transcriptome (scRNA-seq) of healthy pregnancy (38 wk) and early-onset PE (28–32 wk) to identify pathological cell subpopulations and predict PE risk. Based on machine learning methods and feature selection techniques, we observed that the Tuning ReliefF (TURF) score hybrid with XGBoost (TURF_XGB) achieved optimal performance, with 92.61% accuracy and 92.46% recall for classifying nine cell subpopulations of healthy placentas. Biological landscapes of placenta heterogeneity could be mapped by the 110 marker genes screened by TURF_XGB, which revealed the superiority of the TURF feature mining. Moreover, we processed the PE dataset with LASSO to obtain 497 biomarkers. Integration analysis of the above two gene sets revealed that dendritic cells were closely associated with early-onset PE, and C1QB and C1QC might drive preeclampsia by mediating inflammation. In addition, an ensemble model-based risk stratification card was developed to classify preeclampsia patients, and its area under the receiver operating characteristic curve (AUC) could reach 0.99. For broader accessibility, we designed an accessible online web server (http://bioinfor.imu.edu.cn/placenta).ConclusionSingle-cell transcriptome-based preeclampsia risk assessment using an ensemble machine learning framework is a valuable asset for clinical decision-making. C1QB and C1QC may be involved in the development and progression of early-onset PE by affecting the complement and coagulation cascades pathway that mediate inflammation, which has important implications for better understanding the pathogenesis of PE.

A machine learning approach to primacy-peak-recency effect-based satisfaction prediction

Data retrieval systems supporting the discovery and reuse of open data are emerging as important tools in the open data ecosystem. However, user satisfaction with them is relatively low. This study proposes the primacy-peak-recency effect to investigate the cognitive mechanisms underlying data searchers’ overall satisfaction. To test the primacy-peak-recency effect, primacy-peak-recency cubes consisting of eye movement indicators at primacy, peak, and recency moments and their combinations are constructed as the theoretical model. A user experiment was conducted to collect eye movement data and satisfaction scores generated during 48 doctoral students’ interactions with data retrieval systems. An ensemble machine learning framework was then applied to analyze eye movement data to assess the theoretical model. The results indicate that the primacy-peak-recency cubes are salient predictors of data searchers’ satisfaction (the prediction accuracy=0.682 and regression R2=0.749). This finding suggests that data searchers’ complex cognitive processes at primacy, peak, and recency moments measured by uni-, bi-, and three-dimensional eye movement indicators are predictors of overall satisfaction, confirming the primacy-peak-recency effect. In addition, combinations of varying types of influential moments and multidimensional eye movement events are the best predictors of overall satisfaction. This suggests that influential moments and cognitive processes have additive effects on overall satisfaction. Combining theory-driven and data-driven approaches, this study sheds light on the potential of machine learning approaches for analyzing neuropsychological data for heuristics examination. With these insights, practical strategies to predict data searchers’ satisfaction and optimize the user-experience design of data retrieval systems are proposed.