Automated Machine Learning Approach Research Articles

Automated sex and age partitioning for the estimation of reference intervals using a regression tree model

Abstract Objectives Reference intervals (RI) play a decisive role in the interpretation of medical laboratory results. An important step in the determination of RI is age- and sex specific partitioning, which is usually based on an empirical approach by graphical representation. In this study, we evaluate an automated machine learning approach. Methods This study uses pediatric data from the CALIPER RI (Canadian laboratory initiative on pediatric reference intervals) study. The calculation of potential partitions is carried out using a regression tree model included in the rpart package of the statistical programming language R. The Harris & Boyd method is used to compare the corresponding partitions suggested by rpart and CALIPER. For better comparability, the reference ranges of the partitions of both approaches are then calculated using reflimR. Results Most of the partitions suggested by rpart or CALIPER show sufficient heterogeneity among themselves to justify age- and/or sex-specific RI partitioning. With only few individual exceptions, both methods yield comparable results. The partitions of both approaches for albumin and γ-glutamyltransferase are very similar to each other. For creatinine rpart suggests a slightly earlier distinction between the sexes. Alkaline phosphatase shows the most pronounced differences. In addition to a considerable earlier sex split, rpart suggests different age intervals for both sexes, resulting in three partitions for females and four partitions for males. Conclusions Our findings indicate that the automated analysis provided by rpart yields results that comparable to traditional methods. Nevertheless, the medical plausibility of the automatic suggestions needs to be validated by human experts.

A proof of concept for microcirculation monitoring using machine learning based hyperspectral imaging in critically ill patients: a monocentric observational study

BackgroundImpaired microcirculation is a cornerstone of sepsis development and leads to reduced tissue oxygenation, influenced by fluid and catecholamine administration during treatment. Hyperspectral imaging (HSI) is a non-invasive bedside technology for visualizing physicochemical tissue characteristics. Machine learning (ML) for skin HSI might offer an automated approach for bedside microcirculation assessment, providing an individualized tissue fingerprint of critically ill patients in intensive care. The study aimed to determine if machine learning could be utilized to automatically identify regions of interest (ROIs) in the hand, thereby distinguishing between healthy individuals and critically ill patients with sepsis using HSI.MethodsHSI raw data from 75 critically ill sepsis patients and from 30 healthy controls were recorded using TIVITA® Tissue System and analyzed using an automated ML approach. Additionally, patients were divided into two groups based on their SOFA scores for further subanalysis: less severely ill (SOFA ≤ 5) and severely ill (SOFA > 5). The analysis of the HSI raw data was fully-automated using MediaPipe for ROI detection (palm and fingertips) and feature extraction. HSI Features were statistically analyzed to highlight relevant wavelength combinations using Mann–Whitney-U test and Benjamini, Krieger, and Yekutieli (BKY) correction. In addition, Random Forest models were trained using bootstrapping, and feature importances were determined to gain insights regarding the wavelength importance for a model decision.ResultsAn automated pipeline for generating ROIs and HSI feature extraction was successfully established. HSI raw data analysis accurately distinguished healthy controls from sepsis patients. Wavelengths at the fingertips differed in the ranges of 575–695 nm and 840–1000 nm. For the palm, significant differences were observed in the range of 925–1000 nm. Feature importance plots indicated relevant information in the same wavelength ranges. Combining palm and fingertip analysis provided the highest reliability, with an AUC of 0.92 to distinguish between sepsis patients and healthy controls.ConclusionBased on this proof of concept, the integration of automated and standardized ROIs along with automated skin HSI analyzes, was able to differentiate between healthy individuals and patients with sepsis. This approach offers a reliable and objective assessment of skin microcirculation, facilitating the rapid identification of critically ill patients.

The Prediction of Recombination Hotspot Based on Automated Machine Learning

Meiotic recombination plays a pivotal role in genetic evolution. Genetic variation induced by recombination is a crucial factor in generating biodiversity and a driving force for evolution. At present, the development of recombination hotspot prediction methods has encountered challenges related to insufficient feature extraction and limited generalization capabilities. This paper focused on the research of recombination hotspot prediction methods. We explored deep learning-based recombination hotspot prediction and scrutinized the shortcomings of prevalent models in addressing the challenge of recombination hotspot prediction. To addressing these deficiencies, an automated machine learning approach was utilized to construct recombination hotspot prediction model. The model combined sequence information with physicochemical properties by employing TF-IDF-Kmer and DNA composition components to acquire more effective feature data. Experimental results validate the effectiveness of the feature extraction method and automated machine learning technology used in this study. The final model was validated on three distinct datasets and yielded accuracy rates of 97.14%, 79.71%, and 98.73%, surpassing the current leading models by 2%, 2.56%, and 4%, respectively. In addition, we incorporated tools such as SHAP and AutoGluon to analyze the interpretability of black-box models, delved into the impact of individual features on the results, and investigated the reasons behind misclassification of samples. Finally, an application of recombination hotspot prediction was established to facilitate easy access to necessary information and tools for researchers. The research outcomes of this paper underscore the enormous potential of automated machine learning methods in gene sequence prediction.

A tree-based automated machine learning approach of the obstructed view factor of thermal radiation in nuclear pebble beds

For the nuclear pebble bed of the high temperature gas-cooled reactor (HTGR), a tree-based automated machine learning approach is developed to discuss the complicated thermal radiation behaviors. The AutoML model for calculating the obstructed view factor between any two particles in the pebble bed includes the gradient boosting regression tree model with the fine-tuned hyperparameters and the analytical base model. Using the discrete packing of the HTR-PM nuclear reactor and the leaped Halton sequence, a large dataset of the view factor under different conditions is generated to train the AutoML model. On the same platform, numerical results show that AutoML model is approximately 5 × 105 times faster than the traditional approach. The Pareto front of the AutoML model indicates that the mean squared error decreases with the model complexity until it reaches the optimal solution. Then, the trained AutoML model is applied to the engineering pebble bed. It is shown that the average radiation exchange factor near the wall is lower than that in the bulk region. In addition, the packing height is also an important parameter for evaluating the radiative behaviors. In particular, when the height of the nuclear pebble bed is less than 20 times particle diameter, it is necessary to consider the contribution of the packing height to the radiation effective thermal conductivity.

Identifying Correlated Functional Brain Network Patterns Associated with Touch Discrimination in Survivors of Stroke Using Automated Machine Learning

Stroke recovery is multifaceted and complex. Machine learning approaches have potential to identify patterns of brain activity associated with clinical outcomes, providing new insights into recovery. We aim to use machine learning to characterise the contribution of and potential interaction between resting state functional connectivity networks in predicting touch discrimination outcomes in a well-phenotyped, but small, stroke cohort. We interrogated and compared a suite of automated machine learning approaches to identify patterns of brain activity associated with clinical outcomes. Using feature reduction, the identification of combined ‘golden features’, and five-fold cross-validation, two golden features patterns emerged. These golden features identified patterns of resting state connectivity involving interactive relationships: 1. The difference between right insula and right superior temporal lobe correlation and left cerebellum and vermis correlation; 2. The ratio between right inferior temporal lobe and left cerebellum correlation and left frontal inferior operculum and left supplementary motor area correlation. Our findings demonstrate evidence of the potential for automated machine learning to provide new insights into brain network patterns and their interactions associated with the prediction of quantitative touch discrimination outcomes, through the automated identification of robust associations and golden feature brain patterns, even in a small cohort of stroke survivors.

Developing automated machine learning approach for fast and robust crop yield prediction using a fusion of remote sensing, soil, and weather dataset

Estimating smallholder crop yields robustly and timely is crucial for improving agronomic practices, determining yield gaps, guiding investment, and policymaking to ensure food security. However, there is poor estimation of yield for most smallholders due to lack of technology, and field scale data, particularly in Egypt. Automated machine learning (AutoML) can be used to automate the machine learning workflow, including automatic training and optimization of multiple models within a user-specified time frame, but it has less attention so far. Here, we combined extensive field survey yield across wheat cultivated area in Egypt with diverse dataset of remote sensing, soil, and weather to predict field-level wheat yield using 22 Ml models in AutoML. The models showed robust accuracies for yield predictions, recording Willmott degree of agreement, (d > 0.80) with higher accuracy when super learner (stacked ensemble) was used (R2 = 0.51, d = 0.82). The trained AutoML was deployed to predict yield using remote sensing (RS) vegetative indices (VIs), demonstrating a good correlation with actual yield (R2 = 0.7). This is very important since it is considered a low-cost tool and could be used to explore early yield predictions. Since climate change has negative impacts on agricultural production and food security with some uncertainties, AutoML was deployed to predict wheat yield under recent climate scenarios from the Coupled Model Intercomparison Project Phase 6 (CMIP6). These scenarios included single downscaled General Circulation Model (GCM) as CanESM5 and two shared socioeconomic pathways (SSPs) as SSP2-4.5and SSP5-8.5during the mid-term period (2050). The stacked ensemble model displayed declines in yield of 21% and 5% under SSP5-8.5 and SSP2-4.5 respectively during mid-century, with higher uncertainty under the highest emission scenario (SSP5-8.5). The developed approach could be used as a rapid, accurate and low-cost method to predict yield for stakeholder farms all over the world where ground data is scarce.

Automatic detection of expressed emotion from Five-Minute Speech Samples: Challenges and opportunities.

Research into clinical applications of speech-based emotion recognition (SER) technologies has been steadily increasing over the past few years. One such potential application is the automatic recognition of expressed emotion (EE) components within family environments. The identification of EE is highly important as they have been linked with a range of adverse life events. Manual coding of these events requires time-consuming specialist training, amplifying the need for automated approaches. Herein we describe an automated machine learning approach for determining the degree of warmth, a key component of EE, from acoustic and text natural language features. Our dataset of 52 recorded interviews is taken from recordings, collected over 20 years ago, from a nationally representative birth cohort of British twin children, and was manually coded for EE by two researchers (inter-rater reliability 0.84-0.90). We demonstrate that the degree of warmth can be predicted with an F1-score of 64.7% despite working with audio recordings of highly variable quality. Our highly promising results suggest that machine learning may be able to assist in the coding of EE in the near future.

Comparison of machine learning algorithms for slope stability prediction using an automated machine learning approach

Comparison of machine learning algorithms for slope stability prediction using an automated machine learning approach

An automated machine learning approach for detecting anomalous peak patterns in time series data from a research watershed in the northeastern United States critical zone

This paper presents an automated machine learning framework designed to assist hydrologists in detecting anomalies in time series data generated by sensors in a research watershed in the northeastern United States critical zone. The framework specifically focuses on identifying peak-pattern anomalies, which may arise from sensor malfunctions or natural phenomena. However, the use of classification methods for anomaly detection poses challenges, such as the requirement for labeled data as ground truth and the selection of the most suitable deep learning model for the given task and dataset. To address these challenges, our framework generates labeled datasets by injecting synthetic peak patterns into synthetically generated time series data and incorporates an automated hyperparameter optimization mechanism. This mechanism generates an optimized model instance with the best architectural and training parameters from a pool of five selected models, namely Temporal Convolutional Network (TCN), InceptionTime, MiniRocket, Residual Networks (ResNet), and Long Short-Term Memory (LSTM). The selection is based on the user’s preferences regarding anomaly detection accuracy and computational cost. The framework employs Time-series Generative Adversarial Networks (TimeGAN) as the synthetic dataset generator. The generated model instances are evaluated using a combination of accuracy and computational cost metrics, including training time and memory, during the anomaly detection process. Performance evaluation of the framework was conducted using a dataset from a watershed, demonstrating consistent selection of the most fitting model instance that satisfies the user’s preferences.

AutoML‐based predictive framework for predictive analysis in adsorption cooling and desalination systems

AbstractAdsorption cooling and desalination systems have a distinct advantage over other systems that use low‐grade waste heat near ambient temperature. Since improving their performance, including reliability and failure prediction, is challenging, developing an efficient diagnostic system is of great practical significance. The paper introduces artificial intelligence (AI) and an automated machine learning approach (AutoML) in a real‐life application for a computational diagnostic system of existing adsorption cooling and desalination facilities. A total of 1769 simulated data points containing data indicating a failure status are applied to develop a comprehensive AI‐based Diagnostic (AID) system covering a wide range of 42 input parameters. The paper introduces a conditional monitoring system for adsorption cooling and desalination systems. The novelty of the presented study mainly consists of two aspects. First, the intelligent system predicts the health or failure states of various components in a complex three‐bed adsorption chiller installation using the extensive input data sets of 42 different operating parameters. The developed AID expert tool, based on selecting the best from 42 models generated by the DataRobot platform, was validated on the complex, existing three‐bed adsorption chiller. The AID system correctly identified healthy and failure states in various installation components. The developed expert system is very efficient (AUC = 0.988, RMSE = 0.20, LogLoss = 0.14) in predicting emergency states. The proposed method constitutes a quick and easy technique for failure prediction and represents a complementary tool compared to the other condition monitoring methods.

Predicting Co-Occurring Mental Health and Substance Use Disorders in Women: An Automated Machine Learning Approach

Significant clinical overlap exists between mental health and substance use disorders, especially among women. The purpose of this research is to leverage an AutoML (Automated Machine Learning) interface to predict and distinguish co-occurring mental health (MH) and substance use disorders (SUD) among women. By employing various modeling algorithms for binary classification, including Random Forest, Gradient Boosted Trees, XGBoost, Extra Trees, SGD, Deep Neural Network, Single-Layer Perceptron, K Nearest Neighbors (grid), and a super learning model (constructed by combining the predictions of a Random Forest model and an XGBoost model), the research aims to provide healthcare practitioners with a powerful tool for earlier identification, intervention, and personalised support for women at risk. The present research presents a machine learning (ML) methodology for more accurately predicting the co-occurrence of mental health (MH) and substance use disorders (SUD) in women, utilising the Treatment Episode Data Set Admissions (TEDS-A) from the year 2020 (n = 497,175). A super learning model was constructed by combining the predictions of a Random Forest model and an XGBoost model. The model demonstrated promising predictive performance in predicting co-occurring MH and SUD in women with an AUC = 0.817, Accuracy = 0.751, Precision = 0.743, Recall = 0.926 and F1 Score = 0.825. The use of accurate prediction models can substantially facilitate the prompt identification and implementation of intervention strategies.

Simultaneous well spacing and completion optimization using an automated machine learning approach. A case study of the Marcellus Shale reservoir, northeastern United States

Optimizing unconventional field development requires simultaneous optimization of well spacing and completion design. However, the conventional practice of using cross plots and sensitivity analysis via Monte Carlo simulations for independent optimization of well spacing and completion design has proved inadequate for unconventional reservoirs. This is due to the inability of cross plots to capture non-linear cross-correlations between parameters affecting hydrocarbon production, and the computational expense and difficulty of Monte Carlo simulations. Recently, automated machine learning (AutoML) workflows have been used to tackle complex problems. However, applying AutoML workflows to engineering problems presents unique challenges, as achieving high accuracy in forecasting the physics of the problem is crucial. To address this issue, a new physics-informed AutoML workflow based on the TPOT open-source tool developed that guarantees the physical plausibility of the optimum model while minimizing human bias and uncertainty. The workflow has been implemented in a Marcellus Shale reservoir with over 1500 wells to determine the optimal well spacing and completion design parameters for both the field and each well. The results show that using a shorter stage length and a higher sand-to-water ratio is preferable for this field, as it can increase cumulative gas production by up to 8%. Additionally, it is observed that fifty-percentile cumulative gas predictions are in close agreement with actual field productions. Thematic collection: This article is part of the Digitally enabled geoscience workflows: unlocking the power of our data collection available at: https://www.lyellcollection.org/topic/collections/digitally-enabled-geoscience-workflows

CheRRI-Accurate classification of the biological relevance of putative RNA-RNA interaction sites.

RNA-RNA interactions are key to a wide range of cellular functions. The detection of potential interactions helps to understand the underlying processes. However, potential interactions identified via in silico or experimental high-throughput methods can lack precision because of a high false-positive rate. We present CheRRI, the first tool to evaluate the biological relevance of putative RNA-RNA interaction sites. CheRRI filters candidates via a machine learning-based model trained on experimental RNA-RNA interactome data. Its unique setup combines interactome data and an established thermodynamic prediction tool to integrate experimental data with state-of-the-art computational models. Applying these data to an automated machine learning approach provides the opportunity to not only filter data for potential false positives but also tailor the underlying interaction site model to specific needs. CheRRI is a stand-alone postprocessing tool to filter either predicted or experimentally identified potential RNA-RNA interactions on a genomic level to enhance the quality of interaction candidates. It is easy to install (via conda, pip packages), use (via Galaxy), and integrate into existing RNA-RNA interaction pipelines.

Advancing the Use of Deep Learning in Loss Reserving: A Generalized DeepTriangle Approach

This paper proposes a generalized deep learning approach for predicting claims developments for non-life insurance reserving. The generalized approach offers more flexibility and accuracy in solving actuarial reserving problems. It predicts claims outstanding weighted by exposure instead of loss ratio to remove subjectivity associated with premium weighting. Chain-ladder predicted outstanding claims are used as part of the multi-task learning to remove the dependence on case estimates. Grid-search is introduced for hyperparameter tuning to improve model performance. Performance-wise, the Generalized DeepTriangle outperforms both traditional chain-ladder methodology, the automated machine learning approaches (AutoML), and the original DeepTriangle model.

An Intelligent Diagnostic System to Analyze Early-Stage Chronic Kidney Disease for Clinical Application

Chronic kidney disease (CKD) is a progressive condition characterized by the gradual deterioration of kidney functions, potentially leading to kidney failure if not promptly diagnosed and treated. Machine learning (ML) algorithms have shown significant promise in disease diagnosis, but in healthcare, clinical data pose challenges: missing values, noisy inputs, and redundant features, affecting early-stage CKD prediction. Thus, this study presents a novel, fully automated machine learning approach to tackle these complexities by incorporating feature selection (FS) and feature space reduction (FSR) techniques, leading to a substantial enhancement of the model’s performance. A data balancing technique is also employed during preprocessing to address data imbalance issue that is commonly encountered in clinical contexts. Finally, for reliable CKD classification, an ensemble characteristics-based classifier is encouraged. The effectiveness of our approach is rigorously validated and assessed on multiple datasets, and the clinical relevancy of the strategy is evaluated on the real-world therapeutic data collected from Bangladeshi patients. The study establishes the dominance of adaptive boosting, logistic regression, and passive aggressive ML classifiers with 96.48% accuracy in forecasting unseen therapeutic CKD data, particularly in early-stage cases. Furthermore, the effectiveness of the FSR technique in reducing the prediction time significantly is revealed. The outstanding performance of the proposed model demonstrates its effectiveness in addressing the complexity of healthcare CKD data by incorporating the FS and FSR techniques. This highlights its potential as a promising computer-aided diagnosis tool for doctors, enabling early interventions and improving patient outcomes.

Towards accurate real-time luminescence thermometry: An automated machine learning approach

Towards accurate real-time luminescence thermometry: An automated machine learning approach

An automated machine learning approach for classifying infrastructure cost data

AbstractData on infrastructure project costs are often unstructured and lack consistency. To enable costs to be compared within and between organizations, large amounts of data must be classified to a common standard, typically a manual process. This is time‐consuming, error‐prone, inconsistent, and subjective, as it is based on human judgment. This paper describes a novel approach for automating the process by harnessing natural language processing identifying the relevant keywords in the text descriptions and implementing machine learning classifiers to emulate the expert's knowledge. The task was to identify “extra over” cost items, conversion factors, and to recognize the correct work breakdown structure (WBS) category. The results show that 94% of the “extra over” cases were correctly classified, and 90% of cases that needed conversion, correctly predicting an associated conversion factor with 87% accuracy. Finally, the WBS categories were identified with 72% accuracy. The approach has the potential to provide a step change in the speed and accuracy of structuring and classifying infrastructure cost data for benchmarking.

Combining clinical and imaging data for predicting functional outcomes after acute ischemic stroke: an automated machine learning approach

This study aimed to develop and validate an automated machine learning (ML) system that predicts 3-month functional outcomes in acute ischemic stroke (AIS) patients by combining clinical and neuroimaging features. Functional outcomes were categorized as unfavorable (modified Rankin Scale ≥ 3) or not. A clinical model employing optimal clinical features (Model_A), a convolutional neural network model incorporating imaging data (Model_B), and an integrated model combining both imaging and clinical features (Model_C) were developed and tested to predict unfavorable outcomes. The developed models were compared with each other and with traditional risk-scoring models. The dataset comprised 4147 patients from a multicenter stroke registry, with 1268 (30.6%) experiencing unfavorable outcomes. Age, initial NIHSS, and early neurologic deterioration were identified as the most important clinical features. The ML model prediction achieved an area under the curves of 0.757 (95% CI 0.726–0.789) for Model_A, 0.725 (95% CI 0.693–0.755) for Model_B, and 0.786 (95% CI 0.757–0.814) for Model_C in the test set. The integrated models outperformed traditional risk-scoring models by 0.21 (95% CI 0.16–0.25) for HIAT and 0.15 (95% CI 0.11–0.19) for THRIVE. In conclusion, the integrated ML system enhanced stroke outcome prediction by combining imaging data and clinical features, outperforming traditional risk-scoring models.

Hierarchical Automated Machine Learning Approach for Self-Optimizable Driving Distraction Recognition Based on Driver’s Lane-Keeping Performance

With the enrichment of smartphone uses, phone-related driving distractions have become a threat to driving safety. One way to mitigate driving distractions is to detect them and provide real-time warnings. However, most existing driving distraction recognition algorithms are pretrained models composed of structures, hyperparameters, and parameters that may not be able to account for drivers’ individual differences and, thus, might result in low model accuracy. This study proposes a domain-specific hierarchical automated machine learning (HAT-ML) model that self-learns personalized optimal models to detect driving distractions from vehicle movement data. The HAT-ML model integrates key modeling steps into auto-optimizable layers, including knowledge-based feature extraction, feature selection by recursive feature elimination, automated algorithm selection, and hyperparameter autotuning by Bayesian optimization. In our eight-degrees-of-freedom driving simulator experiment, we demonstrated the effectiveness of the proposed model using three driving distraction tasks: browsing a short message, browsing a long message, and answering a phone call. The HAT-ML model was found to be reliable and robust for predicting phone-related driving distraction, achieving satisfactory results with a predictive accuracy of 80% at the group level and 90% at the individual level. Moreover, the results revealed that each distraction and driver type required different optimized hyperparameter values, which demonstrated the value of utilizing HAT-ML to detect driving distractions. The key elements that dominated the performance of the model have several theoretical and practical implications. The proposed method not only enhanced performance, but also provided data-driven insights about model development.

An Automated Machine Learning Approach towards Energy Saving Estimates in Public Buildings

Reducing the energy consumption of buildings in the public sector is an important component in our efforts towards reaching our sustainability goals. In this context, a decisive prerequisite for administrations and policy makers is a tool for estimating the effectiveness of measures to reduce energy consumption. Estimating the impact of planned investments in building technology at scale, however, remains challenging, mainly for two reasons. For one, accurate physical modeling requires detailed building data, which can be difficult to obtain. Second, adapting established building models to novel measures aiming at energy consumption reduction is difficult. Hence, modeling building consumption patterns after retrofitting is a non-trivial task, and more research is needed to improve modeling techniques as well as to assess their effectiveness across a wide range of application scenarios. Modeling tools need to be generic enough to enable modeling of a variety of building types, they should ideally require as few input features as possible and they should allow for a high degree of automation in the selection and calibration of building modeling tools. Here, we propose a novel machine learning approach that does not require detailed building data and can automatically adapt to retrofitting measures. We evaluate our method on a data set of 113 public buildings in 4 building categories in Berlin, Germany. The data set contains energy consumption data in the initial state and after implementation of a weather-predictive heating control system. Despite being fully automated and requiring only minimal information about the building, our model can reliably predict the energy consumption of large public buildings better than established methods. All code and data are publicly released.