An Ensemble Deep Learning Model for Short-Term Road Surface Temperature Prediction

Nowadays, global public health crises are occurring more frequently, and accurate prediction of these diseases can reduce the burden on the healthcare system. Taking COVID-19 as an example, accurate prediction of infection can assist experts in effectively allocating medical resources and diagnosing diseases. Currently, scholars worldwide use single model approaches or epidemiology models more often to predict the outbreak trend of COVID-19, resulting in poor prediction accuracy. Although a few studies have employed ensemble models, there is still room for improvement in their performance. In addition, there are only a few models that use the laboratory results of patients to predict COVID-19 infection. To address these issues, research efforts should focus on improving disease prediction performance and expanding the use of medical disease prediction models. In this paper, we propose an innovative deep learning model Whale Optimization Convolutional Neural Networks (CNN), Long-Short Term Memory (LSTM) and Artificial Neural Network (ANN) called WOCLSA which incorporates three models ANN, CNN and LSTM. The WOCLSA model utilizes the Whale Optimization Algorithm to optimize the neuron number, dropout and batch size parameters in the integrated model of ANN, CNN and LSTM, thereby finding the global optimal solution parameters. WOCLSA employs 18 patient indicators as predictors, and compares its results with three other ensemble deep learning models. All models were validated with train-test split approaches. We evaluate and compare our proposed model and other models using accuracy, F1 score, recall, AUC and precision metrics. Through many studies and tests, our results show that our prediction models can identify patients with COVID-19 infection at the AUC of 91%, 91%, and 93% respectively. Other prediction results achieve a respectable accuracy of 92.82%, 92.79%, and 91.66% respectively, f1-score of 93.41%, 92.79%, and 92.33% respectively, precision of 93.41%, 92.79%, and 92.33% respectively, recall of 93.41%, 92.79%, and 92.33% respectively. All of these exceed 91%, surpassing those of comparable models. The execution time of WOCLSA is also an advantage. Therefore, the WOCLSA ensemble model can be used to assist in verifying laboratory research results and predict and to judge various diseases in public health events.

Accurate estimation of the evaporation is of great significance for the management of limited agricultural water resources. However, developing highly accurate and universal data- driven models using time-series analysis methods to achieve precise evaporation estimation remains a challenging. Specifically, integrating meta-heuristic algorithms, ensemble deep learning models, and data preprocessing techniques for evaporation prediction is notably scarce. The aim of this paper was to employ time series analysis methods to develop data-driven model with high accuracy and universality to realize accurate estimation of evaporation. To achieve this purpose, the Convolutional neural network (CNN) was integrated with Bidirectional long short-term memory network (BiLSTM) as main estimating module, and the Sparrow search algorithm (SSA) was employed to search the optimal hyperparameters of CNN-BiLSTM. To overcome the drawback that directly using measured evaporation time series to predict evaporation may lead to large error, the Variational mode decomposition (VMD) was used to extract multiscale traits of evaporation time series, and Whale optimization algorithm (WOA) was adopted to find the optimal parameters of VMD, and a novel hybrid deep learning model WOA-VMD-CNN-SSA-BiLSTM was proposed to estimate the evaporation in the Linze County, China. The estimating performance was evaluated by using the statistical accuracy metrics, including R2, the mean squared error (MSE), the mean absolute error (MAE), the root mean squared error (RMSE), and the mean absolute percentage error (MAPE). The results show that the Sample entropy (SEn) remains 0.0832 when the optimal values of K and a of VMD are 6 and 0.1773, suggesting that VMD optimized by using WOA effectively overcomes the subjectivity in traditional VMD parameter setting and realizes amplitude-dependent feature extraction of evaporation time series in the study area. In addition, the model performance of CNN-SSA-BiLSTM can be significantly improved by coupling CNN-SSA-BiLSTM with WOA-VMD, and the hybrid model WOA-VMD-SSA-CNN-BiLSTM with MSE = 0.1258, RMSE = 0.3547, MAE = 0.2833, and MAPE = 6.17% in testing stage is superior than other hybrid models and ensemble models, which could be highly recommended for estimating evaporation in study area.

An ensemble deep learning model for exhaust emissions prediction of heavy oil-fired boiler combustion

Enhanced early prediction of Li-ion battery degradation using multicycle features and an ensemble deep learning model

Sentiment analysis (SA) is a machine learning application that drives people’s opinions from text using natural language processing (NLP) techniques. Implementing Arabic SA is challenging for many reasons, including equivocation, numerous dialects, lack of resources, morphological diversity, lack of contextual information, and hiding of sentiment terms in the implicit text. Deep learning models such as convolutional neural networks (CNN) and long short-term memory (LSTM) have significantly improved in the Arabic SA domain. Hybrid models based on CNN combined with long short-term memory (LSTM) or gated recurrent unit (GRU) have further improved the performance of single DL models. In addition, the ensemble of deep learning models, especially stacking ensembles, is expected to increase the robustness and accuracy of the previous DL models. In this paper, we proposed a stacking ensemble model that combined the prediction power of CNN and hybrid deep learning models to predict Arabic sentiment accurately. The stacking ensemble algorithm has two main phases. Three DL models were optimized in the first phase, including deep CNN, hybrid CNN-LSTM, and hybrid CNN-GRU. In the second phase, these three separate pre-trained models’ outputs were integrated with a support vector machine (SVM) meta-learner. To extract features for DL models, the continuous bag of words (CBOW) and the skip-gram models with 300 dimensions of the word embedding were used. Arabic health services datasets (Main-AHS and Sub-AHS) and the Arabic sentiment tweets dataset were used to train and test the models (ASTD). A number of well-known deep learning models, including DeepCNN, hybrid CNN-LSTM, hybrid CNN-GRU, and conventional ML algorithms, have been used to compare the performance of the proposed ensemble model. We discovered that the proposed deep stacking model achieved the best performance compared to the previous models. Based on the CBOW word embedding, the proposed model achieved the highest accuracy of 92.12%, 95.81%, and 81.4% for Main-AHS, Sub-AHS, and ASTD datasets, respectively.

Increasing waste production and inadequate waste management have further complicated global environmental problems. The limited natural resources and the damage caused by waste to the environment necessitate the improvement of waste management systems. Accurate and effective classification of waste provides both economic benefits and reduces environmental impacts. In this study, a hybrid approach is presented by combining deep learning, machine learning, and ensemble learning techniques to classify environmental waste. ResNet50, InceptionResNet-V2, and DenseNet169 models were used, and these models were fine-tuned using pre-trained weights. We created an ensemble model by combining the feature maps obtained from each model. Among the features extracted by the ensemble deep learning model, the most effective features were determined with ANOVA, Variance Threshold, Mutual Information, Random Forests, Lasso, RFE, PCA, and Ridge Regression feature selection methods. The selected features were classified with SVM, MLP and Random Forest, XGBoost, hard voting, and soft voting methods. This study presents the contributions of both individual and ensemble models for environmental waste classification. The effectiveness of the proposed method was tested on two different datasets, and its effectiveness was verified. The results show that the proposed method can make a significant contribution to waste management and recycling processes.

An emerging network for COVID-19 CT-scan classification using an ensemble deep transfer learning model

Background: Breast cancer is one of the leading causes of death in women, making early detection through mammography crucial for improving survival rates. However, human interpretation of mammograms is often prone to diagnostic errors. This study addresses the challenge of improving the accuracy of breast cancer detection by leveraging advanced machine learning techniques. Methods: We propose an extended ensemble deep learning model that integrates three state-of-the-art convolutional neural network (CNN) architectures: VGG16, DenseNet121, and InceptionV3. The model utilizes multi-scale feature extraction to enhance the detection of both benign and malignant masses in mammograms. This ensemble approach is evaluated on two benchmark datasets: INbreast and CBIS-DDSM. Results: The proposed ensemble model achieved significant performance improvements. On the INbreast dataset, the ensemble model attained an accuracy of 90.1%, recall of 88.3%, and an F1-score of 89.1%. For the CBIS-DDSM dataset, the model reached 89.5% accuracy and 90.2% specificity. The ensemble method outperformed each individual CNN model, reducing both false positives and false negatives, thereby providing more reliable diagnostic results. Conclusions: The ensemble deep learning model demonstrated strong potential as a decision support tool for radiologists, offering more accurate and earlier detection of breast cancer. By leveraging the complementary strengths of multiple CNN architectures, this approach can improve clinical decision making and enhance the accessibility of high-quality breast cancer screening.

This study presents ensemble machine learning (ML) models for predicting residential energy consumption in South Africa. By combining the best features of individual ML models, ensemble models reduce the drawbacks of each model and improve prediction accuracy. We present four ensemble models: ensemble by averaging (EA), ensemble by stacking each estimator (ESE), ensemble by boosting (EB), and ensemble by voting estimator (EVE). These models are built on top of Random Forest (RF) and Decision Tree (DT). These base predictor models leverage historical energy consumption patterns to capture temporal intricacies, including seasonal variations and rolling averages. In addition, we employed feature engineering methodologies to further enhance their predictive abilities. The accuracy of each ensemble model was evaluated by assessing various performance indicators, including the mean squared error (MSE), mean absolute error (MAE), mean absolute percentage error (MAPE), and coefficient of determination R2. Overall, the findings illustrate the efficiency of ensemble learning models in providing accurate predictions for residential energy consumption. This study provides valuable insights for researchers and practitioners in predicting energy consumption in residential buildings and the benefits of using ensemble learning models in the building and energy research domains.

Linear and nonlinear ensemble deep learning models for karst spring discharge forecasting

With increasing incidence of renal mass, it is important to make a pretreatment differentiation between benign renal mass and malignant tumor. We aimed to develop a deep learning model that distinguishes benign renal tumors from renal cell carcinoma (RCC) by applying a residual convolutional neural network (ResNet) on routine MR imaging. Preoperative MR images (T2-weighted and T1-postcontrast sequences) of 1,162 renal lesions definitely diagnosed on pathology or imaging in a multicenter cohort were divided into training, validation, and test sets (70:20:10 split). An ensemble model based on ResNet was built combining clinical variables and T1C and T2WI MR images using a bagging classifier to predict renal tumor pathology. Final model performance was compared with expert interpretation and the most optimized radiomics model. Among the 1,162 renal lesions, 655 were malignant and 507 were benign. Compared with a baseline zero rule algorithm, the ensemble deep learning model had a statistically significant higher test accuracy (0.70 vs. 0.56, P = 0.004). Compared with all experts averaged, the ensemble deep learning model had higher test accuracy (0.70 vs. 0.60, P = 0.053), sensitivity (0.92 vs. 0.80, P = 0.017), and specificity (0.41 vs. 0.35, P = 0.450). Compared with the radiomics model, the ensemble deep learning model had higher test accuracy (0.70 vs. 0.62, P = 0.081), sensitivity (0.92 vs. 0.79, P = 0.012), and specificity (0.41 vs. 0.39, P = 0.770). Deep learning can noninvasively distinguish benign renal tumors from RCC using conventional MR imaging in a multi-institutional dataset with good accuracy, sensitivity, and specificity comparable with experts and radiomics.

The accuracy of shear wave elastography for non-invasive assessment of renal fibrosis (RF) in chronic kidney disease (CKD) needs further improvement. We developed a tool using an ensemble deep learning model (EDLM) that can accurately assess RF in CKD patients based solely on two-dimensional shear wave elastography (2D-SWE) images. Retrospective data were collected from CKD patients between April 2019 and October 2024, along with renal 2D-SWE images obtained before biopsy. Pathological evaluation was the reference standard of RF. All patients were randomly divided into training, validation, and test sets in a 7:1:2 ratio. An EDLM integrating three convolutional neural networks (ResNet18, DenseNet121, and EfficientNet-b7) through a voting strategy at the output level was developed and validated using 2D-SWE images. The diagnostic performance of the EDLM was compared with that of radiologists. A total of 286 CKD patients (mean age ± standard deviation: 41.86 ± 14.94, males: 162) and 858 2D-SWE images (mild RF: 405, moderate-severe RF: 453) were included. In the test set, EDLM achieved an accuracy of 93.0% (95% CI: 88.1, 95.9), negative predictive value of 89.6% (95% CI: 81.5, 94.5), positive predictive value of 96.4% (95% CI: 90.0, 98.8), specificity of 96.3% (95% CI: 89.7, 98.7), and sensitivity of 90.0% (95% CI: 82.1, 94.7). The area under the receiver operating characteristic curves of the EDLM was 0.989, surpassing experienced radiologist by 0.186 (P < 0.001) and less experienced radiologist by 0.279 (P < 0.001). EDLM based on 2D-SWE images significantly improved the diagnostic performance of RF in CKD. The EDLM was expected to be a potential tool for accurately non-invasive assessment of RF in CKD.

Structural health monitoring on offshore jacket platforms using a novel ensemble deep learning model

The goal of this research is to create an ensemble deep learning model for Internet of Things (IoT) applications that specifically target remote patient monitoring (RPM) by integrating long short-term memory (LSTM) networks and convolutional neural networks (CNN). The work tackles important RPM concerns such early health issue diagnosis and accurate real-time physiological data collection and analysis using wearable IoT devices. By assessing important health factors like heart rate, blood pressure, pulse, temperature, activity level, weight management, respiration rate, medication adherence, sleep patterns, and oxygen levels, the suggested Remote Patient Monitor Model (RPMM) attains a noteworthy accuracy of 97.23%. The model's capacity to identify spatial and temporal relationships in health data is improved by novel techniques such as the use of CNN for spatial analysis and feature extraction and LSTM for temporal sequence modeling. Early intervention is made easier by this synergistic approach, which enhances trend identification and anomaly detection in vital signs. A variety of datasets are used to validate the model's robustness, highlighting its efficacy in remote patient care. This study shows how using ensemble models' advantages might improve health monitoring's precision and promptness, which would eventually benefit patients and ease the burden on healthcare systems.

Osteoporosis is becoming a global health issue due to increased life expectancy. However, it is difficult to detect in its early stages owing to a lack of discernible symptoms. Hence, screening for osteoporosis with widely used dental panoramic radiographs would be very cost-effective and useful. In this study, we investigate the use of deep learning to classify osteoporosis from dental panoramic radiographs. In addition, the effect of adding clinical covariate data to the radiographic images on the identification performance was assessed. For objective labeling, a dataset containing 778 images was collected from patients who underwent both skeletal-bone-mineral density measurement and dental panoramic radiography at a single general hospital between 2014 and 2020. Osteoporosis was assessed from the dental panoramic radiographs using convolutional neural network (CNN) models, including EfficientNet-b0, -b3, and -b7 and ResNet-18, -50, and -152. An ensemble model was also constructed with clinical covariates added to each CNN. The ensemble model exhibited improved performance on all metrics for all CNNs, especially accuracy and AUC. The results show that deep learning using CNN can accurately classify osteoporosis from dental panoramic radiographs. Furthermore, it was shown that the accuracy can be improved using an ensemble model with patient covariates.