Ensemble Deep Learning Model Research Articles

Conv‐ELSTM: An ensemble deep learning approach for predicting short‐term wind power

AbstractAccurate and reliable forecasting of wind power is essential for the stable integration of wind energy into the electrical grid. However, the chaotic nature of wind power presents a significant challenge in utilizing data for effective short‐term forecasting, such as 60‐min predictions. This article introduces a hybrid data‐driven framework that employs an ensemble deep learning model to provide highly precise short‐term wind power predictions. The framework leverages a data‐driven approach to identify the intrinsic components of wind power data, including high‐frequency and low‐frequency components. A convolutional layer‐based feature fusion network is then established to properly extract important information from irrelevant wind energy features. Subsequently, an ensemble of long short‐term memory (LSTM) networks is developed to forecast wind power using the fused features, thereby mitigating the disadvantage of a single prediction model. The numerical experiment is carried out based on two different real‐life datasets. The results demonstrate the effectiveness of the proposed method in forecasting short‐term wind power compared to five benchmarks.

Novel statistically equivalent signature-based hybrid feature selection and ensemble deep learning LSTM and GRU for chronic kidney disease classification

Chronic kidney disease (CKD) involves numerous variables, but only a few significantly impact the classification task. The statistically equivalent signature (SES) method, inspired by constraint-based learning of Bayesian networks, is employed to identify essential features in CKD. Unlike conventional feature selection methods, which typically focus on a single set of features with the highest predictive potential, the SES method can identify multiple predictive feature subsets with similar performance. However, most feature selection (FS) classifiers perform suboptimally with strongly correlated data. The FS approach faces challenges in identifying crucial features and selecting the most effective classifier, particularly in high-dimensional data. This study proposes using the Least Absolute Shrinkage and Selection Operator (LASSO) in conjunction with the SES method for feature selection in CKD identification. Following this, an ensemble deep-learning model combining long short-term memory (LSTM) and gated recurrent unit (GRU) networks is proposed for CKD classification. The features selected by the hybrid feature selection method are fed into the ensemble deep-learning model. The model’s performance is evaluated using accuracy, precision, recall, and F1 score metrics. The experimental results are compared with individual classifiers, including decision tree (DT), Random Forest (RF), logistic regression (LR), and support vector machine (SVM). The findings indicate a 2% improvement in classification accuracy when using the proposed hybrid feature selection method combined with the LSTM and GRU ensemble deep-learning model. Further analysis reveals that certain features, such as HEMO, POT, bacteria, and coronary artery disease, contribute minimally to the classification task. Future research could explore additional feature selection methods, including dynamic feature selection that adapts to evolving datasets and incorporates clinical knowledge to enhance CKD classification accuracy further.

Enhanced Multi-Class Skin Lesion Classification of Dermoscopic Images Using an Ensemble of Deep Learning Models

This study presents an advanced approach to multi-class skin lesion classification by leveraging an ensemble model comprising the Inception-V3, ResNet-50, and VGG16 architectures. The classification task focuses on categorizing skin lesions into distinct classes, including Melanoma, basal cell carcinoma (BCC), and squamous cell carcinoma (SCC), using the ISIC dataset, a comprehensive collection of dermoscopic images. In order to properly balance the dataset, the oversampling strategy is utilized, as some lesion types are underrepresented due to inherent imbalances in the dataset. By ensuring that the model is trained on a more representative dataset, this balancing improves the algorithm's capacity to categorize all lesion types properly and impartially. By combining the complementary features of ResNet-50, Inception-V3, and VGG16, the ensemble technique improves the overall classification performance. ResNet-50 is chosen for its deep feature extraction capabilities, which help capture fine details in lesion patterns. Inception-V3 is selected for its multi-scale processing, allowing it to effectively analyze lesions at varying resolutions and sizes. VGG16 is included due to its simple yet highly effective architecture for image classification tasks. The ensemble model with data augmentation significantly outperforms individual models in skin lesion classification for both the original and balanced ISIC datasets regarding accuracy, precision, recall, and F1-score. This method offers a robust solution for skin lesion classification, contributing to more accurate and reliable diagnostic tools in dermatology.

An ensemble deep learning model for classification of students as weak and strong learners via multiparametric analysis

Academic data predictions are significantly important for improving the overall education system's effectiveness by providing early identification of weak students and personalized learning strategies. This paper proposes a deep learning model for the identification of weak and strong students using ensemble learning and multiparametric analysis. It combines several machine learning algorithms, including Naive Bayes, Support Vector Machines, Multi-Layer Perceptron, and Logistic Regression using an ensemble learning approach to enhance the model’s performance. Additionally, a custom 1D Convolutional Neural Network (CNN) is designed for classification. It utilizes multiparametric analysis to identify weak and strong students considering various parameters such as age, academic performance, location, and online learning behavior. The evaluation results indicate the performance of the proposed model has been improved in comparison to MLA FIS, SHMM, and DRL by 16.5%, 5.5%, and 2.4%, in terms of precision, 16.4%, 6.5%, and 3.5 % in terms of accuracy and 10.4%, 2.5% and 6.5% in terms of recall. These improvisations described that the model is efficient for multidomain feature extraction, ensemble classification, and high-variance feature selection, which result in a deeper understanding of student performance.

Efficient brain tumor grade classification using ensemble deep learning models

Detecting brain tumors early on is critical for effective treatment and life-saving efforts. The analysis of the brain with MRI scans is fundamental to the diagnosis because it contains detailed structural views of the brain, which is vital in identifying any of its abnormalities. The other option of performing an invasive biopsy is very painful and uncomfortable, which is not the case with MRI as it is free from surgically invasive margins and pieces of equipment. This helps patients to feel more at ease and hasten the diagnostic procedure, allowing physicians to formulate and practice action plans quicker. It is very difficult to locate a human brain tumor by manual because MRI scans produce large numbers of three-dimensional images. Complete applicability of pre-written computerized diagnostics, affords high possibilities in providing areas of interest earlier through the application of machine learning techniques and algorithms. The proposed work in the present study was to develop a deep learning model which will classify brain tumor grade images (BTGC), and hence enhance accuracy in diagnosing patients with different grades of brain tumors using MRI. A MobileNetV2 model, was used to extract the features from the images. This model increases the efficiency and generalizability of the model further. In this study, six standard Kaggle brain tumor MRI datasets were used to train and validate the developed and tested model of a brain tumor detection and classification algorithm into several types. This work consists of two key components: (i) brain tumor detection and (ii) classification of the tumor. The tumor classifications are conducted in both three classes (Meningioma, Pituitary, and glioma) and two classes (malignant, benign). The model has been reported to detect brain tumors with 99.85% accuracy, to distinguish benign and malignant tumors with 99.87% accuracy, and to type meningioma, pituitary, and glioma tumors with 99.38% accuracy. The results of this study indicate that the described technique is useful in the detection and classification of brain tumors.

Unveiling Agricultural Soil Runoff: Remote Sensing and Ensemble Deep Learning Models to Evaluate Impact of Climate on Water Quality and Human Health

Unveiling Agricultural Soil Runoff: Remote Sensing and Ensemble Deep Learning Models to Evaluate Impact of Climate on Water Quality and Human Health

An ensemble deep learning model for medical image fusion with Siamese neural networks and VGG-19.

Multimodal medical image fusion methods, which combine complementary information from many multi-modality medical images, are among the most important and practical approaches in numerous clinical applications. Various conventional image fusion techniques have been developed for multimodality image fusion. Complex procedures for weight map computing, fixed fusion strategy and lack of contextual understanding remain difficult in conventional and machine learning approaches, usually resulting in artefacts that degrade the image quality. This work proposes an efficient hybrid learning model for medical image fusion using pre-trained and non-pre-trained networks i.e. VGG-19 and SNN with stacking ensemble method. The model leveraging the unique capabilities of each architecture, can effectively preserve the detailed information with high visual quality, for numerous combinations of image modalities in image fusion challenges, notably improved contrast, increased resolution, and lower artefacts. Additionally, this ensemble model can be more robust in the fusion of various combinations of source images that are publicly available from Havard-Medical-Image-Fusion Datasets, GitHub. and Kaggle. Our proposed model performance is superior in terms of visual quality and performance metrics to that of the existing fusion methods in literature like PCA+DTCWT, NSCT, DWT, DTCWT+NSCT, GADCT, CNN and VGG-19.

Artificial intelligence driven cyberattack detection system using integration of deep belief network with convolution neural network on industrial IoT

In Industry 4.0, information and communication technology (ICT) was employed in numerous significant infrastructures, like financial networks, smart factories, and power plants, to automate and certify industrial systems. In power control systems, ICT technologies such as IIoT have improved automated monitoring, but legacy methods, originally autonomous, now connect with external networks. This progress has presented safety vulnerabilities from legacy ICT systems. Hence, various cybersecurity approaches are developed and examined to deal with cyberattacks and vulnerabilities. Utilizing new cybersecurity models in power control systems poses risks due to their uncertified safety. Ensuring their stability and efficiency is significant for maintaining reliable power delivery and incorporating these technologies into power control systems. Therefore, this study designs a Next–Generation Cybersecurity Attack Detection using an ensemble deep learning model (NGCAD-EDLM) technique in the IIoT environment. The main cause of the NGCAD-EDLM technique is the automatic recognition of cyber-attacks. In the NGCAD-EDLM approach, the primary data normalization phase utilizing min-max normalization is performed. Next, the honey-badger algorithm (HBA) approach selects the feature subsets. Furthermore, an ensemble deep learning (DL) of two methods, namely convolutional neural networks (CNNs) and deep belief networks (DBNs) methods, are employed for classification. In addition, the DL techniques' hyperparameter selection is accomplished using the lotus effect optimization algorithm (LEOA) method. A complete set of simulation validation is performed to establish the experimental analysis of the NGCAD-EDLM method. The performance validation of the NGCAD-EDLM method exhibited a superior accuracy value of 99.21 % over other existing techniques.

Reduction of Misclassifications in Wildfire Detection: A Weighted Ensemble Deep Learning Approach

Governments worldwide are increasingly prioritizing early wildfire detection to safeguard lives, property, and the environment. Although CNN-based models have demonstrated exceptional performance in various computer vision applications, the evolving nature of wildfire images poses significant challenges for a single CNN-based model in wildfire detection. In this study, we addressed this issue by integrating and weighting the differential learning capabilities of three individual transfer learning models: InceptionV3, ResNet50, and VGG16. Experimental results show that the ensemble deep learning models significantly outperformed all single classifiers across all performance metrics. Both the ensemble and weighted ensemble deep learning models achieved 99.7% accuracy, 99.5% precision, 100% recall, 99.8% F1-score, 0.5%false positive rate, 0.0% false negative rate and 0.3% error rate. Additionally, these models reduced the error rate by 98%, 91%, and 40% compared to the error rates of ResNet50, InceptionV3, and VGG16 respectively. A false negative rate of 0% indicates that our proposed ensemble deep learning models identified and predicted all the wildfire instances present in the test set correctly without a single misclassification. This positions our proposed ensemble deep learning models as superior choices for reducing misclassifications in wildfire detection.

Prediction of delivery truck arrivals at container terminals: an ensemble deep learning model

Prediction of delivery truck arrivals at container terminals: an ensemble deep learning model

Improving predictions of rock tunnel squeezing with ensemble Q-learning and online Markov chain

Predicting rock tunnel squeezing in underground projects is challenging due to its intricate and unpredictable nature. This study proposes an innovative approach to enhance the accuracy and reliability of tunnel squeezing prediction. The proposed method combines ensemble learning techniques with Q-learning and online Markov chain integration. A deep learning model is trained on a comprehensive database comprising tunnel parameters including diameter (D), burial depth (H), support stiffness (K), and tunneling quality index (Q). Multiple deep learning models are trained concurrently, leveraging ensemble learning to capture diverse patterns and improve prediction performance. Integration of the Q-learning-Online Markov Chain further refines predictions. The online Markov chain analyzes historical sequences of tunnel parameters and squeezing class transitions, establishing transition probabilities between different squeezing classes. The Q-learning algorithm optimizes decision-making by learning the optimal policy for transitioning between tunnel states. The proposed model is evaluated using a dataset from various tunnel construction projects, assessing performance through metrics like accuracy, precision, recall, and F1-score. Results demonstrate the efficiency of the ensemble deep learning model combined with Q-learning-Online Markov Chain in predicting surrounding rock tunnel squeezing. This approach offers insights into parameter interrelationships and dynamic squeezing characteristics, enabling proactive planning and support measures implementation to mitigate tunnel squeezing hazards and ensure underground structure safety. Experimental results show the model achieves a prediction accuracy of 98.11%, surpassing individual CNN and RNN models, with an AUC value of 0.98.

Hourly PM2.5 concentration prediction for dry bulk port clusters considering spatiotemporal correlation: A novel deep learning blending ensemble model

Accurate prediction of PM2.5 concentrations in ports is crucial for authorities to combat ambient air pollution effectively and protect the health of port staff. However, in port clusters formed by multiple neighboring ports, we encountered several challenges owing to the impact of unique meteorological conditions, potential correlation between PM2.5 levels in neighboring ports, and coupling influence of background pollutants in city zones. Therefore, considering the spatiotemporal correlation among the factors influencing PM2.5 concentration variations within the harbor cluster, we developed a novel blending ensemble deep learning model. The proposed model combined the strengths of four deep learning architectures: graph convolutional networks (GCN), long short-term memory networks (LSTM), residual neural networks (ResNet), and convolutional neural networks (CNN). GCN, LSTM, and ResNet served as the base models aimed at capturing the spatial correlation of PM2.5 concentrations in neighboring ports, the potential long-term dependence of meteorological factors and PM2.5 concentrations, and the effects of urban ambient air pollutants, respectively. Following the blending ensemble technique, the prediction outcomes of three base models were used as the input data for the meta-model CNN, which employs the blending ensemble technique to produce the final prediction results. Based on actual data obtained from 18 ports in Nanjing, the proposed model was compared and analyzed for its prediction performance against six state-of-the-art models. The findings revealed that the proposed model provided more accurate predictions. It reduced mean absolute error (MAE) by 10.59 %–20.00 %, reduced root mean square error (RMSE) by 13.22 %–17.11 %, improved coefficient of determination (R2) by 10 %–35.38 %, and improved accuracy (ACC) by 3.48 %–7.08 %. Additionally, the contribution of each component to the prediction performance of the proposed model was measured using a systematic ablation study. The results demonstrated that the GCN model exerted the most substantial influence on the prediction performance of the GCN-LSTM-ResNet model, followed by the LSTM model. The influence of urban background pollutants can significantly enhance the generalizability of the complete model. Moreover, a comparison with three blended ensemble models incorporating any two base models demonstrated that the GCN-LSTM-ResNet model exhibited superior prediction performance and was particularly excellent in predicting the occurrence of high-concentration events. Specifically, the GCN-LSTM-ResNet model improved MAE and RMSE by at least 12.3% and 9.2%, respectively, but reduced R2 and ACC by 26.1% and 6.8%, respectively. The proposed model provided reliable PM2.5 concentration prediction outcomes and decision support for air quality management strategies in dry bulk port clusters.

An ensemble deep learning model for fast classification of Twitter spam

Twitter spam needs to be detected and arrested quickly. The paper examines methods for classification of spam in terms of determination of important features, comparative performance of classification models, and improvement in time performance for classification. It presents a conceptualization of several novel rich, deep, and naïve features. The extraction processes for rich and deep features increase the time complexity of spam classification. To address this, the proposed model selectively segregates and combines features to enable near real-time processing. This supersedes the time performance of standard machine learning and deep learning models, with no compromise on the quality of classification.

Enhanced Foreign Exchange Volatility Forecasting Using Ceemdan with Optuna-Optimized Ensemble Deep Learning Model

Foreign Exchange (FX) is the largest financial market in the world, with a daily trading volume that significantly exceeds that of stock and futures markets. The prediction of FX volatility is a critical financial concern that has garnered significant attention from researchers and practitioners due to its far-reaching implications in the financial markets. This paper presents a novel hybrid ensemble forecasting model integrating a decomposition strategy and three deep learning (DL) models: Long Short-Term Memory (LSTM), Bidirectional LSTM (BiLSTM), and Convolutional Neural Network (CNN). This combination addresses individual models' limitations and further improves the accuracy and stability of FX volatility forecasting. The proposed approach utilizes the CEEMDAN technique to decompose volatility into multiple distinct intrinsic mode functions (IMFs) and merges these IMFs with GARCH and EGARCH volatilities to form the input dataset for the DL models. In addition, we employed an attention mechanism to improve the effectiveness of the DL techniques. Furthermore, the hyperparameters for the DL models are optimized using the Optuna algorithm. Finally, a hybrid ensemble model for forecasting exchange rate volatility is developed by combining the predictions of three distinct DL models. The proposed approach is evaluated against various benchmark models using evaluation measures such as MSE, MAE, HMSE, HMAE, RMSE, Q-LIKE, and the model confidence set (MCS) approach. The results demonstrate that our proposed approach provides accurate and reliable forecasts of FX volatility under different forecasting regimes, making it a valuable tool for financial practitioners and researchers.

Hybrid ensemble deep learning model for advancing breast cancer detection and classification in clinical applications

Being the most common type of cancer worldwide, and affecting over 2.3 million women, breast cancer poses a significant health threat. Although survival rates have improved around the world due to advances in screening, diagnosis, and treatment, early detection remains crucial for effective management. This study seeks to introduce a novel hybrid model that makes use of image-preprocessing techniques and deep-learning algorithms on mammograms to enhance the detection and classification accuracy of breast cancer lesions. The model was tested on a dataset comprising 20,000 mammograms. First, image-processing techniques, such as Contrast-Limited Adaptive Histogram Equalization, Gaussian Blur, and sharpening methods were used to optimize the images for enhanced feature extraction. In addition, the Ensemble Deep Random Vector-Functional Link Neural Network algorithm, YOLOv5, and MedSAM segmentation models were utilized for robust deep learning-based extraction, classification, and visualization of lesions. Finally, the model was clinically validated on 800 patients. The study found a notable enhancement in both accuracy and processing time for benign and malignant diagnoses using the hybrid model. The model achieves an impressive accuracy of 99.7 % and demonstrates a remarkable processing time of 0.75 s. In clinical applications, the hybrid model exhibits high proficiency, reporting 97.2 % accuracy for benign cases and 98.6 % for malignant scenarios. These results highlight the effectiveness of the hybrid model in improving diagnostic accuracy, offering a promising tool for early breast cancer detection.

Nonlinear Ensemble Deep Learning Model for Energy Consumption Prediction with Bayesian Optimization

Accurate prediction of electric energy consumption is crucial for efficient load dispatching, energy utilization, and grid operation. Traditional statistical and classical machine learning methods struggle with the nonlinear nature of energy consumption data, often leading to higher prediction errors. Additionally, deep learning models using a single approach face challenges such as convergence to local minima and poor generalization. This paper proposes a nonlinear ensemble deep learning model for residential energy consumption prediction, incorporating Bayesian optimization for hyperparameter tuning. The model combines Long Short-Term Memory (LSTM), Bidirectional LSTM (BiLSTM), and 1D Convolutional Neural Networks (1D-CNN), leveraging their powerful nonlinear feature learning capabilities. A k-means clustering approach is used to preprocess and reduce variability in the data, enhancing the ensemble model's performance. The ensemble model was tested on real energy consumption data from two districts in Addis Ababa, showing significant improvements in prediction accuracy with lower MAE, RMSE, and MAPE values compared to single models and un-clustered data. The integration of clustering and Bayesian optimization further enhanced model generalizability and minimized overfitting, demonstrating the effectiveness of a nonlinear approach in capturing complex energy consumption patterns.

Exploiting histopathological imaging for early detection of lung and colon cancer via ensemble deep learning model

Cancer seems to have a vast number of deaths due to its heterogeneity, aggressiveness, and significant propensity for metastasis. The predominant categories of cancer that may affect males and females and occur worldwide are colon and lung cancer. A precise and on-time analysis of this cancer can increase the survival rate and improve the appropriate treatment characteristics. An efficient and effective method for the speedy and accurate recognition of tumours in the colon and lung areas is provided as an alternative to cancer recognition methods. Earlier diagnosis of the disease on the front drastically reduces the chance of death. Machine learning (ML) and deep learning (DL) approaches can accelerate this cancer diagnosis, facilitating researcher workers to study a vast majority of patients in a limited period and at a low cost. This research presents Histopathological Imaging for the Early Detection of Lung and Colon Cancer via Ensemble DL (HIELCC-EDL) model. The HIELCC-EDL technique utilizes histopathological images to identify lung and colon cancer (LCC). To achieve this, the HIELCC-EDL technique uses the Wiener filtering (WF) method for noise elimination. In addition, the HIELCC-EDL model uses the channel attention Residual Network (CA-ResNet50) model for learning complex feature patterns. Moreover, the hyperparameter selection of the CA-ResNet50 model is performed using the tuna swarm optimization (TSO) technique. Finally, the detection of LCC is achieved by using the ensemble of three classifiers such as extreme learning machine (ELM), competitive neural networks (CNNs), and long short-term memory (LSTM). To illustrate the promising performance of the HIELCC-EDL model, a complete set of experimentations was performed on a benchmark dataset. The experimental validation of the HIELCC-EDL model portrayed a superior accuracy value of 99.60% over recent approaches.

52746 Using artificial intelligence hierarchical ensemble deep learning model to diagnose basal-cell carcinoma in reflective confocal microscopy images

52746 Using artificial intelligence hierarchical ensemble deep learning model to diagnose basal-cell carcinoma in reflective confocal microscopy images

An automated cervical cancer diagnosis model using Y-net and ensemble deep learning model

An automated cervical cancer diagnosis model using Y-net and ensemble deep learning model

Enhancing diagnosis: ensemble deep-learning model for fracture detection using X-ray images

Orthopedic trauma results in the injury of bone joints and tendons of the body. A radiologist reviews and monitors large numbers of radiographs daily, which can lead to the diagnostic error. Therefore, there is a need to automate the detection of bone fractures in X-ray images, particularly humerus bone fractures. In this paper, we have proposed an ensemble model that can detect the fracture in an x-ray image. In this paper, we proposed an ensemble model designed for fracture detection in X-ray images. An ensemble model combines multiple diverse models to improve predictive accuracy and robustness by aggregating their individual predictions. The model leverages MobileNetV2, Vgg16, InceptionV3, and ResNet50, using histogram equalization for preprocessing and a Global Average Pooling layer for feature extraction. The entire humerus from the public Mura-v1.1 dataset is utilized for analysis, utilizing a single training-validation split. The dataset is divided into a ratio of 80:20 for experiments for the training and validation datasets. The proposed model outperformed the modified deep-learning models and achieved 92.96%, 91.62%, and 92.14% accuracy, recall, and F1 scores, respectively. The ensemble model presented effectively automates bone fracture detection in X-ray images of the humerus, demonstrating superior performance compared to modified deep-learning models. A comparison has been made between a novel ensemble model and state-of-the-art models, bench-marking their performance. These findings underscore its potential for enhancing diagnostic accuracy and efficiency in orthopedic radiology.