Ensemble Deep Learning Method Research Articles

EMNet: An ensemble deep learning approach for geological condition detection in tunnel excavation

This paper established a novel ensemble deep learning method for the identification of the geological condition encountered during tunnel boring machine (TBM) operation. By integrating multiple MobileNet base models with information fusion through the Dempster-Shafer theory (DST), the proposed method is able to provide reliable identification of the geological condition based on the images of the excavated mucks on TBM’s conveyor belt. Shapley additive explanations (SHAP) analysis is further presented for model interpretation and understanding of the key features in the images. A case study using data collected from Singapore’s Circle Line 6 tunnel construction projects is conducted to verify the effectiveness of the proposed method. The results indicate that (1) The proposed method detects the encountered geological condition with high accuracy; (2) EMNet outperforms all the base MobileNet models; (3) SHAP analysis demonstrates that surface texture could be the key feature that assists the model for the classification. The developed method contributes to the state of knowledge in proposing a novel ensemble method for reliable image identification and the state of practice in proposing a useful tool to identify the encountered geological condition automatically.

Tuberculosis Detection and Air Purifier Suggestion

Tuberculosis (TB) is a disease that can be fatal if not promptly treated. Ensemble deep learning methods have shown promise in aiding the early detection of TB. Previous research typically trained ensemble classifiers using images with similar features, but for optimal performance, an ensemble requires a range of errors, achievable through diverse classification techniques or feature sets. This study focuses on the latter approach, presenting TB detection using deep learning alongside contrast-enhanced canny edge detected (CEED-Canny) X-ray images. CEED-Canny was employed to generate edge-detected lung X-ray images. Two sets of features were derived: one from the enhanced X- ray images and the other from the edge-detected images. By introducing this variation in features, the diversity of errors among the base classifiers was increased, resulting in improved TB detection. The proposed ensemble method achieved a comparable accuracy of 93.59%, sensitivity of 92.31%, and specificity of 94.87% compared to prior research.

Real-time early warning and the prediction of air pollutants for sustainable development in smart cities

Air quality forecasting is vital for sustainable development in smart cities and is essential to protect public health through early warning against air pollutants. This article presents a novel ensemble deep learning method able to capture spatiotemporal features on short-term time intervals and extract high data abstraction levels. This method uses a hierarchical framework with a new activation function called HT-Tanh to improve the prediction of air pollutant emissions in real time. As such, a residual neural network (ResNet) is integrated with a convolutional neural network (CNN) to deeply extract the temporal and spatial features from pollutant and meteorological data. The model network encodes the fully connected layer to fine-tune the CNN output and decodes the temporal prediction relations based on gate recurrent unit (GRU) to obtain more accurate results. The reliability of the proposed method is verified through a case study from Shantou City, China. The model performance is compared with the recently developed and traditional deep learning models. Results reveal that the proposed method has good precision in the multiscale air quality predictions. Compared with CNN-GRU, convolutional long short-term memory, and CNN models, the forecasting results of the proposed method are significantly improved. The presented method in this article can support the early warning systems in multiple regions for air pollution modeling studies.

Ensemble Deep Learning Methods for Detecting Skin Cancer

Skin cancer is a common and possibly fatal condition. Effective treatment results are greatly influenced by early identification. Deep learning (DP) algorithms have demonstrated encouraging outcomes in skin cancer detection computer-aided diagnostic systems. This article investigates the many forms of skin cancer, such as melanoma, basal cell carcinoma (BCC), and squamous cell carcinoma (SCC), and offers a system for detecting skin cancer utilizing convolutional neural network (CNN) approaches, particularly the multi-model ResNet (M-ResNet) architecture. We present a ResNet architecture that is capable of handling deep networks and has increased skin cancer detection performance. The proposed approach uses a thorough pipeline to find skin cancer. The dataset first goes through pre-processing (PP) procedures, such as picture resizing, normalization, and augmentation approaches, to improve the model's capacity for generalization. The multi-model assembles, leading to improved accuracy, sensitivity, and specificity in skin cancer LEARNING Classification SYSTEM (SC-LCS) tasks. In this study FINAL highlights, the effectiveness of deep learning (DL)techniques, specifically the multi-model ResNet architecture, AND skin cancer LEARNING classification SYSTEM (SC-LCS) for skin cancer detection. The suggested framework seems to have promising results in accurately identifying different types of skin cancer, assisting in diagnosis and therapy at an early stage. Further research and development in this field can potentially contribute to improving healthcare systems and reducing the global burden of skin cancer-related EFFECTED and DEATH RATE.

Two-Stage Ensemble Deep Learning Model for Precise Leaf Abnormality Detection in Centella asiatica

Leaf abnormalities pose a significant threat to agricultural productivity, particularly in medicinal plants such as Centella asiatica (Linn.) Urban (CAU), where they can severely impact both the yield and the quality of leaf-derived substances. In this study, we focus on the early detection of such leaf diseases in CAU, a critical intervention for minimizing crop damage and ensuring plant health. We propose a novel parallel-Variable Neighborhood Strategy Adaptive Search (parallel-VaNSAS) ensemble deep learning method specifically designed for this purpose. Our approach is distinguished by a two-stage ensemble model, which combines the strengths of advanced image segmentation and Convolutional Neural Networks (CNNs) to detect leaf diseases with high accuracy and efficiency. In the first stage, we employ U-net, Mask-R-CNN, and DeepNetV3++ for the precise image segmentation of leaf abnormalities. This step is crucial for accurately identifying diseased regions, thereby facilitating a focused and effective analysis in the subsequent stage. The second stage utilizes ShuffleNetV2, SqueezeNetV2, and MobileNetV3, which are robust CNN architectures, to classify the segmented images into different categories of leaf diseases. This two-stage methodology significantly improves the quality of disease detection over traditional methods. By employing a combination of ensemble segmentation and diverse CNN models, we achieve a comprehensive and nuanced analysis of leaf diseases. Our model’s efficacy is further enhanced through the integration of four decision fusion strategies: unweighted average (UWA), differential evolution (DE), particle swarm optimization (PSO), and Variable Neighborhood Strategy Adaptive Search (VaNSAS). Through extensive evaluations of the ABL-1 and ABL-2 datasets, which include a total of 14,860 images encompassing eight types of leaf abnormalities, our model demonstrates its superiority. The ensemble segmentation method outperforms single-method approaches by 7.34%, and our heterogeneous ensemble model excels by 8.43% and 14.59% compared to the homogeneous ensemble and single models, respectively. Additionally, image augmentation contributes to a 5.37% improvement in model performance, and the VaNSAS strategy enhances solution quality significantly over other decision fusion methods. Overall, our novel parallel-VaNSAS ensemble deep learning method represents a significant advancement in the detection of leaf diseases in CAU, promising a more effective approach to maintaining crop health and productivity.

Developing an EEG-Based Emotion Recognition Using Ensemble Deep Learning Methods and Fusion of Brain Effective Connectivity Maps

Developing an EEG-Based Emotion Recognition Using Ensemble Deep Learning Methods and Fusion of Brain Effective Connectivity Maps

Sarcasm Detection in News Headline Dataset with Ensemble Deep Learning Method

Sarcasm, a prevalent linguistic device, is frequently used in public discourse, often causing offence and distress to the listener. The complexity inherent in detecting sarcasm is a significant and ongoing challenge in the field of sentiment analysis research. The widespread use of this phenomenon in diverse conversational contexts further complicates its identification in data sets full of human interactions. Deficiencies in methodologies for distinguishing such statements adversely affect the performance of sentiment analysis, especially in distinguishing negative, positive or neutral sentiments. Inaccuracies in sarcasm detection can affect the classification results of sentiment analysis. Therefore, sentiment analysis seeks to categorise sarcastic sentences that, despite appearing positive, actually contain negative meanings. This research aims to build a deep learning ensemble stack model. The basic deep learning methods used are Bidirectional Gated Recurrent Unit (BiGRU) and Convolutional Neural Network (CNN). LightGBM is used to perform stack ensemble of deep learning methods. The dataset used comes from the Kaggle website and consists of English headlines. The findings show that the stack ensemble method outperforms BiGRU and CNN, evidenced by an accuracy rate of 91.2% and an F1 score of 90.2%. Therefore, from the above discussion, it can be concluded that the LightGBM method emerges as the optimal solution for sarcasm detection

Ensemble Deep Learning for Wear Particle Image Analysis

This technical note focuses on the application of deep learning techniques in the area of lubrication technology and tribology. This paper introduces a novel approach by employing deep learning methodologies to extract features from scanning electron microscopy (SEM) images, which depict wear particles obtained through the extraction and filtration of lubricating oil from a 4-stroke petrol internal combustion engine following varied travel distances. Specifically, this work postulates that the amalgamation of ensemble deep learning, involving the combination of multiple deep learning models, leads to greater accuracy compared to individually trained techniques. To substantiate this hypothesis, a fusion of deep learning methods is implemented, featuring deep convolutional neural network (CNN) architectures including Xception, Inception V3, and MobileNet V2. Through individualized training of each model, accuracies reached 85.93% for MobileNet V2 and 93.75% for Inception V3 and Xception. The major finding of this study is the hybrid ensemble deep learning model, which displayed a superior accuracy of 98.75%. This outcome not only surpasses the performance of the singularly trained models, but also substantiates the viability of the proposed hypothesis. This technical note highlights the effectiveness of utilizing ensemble deep learning methods for extracting wear particle features from SEM images. The demonstrated achievements of the hybrid model strongly support its adoption to improve predictive analytics and gain insights into intricate wear mechanisms across various engineering applications.

SnapKin: a snapshot deep learning ensemble for kinase-substrate prediction from phosphoproteomics data.

A major challenge in mass spectrometry-based phosphoproteomics lies in identifying the substrates of kinases, as currently only a small fraction of substrates identified can be confidently linked with a known kinase. Machine learning techniques are promising approaches for leveraging large-scale phosphoproteomics data to computationally predict substrates of kinases. However, the small number of experimentally validated kinase substrates (true positive) and the high data noise in many phosphoproteomics datasets together limit their applicability and utility. Here, we aim to develop advanced kinase-substrate prediction methods to address these challenges. Using a collection of seven large phosphoproteomics datasets, and both traditional and deep learning models, we first demonstrate that a 'pseudo-positive' learning strategy for alleviating small sample size is effective at improving model predictive performance. We next show that a data resampling-based ensemble learning strategy is useful for improving model stability while further enhancing prediction. Lastly, we introduce an ensemble deep learning model ('SnapKin') by incorporating the above two learning strategies into a 'snapshot' ensemble learning algorithm. We propose SnapKin, an ensemble deep learning method, for predicting substrates of kinases from large-scale phosphoproteomics data. We demonstratethat SnapKin consistently outperforms existing methods in kinase-substrate prediction. SnapKin is freely available at https://github.com/PYangLab/SnapKin.

Multi-class Tissue Segmentation of CT images using an Ensemble Deep Learning method.

Microwave ablation (MWA) therapy is a well-known technique for locally destroying lung tumors with the help of computed tomography (CT) images. However, tumor recurrence occurs because of insufficient ablation of the tumor. In order to perform an accurate treatment of lung cancer, there is a demand to determine the tumor area precisely. To address the problem at hand, which involves accurately segmenting organs and tumors in CT images obtained during MWA therapy, physicians could benefit from a semantic segmentation method. However, such a method typically requires a large number of images to achieve optimal results through deep learning techniques. To overcome this challenge, our team developed four different (multiple) U-Net based semantic segmentation models that work in conjunction with one another to produce a more precise segmented image, even when working with a relatively small dataset. By combining the highest weight value of segmentation from multiple methods into a single output, we can achieve a more reliable and accurate segmentation outcome. Our approach proved successful in segmenting four different tissue structures, including lungs, lung tumors, and ablated tissues in CT medical images. The Intersection over Union (IoU) is employed to quantitatively evaluate the proposed method. The method shows the highest average IoU, with 0.99 for the background, 0.98 for the lung, 0.77 for the ablated, and 0.54 for the tumor tissue. The results show that employing multiple DL methods is superior to that of individual base-learner models for all four different tissue structures, even in the presence of the relatively small dataset.Clinical relevance- An essential issue of tumor ablation therapy is to know when the entire tumor tissue has completely been destroyed. However, as it is difficult to distinguish between destroyed and living tumor, this is hardly reliable in clinical practice during MWA therapy, especially when working with a small dataset. Improved AI segmentation methods can help to improve performance to reduce recurrence.

OEDL: an optimized ensemble deep learning method for the prediction of acute ischemic stroke prognoses using union features.

Early stroke prognosis assessments are critical for decision-making regarding therapeutic intervention. We introduced the concepts of data combination, method integration, and algorithm parallelization, aiming to build an integrated deep learning model based on a combination of clinical and radiomics features and analyze its application value in prognosis prediction. The research steps in this study include data source and feature extraction, data processing and feature fusion, model building and optimization, model training, and so on. Using data from 441 stroke patients, clinical and radiomics features were extracted, and feature selection was performed. Clinical, radiomics, and combined features were included to construct predictive models. We applied the concept of deep integration to the joint analysis of multiple deep learning methods, used a metaheuristic algorithm to improve the parameter search efficiency, and finally, developed an acute ischemic stroke (AIS) prognosis prediction method, namely, the optimized ensemble of deep learning (OEDL) method. Among the clinical features, 17 features passed the correlation check. Among the radiomics features, 19 features were selected. In the comparison of the prediction performance of each method, the OEDL method based on the concept of ensemble optimization had the best classification performance. In the comparison to the predictive performance of each feature, the inclusion of the combined features resulted in better classification performance than that of the clinical and radiomics features. In the comparison to the prediction performance of each balanced method, SMOTEENN, which is based on a hybrid sampling method, achieved the best classification performance than that of the unbalanced, oversampled, and undersampled methods. The OEDL method with combined features and mixed sampling achieved the best classification performance, with 97.89, 95.74, 94.75, 94.03, and 94.35% for Macro-AUC, ACC, Macro-R, Macro-P, and Macro-F1, respectively, and achieved advanced performance in comparison with that of methods in previous studies. The OEDL approach proposed herein could effectively achieve improved stroke prognosis prediction performance, the effect of using combined data modeling was significantly better than that of single clinical or radiomics feature models, and the proposed method had a better intervention guidance value. Our approach is beneficial for optimizing the early clinical intervention process and providing the necessary clinical decision support for personalized treatment.

Ensemble deep learning in speech signal tasks: A review

Machine learning methods are extensively used for processing and analysing speech signals by virtue of their performance gains over multiple domains. Deep learning and ensemble learning are the two most commonly used techniques, which results in benchmark performance across different downstream tasks. Ensemble deep learning is a recent development which combines these two techniques to result in a robust architecture having substantial performance gains, as well as better generalization performance over the individual techniques. In this paper, we extensively review the use of ensemble deep learning methods for different speech signal related tasks, ranging from general objectives such as automatic speech recognition and voice activity detection, to more specific areas such as biomedical applications involving the detection of pathological speech or music genre detection. We provide a discussion on the use of different ensemble strategies such as bagging, boosting and stacking in the context of speech signals, and identify the various salient features and advantages from a broader perspective when coupled with deep learning architectures. The main objective of this study is to comprehensively evaluate existing works in the area of ensemble deep learning, and highlight the future directions that may be explored to further develop it as a tool for several speech related tasks. To the best of our knowledge, this is the first review study which primarily focuses on ensemble deep learning for speech applications. This study aims to serve as a valuable resource for researchers in academia and in industry working with speech signals, supporting advanced novel applications of ensemble deep learning models towards solving challenges in existing speech processing systems.

Brain Tumor Classification based on Improved Stacked Ensemble Deep Learning Methods.

Brain Tumor diagnostic prediction is essential for assisting radiologists and other healthcare professionals in identifying and classifying brain tumors. For the diagnosis and treatment of cancer diseases, prediction and classification accuracy are crucial. The aim of this study was to improve ensemble deep learning models for classifing brain tumor and increase the performance of structure models by combining different model of deep learning to develop a model with more accurate predictions than the individual models. Convolutional neural networks (CNNs), which are made up of a single algorithm called CNN model, are the foundation of most current methods for classifying cancer illness images. The model CNN is combined with other models to create other methods of classification called ensemble method. However, compared to a single machine learning algorithm, ensemble machine learning models are more accurate. This study used stacked ensemble deep learning technology. The data set used in this study was obtained from Kaggle and included two categories: abnormal & normal brains. The data set was trained with three models: VGG19, Inception v3, and Resnet 10. The 96.6% accuracy for binary classification (0,1) have been achieved by stacked ensemble deep learning model with Loss binary cross entropy, and Adam optimizer take into consideration with stacking models. The stacked ensemble deep learning model can be improved over a single framework.

Deep learning and ensemble deep learning for circRNA-RBP interaction prediction in the last decade: A review

Circular ribonucleic acids (circRNAs) are widely expressed in cells and tissues and play vital roles in cellular physiological processes. Their expressions are associated with clinicopathological features in cancer patients. Thus, they act as molecular biomarkers for tumor diagnosis, non-invasive monitoring, prognosis, and therapeutic intervention. Recent research has shown that circRNAs can interact with RNA-binding proteins (RBPs), which is a critical aspect for understanding circRNA functions. In this paper, we review the state-of-the-art deep learning and ensemble deep learning methods highlighting their strengths and weaknesses in circRNA-RBP interaction prediction. We further discuss new strategies for improving the existing methods. The existing circRNA-RBP interaction prediction methods are further classified as deep learning or ensemble deep learning. Moreover, we elaborate on the critical factors for cicRNA-RBP interactions, which can help the development of prediction models by providing necessary clarifications. This review further presents the benefits of using ensemble deep learning methods over single deep learning methods. Prediction performance improvements of ensemble deep learning methods over single deep learning methods are observed and the reasons for those improvements are discussed. Furthermore, this review discusses open problems of this research field and provides recommendations on future research directions.

Risk factor refinement and ensemble deep learning methods on prediction of heart failure using real healthcare records

The prediction of heart failure (HF) is crucial in preventing disease progression by implementing lifestyle changes and pharmacological interventions before the onset of heart diseases. While there have been numerous attempts to predict HF, many have failed to consider the coexisting risk factors and their complex relationships with one another. In this research paper, we present an early warning and prediction method for HF using deep learning approaches. Our proposed method involves a risk factor selection method to identify significant risk factors that contain relevant and valuable information for HF prediction. Additionally, we present an anomaly detection method to eliminate abnormal data that may be caused by mood changes or environmental factors. Finally, we propose an ensemble deep learning model for HF prediction based on scalable conjugate-gradient concept and back propagation learning algorithm that aims to predict and provide early warning of HF in massive medical data. We evaluate our proposed method based on our real research project, HeartCarer, and achieve an accuracy of 98.5%, which surpasses other state-of-the-art methods and our prior work (90%).

AI Enabled Ensemble Deep Learning Method for Automated Sensing and Quantification of DNA Damage in Comet Assay

Comet assay is a widely used technique to assess and quantify DNA damage in individual cells. Recently, researchers have applied various deep learning techniques to automate the analysis of comet assay. Image analysis using deep learning allows combining multiple parameters of images and performing computation at a pixel level to provide quantifiable information about the comets. The current deep learning analysis algorithms use a single neural network as a standard method, which relies on many comet images and prone to high variance in predictions. Here, we propose a new ensemble model consisting of a collection of deep learning networks with different configurations and different initial random weights trained on the same dataset to calculate one weighted prediction for DNA damage quantification. To develop this model, we curated a trainable comet assay image dataset consisting of1309 images with 9204 extracted features of cell head and tail length, area, etc With the proposed method we could achieve significantly higher accuracy (R2 = 89.3%, compared to 74% with the standard single neural network as reported in data published by M. D. Zeiler and R Fergus (European conference on computer vision, pp. 818–833 2014). Furthermore, deep regression with the proposed architecture produced much more reliable and accurate results than conventional method.

A Health state-related ensemble deep learning method for aircraft engine remaining useful life prediction

Remaining useful life (RUL) prediction for aircraft engines is crucial to enabling predictive maintenance. Current RUL predictions for aircraft engines mainly focus on model-based and data-driven methods that employ a single model or algorithm. Few studies on RUL prediction have been conducted by using an ensemble method that combines prediction results from multiple algorithms. As an emerging frontier technology, ensemble learning has become a topic of interest in the field of RUL prediction because it can achieve better prediction performance than single model. In this study, a health-state-related (HSR) ensemble deep learning method that considers different degradation laws of the aircraft engine is proposed for RUL prediction. First, a health baseline is constructed and lifetime degradation is divided into several health states to represent different degradation laws. The Mahalanobis distance to the health baseline is utilized to recognize the current health state of the aircraft engine. Second, three deep learning methods, namely stacked autoencoder, convolutional neural network and long short-term memory, are selected as member algorithms and trained on different health states. Thus, different member algorithm sets are constructed for different health states, learning different degradation laws in different health states. Third, self-adaptive ensemble weight sets for different health states are calculated by applying ridge regression, which can comprehensively utilize the prediction results of each algorithm model in different health states. A case study is conducted by using a dataset of the PHM data challenge to demonstrate the effectiveness of the proposed method. The experiment result shows that the proposed HSR ensemble deep learning method can considerably improve prediction performance compared with methods that are based on a single prediction algorithm and ensemble learning method that does not consider the health state.

Combining Deep Convolutional Neural Networks With Stochastic Ensemble Weight Optimization for Facial Expression Recognition in the Wild

Although recent emotion recognition methods (based on facial expression cues) achieve excellent performance in controlled scenarios, the recognition of emotion in the wild remains a challenging problem because of occlusion, large head poses, illumination variations, etc. Recent advances in deep learning show that combining an ensemble of deep learning models can considerably outperform the approach of using only a single deep learning model for challenging recognition problems. This paper presents a novel ensemble deep learning method, “deep convolutional neural network (DCNN) ensemble classifier”, for improved facial expression recognition (FER) in the wild. Our proposed DCNN ensemble classifier is novel in terms of the following aspects: (1) the process of finding ensemble weights for combining DCNN decision outputs is formulated as a stochastic optimization problem (via simulated annealing) in which the energy to be minimized represents the generalized (test) classification error of the DCNN ensemble and (2) for the creation of DCNN ensemble members, we propose the combined use of different types of face representations and bagging (T. G. Dietterich, 2000), which is quite useful in increasing the diversity of the DCNN ensemble. Extensive and comparative experiments on three wild FER datasets, namely FER2013, SFEW2.0, and RAF-DB, show that the proposed DCNN ensemble classifier achieves competitive FER performances when compared with other recently developed methods—76.69%, 58.68%, and 87.13% of FER accuracy under the FER2013, SFEW2.0, and RAF-DB evaluation protocols, respectively.

SENSDeep: An Ensemble Deep Learning Method for Protein-Protein Interaction Sites Prediction.

The determination of which amino acid in a protein interacts with other proteins is important in understanding the functional mechanism of that protein. Although there are experimental methods to detect protein-protein interaction sites (PPISs), these are costly, time-consuming, and require expertise. Therefore, many computational methods have been proposed to accelerate this type of research, but they are generally insufficient to predict PPISs accurately. There is a need for development in this field. In this study, we introduce a new PPISs prediction method. This method is a sequence-based Stacking ENSemble Deep (SENSDeep) learning method that has an ensemble learning model including the models of RNN, CNN, GRU sequence to sequence (GRUs2s), GRU sequence to sequence with an attention layer (GRUs2satt) and a multilayer perceptron. Two embedded features, secondary structure, and protein sequence information are added to the training data set in addition to twelve existing features to improve the prediction performance of the method. SENSDeep trained on the training data set without two extra features obtains a better performance on some of the independent testing data sets than that of the other methods in the literature, especially on scoring metrics of sensitivity, F1, MCC, and AUPRC, having increments up to 63.5%, 19.3%, 18.5%, 11.4%, respectively. It is shown that the added extra features improve the performance of the method by having almost the same performance with less data as the method trained on the data set without these added features. On the other hand, different sizes of the sliding window are tried on the data sets and an optimal sliding window size for SENSDeep is found. Moreover, SENSDeep has also been compared to structure-based methods. Some of these methods have been found to perform better. Using SENSDeep obtained by training with both training data sets, PPISs prediction examples of various proteins that are not in these training data sets are also presented. Furthermore, execution times for SENSDeep and its submodels are shown. https://github.com/enginaybey/SENSDeep.

PD-BertEDL: An Ensemble Deep Learning Method Using BERT and Multivariate Representation to Predict Peptide Detectability.

Peptide detectability is defined as the probability of identifying a peptide from a mixture of standard samples, which is a key step in protein identification and analysis. Exploring effective methods for predicting peptide detectability is helpful for disease treatment and clinical research. However, most existing computational methods for predicting peptide detectability rely on a single information. With the increasing complexity of feature representation, it is necessary to explore the influence of multivariate information on peptide detectability. Thus, we propose an ensemble deep learning method, PD-BertEDL. Bidirectional encoder representations from transformers (BERT) is introduced to capture the context information of peptides. Context information, sequence information, and physicochemical information of peptides were combined to construct the multivariate feature space of peptides. We use different deep learning methods to capture the high-quality features of different categories of peptides information and use the average fusion strategy to integrate three model prediction results to solve the heterogeneity problem and to enhance the robustness and adaptability of the model. The experimental results show that PD-BertEDL is superior to the existing prediction methods, which can effectively predict peptide detectability and provide strong support for protein identification and quantitative analysis, as well as disease treatment.