Dilated Convolutional Neural Network Research Articles

ECG signal reconstruction from PPG using a hybrid attention-based deep learning network

Electrocardiography (ECG) and photoplethysmography (PPG) are non-invasive methods used to quantify signals originating from the cardiovascular system. Although there is a strong correlation between the cycles of the two measures, the correlation between the waveforms has received little attention in research. Measuring the PPG is significantly simpler and more convenient compared to the ECG measure. Recent research has demonstrated that PPG signals can be utilized to rebuild the ECG signals, suggesting that healthcare professionals might acquire a comprehensive comprehension of patients' cardiovascular well-being by only measuring PPG. With the advancement of artificial intelligence, the deep learning model has made significant progress in reconstructing ECG signals from PPG signals. However, the quality of the reconstructed ECG signal is still in need of more enhancement. In order to enhance the quality of the reconstructed ECG signal, we propose an innovative hybrid attention-based bidirectional recurrent neural network (Bi-RNN) that incorporates a dilated convolutional neural network technique for the purpose of reconstructing ECG signals from PPG signals. This addresses issues that occur when standard dilated CNN (DCNN) models neglect the link between circumstances and dispersion of gradients. The suggested approach maximizes the utilization of the DCNN and Bi-RNN unit design to provide fusion features. In order to ensure the model's resilience to deformation, it is imperative to initially extract spatial properties utilizing convolutional neural networks (CNNs). Once we have obtained geographic data, we employ BiLSTM to extract temporal features. The proposed model is so-called hybrid attention-based CNN and BiLSTM (HA-CNN-BiLSTM). BiLSTM mitigates the issues of gradient vanishing and exploding while maintaining accuracy. To showcase the advantages of the suggested model, we conduct a comparison between HA-CNN-BiLSTM and each separate state-of-the-art method. The simulation results indicated that the proposed method yielded superior root mean square error (RMSE) when reconstructing the ECG signal across different optimizers. The results also demonstrated that the proposed method results in the lowest RMSE with SGDM optimizer which is 0.031.

Symmetric Connected U-Net with Multi-Head Self Attention (MHSA) and WGAN for Image Inpainting

This study presents a new image inpainting model based on U-Net and incorporating the Wasserstein Generative Adversarial Network (WGAN). The model uses skip connections to connect every encoder block to the corresponding decoder block, resulting in a strictly symmetrical architecture referred to as Symmetric Connected U-Net (SC-Unet). By combining SC-Unet with a GAN, the study aims to reconstruct images more effectively and seamlessly. The traditional discriminators only differentiate the entire image as true or false. In this study, the discriminator calculated the probability of each pixel belonging to the hole and non-hole regions, which provided the generator with more gradient loss information for image inpainting. Additionally, every block of SC-Unet incorporated a Dilated Convolutional Neural Network (DCNN) to increase the receptive field of the convolutional layers. Our model also integrated Multi-Head Self-Attention (MHSA) into selected blocks to enable it to efficiently search the entire image for suitable content to fill the missing areas. This study adopts the publicly available datasets CelebA-HQ and ImageNet for evaluation. Our proposed algorithm demonstrates a 10% improvement in PSNR and a 2.94% improvement in SSIM compared to existing representative image inpainting methods in the experiment.

Retraction Note: HQDCNet: Hybrid quantum dilated convolution neural network for detecting covid-19 in the context of big data analytics

Retraction Note: HQDCNet: Hybrid quantum dilated convolution neural network for detecting covid-19 in the context of big data analytics

Intelligent Fault Diagnosis Method for Rotating Machinery Based on Recurrence Binary Plot and DSD-CNN.

To tackle the issue of the traditional intelligent diagnostic algorithm's insufficient utilization of correlation characteristics within the time series of fault signals and to meet the challenges of accuracy and computational complexity in rotating machinery fault diagnosis, a novel approach based on a recurrence binary plot (RBP) and a lightweight, deep, separable, dilated convolutional neural network (DSD-CNN) is proposed. Firstly, a recursive encoding method is used to convert the fault vibration signals of rotating machinery into two-dimensional texture images, extracting feature information from the internal structure of the fault signals as the input for the model. Subsequently, leveraging the excellent feature extraction capabilities of a lightweight convolutional neural network embedded with attention modules, the fault diagnosis of rotating machinery is carried out. The experimental results using different datasets demonstrate that the proposed model achieves excellent diagnostic accuracy and computational efficiency. Additionally, compared with other representative fault diagnosis methods, this model shows better anti-noise performance under different noise test data, and it provides a reliable and efficient reference solution for rotating machinery fault-classification tasks.

DCNNLFS: A Dilated Convolutional Neural Network With Late Fusion Strategy for Intelligent Classification of Gastric Histopathology Images.

Gastric cancer has a high incidence rate, significantly threatening patients' health. Gastric histopathology images can reliably diagnose related diseases. Still, the data volume of histopathology images is too large, making misdiagnosis or missed diagnosis easy. The classification model based on deep learning has made some progress on gastric histopathology images. However, traditional convolutional neural networks (CNNs) generally use pooling operations, which will reduce the spatial resolution of the image, resulting in poor prediction results. The image feature in previous CNN has a poor perception of details. Therefore, we design a dilated CNN with a late fusion strategy (DCNNLFS) for gastric histopathology image classification. The DCNNLFS model utilizes dilated convolutions, enabling it to expand the receptive field. The dilated convolutions can learn the different contextual information by adjusting the dilation rate. The DCNNLFS model uses a late fusion strategy to enhance the classification ability of DCNNLFS. We run related experiments on a gastric histopathology image dataset to verify the excellence of the DCNNLFS model, where the three metrics Precision, Accuracy, and F1-Score are 0.938, 0.935, and 0.959.

Joint relational triple extraction with enhanced representation and binary tagging framework in cybersecurity

The cyber threat intelligence (CTI) knowledge graph is a valuable tool for aiding security practitioners in the identification and analysis of cyberattacks. These graphs are constructed from CTI data, organized into relational triples, where each triple comprises two entities linked by a particular relation. However, as the volume of CTI data is expanding at a faster rate than predicted, existing technologies are unable to extract relational triples quickly and accurately. This work mainly focuses on the extraction of relational triples in CTI data, which is achieved by an enhanced representation and binary tagging framework (ERBTF). Firstly, we introduce embedding representations for relations and concatenate these with word embeddings to obtain the initial hidden representation. Subsequently, we employ a novel dilated convolutional encoder that consists of a dilated convolution neural network, gate mechanism and residual connection to enhance the learned contextual representation. Afterwards, we adopt an attention module that includes multi-head self-attention and position-wise feed-forward neural network to allocate greater attention to words that significantly influence the specific relation. Additionally, we utilize the straightforward yet efficient binary entity tagger to identify subject and object entities under different relations for constructing relational triples. We conduct massive experiments on relational triple extraction from CTI data, the results show that ERBTF is superior to the existing relation extraction models, and achieves state-of-the-art performance.

Three Novel Artificial Neural Network Architectures Based on Convolutional Neural Networks for the Spatio-Temporal Processing of Solar Forecasting Data

In this work, three new convolutional neural network models—spatio-temporal convolutional neural network versions 1 and 2 (ST_CNN_v1 and ST_CNN_v2), and the spatio-temporal dilated convolutional neural network (ST_Dilated_CNN)—are proposed for solar forecasting and processing global horizontal irradiance (GHI) data enriched with meteorological and astronomical variables. A comparative analysis of the proposed models with two traditional benchmark models shows that the proposed ST_Dilated_CNN model outperforms the rest in capturing long-range dependencies, achieving a mean absolute error of 31.12 W/m2, a mean squared error of 54.07 W/m2, and a forecast skill of 37.21%. The statistical analysis carried out on the test set suggested highly significant differences in performance (p-values lower than 0.001 for all metrics in all the considered scenarios), with the model with the lowest variability in performance being ST_CNN_v2. The statistical tests applied confirmed the robustness and reliability of the proposed models under different conditions. In addition, this work highlights the significant influence of astronomical variables on prediction performance. The study also highlights the intricate relationship between the proposed models and meteorological and astronomical input characteristics, providing important insights into the field of solar prediction and reaffirming the need for further research into variability factors that affect the performance of models.

Reinforced convolutional neural network fault diagnosis of industrial production systems

A new fault diagnosis method is proposed combining multiple models into a multiscale residual jagged dilated convolutional neural network with long short-term memory (MRJDCNN-LSTM). This method has strong feature extraction ability and can effectively extract and classify fault features. First, a new multi-scale residual jagged dilated convolution neural network (MRJDCNN) model is designed by incorporating the principle of residual learning into the improved jagged dilated convolution, and then it is combined with the long short term memory(LSTM) network delicately. This not only greatly improves the extraction rate of nonlinear high-latitude spatial features at different scales while preventing model degradation, but also subtly extracts time-related features, effectively reducing the loss of necessary features, and thus greatly improving the accuracy of model diagnosis. The simulation and comparative experiments of Tennessee-Eastman (TE) process and industrial coking furnace both prove that the constructed model has excellent performance.

An Order-Invariant and Interpretable Dilated Convolution Neural Network for Chemical Process Fault Detection and Diagnosis

An Order-Invariant and Interpretable Dilated Convolution Neural Network for Chemical Process Fault Detection and Diagnosis

Multi-Scale Attention and Dilated Convolutional Neural Network-Based 3D Scene Reconstruction for Moving Objects

Three-dimensional (3D) scene reconstruction for moving objects remains a challenging research topic. It is crucial to effectively capture feature representations from dynamic and complex scenarios. Consequently, this work introduces the integration of multi-scale attention and dilated convolution to create an enhanced deep-learning structure for this purpose. Therefore, this paper proposes a 3D reconstruction method for moving objects based on multi-scale attention and a dilated convolutional neural network (CNN). Specifically, a multi-scale attention algorithm framework that incorporates dilated CNNs is designed to extract multi-scale features of moving targets. The dilated CNN is incorporated to enhance the model’s perception ability and receptive field while maintaining a lightweight structure. This integrated design aims to achieve automatic learning targeted at features and scene information at different scales. By increasing the effective range of information perception and further enhancing the quality of reconstruction results, a coordinate system is established for 3D scene reconstruction of moving targets. Finally, a comparative analysis of subjective vision, visualization, and reconstruction algorithms is conducted using real-world cases. The experimental results demonstrate that the proposed method exhibits significant advantages in the 3D scene reconstruction task of moving targets compared to traditional methods.

Improved XLNet modeling for Chinese named entity recognition of edible fungus.

The diversity of edible fungus species and the extent of mycological knowledge pose significant challenges to the research, cultivation, and popularization of edible fungus. To tackle this challenge, there is an urgent need for a rapid and accurate method of acquiring relevant information. The emergence of question and answer (Q&A) systems has the potential to solve this problem. Named entity recognition (NER) provides the basis for building an intelligent Q&A system for edible fungus. In the field of edible fungus, there is a lack of a publicly available Chinese corpus suitable for use in NER, and conventional methods struggle to capture long-distance dependencies in the NER process. This paper describes the establishment of a Chinese corpus in the field of edible fungus and introduces an NER method for edible fungus information based on XLNet and conditional random fields (CRFs). Our approach combines an iterated dilated convolutional neural network (IDCNN) with a CRF. First, leveraging the XLNet model as the foundation, an IDCNN layer is introduced. This layer addresses the limited capacity to capture features across utterances by extending the receptive field of the convolutional kernel. The output of the IDCNN layer is input to the CRF layer, which mitigates any labeling logic errors, resulting in the globally optimal labels for the NER task relating to edible fungus. Experimental results show that the precision achieved by the proposed model reaches 0.971, with a recall of 0.986 and an F1-score of 0.979. The proposed model outperforms existing approaches in terms of these evaluation metrics, effectively recognizing entities related to edible fungus information and offering methodological support for the construction of knowledge graphs.

Multiscale dilated convolutional neural network for Atrial Fibrillation detection.

Atrial Fibrillation (AF), a type of heart arrhythmia, becomes more common with aging and is associated with an increased risk of stroke and mortality. In light of the urgent need for effective automated AF monitoring, existing methods often fall short in balancing accuracy and computational efficiency. To address this issue, we introduce a framework based on Multi-Scale Dilated Convolution (AF-MSDC), aimed at achieving precise predictions with low cost and high efficiency. By integrating Multi-Scale Dilated Convolution (MSDC) modules, our model is capable of extracting features from electrocardiogram (ECG) datasets across various scales, thus achieving an optimal balance between precision and computational savings. We have developed three MSDC modules to construct the AF-MSDC framework and assessed its performance on renowned datasets, including the MIT-BIH Atrial Fibrillation Database and Physionet Challenge 2017. Empirical results unequivocally demonstrate that our technique surpasses existing state-of-the-art (SOTA) methods in the AF detection domain. Specifically, our model, with only a quarter of the parameters of a Residual Network (ResNet), achieved an impressive sensitivity of 99.45%, specificity of 99.64% (on the MIT-BIH AFDB dataset), and an [Formula: see text] score of 85.63% (on the Physionet Challenge 2017 AFDB dataset). This high efficiency makes our model particularly suitable for integration into wearable ECG devices powered by edge computing frameworks. Moreover, this innovative approach offers new possibilities for the early diagnosis of AF in clinical applications, potentially improving patient quality of life and reducing healthcare costs.

LSTM-QDCNN: long short-term memory and quantum dilated convolutional neural network enabled occlusion percentage prediction

ABSTRACT Occlusion detection is vital in longer video sequences of real-time scenarios, as deformable objects generally occlude themselves or be occluded by exterior objects eventually. Occlusion can affect accuracy of the entire model significantly, because optical flow may reveal random attributes in occluded as well as neighbourhood areas. Occlusion is a challenging issue in real-world visual object tracking. Several techniques learn imprecise appearance of target while it becomes occluded by another object in the scene. Occlusion is a complicated issue that causes target loss in tracking procedure. Here, long short-term memory fused quantum dilated convolutional neural network (LSTM-QDCNN) is presented for occlusion percentage prediction. Initially, video frames are extracted from considered input video. The extracted frame is pre-processed by adaptive fuzzy filtering, and object localisation is accomplished by employing sparse fuzzy c-means with local optimal oriented pattern feature. Thereafter, occlusion category detection is conducted by deep Q-network. Lastly, occlusion percentage prediction is done by utilising LSTM-QDCNN. Additionally, LSTM-QDCNN is designed by merging deep LSTM (DLSTM) with quantum dilated convolutional neural network (QDCNN). Furthermore LSTM-QDCNN achieved maximum multiple-object tracking precision of 0.892 and minimum tracking distance of 3.714. In addition, LSTM-QDCNN achieved tracking number about 18.

Predicting Tool Wear with ParaCRN-AMResNet: A Hybrid Deep Learning Approach

In the manufacturing sector, tool wear substantially affects product quality and production efficiency. While traditional sequential deep learning models can handle time-series tasks, their neglect of complex temporal relationships in time-series data often leads to errors accumulating in continuous predictions, which reduces their forecasting accuracy for tool wear. For addressing these limitations, the parallel convolutional and recurrent neural networks with attention-modulated residual learning (ParaCRN-AMResNet) model is introduced. Compared with conventional deep learning models, ParaCRN-AMResNet markedly enhances the efficiency and precision of feature extraction from time-series data through its innovative parallel architecture. The model adeptly combines dilated convolution neural network and bidirectional gated recurrent units, effectively addressing distance dependencies and enriching the quantity and dimensions of extracted features. The strength of ParaCRN-AMResNet lies in its refined ability to capture the complex dynamics of time-series data, significantly boosting the model’s accuracy and generalization capability. The model’s efficacy was validated through comprehensive milling experiments and vibration signal analyses, showcasing ParaCRN-AMResNet’s superior performance. In evaluation metrics, the model achieved a MAE of 2.6015, MSE of 15.1921, R2 of 0.9897, and MAPE of 2.7997%, conclusively proving its efficiency and accuracy in the precise prediction of tool wear.

TriConvUNeXt: A Pure CNN-Based Lightweight Symmetrical Network for Biomedical Image Segmentation.

Biomedical image segmentation is essential in clinical practices, offering critical insights for accurate diagnosis and strategic treatment approaches. Nowadays, self-attention-based networks have achieved competitive performance in both natural language processing and computer vision, but the computational cost has reduced their popularity in practical applications. The recent study of Convolutional Neural Network (CNN) explores linear functions within modified CNN layer demonstrating pure CNN-based networks can still achieve competitive results against Vision Transformer (ViT) in biomedical image segmentation, with fewer parameters. The modified CNN, i.e., Depthwise CNN, however, leaves the features cleaved off in the channel dimension and prevents the extraction of features in the perspective of channel interaction. To effectively further explore the feature learning power of modified CNN with biomedical image segmentation, we design a lightweight multi-convolutional multi-scale convolutional network block (MSConvNeXt) for U-shape symmetrical network. Specifically, a network block consisting of a depthwise CNN, a deformable CNN, and a dilated CNN is proposed to capture semantic feature information effectively while with low computational cost. Furthermore, channel shuffling operation is proposed to dynamically promote an efficient feature fusion among the feature maps. The network block hereby is properly deployed within U-shape symmetrical encoder-decoder style network, named TriConvUNeXt. The proposed network is validated on a public benchmark dataset with a comprehensive evaluation in both computational cost and segmentation performance against 13 baseline methods. Specifically, TriConvUNeXt achieves 1% higher than UNet and TransUNet in Dice-Coefficient while 81% and 97% lower in computational cost. The implementation of TriConvUNeXt is made publicly accessible via https://github.com/ziyangwang007/TriConvUNeXt .

Sentiment analysis in social internet of things using contextual representations and dilated convolution neural network

Sentiment analysis in social internet of things using contextual representations and dilated convolution neural network

Blind recognition of channel codes based on a multiscale dilated convolution neural network

Channel coding is an essential part of communication. In a non-cooperative communication system, the receiver has to recover the signal without any priori knowledge. Therefore, it is important to recognize channel code types and parameters. At present, only a few studies focus on channel code type recognition. In this paper, a multiscale dilated convolution neural network (MSDCNN) is proposed to achieve fine-grained recognition of seven commonly used channel code types. MSDCNN has three multiscale modules. Based on the characteristics of each channel code type, the first two identical modules are designed to extract the overall features of codewords with unit convolution and three parallel regular convolution layers. To lower complexity, the third module uses dilated convolution instead of regular convolution to extract features between codewords. Simulation results show that MSDCNN has higher average recognition accuracy than other neural networks. More importantly, MSDCNN lowers complexity, making it more suitable for deployment so that it can be applied in practical non-cooperative receivers.

SADCNN-ORBM: a hybrid deep learning model based citrus disease detection and classification

Citrus disease has a significant influence on agricultural productivity these days, so technology based on artificial intelligence has been developed for creating computer vision (CV) models. By spotting disease in its early stages and enabling necessary productivity actions, CV in agriculture improves the production of agricultural goods. In this paper, we developed a CV-based citrus disease detection model called the self-attention dilated convolutional neural network optimized restricted Boltzmann machine (SADCNN-ORBM) model, which consists of two crucial parts: a SADCNN for disease segmentation and an ORBM optimized by the self-adaptive coati optimization (SACO) algorithm to improve the classification performance of diseases, which successfully divides the disease type into three groups: anthracnose, melanose, and brown spot. Numerous feature sets, such as texture features, three-channel red, green, blue (RGB) features, local binary pattern (LBP) features, and speeded-up robust features (SURF) features, are combined and given as input into the classification layer in the proposed model. We compare our proposed model's performance with existing methods by using several evaluation metrics. The findings demonstrate the SADCNN-ORBM model's superiority in precisely recognizing and classifying citrus illnesses, outperforming all available techniques.

A Data-Driven Autonomous Assessment Framework for Education Quality Based on Multiscale Deep Learning

Nowadays, computational intelligence-assisted autonomous assessment of education quality has become a more and more general concern in the area of smart education management. As education quality assessment is a complicated process with multiple heterogeneous factors, it remains challenging to make effective assessment using simple information modality and criteria. To deal with this issue, this paper introduces multiscale deep learning, and proposes a novel data-driven autonomous assessment framework for education quality. In particular, four aspects of heterogeneous indicators are selected as the basic indexes and a dilated convolutional neural network structure is formulated to perform multiscale feature extraction. Then, the structural equation is adopted to make multivariate characterization and output the final assessment results. At last, some simulations are carried out on realistic education operation data to evaluate the efficiency of the proposed autonomous assessment framework. Two aspects of findings can be deduced from the results. For one thing, multisource fusion of multiple indicators well makes sense to autonomous education assessment. For another, multiscale deep learning can provide some beneficial promotion to assessment efficiency.

The graft‐versus‐host problem for data‐driven gravity‐wave parameterizations in a one‐dimensional quasibiennial oscillation model

AbstractTwo key challenges in the development of data‐driven gravity‐wave parameterizations are generalization, how to ensure that a data‐driven scheme trained on the present‐day climate will continue to work in a new climate regime, and calibration, how to account for biases in the “host” climate model. Both problems depend fundamentally on the response to out‐of‐sample inputs compared with the training dataset, and are often conflicting. The ability to generalize to new climate regimes often goes hand in hand with sensitivity to model biases. To probe these challenges, we employ a one‐dimensional (1D) quasibiennial oscillation (QBO) model with a stochastic source term that represents convectively generated gravity waves in the Tropics with randomly varying strengths and spectra. We employ an array of machine‐learning models consisting of a fully connected feed‐forward neural network, a dilated convolutional neural network, an encoder–decoder, a boosted forest, and a support‐vector regression model. Our results demonstrate that data‐driven schemes trained on “observations” can be critically sensitive to model biases in the wave sources. While able to emulate accurately the stochastic source term on which they were trained, all of our schemes fail to simulate fully the expected QBO period or amplitude, even with the slightest perturbation to the wave sources. The main takeaway is that some measures will always be required to ensure the proper response to climate change and to account for model biases. We examine one approach based on the ideas of optimal transport, where the wave sources in the model are first remapped to the observed one before applying the data‐driven scheme. This approach is agnostic to the data‐driven method and guarantees that the model adheres to the observational constraints, making sure the model yields the right results for the right reasons.