Deep Residual Network Research Articles

An Early Detection and Classification of Alzheimer's Disease Framework Based on ResNet-50.

The objective of this study is to develop a more effective early detection system for Alzheimer's disease (AD) using a Deep Residual Network (ResNet) model by addressing the issue of convolutional layers in conventional Convolutional Neural Networks (CNN) and applying image preprocessing techniques. The proposed method involves using Contrast Limited Adaptive Histogram Equalizer (CLAHE) and Boosted Anisotropic Diffusion Filters (BADF) for equalization and noise removal and K-means clustering for segmentation. A ResNet-50 model with shortcut links between three residual layers is proposed to extract features more efficiently. ResNet-50 is preferred over other ResNet types due to its intermediate depth, striking a balance between computational efficiency and improved performance, making it a widely adopted and effective architecture for various computer vision tasks. While other ResNet variations may offer higher depths, they are more prone to overfitting and computational complexity, which can hinder their practical application. The proposed method is evaluated on a dataset of MRI scans of AD patients. The proposed method achieved high accuracy and minimum losses of 95% and 0.12, respectively. While some models showed better accuracy, they were prone to overfitting. In contrast, the suggested framework, based on the ResNet-50 model, demonstrated superior performance in terms of various performance metrics, providing a robust and reliable approach to Alzheimer's disease categorization. The proposed ResNet-50 model with shortcut links between three residual layers, combined with image preprocessing techniques, provides an effective early detection system for AD. The study demonstrates the potential of deep learning and image processing techniques in developing accurate and efficient diagnostic tools for AD. The proposed method improves the existing approaches to AD classification and provides a promising framework for future research in this area.

Identification of gastric cancer types based on hyperspectral imaging technology.

Gastric cancer is becoming the second biggest cause of death from cancer. Treatment and prognosis of different types of gastric cancer vary greatly. However, the routine pathological examination is limited to the tissue level and is easily affected by subjective factors. In our study, we examined gastric mucosal samples from 50 normal tissue and 90 cancer tissues. Hyperspectral imaging technology was used to obtain spectral information. A two-classification model for normal tissue and cancer tissue identification and a four-classification model for cancer type identification are constructed based on the improved deep residual network (IDRN). The accuracy of the two-classification model and four-classification model are 0.947 and 0.965. Hyperspectral imaging technology was used to extract molecular information to realize real-time diagnosis and accurate typing. The results show that hyperspectral imaging technique has good effect on diagnosis and type differentiation of gastric cancer, which is expected to be used in auxiliary diagnosis and treatment.

A Study of Sustainable Product Design Evaluation Based on the Analytic Hierarchy Process and Deep Residual Networks

Traditional product design evaluation processes are resource-intensive and time-consuming, resulting in unsustainably higher costs and longer lead times. Therefore, sustainable product design evaluation has become an increasingly crucial aspect of product design, focusing on creating a high-efficiency, high-reliability, and low-carbon-emission approach. In this study, we proposed an integrated approach that combines manual design evaluation based on the analytic hierarchy process (AHP) with an automatic design evaluation based on a ResNet-50 network in order to develop a sustainable design evaluation method. First, the evaluation level and indicators for the shape design of a tail-light were defined using the AHP. We followed this by establishing a determination matrix and weight coefficients for the design indicators to create a manual design evaluation model. Second, tail-light shape image datasets were manually annotated based on the evaluation indicators, and design datasets were constructed. The ResNet-50 algorithm was introduced to train the datasets, and the automatic evaluation model for product design was constructed through training and tuning. Finally, we validated the feasibility and effectiveness of the product design evaluation method, which was based on AHP and ResNet-50, by comparing the results obtained using both manual design and automatic design evaluations. The results showed that the proposed sustainable product design evaluation model provides an efficient and reliable method for evaluating product design, improves the decision-making process, and empowers the design and development process. The model enhances resource efficiency and economic sustainability.

State of Charge Estimation of Lithium-Ion Battery Based on IDRSN and BiGRU

Abstract The estimation of state of charge (SOC) is a critical issue in the energy management of electric vehicle (EV) power batteries. However, the current accuracy of SOC estimation methods does not meet the requirements of practical applications. Therefore, this study proposes an improved lithium-ion battery SOC estimation method that combines deep residual shrinkage network (DRSN) and bidirectional gated recurrent unit (BiGRU) to enhance the SOC estimation accuracy. First, we insert the bidirectional gated recurrent unit neural network between the global average pooling layer and the output fully connected layer of the deep residual shrinkage network. This improvement enhances the model’s expressiveness, robustness, and data learning effect. Second, we develop a new activation function called “∂_swish” to replace the original ReLU activation function in the deep residual shrinkage network. The ∂_swish activation function improves the accuracy of the deep network model and reduces the risk of overfitting by utilizing its regularization effect. Finally, we conduct experimental tests at three different temperatures using the FUDS driving cycle dataset and the DST-US06-FUDS continuous driving cycle dataset. The algorithm model’s convergence speed is verified by comparing it with other models. The results show that compared to other models, the proposed method significantly improves SOC estimation accuracy at three different temperatures. In addition, the method demonstrates a high convergence speed.

Deep residual convolutional neural Network: An efficient technique for intrusion detection system

The fast growth of computer networks over the past few years has made network security in smart cities a significant issue. Network intrusion detection is crucial to maintaining the integrity, confidentiality, and resource accessibility of the various network security rules. Conventional intrusion detection systems frequently use mining association rules to identify intrusion behaviors. They run into issues such as a high false alarm rate (FAR), limited generalization capacity, and slow timeliness because they cannot adequately extract distinctive information about user activities. The primary goal of the current research is to classify attacks using efficient approaches to identify genuine packets. If the number of characteristics in a dataset decreases, the complexity of DL approaches is significantly decreased. In this research work, the Deep Residual Convolutional neural network (DCRNN) is proposed to enhance network security through intrusion detection, which is optimized by the Improved Gazelle Optimization Algorithm (IGOA). Feature selection has eliminated irrelevant features from network data used in obstacle classification processes. Essential features are chosen using the Novel Binary Grasshopper Optimization Algorithm (NBGOA). Experimentation is carried out using the UNSW-NB-15, Cicddos2019 dataset, and CIC-IDS-2017 dataset. According to the experimental findings, the proposed system outperforms existing models regarding classification accuracy and processing time. The results demonstrate that the presented approach efficiently and precisely identifies various assaults.

Discovery of type 2 diabetes mellitus with correlation and optimization driven hybrid deep learning approach

Diabetes mellitus is a severe condition that has the potential to impair strength. The disease known as diabetes mellitus, which is a chronic condition, is brought on by a significant rise in blood glucose levels. The diagnosis of this condition is made using a variety of chemical and physical testing. Diabetes, however, can harm the organs if it goes undetected. This study develops a hybrid deep-learning technique to recognize Type 2 diabetes mellitus. The data is cleaned up at the pre-processing stage using a data transformation technique based on the Yeo-Jhonson transformation. The tanimoto similarity is used in the feature selection process to select the best features from the data. To prepare data for future processing, data augmentation is performed. The Deep Residual Network and the Rider-based Neural Network are recommended and trained separately for the T2DM identification using the Competitive Multi-Verse Rider Optimizer. The outputs generated by the RideNN and DRN classifiers are blended using correlation-based fusion. The suggested CMVRO-based NN-DRN has shown improved performance with the highest accuracy of 91.4%, sensitivity of 94.8%, and specificity of 90.1%.

A Prior-Knowledge-Based Generative Adversarial Network for Unsupervised Satellite Cloud Image Restoration

High-quality satellite cloud images are of great significance for weather diagnosis and prediction. However, many of these images are often degraded due to relative motion, atmospheric turbulence, instrument noise, and other factors. In the satellite imaging process, the degradation also cannot be completely corrected. Therefore, it is necessary to further improve the satellite cloud image quality for real applications. In this study, we propose an unsupervised image restoration model with a two-stage network, in which the first stage, named the Prior-Knowledge-based Generative Adversarial Network (PKKernelGAN), aims to learn the blur kernel, and the second stage, named the Zero-Shot Deep Residual Network (ZSResNet), aims to improve the image quality. In PKKernelGAN, we propose a satellite cloud imaging loss function, which is a novel objective function that brings optimization of a generative model into the prior-knowledge domain. In ZSResNet, we build a dataset which contains the original satellite cloud image as high-quality images (HQ) paired with low-quality images (LQ) generated by the blur kernel learning from PKKernelGAN. The above innovations lead to a more efficient local structure in satellite cloud image restoration. The original dataset of our experiment is from the Sunflower 8 satellite provided by the Japan Meteorological Agency. This dataset is divided into training and testing sets to train and test PKKernelGAN. Then, ZSResNet is trained by the “LQ–HQ” image pairs generated by PKKernelGAN. Compared with other supervised and unsupervised deep learning models for image restoration, our model has a better performance. Extensive experiments have demonstrated that our proposed model can achieve better performance on different datasets.

Whale Optimization based Deep Residual Learning Network for Early Rice Disease Prediction in IoT

Disease detection on a farm requires laborious and time-consuming observation of individual plants, which is made more difficult when the farm is large and many different plants are farmed. To address these problems, cutting-edge technologies, AI, and Deep Learning (DL) are employed to provide more accurate illness predictions. When it comes to smart farming and precision agriculture, IoT opens up exciting new possibilities. To a certain extent, the goal-mouth of "smart farming" is to upsurge productivity and efficiency in agricultural processes. Smart farming is an approach to agriculture in which Internet of Things devices are interconnected and new technologies are used to optimize existing methods. Utilizing Internet of Things (IoT) devices, smart farming aids in more informed decision making. In many parts of the world, rice is the staple diet. This means that early detection of rice plant diseases using automated techniques and IoT devices is essential. Growing rice yields and profits may be helped along by DL model creation and deployment in agriculture. Here we introduce DRL, a deep residual learning framework that has been trained using photos of rice leaves to recognize one of four classes. The suggested model is called WO-DRL, and the hyper-parameter tuning procedure of DRL is executed with the help of the Whale Optimization algorithm. The outcomes demonstrate the efficacy of our suggested approach in directing the WO-DRL model to learn important characteristics. The findings of this study will pave the way for the agriculture sector to more quickly diagnose and treat plant diseases using AI.

Classification of brain tumours from MRI images using deep learning-enabled hybrid optimization algorithm

ABSTRACT Brain tumours are produced by the uncontrolled, and unusual tissue growth of brain. Because of the wide range of brain tumour locations, potential shapes, and image intensities, segmentation of the brain tumour by magnetic resonance imaging (MRI) is challenging. In this research, the deep learning (DL)-enabled brain tumour detection is developed by hybrid optimization method. The pre-processing stage used adaptive Wiener filter for minimizing the noise from input image. After that, the abnormal section of the image is segmented using U-Net. Afterwards, the data augmentation is accomplished to recover the random erasing, brightness, and translation characters. The statistical, shape, and texture features are extracted in feature extraction process. In first-level classification, the abnormal section of the image is sensed as brain tumour or not. Here, the Red Deer Tasmanian Devil Optimization (RDTDO) trained DenseNet is hired for brain tumour detection process. If tumour is identified, then second-level classification provides the brain tumour classification, where deep residual network (DRN)-enabled RDTDO is employed. Furthermore, the system performance is assessed by accuracy, true positive rate (TPR), true negative rate (TNR), positive predictive value (PPV), and negative predictive value (NPV) with the maximum values of 0.947, 0.926, 0.950, 0.937, and 0.926 are attained.

An Online Multiple Open-Switch Fault Diagnosis Method for T-Type Three-Level Inverters Based on Multimodal Deep Residual Filter Network

With the development of the processing capacity of the embedded chip, it is possible to implement a machine learning algorithm in the embedded system. To achieve the fault status without poor portability, tricky threshold selection and complex rulemaking, this paper proposes a multi-modal deep residual filter network for online multiple open-switch fault diagnosis of T-type three-level inverter. It contains low-rank matrix fusion (LMF), deep residual filter network (DRFN), and cross transformer mechanism. The LMF fuses the voltage signal and the current signal for obtaining the unified representation. And then, the DRFN filters noise adaptively and extracts information effectively. Finally, the cross-transformer mechanism output the fault state of the T-type three-level inverter. The data sets consist of the dc-link voltage and load side current of the inverter control system. The data time window is selected as 20 ms. Through the real-time calculation of online monitored data, the experimental results show the effectiveness of the proposed fault diagnosis approach. Moreover, the accuracy of fault diagnosis obtains 99.18% and the average open-circuit fault diagnosis time is 21 ms.

R2Net: Efficient and flexible diffeomorphic image registration using Lipschitz continuous residual networks.

Classical diffeomorphic image registration methods, while being accurate, face the challenges of high computational costs. Deep learning based approaches provide a fast alternative to address these issues; however, most existing deep solutions either lose the good property of diffeomorphism or have limited flexibility to capture large deformations, under the assumption that deformations are driven by stationary velocity fields (SVFs). Also, the adopted squaring and scaling technique for integrating SVFs is time- and memory-consuming, hindering deep methods from handling large image volumes. In this paper, we present an unsupervised diffeomorphic image registration framework, which uses deep residual networks (ResNets) as numerical approximations of the underlying continuous diffeomorphic setting governed by ordinary differential equations, which is parameterized by either SVFs or time-varying (non-stationary) velocity fields. This flexible parameterization in our Residual Registration Network (R2Net) not only provides the model's ability to capture large deformation but also reduces the time and memory cost when integrating velocity fields for deformation generation. Also, we introduce a Lipschitz continuity constraint into the ResNet block to help achieve diffeomorphic deformations. To enhance the ability of our model for handling images with large volume sizes, we employ a hierarchical extension with a multi-phase learning strategy to solve the image registration task in a coarse-to-fine fashion. We demonstrate our models on four 3D image registration tasks with a wide range of anatomies, including brain MRIs, cine cardiac MRIs, and lung CT scans. Compared to classical methods SyN and diffeomorphic VoxelMorph, our models achieve comparable or better registration accuracy with much smoother deformations. Our source code is available online at https://github.com/ankitajoshi15/R2Net.

Aberrations estimate based on diffraction patterns using deep residual network

Lenses are fundamental elements in many optical applications. However, various aberrations are inevitably present in lenses, which will affect the distribution of focused light intensity and optical imaging. Accurately predicting the aberrations of a lens is of great significance. Nevertheless, quantitatively measuring the aberrations of a lens, especially when multiple aberrations are present simultaneously, is a challenging task. In this paper, we propose a method based on a designed deep residual network called Y-ResNet to measure the astigmatism and coma of a lens simultaneously. The Y-ResNet was trained on the focused image pattern of a Gaussian beam passing through a lens with astigmatism and coma. The trained network can accurately predict the aberration coefficients of the lens with 0.99 specificity, 0.925 precision, 0.9382 recall, and a 0.9406 F1-score achieved on astigmatism and 0.99 specificity, 0.956 precision, 0.98 recall, and a 0.954 F1-score achieved on coma. Specifically, even if only part of the intensity distribution of the light spot is captured, the network can accurately estimate the aberrations of the lens with an accuracy of over 90% on coma and can identify astigmatism aberration features. This paper can provide a feasible method for correcting beam patterns caused by aberration based on deep learning.

ResNet-WGAN-Based End-to-End Learning for IoV Communication With Unknown Channels

An end-to-end learning framework is proposed to optimize each module jointly in the communication system. Recently, Convolutional Neural Network (CNN) and conditional Generative Adversarial Network (cGAN) are used for end-to-end learning. However, deeper network layers will degrade the effect of CNN. cGAN suffers from unstable training and lacks generative diversity. In this paper, we propose the end-to-end learning based on Deep Residual Network (ResNet) and Wasserstein GAN (WGAN) for communication with unknown channels (ResNet-WGAN). First, ResNet is applied to solve the problem of network degradation to extract deeper data features. Second, for unknown channels, WGAN with conditional information is used to fit the channel effect to improve training stability and generative diversity. Finally, we present the simulation results of the ResNet-WGAN under additive white Gaussian noise (AWGN) channel, Rayleigh fading channel and frequency selective channel. The results demonstrate that the ResNet-WGAN reduces the communication Bit Error Rate (BER) and Block Error Rate (BLER). In particular, this paper applies ResNet-WGAN to the Internet of Vehicles (IoV) communication, and the results demonstrate that ResNet-WGAN is more effective.

Structure-preserving low-dose computed tomography image denoising using a deep residual adaptive global context attention network.

Low-dose computed tomography (LDCT) scans can effectively reduce the radiation damage to patients, but this is highly detrimental to CT image quality. Deep convolutional neural networks (CNNs) have shown their potential in improving LDCT image quality. However, the conventional CNN-based approaches rely fundamentally on the convolution operations, which are ineffective for modeling the correlations among nonlocal similar structures and the regionally distinct statistical properties in CT images. This modeling deficiency hampers the denoising performance for CT images derived in this manner. In this paper, we propose an adaptive global context (AGC) modeling scheme to describe the nonlocal correlations and the regionally distinct statistics in CT images with negligible computation load. We further propose an AGC-based long-short residual encoder-decoder (AGC-LSRED) network for efficient LDCT image noise artifact-suppression tasks. Specifically, stacks of residual AGC attention blocks (RAGCBs) with long and short skip connections are constructed in the AGC-LSRED network, which allows valuable structural and positional information to be bypassed through these identity-based skip connections and thus eases the training of the deep denoising network. For training the AGC-LSRED network, we propose a compound loss that combines the L1 loss, adversarial loss, and self-supervised multi-scale perceptual loss. Quantitative and qualitative experimental studies were performed to verify and validate the effectiveness of the proposed method. The simulation experiments demonstrated the proposed method exhibits the best result in terms of noise suppression [root-mean-square error (RMSE) =9.02; peak signal-to-noise ratio (PSNR) =33.17] and fine structure preservation [structural similarity index (SSIM) =0.925] compared with other competitive CNN-based methods. The experiments on real data illustrated that the proposed method has advantages over other methods in terms of radiologists' subjective assessment scores (averaged scores =4.34). With the use of the AGC modeling scheme to characterize the structural information in CT images and of residual AGC-attention blocks with long and short skip connections to ease the network training, the proposed AGC-LSRED method achieves satisfactory results in preserving fine anatomical structures and suppressing noise in LDCT images.

High-Speed Bearing Health Monitoring Method Based on Attention Mechanism Optimized Siamese Deep Residual Network

High-Speed Bearing Health Monitoring Method Based on Attention Mechanism Optimized Siamese Deep Residual Network

Deep residual attention network for human defecation prediction using bowel sounds

Deep residual attention network for human defecation prediction using bowel sounds

Smart bird identification system based on a hybrid approach: Petri nets, convolutional neural and deep residual networks

Smart bird identification system based on a hybrid approach: Petri nets, convolutional neural and deep residual networks

An autoencoder deep residual network model for multi focus image fusion

An autoencoder deep residual network model for multi focus image fusion

DeepUMQA3: a web server for accurate assessment of interface residue accuracy in protein complexes.

Model quality assessment is a crucial part of protein structure prediction and a gateway to proper usage of models in biomedical applications. Many methods have been proposed for assessing the quality of structural models of protein monomers, but few methods for evaluating protein complex models. As protein complex structure prediction becomes a new challenge, there is an urgent need for model quality assessment methods that can accurately assess the accuracy of interface residues of complex structures. Here, we present DeepUMQA3, a web server for evaluating the accuracy of interface residues of protein complex structures using deep neural networks. For an input complex structure, features are extracted from three levels of overall complex, intra-monomer, and inter-monomer, and an improved deep residual neural network is used to predict per-residue lDDT and interface residue accuracy. DeepUMQA3 ranks first in the blind test of interface residue accuracy estimation in CASP15, with Pearson, Spearman, and AUC of 0.564, 0.535, and 0.755 under the lDDT measurement, which are 17.6%, 23.6%, and 10.9% higher than the second best method, respectively. DeepUMQA3 can also assess the accuracy of all residues in the entire complex and distinguish high- and low-precision residues. The web sever of DeepUMQA3 are freely available at http://zhanglab-bioinf.com/DeepUMQA_server/.

A Novel Joint Channel Estimation and Symbol Detection Receiver for Orthogonal Time Frequency Space in Vehicular Networks.

A vehicular network embodies a specialized variant of wireless network systems, characterized by its capability to facilitate inter-vehicular communication and connectivity with the encompassing infrastructure. With the rapid development of wireless communication technology, high-speed and reliable communication has become increasingly important in vehicular networks. It has been demonstrated that orthogonal time frequency space (OTFS) modulation proves effective in addressing the challenges posed by high-mobility environments, as it transforms the time-varying channels into the delay-Doppler domain. Motivated by this, in this paper, we focus on the theme of integrated sensing and communication (ISAC)-assisted OTFS receiver design, which aims to perform sensing channel estimation and communication symbol detection. Specifically, the estimation of the sensing channel is accomplished through the utilization of a deep residual denoising network (DRDN), while the communication symbol detection is performed by orthogonal approximate message passing (OAMP) processing. The numerical results demonstrate that the proposed ISAC system exhibits superior performance and robustness compared to traditional methods, with a lower complexity as well. The proposed system has great potential for future applications in wireless communication systems, especially in challenging scenarios with high mobility and interference.