Deep Residual Network Research Articles

A Deep Learning-Based Rotten Food Recognition App for Older Adults: Development and Usability Study.

Older adults are at greater risk of eating rotten fruits and of getting food poisoning because cognitive function declines as they age, making it difficult to distinguish rotten fruits. To address this problem, researchers have developed and evaluated various tools to detect rotten food items in various ways. Nevertheless, little is known about how to create an app to detect rotten food items to support older adults at a risk of health problems from eating rotten food items. This study aimed to (1) create a smartphone app that enables older adults to take a picture of food items with a camera and classifies the fruit as rotten or not rotten for older adults and (2) evaluate the usability of the app and the perceptions of older adults about the app. We developed a smartphone app that supports older adults in determining whether the 3 fruits selected for this study (apple, banana, and orange) were fresh enough to eat. We used several residual deep networks to check whether the fruit photos collected were of fresh fruit. We recruited healthy older adults aged over 65 years (n=15, 57.7%, males and n=11, 42.3%, females) as participants. We evaluated the usability of the app and the participants' perceptions about the app through surveys and interviews. We analyzed the survey responses, including an after-scenario questionnaire, as evaluation indicators of the usability of the app and collected qualitative data from the interviewees for in-depth analysis of the survey responses. The participants were satisfied with using an app to determine whether a fruit is fresh by taking a picture of the fruit but are reluctant to use the paid version of the app. The survey results revealed that the participants tended to use the app efficiently to take pictures of fruits and determine their freshness. The qualitative data analysis on app usability and participants' perceptions about the app revealed that they found the app simple and easy to use, they had no difficulty taking pictures, and they found the app interface visually satisfactory. This study suggests the possibility of developing an app that supports older adults in identifying rotten food items effectively and efficiently. Future work to make the app distinguish the freshness of various food items other than the 3 fruits selected still remains.

Deep Learning-based Intelligent Fault Diagnosis for Power Distribution Networks

Power distribution networks with distributed generation (DG) face challenges in fault diagnosis due to the high uncertainty, randomness, and complexity introduced by DG integration. This study proposes a two-stage approach for fault location and identification in distribution networks with DG. First, an improved bald eagle search algorithm combined with the Dijkstra algorithm (D-IBES) is developed for fault location. Second, a fusion deep residual shrinkage network (FDRSN) is integrated with IBES and support vector machine (SVM) to form the FDRSN-IBS-SVM model for fault identification. Experimental results showed that the D-IBES algorithm achieved a CPU loss rate of 0.54% and an average time consumption of 1.70 seconds in complex scenarios, outperforming the original IBES algorithm. The FDRSN-IBS-SVM model attained high fault identification accuracy (99.05% and 98.54%) under different DG output power levels and maintained robustness (97.89% accuracy and 97.54% recall) under 5% Gaussian white noise. The proposed approach demonstrates superior performance compared to existing methods and provides a promising solution for intelligent fault diagnosis in modern distribution networks.

Correction to “Universal Approximation Power of Deep Residual Neural Networks Through the Lens of Control”

Correction to “Universal Approximation Power of Deep Residual Neural Networks Through the Lens of Control”

Rapid diagnosis of celiac disease based on plasma Raman spectroscopy combined with deep learning

Celiac Disease (CD) is a primary malabsorption syndrome resulting from the interplay of genetic, immune, and dietary factors. CD negatively impacts daily activities and may lead to conditions such as osteoporosis, malignancies in the small intestine, ulcerative jejunitis, and enteritis, ultimately causing severe malnutrition. Therefore, an effective and rapid differentiation between healthy individuals and those with celiac disease is crucial for early diagnosis and treatment. This study utilizes Raman spectroscopy combined with deep learning models to achieve a non-invasive, rapid, and accurate diagnostic method for celiac disease and healthy controls. A total of 59 plasma samples, comprising 29 celiac disease cases and 30 healthy controls, were collected for experimental purposes. Convolutional Neural Network (CNN), Multi-Scale Convolutional Neural Network (MCNN), Residual Network (ResNet), and Deep Residual Shrinkage Network (DRSN) classification models were employed. The accuracy rates for these models were found to be 86.67%, 90.76%, 86.67% and 95.00%, respectively. Comparative validation results revealed that the DRSN model exhibited the best performance, with an AUC value and accuracy of 97.60% and 95%, respectively. This confirms the superiority of Raman spectroscopy combined with deep learning in the diagnosis of celiac disease.

Rotation Error Prediction of CNC Spindle Based on Short-Time Fourier Transform of Vibration Sensor Signals and Improved Weighted Residual Network.

The spindle rotation error of computer numerical control (CNC) equipment directly reflects the machining quality of the workpiece and is a key indicator reflecting the performance and reliability of CNC equipment. Existing rotation error prediction methods do not consider the importance of different sensor data. This study developed an adaptive weighted deep residual network (ResNet) for predicting spindle rotation errors, thereby establishing accurate mapping between easily obtainable vibration information and difficult-to-obtain rotation errors. Firstly, multi-sensor data are collected by a vibration sensor, and Short-time Fourier Transform (STFT) is adopted to extract the feature information in the original data. Then, an adaptive feature recalibration unit with residual connection is constructed based on the attention weighting operation. By stacking multiple residual blocks and attention weighting units, the data of different channels are adaptively weighted to highlight important information and suppress redundancy information. The weight visualization results indicate that the adaptive weighted ResNet (AWResNet) can learn a set of weights for channel recalibration. The comparison results indicate that AWResNet has higher prediction accuracy than other deep learning models and can be used for spindle rotation error prediction.

Source-free cross-domain fault diagnosis of rotating machinery using the Siamese framework

Despite deep learning based intelligent diagnosis has become an essential means of perceiving the health status of rotating machinery, existing diagnostic models struggle to efficiently extract domain-invariant representations for cross-domain tasks in the absence of source domain data due to the limitations of imbalanced machine fault data, the various scenarios, as well as privacy protection in industrial applications. In order to solve these issues, we innovatively propose a source-free cross-domain fault diagnosis algorithm for rotating machinery using the Siamese framework (SCSF). Specifically, a deep residual shrinkage network with parallel spatial and channel-wise attention mechanisms (DRSN-SCW) is used for feature extraction to suppress background noise. In addition, pre-trained feature extraction networks and classifiers use only source domains based on the Siamese framework for end-to-end representation learning to address the problem of fault diagnosis of category-imbalanced data at the feature representation level. Finally, for cross-domain scenarios where the target domain does not have access to source domain data during training, we use a prototype-based pseudo-labeling strategy as well as impose consistency and diversity constraints on the classifier outputs to improve the diagnostic performance of unlabeled target domains. Extensive experiments conducted on the Spectra Quest mechanical fault dataset and the Case Western Reserve University rolling bearing dataset validate the effectiveness of the SCSF. The code is available at .

Brain Tumor MRI Classification Using a Novel Deep Residual and Regional CNN.

Brain tumor classification is essential for clinical diagnosis and treatment planning. Deep learning models have shown great promise in this task, but they are often challenged by the complex and diverse nature of brain tumors. To address this challenge, we propose a novel deep residual and region-based convolutional neural network (CNN) architecture, called Res-BRNet, for brain tumor classification using magnetic resonance imaging (MRI) scans. Res-BRNet employs a systematic combination of regional and boundary-based operations within modified spatial and residual blocks. The spatial blocks extract homogeneity, heterogeneity, and boundary-related features of brain tumors, while the residual blocks significantly capture local and global texture variations. We evaluated the performance of Res-BRNet on a challenging dataset collected from Kaggle repositories, Br35H, and figshare, containing various tumor categories, including meningioma, glioma, pituitary, and healthy images. Res-BRNet outperformed standard CNN models, achieving excellent accuracy (98.22%), sensitivity (0.9811), F1-score (0.9841), and precision (0.9822). Our results suggest that Res-BRNet is a promising tool for brain tumor classification, with the potential to improve the accuracy and efficiency of clinical diagnosis and treatment planning.

Biological direct-shortcut deep residual learning for sparse visual processing

We show, based on the following three grounds, that the primary visual cortex (V1) is a biological direct-shortcut deep residual learning neural network (ResNet) for sparse visual processing: (1) We first highlight that Gabor-like sets of basis functions, which are similar to the receptive fields of simple cells in the primary visual cortex (V1), are excellent candidates for sparse representation of natural images; i.e., images from the natural world, affirming the brain to be optimized for this. (2) We then prove that the intra-layer synaptic weight matrices of this region can be reasonably first-order approximated by identity mappings, and are thus sparse themselves. (3) Finally, we point out that intra-layer weight matrices having identity mapping as their initial approximation, irrespective of this approximation being also a reasonable first-order one or not, resemble the building blocks of direct-shortcut digital ResNets, which completes the grounds. This biological ResNet interconnects the sparsity of the final representation of the image to that of its intra-layer weights. Further exploration of this ResNet, and understanding the joint effects of its architecture and learning rules, e.g. on its inductive bias, could lead to major advancements in the area of bio-inspired digital ResNets. One immediate line of research in this context, for instance, is to study the impact of forcing the direct-shortcuts to be good first-order approximations of each building block. For this, along with the ℓ1\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$${{\\ell}}_{1}$$\\end{document}-minimization posed on the basis function coefficients the ResNet finally provides at its output, another parallel one could e.g. also be posed on the weights of its residual layers.

Classification of Privacy Preserved Medical Data with Fractional Tuna Sailfish Optimization Based Deep Residual Network in Cloud

Classification of Privacy Preserved Medical Data with Fractional Tuna Sailfish Optimization Based Deep Residual Network in Cloud

AHBSMO-DRN: Single Device and Multiple Sharing-Based Geo-Position Spoofing Detection in Instant Messaging Platform

In recent years, location check-in on mobile components is a trending topic over social media. At the same time, hackers grasp the geographical position (geo-position) data that destruct the security of users. Hence, it is crucial to detect the originality of geo-position. A plethora of methods have been developed for geo-position spoofing identification that depends on geo-position data. Nonetheless, such techniques are incapable in terms of missing prior data or insufficient of large samples. To counterpart this issue, an effective model is invented to detect spoofing activity by Adaptive Honey Badger Spider Monkey Optimization_Deep residual Network (AHBSMO-based DRN). Here, neuro camera footprint refining is performed using Neuro Fuzzy filter and extracted footprint image obtained while considering the input and spoofed image are fused using Pearson correlation coefficient. Meanwhile, geo-tagged value of input image and spoofed image is also fused based on same Pearson coefficient. Finally, fusion is performed and then, spoofing detection is accomplished by comparing the Discrete Cosine Transform (DCT) foot print of two images to find if the input image is spoofed or not. Moreover, AHBSMO-based DRN model has gained outstanding outcomes in regard of accuracy of 0.921, True Positive Rate (TPR) 0 of 0.911, and False Positive Rate (FPR) of 0.136.

Residual Temporal Convolutional Network With Dual Attention Mechanism for Multilead-Time Interpretable Runoff Forecasting.

As a pivotal subfield within the domain of time series forecasting, runoff forecasting plays a crucial role in water resource management and scheduling. Recent advancements in the application of artificial neural networks (ANNs) and attention mechanisms have markedly enhanced the accuracy of runoff forecasting models. This article introduces an innovative hybrid model, ResTCN-DAM, which synergizes the strengths of deep residual network (ResNet), temporal convolutional networks (TCNs), and dual attention mechanisms (DAMs). The proposed ResTCN-DAM is designed to leverage the unique attributes of these three modules: TCN has outstanding capability to process time series data in parallel. By combining with modified ResNet, multiple TCN layers can be densely stacked to capture more hidden information in the temporal dimension. DAM module adeptly captures the interdependencies within both temporal and feature dimensions, adeptly accentuating relevant time steps/features while diminishing less significant ones with minimal computational cost. Furthermore, the snapshot ensemble method is able to obtain the effect of training multiple models through one single training process, which ensures the accuracy and robustness of the forecasts. The deep integration and collaborative cooperation of these modules comprehensively enhance the model's forecasting capability from various perspectives. Ablation studies conducted validate the efficacy of each module, and through multiple sets of comparative experiments, it is shown that the proposed ResTCN-DAM has exceptional and consistent performance across varying lead times. We also employ visualization techniques to display heatmaps of the model's weights, thereby enhancing the interpretability of the model. When compared with the prevailing neural network-based runoff forecasting models, ResTCN-DAM exhibits state-of-the-art accuracy, temporal robustness, and interpretability, positioning it at the forefront of contemporary research.

MRI-Based Prediction of Clinical Improvement after Ventricular Shunt Placement for Normal Pressure Hydrocephalus: Development and Evaluation of an Integrated Multisequence Machine Learning Algorithm.

Symptoms of normal pressure hydrocephalus (NPH) are sometimes refractory to shunt placement, with limited ability to predict improvement for individual patients. We evaluated an MRI-based artificial intelligence method to predict postshunt NPH symptom improvement. Patients with NPH who underwent MRI before shunt placement at a single center (2014-2021) were identified. Twelve-month postshunt improvement in mRS, incontinence, gait, and cognition were retrospectively abstracted from clinical documentation. 3D deep residual neural networks were built on skull-stripped T2-weighted and FLAIR images. Predictions based on both sequences were fused by additional network layers. Patients from 2014-2019 were used for parameter optimization, while those from 2020-2021 were used for testing. Models were validated on an external validation data set from a second institution (n = 33). Of 249 patients, n = 201 and n = 185 were included in the T2-based and FLAIR-based models according to imaging availability. The combination of T2-weighted and FLAIR sequences offered the best performance in mRS and gait improvement predictions relative to models trained on imaging acquired by using only 1 sequence, with area under the receiver operating characteristic (AUROC) values of 0.7395 [0.5765-0.9024] for mRS and 0.8816 [0.8030-0.9602] for gait. For urinary incontinence and cognition, combined model performances on predicting outcomes were similar to FLAIR-only performance, with AUROC values of 0.7874 [0.6845-0.8903] and 0.7230 [0.5600-0.8859]. Application of a combined algorithm by using both T2-weighted and FLAIR sequences offered the best image-based prediction of postshunt symptom improvement, particularly for gait and overall function in terms of mRS.

ESM data downscaling: a comparison of super-resolution deep learning models

Climate projections at fine spatial resolutions are required to conduct accurate risk assessment for critical infrastructure and design adaptation planning. Generating these projections using advanced Earth system models (ESM) requires significant computational resources. To address this issue, various statistical downscaling techniques have been introduced to generate fine-resolution data from coarse-resolution simulations. In this study, we evaluate and compare five deep learning-based downscaling techniques, namely, super-resolution convolutional neural networks, fast super-resolution convolutional neural network ESM, efficient sub-pixel convolutional neural network, enhanced deep residual network (EDRN), and super-resolution generative adversarial network (SRGAN). These techniques are applied to a dataset generated by the Energy Exascale Earth System Model (E3SM), focusing on key surface variables such as surface temperature, shortwave heat flux, and longwave heat flux. Models are trained and validated using paired fine-resolution (0.25∘\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$^{\\circ }$$\\end{document}) and coarse-resolution (1∘\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$^{\\circ }$$\\end{document}) monthly data obtained from a 9-year simulation. Next, blind testing is performed using monthly data obtained from two different years outside of the training and validation set. To evaluate the efficiency of each technique, different statistical metrics are used, including mean squared error (MSE), peak signal-to-noise ratio (PSNR), structural similarity index measure (SSIM), and learned perceptual image patch similarity (LPIPS). The results show that EDRN outperforms other algorithms in terms of PSNR, SSIM, and MSE, but struggles to capture fine-scale features in the data. In contrast, SRGAN, a generative model that uses perceptual loss, excels in capturing fine details at boundaries and internal structures, resulting in lower LPIPS than other methods.

Application value of artificial intelligence algorithm-based magnetic resonance multi-sequence imaging in staging diagnosis of cervical cancer.

The aim of this research is to explore the application value of Deep residual network model (DRN) for deep learning-based multi-sequence magnetic resonance imaging (MRI) in the staging diagnosis of cervical cancer (CC). This research included 90 patients diagnosed with CC between August 2019 and May 2021 at the hospital. After undergoing MRI examination, the clinical staging and surgical pathological staging of patients were conducted. The research then evaluated the results of clinical staging and MRI staging to assess their diagnostic accuracy and correlation. In the staging diagnosis of CC, the feature enhancement layer was added to the DRN model, and the MRI imaging features of CC were used to enhance the image information. The precision, specificity, and sensitivity of the constructed model were analyzed, and then the accuracy of clinical diagnosis staging and MRI staging were compared. As the model constructed DRN in this research was compared with convolutional neural network (CNN) and the classic deep neural network visual geometry group (VGG), the precision was 67.7, 84.9, and 93.6%, respectively. The sensitivity was 70.4, 82.5, and 91.2%, while the specificity was 68.5, 83.8, and 92.2%, respectively. The precision, sensitivity, and specificity of the model were remarkably higher than those of CNN and VGG models (P < 0.05). As the clinical staging and MRI staging of CC were compared, the diagnostic accuracy of MRI was 100%, while that of clinical diagnosis was 83.7%, showing a significant difference between them (P < 0.05). Multi-sequence MRI under intelligent algorithm had a high diagnostic rate for CC staging, deserving a good clinical application value.

Improved Identification of Forest Types in the Loess Plateau Using Multi-Source Remote Sensing Data, Transfer Learning, and Neural Residual Networks

This study aims to establish a deep learning-based classification framework to efficiently and rapidly distinguish between coniferous and broadleaf forests across the Loess Plateau. By integrating the deep residual neural network (ResNet) architecture with transfer learning techniques and multispectral data from unmanned aerial vehicles (UAVs) and Landsat remote sensing data, the effectiveness of the framework was validated through well-designed experiments. The study began by selecting optimal spectral band combinations, using the random forest algorithm. Pre-trained models were then constructed, and model performance was optimized with different training strategies, considering factors such as image size, sample quantity, and model depth. The results indicated substantial improvements in the model’s classification accuracy and efficiency for reasonable image dimensions and sample sizes, especially for an image size of 3 × 3 pixels and 2000 samples. In addition, the application of transfer learning and model fine-tuning strategies greatly enhanced the adaptability and universality of the model in different classification scenarios. The fine-tuned model achieved remarkable performance improvements in forest-type classification tasks, increasing classification accuracy from 85% to 93% in Zhengning, from 89% to 96% in Yongshou, and from 86% to 94% in Baishui, as well as exceeding 90% in all counties. These results not only confirm the effectiveness of the proposed framework, but also emphasize the roles of image size, sample quantity, and model depth in improving the generalization ability and classification accuracy of the model. In conclusion, this research has developed a technological framework for effective forest landscape recognition, using a combination of multispectral data from UAVs and Landsat satellites. This combination proved to be more effective in identifying forest types than was using Landsat data alone, demonstrating the enhanced capability and accuracy gained by integrating UAV technology. This research provides valuable scientific guidance and tools for policymakers and practitioners in forest management and sustainable development.

An attention mechanism and residual network based knowledge graph-enhanced recommender system

Recommender systems enhanced by a knowledge graph (KG) have attained widespread popularity and attention in recent years. However, traditional KG-based recommender systems encounter the challenge of gradient explosion as the network depth increases. Additionally, the abundance of unreliable paths in a KG has a detrimental impact on feature representation learning. In this article, we propose a KG-enhanced recommender system based on residual network and attention mechanism, which can capture high-order connectivity and long-range dependencies of the KG. Specifically, a resource allocation approach is employed to calculate the resource amount, which is subsequently utilized to evaluate the path reliability of the KG. After completing path extraction, we employ an attention mechanism to capture semantic correlations and structural information. To leverage the KG for enhancing recommender systems, we design a deep residual network with shortcut connections, effectively amalgamating advanced and abstract features using deep neural networks. The introduction of shortcut connections not only facilitates the fitting of residual mappings but also mitigates potential issues such as gradient explosion and convergence difficulties due to excessive network depth. Extensive experiments conducted on three standard datasets over baseline methods have demonstrated the superiority of our proposed recommender system.

MpoxNet: dual-branch deep residual squeeze and excitation monkeypox classification network with attention mechanism.

While the world struggles to recover from the devastation wrought by the widespread spread of COVID-19, monkeypox virus has emerged as a new global pandemic threat. In this paper, a high precision and lightweight classification network MpoxNet based on ConvNext is proposed to meet the need of fast and safe detection of monkeypox classification. In this method, a two-branch depth-separable convolution residual Squeeze and Excitation module is designed. This design aims to extract more feature information with two branches, and greatly reduces the number of parameters in the model by using depth-separable convolution. In addition, our method introduces a convolutional attention module to enhance the extraction of key features within the receptive field. The experimental results show that MpoxNet has achieved remarkable results in monkeypox disease classification, the accuracy rate is 95.28%, the precision rate is 96.40%, the recall rate is 93.00%, and the F1-Score is 95.80%. This is significantly better than the current mainstream classification model. It is worth noting that the FLOPS and the number of parameters of MpoxNet are only 30.68% and 31.87% of those of ConvNext-Tiny, indicating that the model has a small computational burden and model complexity while efficient performance.

Graphic Style Transfer Technology in Multimedia Communication: An Application of Deep Residual Adaptive Networks in Graphic Design

Graphic Style Transfer Technology in Multimedia Communication: An Application of Deep Residual Adaptive Networks in Graphic Design

Deep residual shrinkage network with multichannel VMD inputs for noise reduction of micro-thrust measurement

Micro-newton thrusters are widely utilized in the field of astronautics. Typically, the precision of micro-newton thrust measurement fundamentally depends on the background noise level. In this research, we introduce the Multichannel Variational Mode Decomposition Input Deep Residual Shrinkage Network (MV-DRSN) to identify the effective signals merged in the background noise. Experimental studies in vacuum were conducted to investigate the effect of noise reduction on MV-DRSN. It is shown that a steady-state signal with 0.1 μN as the minimum change unit can be recovered from the noises with an amplitude of 0.8 μN with an accuracy of 96.7% using MV-DRSN. In addition, the superiority of MV-DRSN over conventional ResNet has been validated, and its effectiveness in practical scenarios is verified. The proposed method has potential for noise reduction of steady-state sensor signals.

Enhanced Deep Learning Approach for Electromagnetic Forward Modeling of Dielectric Target Within the Wide Frequency Band Using Deep Residual Convolutional Neural Network

Enhanced Deep Learning Approach for Electromagnetic Forward Modeling of Dielectric Target Within the Wide Frequency Band Using Deep Residual Convolutional Neural Network