Multi-scale Convolutional Network Research Articles

Multi-Scale convolutional neural network for finger vein recognition

With the continuous advancement of science and technology, an increasing number of deep learning methods are being applied in the field of finger vein recognition to describe the structural characteristics of finger veins. However, some deep learning methods fail to adequately extract longer texture features. during the feature extraction process, resulting in a decrease in the uniqueness of extracted finger vein features. Additionally, these methods tend to extract global information while neglecting the importance of local texture information. To address the aforementioned issues, this paper introduces a multiscale convolution network (MCNet) model based on finger vein structure. On one hand, a multiscale feature extraction (MFE) model based on the rectangular and square convolution kernels are employed to extract structural information from finger veins and to simultaneously enhance the features of longer texture features. On the other hand, the paper introduces a cross-information fusion attention (CFA) block that combines spatial and channel information, in order to enhance local details information and the network’s ability to extract vein patterns. The experimental results on the public datasets FV-USM, SDUMLA-HMT, and HKPU validate the effectiveness of MCNet with the recognition rates of 99.86%, 99.11%, and 99.15% respectively.

Cross Attention-Based Multi-Scale Convolutional Fusion Network for Hyperspectral and LiDAR Joint Classification

Cross Attention-Based Multi-Scale Convolutional Fusion Network for Hyperspectral and LiDAR Joint Classification

Intelligent extraction of salient objects from fuzzy distorted images based on multi-scale convolution

ABSTRACT To solve the problem of how to obtain important information from fuzzy distorted images, an intelligent method for extracting salient objects from fuzzy distorted images based on multi-scale convolution is proposed. A multi-scale deformation feature convolution network is established to extract the salient features of fuzzy distorted images. Among them, the multi-scale convolution network VGG-16 extracts the shallow features of the fuzzy distortion image through the convolution layer operation, uses the multi-scale convolution kernel to extract the fuzzy distortion image in parallel, and introduces the self-attention mechanism to make the extracted features more relevant, Input the fused features into the proposed area extraction network, Through the target area detection network, the proposed target area of the fuzzy distortion image is classified and position regression is performed to obtain the final salient target of the fuzzy distortion image. The experimental results show that this method can accurately recognize the contour of salient objects, and extract salient objects from fuzzy distorted images; The extracted salient objects have high accuracy, low mean square error and similarity of 92.9% with the original image; For the salient target extraction in various scenarios, it shows high advantages.

Prediction of mechanical properties of rolled steel based on dual-attention multiscale convolutional neural network

The mechanical properties of carbon steel sheet directly depend on the chemical composition and process parameters of the steel. There is a complex nonlinear relationship between chemical composition, process parameters, and mechanical properties, and the establishment of a model with the ability to automatically distinguish the importance of different parameters, and to have good prediction accuracy and generalisation in different data sets is one of the important issues in the field of carbon steel mechanical properties prediction. In this paper, we proposed a multi-scale convolutional network model based on dual-attention mechanism (DAM-MSDSC), where the dual-attention module mines from features and channels at the same time, making the model focus on the important features. The multiscale feature fusion module effectively improves the model prediction accuracy by mining features from the output of the middle layer of the network to obtain features containing multiscale fusion features. In hot-rolled steel, for the two parameters of carbon content and temperature, it is confirmed that the change of carbon content has a greater impact on TS, while FTT and CT have a greater impact on YS. Through comparative experiments on different datasets, the proposed model had the best prediction performance, in which the correct rates of YS, TS, and EL are 98 %, 98.7 %, and 99.4 %, respectively, in cold rolled steel, and 97.8 %, 98.6 %, and 99.2 %, respectively, in hot rolled steel.

Global feature capture and spatially-aware neural networks for predicting CO2-flooding performance in heterogeneous low-permeable reservoirs

CO2-flooding can enhance crude oil recovery rates by reducing the viscosity of crude oil, improving the mobility ratio between crude oil and water, and leveraging the swelling effects of crude oil components. Furthermore, it facilitates the sequestration of greenhouse gases, leading to the realization of carbon capture, utilization, and storage (CCUS), which holds significant strategic importance for mitigating climate change, safeguarding ecological environments, and achieving sustainable development. Consequently, predicting CO2-flooding performance in heterogeneous low-permeability reservoirs holds crucial significance in sustainable energy production. However, the drawbacks of numerical simulation techniques, such as extensive computational resource consumption and prolonged simulation durations, have prompted extensive research into the utilization of artificial intelligence technologies. Prevalent approaches often treat the problem as a time series issue, which proves inadequate for reservoirs lacking historical production data. Furthermore, this methodology is unable to fully exploit the complex implicit relationships between various factors and the prediction target. Our study proposes a novel method for predicting the performance, which stands apart from previous approaches by not treating the problem as a time series issue, eliminating the need for historical production data for each prediction, and can predict various production variables such as gas production, oil production, water production, etc. in a universal manner. We combine enhanced MultiScale Non-local Neural Networks with ConvNet to handle sparse well network matrices with injection-production parameters. Additionally, we employ MultiScale convolutional networks with spatial attention mechanism to address formation permeability fields with spatial distribution features. Experimental results demonstrate the superiority of our approach in accuracy, achieving a prediction accuracy of over 97%. This research provides an innovative and flexible method, making significant contributions to the intelligentization and sustainable development of the petroleum industry, aligned with global efforts to both reduce carbon emissions and neutralize the existing ones.

Sensor-Enhanced Deep Learning for ECG Arrhythmia Detection: Integrating Multiscale Convolutional and Self-Attentive GRU Networks

Sensor-Enhanced Deep Learning for ECG Arrhythmia Detection: Integrating Multiscale Convolutional and Self-Attentive GRU Networks

A Multi-Scale Convolutional Hybrid Attention Residual Network for Enhancing Underwater Image and Identifying Underwater Multi-Scene Sea Cucumber

A Multi-Scale Convolutional Hybrid Attention Residual Network for Enhancing Underwater Image and Identifying Underwater Multi-Scene Sea Cucumber

A new multi-modal time series transformation method and multi-scale convolutional attention network for railway wagon bearing fault diagnosis

To align with the evolving trends in intelligent railway wagon operation and maintenance and to enhance the precision of railway wagon bearing fault diagnosis, this paper introduces a novel method for bearing fault diagnosis. The method comprises two key innovations. Firstly, a multi-modal time series transformation method is proposed. This method extracts time series data from the original time domain signals via self-adaptive ensemble empirical mode decomposition with adaptive noise, transforms them into 2D matrices, and captures inter- and intra-period information relationships through convolution. Secondly, a multi-scale convolutional attention network is introduced, enriching fault information by utilizing parallel multi-scale convolution for down-sampling. To prevent feature loss, sliding convolution is adopted instead of pooling. Additionally, the model incorporates the convolutional block attention module to focus on critical information. Experimental validation conducted in a laboratory using a self-developed railway wagon bearing dynamic performance tester demonstrates high diagnostic accuracy and strong overall performance. The method’s generalizability is further confirmed through validation using publicly available datasets. This method could find practical use in railway maintenance, improving the accuracy of bearing fault diagnosis, and making operations more efficient.

Detection model of atrial fibrillation based on multi-branch and multi-scale convolutional networks

Atrial fibrillation (AF) is a life-threatening heart condition, and its early detection and treatment have garnered significant attention from physicians in recent years. Traditional methods of detecting AF heavily rely on doctor's diagnosis based on electrocardiograms (ECGs), but prolonged analysis of ECG signals is very time-consuming. This paper designs an AF detection model based on the Inception module, constructing multi-branch detection channels to process raw ECG signals, gradient signals, and frequency signals during AF. The model efficiently extracted QRS complex and RR interval features using gradient signals, extracted P-wave and f-wave features using frequency signals, and used raw signals to supplement missing information. The multi-scale convolutional kernels in the Inception module provided various receptive fields and performed comprehensive analysis of the multi-branch results, enabling early AF detection. Compared to current machine learning algorithms that use only RR interval and heart rate variability features, the proposed algorithm additionally employed frequency features, making fuller use of the information within the signals. For deep learning methods using raw and frequency signals, this paper introduced an enhanced method for the QRS complex, allowing the network to extract features more effectively. By using a multi-branch input mode, the model comprehensively considered irregular RR intervals and P-wave and f-wave features in AF. Testing on the MIT-BIH AF database showed that the inter-patient detection accuracy was 96.89%, sensitivity was 97.72%, and specificity was 95.88%. The proposed model demonstrates excellent performance and can achieve automatic AF detection.

ITSC Fault Diagnosis for Five Phase Permanent Magnet Motors by Attention Mechanisms and Multiscale Convolutional Residual Network

ITSC Fault Diagnosis for Five Phase Permanent Magnet Motors by Attention Mechanisms and Multiscale Convolutional Residual Network

Real-time topology optimization based on multi-scale convolutional attention mechanism

This article proposes a deep learning model based on a multi-scale convolutional attention mechanism network SegNext for improving Topology Optimization (TO-Next), aimed at addressing the computational challenges associated with finite element iterations in traditional density-based methods. TO-Next is trained on diverse topology structures with varying loads, constraints and enriched physical information after initial iterations to enhance its generalization. Following training on three distinct decoder architectures, the optimal encoder–decoder network structure is determined. This study also investigates the algorithm's generalization capability under both single and multiple load constraints. The results indicate the superior performance and efficiency of the proposed method compared with the Solid Isotropic Material with Penalization (SIMP) method, enabling real-time generation of near-optimal topology structures within a short timeframe.

An accurate measurement of high-reflective objects by using 3D structured light

Using three-dimensional structured light to measure high-reflective objects accurately is a big challenge. Some overexposed and blurred areas in the structured light fringe patterns lead to the loss of semantic and texture information on the object surface, further leading to 3D model reconstruction errors. To solve this problem, a lightweight novel network, Deformable Convolutional and Multi-scale Convolutional Network (DcMcNet), is proposed for repairing highly reflectively distorted regions in sinusoidal fringe patterns and the Gray code binary fringe patterns. DcMcNet uses deformable convolution and multi-scale convolution to realize the effective utilization of multiscale global features in repairing highly reflective distorted regions and can adapt well to the different shapes of these regions. In addition, virtual software is used to acquire large-scale and high-fidelity datasets and a diverse loss function is constructed to better optimize DcMcNet. Depth reconstruction experiments of sinusoidal fringe patterns and point cloud reconstruction experiments of Gray code binary fringe patterns show that our method can repair highly reflective distortion regions with high accuracy, and for aeronautical blades, the MAE of the depth map is reduced from 0.1608 to 0.0675, and the point cloud coverage is improved from 76.64% to 98.95%.

Leadwise clustering multi-branch network for multi-label ECG classification

The 12-lead electrocardiogram (ECG) is widely used for diagnosing cardiovascular diseases in clinical practice. Recently, deep learning methods have become increasingly effective for automatically classifying ECG signals. However, most current research simply combines the 12-lead ECG signals into a matrix without fully considering the intrinsic relationships between the leads and the heart's structure. To better utilize medical domain knowledge, we propose a multi-branch network for multi-label ECG classification and introduce an intuitive and effective lead grouping strategy. Correspondingly, we design multi-branch networks where each branch employs a multi-scale convolutional network structure to extract more comprehensive features, with each branch corresponding to a lead combination. To better integrate features from different leads, we propose a feature weighting fusion module. We evaluate our method on the PTB-XL dataset for classifying 4 arrhythmia types and normal rhythm, and on the China Physiological Signal Challenge 2018 (CPSC2018) database for classifying 8 arrhythmia types and normal rhythm. Experimental results on multiple multi-label datasets demonstrate that our proposed multi-branch network outperforms state-of-the-art networks in multi-label classification tasks

Research on bearing remaining useful life anti-noise prediction based on fusion of color-grayscale time-frequency features

In contemporary industrial processes, vibration signals collected from bearings often contain significant noise, challenging the efficacy of conventional predictive models in extracting critical degradation features and accurately predicting the remaining useful life (RUL) of bearings. Addressing these challenges, this paper introduces a novel method for predicting bearing RUL under noisy conditions, leveraging a dual-branch multi-scale convolutional attention network (DMCSA) integrated with a dense residual feature fusion network (DRF). Initially, the method applies continuous wavelet transform (CWT) to vibration signals to extract color time-frequency image data, followed by grayscale processing to construct a comprehensive color-grayscale time-frequency image dataset, thereby augmenting the model’s input features. Enhanced channel and spatial attention mechanisms, combined with multi-scale convolutions, facilitate superior feature extraction and selection. The model’s resilience to noise is fortified by incorporating noise into the training dataset. Subsequently, selected color-gray time-frequency features undergo fusion and relearning through the DRF framework at the model’s backend. The crayfish optimization algorithm (COA) is deployed for the astute determination of the model’s critical hyperparameters. The proposed DMCSA-DRF model is then applied to predict the health indicator (MSCA-DRF-HI) of the test dataset, culminating in the accurate prediction of the bearings’ RUL. Validation experiments demonstrate that our method surpasses comparative models in prediction accuracy under diverse noise interferences, signifying a substantial advancement in predictive performance.

Coal slurry foam image enhancement based on multiscale convolutional network

Coal slurry foam image enhancement based on multiscale convolutional network

Cross-Attention Enhanced Pyramid Multi-Scale Networks for Sensor-Based Human Activity Recognition.

Human Activity Recognition (HAR) has recently attracted widespread attention, with the effective application of this technology helping people in areas such as healthcare, smart homes, and gait analysis. Deep learning methods have shown remarkable performance in HAR. A pivotal challenge is the trade-off between recognition accuracy and computational efficiency, especially in resource-constrained mobile devices. This challenge necessitates the development of models that enhance feature representation capabilities without imposing additional computational burdens. Addressing this, we introduce a novel HAR model leveraging deep learning, ingeniously designed to navigate the accuracy-efficiency trade-off. The model comprises two innovative modules: 1) Pyramid Multi-scale Convolutional Network (PMCN), which is designed with a symmetric structure and is capable of obtaining a rich receptive field at a finer level through its multiscale representation capability; 2) Cross-Attention Mechanism, which establishes interrelationships among sensor dimensions, temporal dimensions, and channel dimensions, and effectively enhances useful information while suppressing irrelevant data. The proposed model is rigorously evaluated across four diverse datasets: UCI, WISDM, PAMAP2, and OPPORTUNITY. Additional ablation and comparative studies are conducted to comprehensively assess the performance of the model. Experimental results demonstrate that the proposed model achieves superior activity recognition accuracy while maintaining low computational overhead.

TriConvUNeXt: A Pure CNN-Based Lightweight Symmetrical Network for Biomedical Image Segmentation.

Biomedical image segmentation is essential in clinical practices, offering critical insights for accurate diagnosis and strategic treatment approaches. Nowadays, self-attention-based networks have achieved competitive performance in both natural language processing and computer vision, but the computational cost has reduced their popularity in practical applications. The recent study of Convolutional Neural Network (CNN) explores linear functions within modified CNN layer demonstrating pure CNN-based networks can still achieve competitive results against Vision Transformer (ViT) in biomedical image segmentation, with fewer parameters. The modified CNN, i.e., Depthwise CNN, however, leaves the features cleaved off in the channel dimension and prevents the extraction of features in the perspective of channel interaction. To effectively further explore the feature learning power of modified CNN with biomedical image segmentation, we design a lightweight multi-convolutional multi-scale convolutional network block (MSConvNeXt) for U-shape symmetrical network. Specifically, a network block consisting of a depthwise CNN, a deformable CNN, and a dilated CNN is proposed to capture semantic feature information effectively while with low computational cost. Furthermore, channel shuffling operation is proposed to dynamically promote an efficient feature fusion among the feature maps. The network block hereby is properly deployed within U-shape symmetrical encoder-decoder style network, named TriConvUNeXt. The proposed network is validated on a public benchmark dataset with a comprehensive evaluation in both computational cost and segmentation performance against 13 baseline methods. Specifically, TriConvUNeXt achieves 1% higher than UNet and TransUNet in Dice-Coefficient while 81% and 97% lower in computational cost. The implementation of TriConvUNeXt is made publicly accessible via https://github.com/ziyangwang007/TriConvUNeXt .

EEG emotion recognition based on the TimesNet fusion model

In recent years, emotion recognition based on electroencephalogram (EEG) has become an important research field. This paper proposes an innovative multi-scale emotion recognition method (MS-ERM), which is based on a deep learning model. First, we divide the EEG signal into time windows of 0.5 s in different frequency bands to extract the differential entropy feature and embed the feature into the brain electrode map to express spatial information. Then, the features of each segment are used as input to the new deep learning model (MS-TimesNet). The model combines multi-scale convolution and TimesNet network to effectively extract dynamic time features, cross-channel spatial features, and complex time features in 2D space. Through extensive tests on the DEAP dataset, we prove that this method is superior to existing methods in terms of sentiment classification performance. In the arousal and valence classification, the average classification accuracy of subject-dependent tests reached 91.31% and 90.45%, respectively, while in subject-independent tests, the average classification accuracy was 86.66% and 85.40%, respectively. Code is available at this repository: https://github.com/hyao0827/MS-ERM.

HEVC Video Steganalysis Based on PU Maps and Multi-Scale Convolutional Residual Network

HEVC Video Steganalysis Based on PU Maps and Multi-Scale Convolutional Residual Network

Multi-scale Convolutional Feature Fusion Network Based on Attention Mechanism for IoT Traffic Classification

AbstractThe Internet of Things (IoT) has been extensively utilized in domains such as smart homes, healthcare, and other industries. With the exponential growth of Internet of Things (IoT) devices, they have become prime targets for malicious cyber-attacks. Effective classification of IoT traffic is, therefore, imperative to enable robust intrusion detection systems. However, IoT traffic data contain intricate spatial relationships and topological information, which traditional methods for traffic identification lack the capability to fully extract features and capture crucial characteristics. We propose a multi-scale convolutional feature fusion network augmented with a Convolutional Block Attention Module (MCF-CBAM) for accurate IoT traffic classification. The network incorporates three critical innovations: (1) Parallel convolution extracts multi-scale spatial features from traffic data. The 1 × 1 convolution operation reduces the amount of parameters and calculations of the network, thereby improving work efficiency. (2) The attention module suppresses less informative features while highlighting the most discriminative ones, enabling focused learning on decisive features. (3) Cross-scale connections with channel jumps reuse features from prior layers to enhance generalization. We evaluate the method extensively on three widely adopted public datasets. Quantitative results demonstrate MCF-CBAM establishes new state-of-the-art performance benchmarks for IoT traffic classification, surpassing existing methods by a significant margin. Qualitative visualizations of the learned attention weights provide intuitive insights into how the network automatically discovers the most decisive spatial features for identification. With its strong empirical performance and interpretable attention mechanisms, this work presents a promising deep learning solution to augment real-world IoT intrusion detection systems against growing cybersecurity threats.