Feature Fusion Module Research Articles

S2VSNet: Single stage V-shaped network for image deraining & dehazing

Producing high-quality, noise-free images from noisy or hazy inputs relies on essential tasks such as single image deraining and dehazing. In many advanced multi-stage networks, there is often an imbalance in contextual information, leading to increased complexity. To address these challenges, we propose a simplified method inspired by a U-Net structure, resulting in the “Single-Stage V-Shaped Network” (S2VSNet), capable of handling both deraining and dehazing tasks. A key innovation in our approach is the introduction of a Feature Fusion Module (FFM), which facilitates the sharing of information across multiple scales and hierarchical layers within the encoder-decoder structure. As the network progresses towards deeper layers, the FFM gradually integrates insights from higher levels, ensuring that spatial details are preserved while contextual feature maps are balanced. This integration enhances the image processing capability, producing noise-free, high-quality outputs. To maintain efficiency and reduce system complexity, we replaced or removed several non-essential non-linear activation functions, opting instead for simple multiplication operations. Additionally, we introduced a “Multi-Head Attention Integrated Module” (MHAIM) as an intermediary layer between encoder-decoder levels. This module addresses the limited receptive fields of traditional Convolutional Neural Networks (CNNs), allowing for the capture of more comprehensive feature-map information. Our focus on deraining and dehazing led to extensive experiments on a wide range of synthetic and real-world datasets. To further validate the robustness of our network, we implemented S2VSNet on a low-end edge device, achieving deraining in 2.46 seconds.

HPIDN: A Hierarchical prior-guided iterative denoising network with global–local fusion for enhancing low-dose CT images

Low-dose computed tomography (LDCT) is an emerging medical diagnostic tool that reduces radiation exposure but suffers from noise retention. Current CNN-based LDCT denoising algorithms struggle to capture comprehensive global representations, impacting diagnostic accuracy. To address this, we propose a novel Hierarchical Prior-guided Iterative Denoising Network (HPIDN) for LDCT images, consisting of two main modules: the Dynamic Feature Extraction and Fusion Module (DFEFM) and the Feature-domain Iterative Denoising Module (FIDM). DFEFM dynamically captures a comprehensive representation, encompassing detailed local features in intra-relationships and complex global features in inter-relationships. It effectively guides the multi-stage iterative denoising process. FIDM hierarchically fuses the prior with image features from DFEFM by using the dual-domain attention fusion sub-network (DAFSN), enhancing denoising robustness and adaptability. This yields higher-quality images with reduced noise artifacts. Extensive experiments on the Mayo and ELCAP Datasets demonstrate the superior performance of our method quantitatively and qualitatively, improving diagnostic accuracy of lung diseases.

Skin Lesion Segmentation through Generative Adversarial Networks with Global and Local Semantic Feature Awareness

The accurate segmentation of skin lesions plays an important role in the diagnosis and treatment of skin cancers. However, skin lesion areas are rich in details and local features, including the appearance, size, shape, texture, etc., which pose challenges for the accurate localization and segmentation of the target area. Unfortunately, the consecutive pooling and stride convolutional operations in existing convolutional neural network (CNN)-based solutions lead to the loss of some spatial information and thus constrain the accuracy of lesion region segmentation. In addition, using only the traditional loss function in CNN cannot ensure that the model is adequately trained. In this study, a generative adversarial network is proposed, with global and local semantic feature awareness (GLSFA-GAN) for skin lesion segmentation based on adversarial training. Specifically, in the generator, a multi-scale localized feature fusion module and an effective channel-attention module are designed to acquire the multi-scale local detailed information of the skin lesion area. In addition, a global context extraction module in the bottleneck between the encoder and decoder of the generator is used to capture more global semantic features and spatial information about the lesion. After that, we use an adversarial training strategy to make the discriminator discern the generated labels and the segmentation prediction maps, which assists the generator in yielding more accurate segmentation maps. Our proposed model was trained and validated on three public skin lesion challenge datasets involving the ISIC2017, ISIC2018, and HAM10000, and the experimental results confirm that our proposed method provides a superior segmentation performance and outperforms several comparative methods.

MLFEU-NET: A Multi-scale Low-level Feature Enhancement Unet for breast lesions segmentation in ultrasound images

Breast lesions constantly threaten the health of females. Segmentation methods of breast lesions are important for clinical diagnosis, and neural networks have been widely used and played a significant role in this field. However, false detections and miss detections still exist due to the variability in the shape and location of breast lesions, artifacts and noise in breast ultrasound (BUS) images, and structural defects in conventional segmentation networks. In this paper, a multi-scale low-level feature enhancement Unet (MLFEU-net) structure is presented, consisting of the U-net structure, low-level feature enhancement block (LFEB), and a parallel multiscale feature fusion (PMFF) module. Specifically, LFEB enhances the detail information during shallow downsampling and further feature selection. Meanwhile, in the neck of Unet, PMFF module uses different scales of dilation convolution to provide different sizes of sensory fields, and to efficiently merge shallow and deep features filtered, leads to more accurate segmentation results. To evaluate the MLFEU-net’s segmentation ability, five quantitative metrics were used on two breast ultrasound datasets, and it was compared with several advanced segmentation techniques. The results illustrate that our approach surpasses other methods in performance. Moreover, robustness experiments validate the effectiveness of our approach in achieving robust segmentation of breast lesions.

BCL-Former: Localized Transformer Fusion with Balanced Constraint for polyp image segmentation

Polyp segmentation remains challenging for two reasons: (a) the size and shape of colon polyps are variable and diverse; (b) the distinction between polyps and mucosa is not obvious. To solve the above two challenging problems and enhance the generalization ability of segmentation method, we propose the Localized Transformer Fusion with Balanced Constraint (BCL-Former) for Polyp Segmentation. In BCL-Former, the Strip Local Enhancement module (SLE module) is proposed to capture the enhanced local features. The Progressive Feature Fusion module (PFF module) is presented to make the feature aggregation smoother and eliminate the difference between high-level and low-level features. Moreover, the Tversky-based Appropriate Constrained Loss (TacLoss) is proposed to achieve the balance and constraint between True Positives and False Negatives, improving the ability to generalize across datasets. Extensive experiments are conducted on four benchmark datasets. Results show that our proposed method achieves state-of-the-art performance in both segmentation precision and generalization ability. Also, the proposed method is 5%–8% faster than the benchmark method in training and inference. The code is available at: https://github.com/sjc-lbj/BCL-Former.

3D Point Cloud Semantic Segmentation based on Multi-scale Dense Nested Networks

Aiming at the problem that the relationship between geometric features and semantic features is ignored in the point cloud data downsampling process, which leads to inaccurate segmentation of object boundaries and structural details, this paper proposes a 3D point cloud semantic segmentation network based on multi-scale dense nested type. Firstly, a dense nested network architecture is constructed by nesting multiple multi-scale feature fusion modules to fuse multi-scale features of different directions between encoder-decoder paths, so as to effectively propagate local ge-ometric context information and enhance the ability of cross-scale information interaction. Secondly, a local feature aggregation unit is constructed in the multi-scale feature fusion module, which strengthens the structural awareness within the local point set based on graph convolution and attention mechanism, and promotes the complementarity of local geometric features and abstract semantic information. Then, the cross-layer multi-loss supervision module is combined to further optimize the multi-scale feature propagation, which makes the network training more stable and improves the point cloud segmentation accuracy. Finally, this paper verified the proposed network on the S3DIS dataset. The experimental results show that the proposed network has the mean intersection over Union of 71.2% and the overall accuracy of 88.7%, which is 1.2 and 0.7 percentage points higher than RandLA-Net, respectively, which proves that the proposed network can effectively improve the accuracy of 3D point cloud semantic segmentation.

TDAD: Self-supervised industrial anomaly detection with a two-stage diffusion model

Visual anomaly detection has emerged as a highly applicable solution in practical industrial manufacturing, owing to its notable effectiveness and efficiency. However, it also presents several challenges and uncertainties. To address the complexity of anomaly types and the high cost associated with data annotation, this paper introduces a self-supervised learning framework called TDAD, based on a two-stage diffusion model. TDAD consists of three key components: anomaly synthesis, image reconstruction, and defect segmentation. It is trained end-to-end, with the goal of improving pixel-level segmentation accuracy of anomalies and reducing false detection rates. By synthesizing anomalies from normal samples, designing a diffusion model-based reconstruction network, and incorporating a multiscale semantic feature fusion module for defect segmentation, TDAD achieves state-of-the-art performance in image-level detection and anomaly localization on challenging and widely used datasets such as MVTec and VisA benchmarks.

Detection of Camellia oleifera fruit maturity in orchards based on modified lightweight YOLO

Fruit maturity is the main factor affecting the quality and yield of Camellia oil. At present, accurate and efficient detection of the maturity level of Camellia oleifera fruits in orchards and enabling selective picking for harvesting robots is a crucial issue. Aiming at the challenge of low detection efficiency of Camellia oleifera fruit maturity and complex object detection models that are difficult to deploy to Camellia oleifera selective harvesting robots, a modified lightweight You Only Look Once model (YOLO-LM) based on YOLOv7-tiny is proposed. Specifically, three Criss-Cross Attention (CCA) modules are introduced to the backbone network to reduce the influence of leaves and branches occlusion as well as mutual occlusion between fruits. Then, the Adaptively Spatial Feature Fusion (ASFF) module is applied as the head to solve the limitation of inconsistency across different feature scales on the feature pyramid. Furthermore, the GSConv is introduced to replace the standard convolution of the Neck network to enable the model to simultaneously preserve model accuracy and reduce model complexity. Experiment results demonstrate that the precision, recall, mAP@0.5, parameters, FLOPs, and model size of YOLO-LM reached 93.96 %, 93.32 %, 93.18 %, 10.17 million, 19.46 G, and 19.82 MB, which outperformed YOLOv3, Faster R-CNN (VGG16), Faster R-CNN (ResNet50), YOLOv4, and YOLOv5m. Compared to YOLOv3-tiny, YOLOv4-tiny, YOLOv5s, YOLOv7-tiny, and YOLOv8s, the mAP@0.5 of YOLO-LM increased by 6.24 %, 6.11 %, 2.52 %, 2.45 %, and 0.57 %, respectively. Meanwhile, the parameters and model size of YOLO-LM are slightly higher than that of YOLOv3-tiny, YOLOv4-tiny, YOLOv5s and YOLOv7-tiny, and significantly lower than that of YOLOv8s. In addition, the detection heatmaps of YOLOv7-tiny and YOLO-LM demonstrate these optimization operations contribute to the enhanced performance of maturity detection for Camellia oleifera fruits within natural orchard environments. Overall, the YOLO-LM model can be used for the maturity detection of Camellia oleifera fruits in orchards, which is expected to provide theoretical reference for orchard yield estimation, growth monitoring, planting management optimization and the development of Camellia oleifera selective harvesting robots.

Exploiting K-Space in Magnetic Resonance Imaging Diagnosis: Dual-Path Attention Fusion for K-Space Global and Image Local Features.

Magnetic resonance imaging (MRI) diagnosis, enhanced by deep learning methods, plays a crucial role in medical image processing, facilitating precise clinical diagnosis and optimal treatment planning. Current methodologies predominantly focus on feature extraction from the image domain, which often results in the loss of global features during down-sampling processes. However, the unique global representational capacity of MRI K-space is often overlooked. In this paper, we present a novel MRI K-space-based global feature extraction and dual-path attention fusion network. Our proposed method extracts global features from MRI K-space data and fuses them with local features from the image domain using a dual-path attention mechanism, thereby achieving accurate MRI segmentation for diagnosis. Specifically, our method consists of four main components: an image-domain feature extraction module, a K-space domain feature extraction module, a dual-path attention feature fusion module, and a decoder. We conducted ablation studies and comprehensive comparisons on the Brain Tumor Segmentation (BraTS) MRI dataset to validate the effectiveness of each module. The results demonstrate that our method exhibits superior performance in segmentation diagnostics, outperforming state-of-the-art methods with improvements of up to 63.82% in the HD95 distance evaluation metric. Furthermore, we performed generalization testing and complexity analysis on the Automated Cardiac Diagnosis Challenge (ACDC) MRI cardiac segmentation dataset. The findings indicate robust performance across different datasets, highlighting strong generalizability and favorable algorithmic complexity. Collectively, these results suggest that our proposed method holds significant potential for practical clinical applications.

A Multi-Scale Content-Structure Feature Extraction Network Applied to Gully Extraction

Black soil is a precious soil resource, yet it is severely affected by gully erosion, which is one of the most serious manifestations of land degradation. The determination of the location and shape of gullies is crucial for the work of gully erosion control. Traditional field measurement methods consume a large amount of human resources, so it is of great significance to use artificial intelligence techniques to automatically extract gullies from satellite remote sensing images. This study obtained the gully distribution map of the southwestern region of the Dahe Bay Farm in Inner Mongolia through field investigation and measurement and created a gully remote sensing dataset. We designed a multi-scale content structure feature extraction network to analyze remote sensing images and achieve automatic gully extraction. The multi-layer information obtained through the resnet34 network is input into the multi-scale structure extraction module and the multi-scale content extraction module designed by us, respectively, obtained richer intrinsic information about the image. We designed a structure content fusion network to further fuse structural features and content features and improve the depth of the model’s understanding of the image. Finally, we designed a muti-scale feature fusion module to further fuse low-level and high-level information, enhance the comprehensive understanding of the model, and improve the ability to extract gullies. The experimental results show that the multi-scale content structure feature extraction network can effectively avoid the interference of complex backgrounds in satellite remote sensing images. Compared with the classic semantic segmentation models, DeepLabV3+, PSPNet, and UNet, our model achieved the best results in several evaluation metrics, the F1 score, recall rate, and intersection over union (IoU), with an F1 score of 0.745, a recall of 0.777, and an IoU of 0.586. These results proved that our method is a highly automated and reliable method for extracting gullies from satellite remote sensing images, which simplifies the process of gully extraction and provides us with an accurate guide to locate the location of gullies, analyze the shape of gullies, and then provide accurate guidance for gully management.

GPAC-YOLOv8: lightweight target detection for fire scenarios

Abstract Due to the large number of parameters in the deep network model, it is difficult for existing fire detection methods to adapt to limited hardware configurations. In addition, detecting targets in the early stages of a fire is challenging owing to their small size. Therefore, this study presents a novel fire and smoke detection framework called GPAC-YOLOv8, which is based on the YOLOv8 architecture. Firstly, the integration of the ghost module and the Polarized Self-Attention attention mechanism into the backbone culminates in the CGP module, which is designed to improve computational efficiency while maintaining accuracy. Next, an innovative feature fusion module, AC-Neck, is developed through the application of the adaptive spatial feature fusion strategy and the lightweight content-aware reassembly of features upsampling mechanism, aiming to optimize feature map fusion and increase small target detection efficiency. Finally, a Focal-WIoU loss function, augmented with a dual weighting mechanism, is formulated to precisely delineate the aspect ratios of the predicted bounding boxes, thereby strengthening the generalization capacity of the model. Experimental results, derived from the application of the proposed GEAC-YOLOv8 method to a specially constructed dataset, show significant improvements in detection speed while maintaining detection accuracy compared to conventional methods. Thus, the GPAC-YOLOv8 framework demonstrably improves the effectiveness of object detection in fire and smoke scenarios.

A Chinese Nested Named Entity Recognition Model for Chicken Disease Based on Multiple Fine-Grained Feature Fusion and Efficient Global Pointer

Extracting entities from large volumes of chicken epidemic texts is crucial for knowledge sharing, integration, and application. However, named entity recognition (NER) encounters significant challenges in this domain, particularly due to the prevalence of nested entities and domain-specific named entities, coupled with a scarcity of labeled data. To address these challenges, we compiled a corpus from 50 books on chicken diseases, covering 28 different disease types. Utilizing this corpus, we constructed the CDNER dataset and developed a nested NER model, MFGFF-BiLSTM-EGP. This model integrates the multiple fine-grained feature fusion (MFGFF) module with a BiLSTM neural network and employs an efficient global pointer (EGP) to predict the entity location encoding. In the MFGFF module, we designed three encoders: the character encoder, word encoder, and sentence encoder. This design effectively captured fine-grained features and improved the recognition accuracy of nested entities. Experimental results showed that the model performed robustly, with F1 scores of 91.98%, 73.32%, and 82.54% on the CDNER, CMeEE V2, and CLUENER datasets, respectively, outperforming other commonly used NER models. Specifically, on the CDNER dataset, the model achieved an F1 score of 79.68% for nested entity recognition. This research not only advances the development of a knowledge graph and intelligent question-answering system for chicken diseases, but also provides a viable solution for extracting disease information that can be applied to other livestock species.

Hybrid multiple instance learning network for weakly supervised medical image classification and localization

Weakly supervised medical image analysis is of great significance for computer-aided diagnosis due to the difficulty in obtaining accurately labeled medical data. In this paper, we proposed a new Multi-instance Learning (MIL) framework called HybridMIL integrating CNN Convolutional Neural Networks (CNN) and Broad Learning Systems (BLS). Our HybridMIL can overcome several challenging issues over existing MIL methods based on either CNN or BLS alone: (i) Multiple levels (i.e., different resolutions) of feature information can be simultaneously extracted through a newly proposed instance-level feature enhancement (IFE) module; (ii) Global-level semantic information contained in the deep layers can be better represented under the global-level semantic enhancement (GSE) module; (iii) Hybrid feature fusion (HFF) module is newly designed to effectively fuse and align the multi-level outputs of IFE and global-level semantic information of GSE for subsequent classification and localization tasks. The proposed HybridMIL is evaluated on various public medical and MIL benchmark datasets. The results indicate that HybridMIL surpasses other recent MIL models in terms of classification and localization performance by up to 8.5% and 9.0%, respectively. Lastly, we demonstrate the highly competitive performance of HybridMIL in general MIL problems, going beyond weakly supervised medical image analysis.

Specific Emitter Identification Algorithm Based on Time–Frequency Sequence Multimodal Feature Fusion Network

Specific emitter identification is a challenge in the field of radar signal processing. Its aims to extract individual fingerprint features of the signal. However, early works are all designed using either signal or time–frequency image and heavily rely on the calculation of hand-crafted features or complex interactions in high-dimensional feature space. This paper introduces the time–frequency multimodal feature fusion network, a novel architecture based on multimodal feature interaction. Specifically, we designed a time–frequency signal feature encoding module, a wvd image feature encoding module, and a multimodal feature fusion module. Additionally, we propose a feature point filtering mechanism named FMM for signal embedding. Our algorithm demonstrates high performance in comparison with the state-of-the-art mainstream identification methods. The results indicate that our algorithm outperforms others, achieving the highest accuracy, precision, recall, and F1-score, surpassing the second-best by 9.3%, 8.2%, 9.2%, and 9%. Notably, the visual results show that the proposed method aligns with the signal generation mechanism, effectively capturing the distinctive fingerprint features of radar data. This paper establishes a foundational architecture for the subsequent multimodal research in SEI tasks.

Multi-feature fusion dehazing based on CycleGAN

Under the foggy environment, lane line images are obscured by haze, which leads to lower detection accuracy, higher false detection of lane lines. To address the above problems, a multi-layer feature fusion dehazing network based on CycleGAN architecture is proposed. Firstly, the foggy image is enhanced to remove the fog in the image, and then the lane line detection network is used for detection. For the dehazing network, a multi-layer feature fusion module is used in the generator to fuse the features of different coding layers of U-Net to enhance the network’s recovery of information such as details and edges, and a frequency domain channel attention mechanism is added at the key nodes of the network to enhance the network’s attention to different fog concentrations. At the same time, to improve the discriminant effect of the discriminator, the discriminator is extended to a global and local discriminator. The experimental results show that the dehaze effect on Reside and other test data sets is better than the comparison method. The peak signal-to-noise ratio is improved by 2.26 dB compared to the highest GCA-Net algorithm. According to the lane detection of fog images, it is found that the proposed network improves the accuracy of lane detection on foggy days.

Prediction of mechanical properties of rolled steel based on dual-attention multiscale convolutional neural network

The mechanical properties of carbon steel sheet directly depend on the chemical composition and process parameters of the steel. There is a complex nonlinear relationship between chemical composition, process parameters, and mechanical properties, and the establishment of a model with the ability to automatically distinguish the importance of different parameters, and to have good prediction accuracy and generalisation in different data sets is one of the important issues in the field of carbon steel mechanical properties prediction. In this paper, we proposed a multi-scale convolutional network model based on dual-attention mechanism (DAM-MSDSC), where the dual-attention module mines from features and channels at the same time, making the model focus on the important features. The multiscale feature fusion module effectively improves the model prediction accuracy by mining features from the output of the middle layer of the network to obtain features containing multiscale fusion features. In hot-rolled steel, for the two parameters of carbon content and temperature, it is confirmed that the change of carbon content has a greater impact on TS, while FTT and CT have a greater impact on YS. Through comparative experiments on different datasets, the proposed model had the best prediction performance, in which the correct rates of YS, TS, and EL are 98 %, 98.7 %, and 99.4 %, respectively, in cold rolled steel, and 97.8 %, 98.6 %, and 99.2 %, respectively, in hot rolled steel.

HPNet: Text Detection Network with Hybrid Attention and Pixel Aggregation for Irregularly-Shaped Nearby Texts

Scene text detection is a challenging topic in computer vision, characterized by complex illumination, irregular shape, and arbitrary size. While recent advancements have been made in scene text detection, it remains difficult to simultaneously distinguish nearby text and accommodate irregularly shaped text. Therefore, this paper introduces HPNet, an enhanced text detector, based on the segmentation method that predicts two-scale results. To improve the shape robustness, the Hybrid Attentional Feature Fusion (HAFF) module is integrated into Feature Pyramid Networks (FPN) to dynamically perform feature fusion. Additionally, to distinguish nearby text, the model predicts the text region covering text instances and the text kernel covering the central region of the text. The improved Pixel Aggregation (PA) algorithm is then utilized to guide the expansion from the text kernel to the text region. Experiments on IC15, Total-Text, and CTW1500 validate the effectiveness of these improvements and the superiority of HPNet. Compared with the previous method PSENet for nearby texts, the proposed HPNet has improved inference speed by 63.6% and F-measure metric by 2.6%, 3.7%, and 2.5% on three datasets, respectively.

Efficient object detector via dynamic prior and dynamic feature fusion

Abstract Sparse R-CNN is a new paradigm of object detection, which predicts objects in a sparse way. However, there are some limitations in Sparse R-CNN. One is the presence of weak prior information caused by fixed learnable proposal boxes and features across different images, necessitating excessive iterations for the model to refine its predictions; the other is the inadequate exploitation of multi-scale information, leading to the sub-optimal detection performance. Thus, building upon Sparse R-CNN, we propose an efficient detector that incorporates dynamic prior and dynamic feature fusion, called $D^{2}$-Det. In particular, for the dynamic prior part, a prior information generator module dynamically generates proposal features and boxes as the dynamic prior for different images to alleviate the inference-inefficient iterative refinement process of predictions, and we further propose the class scores decoupling method to reduce the computation overhead. Furthermore, for the dynamic feature fusion part, we develop a novel lightweight multi-scale feature fusion module, which dynamically aggregates features from all layers for each proposal box, enabling adaptive feature fusion and improving detection precision by nearly 2 AP. Experiments show that $D^{2}$-Det can achieve 46.6 AP on COCO 2017 with fewer computations for the backbone ResNet50, surpassing most of the state-of-the-art detectors.

Brain tumor segmentation by combining MultiEncoder UNet with wavelet fusion.

Accurate segmentation of brain tumors from multimodal magnetic resonance imaging (MRI) holds significant importance in clinical diagnosis and surgical intervention, while current deep learning methods cope with situations of multimodal MRI by an early fusion strategy that implicitly assumes that the modal relationships are linear, which tends to ignore the complementary information between modalities, negatively impacting the model's performance. Meanwhile, long-range relationships between voxels cannot be captured due to the localized character of the convolution procedure. Aiming at this problem, we propose a multimodal segmentation network based on a late fusion strategy that employs multiple encoders and a decoder for the segmentation of brain tumors. Each encoder is specialized for processing distinct modalities. Notably, our framework includes a feature fusion module based on a 3D discrete wavelet transform aimed at extracting complementary features among the encoders. Additionally, a 3D global context-aware module was introduced to capture the long-range dependencies of tumor voxels at a high level of features. The decoder combines fused and global features to enhance the network's segmentation performance. Our proposed model is experimented on the publicly available BraTS2018 and BraTS2021 datasets. The experimental results show competitiveness with state-of-the-art methods. The results demonstrate that our approach applies a novel concept for multimodal fusion within deep neural networks and delivers more accurate and promising brain tumor segmentation, with the potential to assist physicians in diagnosis.

Structure-Guided Image Inpainting Based on Multi-Scale Attention Pyramid Network

Current single-view image inpainting methods often suffer from low image information utilization and suboptimal repair outcomes. To address these challenges, this paper introduces a novel image inpainting framework that leverages a structure-guided multi-scale attention pyramid network. This network consists of a structural repair network and a multi-scale attention pyramid semantic repair network. The structural repair component utilizes a dual-branch U-Net network for robust structure prediction under strong constraints. The predicted structural view then serves as auxiliary information for the semantic repair network. This latter network exploits the pyramid structure to extract multi-scale features of the image, which are further refined through an attention feature fusion module. Additionally, a separable gated convolution strategy is employed during feature extraction to minimize the impact of invalid information from missing areas, thereby enhancing the restoration quality. Experiments conducted on standard datasets such as Paris Street View and CelebA demonstrate the superiority of our approach over existing methods through quantitative and qualitative comparisons. Further ablation studies, by incrementally integrating proposed mechanisms into a baseline model, substantiate the effectiveness of our multi-view restoration strategy, separable gated convolution, and multi-scale attention feature fusion.