Target Feature Extraction Research Articles

Improved Faster R-CNN Based on Multi-Scale Module for Detecting Weak Ground Targets in Remote Sensing Images

In order to optimize the detection capability of small and weak ground targets in remote sensing images, a remote sensing image ground weak target detection method based on multi-scale module improved Faster R-CNN is proposed. By adjusting the Region Proposal Network (RPN) and Region of Interest (RoI) pooling layers, the model is better suited for feature extraction and classification of small targets. Generate feature maps at multiple scales by introducing additional convolutional layers to process inputs at different resolutions, with each layer focusing on targets within a specific size range. These multi-scale features are integrated and input into RPN to provide richer target proposal characteristics. By using image transformation techniques such as scaling, cropping, and rotation, the training dataset is expanded to simulate different small target scenes, enhancing the model’s adaptability to changes in target size, direction, and environment. The experimental results show that the proposed method not only outperforms other models in accuracy, recall, and F1 score, but also maintains high consistency and stability across different datasets. Its significant advantage in mean accuracy (MAP) further proves its reliability and effectiveness in remote sensing applications.

Extraction of agricultural plastic greenhouses based on a U-Net Convolutional Neural Network Coupled with edge expansion and loss function improvement

ABSTRACT Agricultural plastic greenhouses (APGs) are crucial for sustainable agricultural planting, and accurate spatial distribution information acquisition is crucial. Deep learning network models can extract target features from remote sensing images more effectively than traditional interpretation methods, which face challenges like high workloads and poor repeatability. In this study, we aim to enhance the inventorying of Agricultural Plastic Greenhouses (APGs) by improving the extraction accuracy of their locations and numbers through remote sensing techniques. Utilizing GF-7 satellite imagery, we propose an enhanced U-Net convolutional neural network (CNN) model that incorporates edge information expansion and a joint loss function to optimize performance. The primary objective is to provide a rapid and accurate method for mapping APGs, which is crucial for effective agricultural management and environmental monitoring. The U-Net network’s accuracy was enhanced by 1.1% after expanding 3 × 3sample edge information, and further by 1.9% by combining edge extension and loss function constraints. Our results demonstrate that the modified U-Net model significantly improves extraction accuracy compared to traditional methods, thereby facilitating better inventory management and planning for agricultural cash crops. This advancement not only supports farmers in optimizing resources but also contributes to sustainable agricultural practices by enabling precise monitoring of APG distribution. Implication Statement Compared to traditional interpretation methods, which suffer problems such as heavy workloads, small adaptation ranges and poor repeatability, deep learning network models can better extract target features from remote sensing images. In this study, we used GF-7 image data to improve the traditional U-Net convolutional neural network (CNN) model. The Canny operator and Gaussian kernel (GK) function were used for sample edge expansion, and the binary cross-entropy and GK functions were used to jointly constrain the loss. Finally, APGs were accurately extracted and compared to those obtained with the original model. The results indicated that the APG extraction accuracy of the U-Net network was improved through the expansion of sample edge information and adoption of joint loss function constraints.

Deep Learning-Based Intelligent Detection Algorithm for Surface Disease in Concrete Buildings

In this study, the extent of concrete building distress is used to determine whether a building needs to be demolished and maintained, and the study focuses on accurately identifying target distress in different complex contexts and accurately distinguishing between their categories. To solve the problem of insufficient feature extraction of small targets in bridge disease images under complex backgrounds and noise, we propose the YOLOv8 Dynamic Plus model. First, we enhanced attention on multi-scale disease features by implementing structural reparameterization with parallel small-kernel expansion convolution. Next, we reconstructed the relationship between localization and classification tasks in the detection head and implemented dynamic selection of interactive features using a feature extractor to improve the accuracy of classification and recognition. Finally, to address problems of missed detection, such as inadequate extraction of small targets, we extended the original YOLOv8 architecture by adding a layer in the feature extraction phase dedicated to small-target detection. This modification integrated the neck part more effectively with the shallow features of the original three-layer YOLOv8 feature extraction stage. The improved YOLOv8 Dynamic Plus model demonstrated a 7.4 percentage-point increase in performance compared to the original model, validating the feasibility of our approach and enhancing its capability for building disease detection. In practice, this improvement has led to more accurate maintenance and safety assessments of concrete buildings and earlier detection of potential structural problems, resulting in lower maintenance costs and longer building life. This not only improves the safety of buildings but also brings significant economic benefits and social value to the industries involved.

M-YOLOv8s: An improved small target detection algorithm for UAV aerial photography

The object of UAV target detection usually means small target with complicated backgrounds. In this paper, an object detection model M-YOLOv8s based on UAV aerial photography scene is proposed. Firstly, to solve the problem that the YOLOv8s model cannot adapt to small target detection, a small target detection head (STDH) module is introduced to fuse the location and appearance feature information of the shallow layers of the backbone network. Secondly, Inner-Wise intersection over union (Inner-WIoU) is designed as the boundary box regression loss, and auxiliary boundary calculation is used to accelerate the regression speed of the model. Thirdly, the structure of multi-scale feature pyramid network (MS-FPN) can effectively combine the shallow network information with the deep network information and improve the performance of the detection model. Furthermore, a multi-scale cross-spatial attention (MCSA) module is proposed to expand the feature space through multi-scale branch, and then achieves the aggregation of target features through cross-spatial interaction, which improves the ability of the model to extract target features. Finally, the experimental results show that our model does not only possess fewer parameters, but also the values of mAP0.5 are 6.6% and 5.4% higher than the baseline model on the Visdrone2019 validation dataset and test dataset, respectively. Then, as a conclusion, the M-YOLOv8s model achieves better detection performance than some existing ones, indicating that our proposed method can be more suitable for detecting the small targets.

Learning Unsupervised Cross-Domain Model for TIR Target Tracking

The limited availability of thermal infrared (TIR) training samples leads to suboptimal target representation by convolutional feature extraction networks, which adversely impacts the accuracy of TIR target tracking methods. To address this issue, we propose an unsupervised cross-domain model (UCDT) for TIR tracking. Our approach leverages labeled training samples from the RGB domain (source domain) to train a general feature extraction network. We then employ a cross-domain model to adapt this network for effective target feature extraction in the TIR domain (target domain). This cross-domain strategy addresses the challenge of limited TIR training samples effectively. Additionally, we utilize an unsupervised learning technique to generate pseudo-labels for unlabeled training samples in the source domain, which helps overcome the limitations imposed by the scarcity of annotated training data. Extensive experiments demonstrate that our UCDT tracking method outperforms existing tracking approaches on the PTB-TIR and LSOTB-TIR benchmarks.

Contrast-enhanced ultrasound image sequences based on radiomics analysis for diagnosis of metastatic cervical lymph nodes from thyroid cancer.

Thyroid cancer (TC) prone to cervical lymph node (CLN) metastasis both before and after surgery. Ultrasonography (US) is the first-line imaging method for evaluating the thyroid gland and CLNs. However, this assessment relies mainly on the subjective judgment of the sonographer and is very much dependent on the sonographer's experience. This prospective study was designed to construct a machine learning model based on contrast-enhanced ultrasound (CEUS) videos of CLNs to predict the risk of CLN metastasis in patients with TC. Patients who were proposed for surgical treatment due to TC from August 2019 to May 2020 were prospectively included. All patients underwent US of CLNs suspected of metastasis, and a 2-minute imaging video was recorded. After target tracking, feature extraction, and feature selection through the lymph node imaging video, three machine learning models, namely, support vector machine, linear discriminant analysis (LDA), and decision tree (DT), were constructed, and the sensitivity, specificity, and accuracy of each model for diagnosing lymph nodes were calculated by leave-one-out cross-validation (LOOCV). A total of 75 lymph nodes were included in the study, with 42 benign cases and 33 malignant cases. Among the machine learning models constructed, the support vector machine had the best diagnostic efficacy, with a sensitivity of 93.0%, a specificity of 93.8%, and an accuracy of 93.3%. The machine learning model based on US video is helpful for the diagnosis of whether metastasis occurs in the CLNs of TC patients.

ESFD-YOLOv8n: Early Smoke and Fire Detection Method Based on an Improved YOLOv8n Model

Ensuring fire safety is essential to protect life and property, but modern infrastructure and complex settings require advanced fire detection methods. Traditional object detection systems, often reliant on manual feature extraction, may fall short, and while deep learning approaches are powerful, they can be computationally intensive, especially for real-time applications. This paper proposes a novel smoke and fire detection method based on the YOLOv8n model with several key architectural modifications. The standard Complete-IoU (CIoU) box loss function is replaced with the more robust Wise-IoU version 3 (WIoUv3), enhancing predictions through its attention mechanism and dynamic focusing. The model is streamlined by replacing the C2f module with a residual block, enabling targeted feature extraction, accelerating training and inference, and reducing overfitting. Integrating generalized efficient layer aggregation network (GELAN) blocks with C2f modules in the neck of the YOLOv8n model further enhances smoke and fire detection, optimizing gradient paths for efficient learning and high performance. Transfer learning is also applied to enhance robustness. Experiments confirmed the excellent performance of ESFD-YOLOv8n, outperforming the original YOLOv8n by 2%, 2.3%, and 2.7%, with a mean average precision (mAP@0.5) of 79.4%, precision of 80.1%, and recall of 72.7%. Despite its increased complexity, the model outperforms several state-of-the-art algorithms and meets the requirements for real-time fire and smoke detection.

MSH-DTI: multi-graph convolution with self-supervised embedding and heterogeneous aggregation for drug-target interaction prediction

Background:The rise of network pharmacology has led to the widespread use of network-based computational methods in predicting drug target interaction (DTI). However, existing DTI prediction models typically rely on a limited amount of data to extract drug and target features, potentially affecting the comprehensiveness and robustness of features. In addition, although multiple networks are used for DTI prediction, the integration of heterogeneous information often involves simplistic aggregation and attention mechanisms, which may impose certain limitations.Results:MSH-DTI, a deep learning model for predicting drug-target interactions, is proposed in this paper. The model uses self-supervised learning methods to obtain drug and target structure features. A Heterogeneous Interaction-enhanced Feature Fusion Module is designed for multi-graph construction, and the graph convolutional networks are used to extract node features. With the help of an attention mechanism, the model focuses on the important parts of different features for prediction. Experimental results show that the AUROC and AUPR of MSH-DTI are 0.9620 and 0.9605 respectively, outperforming other models on the DTINet dataset.Conclusion:The proposed MSH-DTI is a helpful tool to discover drug-target interactions, which is also validated through case studies in predicting new DTIs.

An improved smoking behavior detection algorithm via incorporating an interference information filtering network

Efficient and accurate identification of smoking behavior in public places is crucial for ensuring public health and safety. However, due to various factors like small target size, complex image background, varying cigarette angles and numerous similar objects, current methods still grapple with challenges such as missed detection and false detection when identifying cigarette targets in smoking behavior. This paper presents an enhanced version of the You Only Look Once version5-small algorithm to address these issues effectively. Firstly, to bolster the model's ability for feature extraction of cigarette targets, the Swin Transformer Block structure is integrated into the backbone network to capture long-range dependencies. Secondly, a novel Hybrid Spatial Pyramid Pooling-Fast with Cross Stage Partial Connection module is built based on the foundation of the Spatial Pyramid Pooling-Fast module by integrating both maximum pooling and average pooling to enhance the fusion ability of the multi-scale feature maps. Thirdly, a novel interference information filtering network is introduced to effectively reduce the impact of noise and confusion caused by similar objects, thus enhancing the performance of the model. According to the experimental results, the accuracy of the improved algorithm on the self-made cigarette target image data set reaches 93.5 %, and the recall reaches 89.1 %.

Research on image saliency detection based on deep neural network

AbstractAs a hot research field at present, computer vision is devoted to the rapid acquisition and application of target information from images or videos by simulating human visual mechanism. In order to improve the accuracy and efficiency of image detection, image saliency region detection technology has received more and more attention in the field of computer vision research; an important research content in the field, the core part of which lies in the research on algorithms related to feature extraction and saliency calculation of targets. This paper analyzes the multi‐feature fusion saliency detection model and visual saliency calculation process, and based on the existing algorithm, by improving the VGG16 network, a fully convolutional network saliency detection algorithm is proposed. The qualitative and quantitative experimental results show that compared with the four mainstream methods of BL, GS, SF, and RFCN, our algorithm not only improves the accuracy of salient object detection, but also effectively solves the problem of target edge blur. Therefore, this study has improved the accuracy and efficiency of saliency detection, which can not only promote the development of computer vision technology, but also provide support for research in the field of image processing.

Intelligent assessment system of material deterioration in masonry tower based on improved image segmentation model

Accurate and timely data collection of material deterioration on the surfaces of architectural heritage is crucial for effective conservation and restoration. Traditional methods rely heavily on extensive field surveys and manual feature identification, which are significantly affected by objective conditions and subjective factors. While machine vision-based methods can help address these issues, the accuracy, intelligence, and systematic nature of material deterioration assessment for large-scale masonry towers with complex geometries still require significant improvement. This research focuses on the architectural heritage of masonry towers and proposes an intelligent assessment system that integrates an improved YOLOv8-seg machine vision image segmentation model with refined 3D reconstruction technology. By optimizing the YOLOv8-seg model, the system enhances the extraction capabilities of both detailed and global features of material deterioration in masonry towers. Furthermore, by complementing it with image processing methods for the global visualization of large-scale objects, this research constructs a comprehensive intelligent assessment process that includes "deterioration feature extraction—global visualization—quantitative and qualitative comprehensive assessment." Experimental results demonstrate that the intelligent assessment system significantly improves the performance of target feature extraction for material deterioration in masonry towers compared to existing methods. The improved model shows improvements of 3.39% and 4.55% in the key performance metrics of mAP50 and mAP50-95, respectively, over the baseline model. Additionally, the efficiency of global feature extraction and visualization of material deterioration increased by 66.36%, with an average recognition accuracy of 95.78%. Consequently, this system effectively overcomes the limitations and subjective influences of field surveys, enhancing the objectivity and efficiency of identifying and analyzing material deterioration in masonry towers, and providing invaluable data support for the subsequent preservation and restoration efforts.

Line spectrum target recognition algorithm based on time‐delay autoencoder

AbstractEffective extraction of target features has always been a key issue in target recognition technology in the field of signal processing. Traditional deep learning algorithms often require extensive data for pre‐training models to ensure the accuracy of feature extraction. Moreover, it is challenging to completely remove noise due to the complexity of the underwater environment. A Time‐Delay Autoencoder (TDAE) is employed to extract ship‐radiated noise characteristics by leveraging the strong coherent properties of line spectrum. This approach eliminates the need for previous data to adaptively develop a nonlinear model for line spectrum extraction. The test data was processed using three distinct approaches, and plots of recognition accuracy curves at various signal‐to‐noise ratios were made. On the dataset utilised in the research, experimental results show that the proposed approach achieves over 75% recognition accuracy, even at a signal‐to‐noise ratio of −15 dB.

An Infrared Aircraft Detection Algorithm Based on Context Perception Feature Enhancement

To address the issue of insufficient extraction of target features and the resulting impact on detection performance in long-range infrared aircraft target detection caused by small imaging area and weak radiation intensity starting from the idea of perceiving target context to enhance the features extracted by convolutional neural network, this paper proposes a detecting algorithm based on AWFGLC (adaptive weighted fusion of global–local context). Based on the mechanism of AWFGLC, the input feature map is randomly reorganized and partitioned along the channel dimension, resulting in two feature maps. One feature map is utilized by self-attention for global context modeling, establishing the correlation between target features and background features to highlight the salient features of the target, thereby enabling the detecting algorithm to better perceive the global features of the target. The other feature map is subjected to window partitioning, with max pooling and average pooling performed within each window to highlight the local features of the target. Subsequently, self-attention is applied to the pooled feature map for local context modeling, establishing the correlation between the target and its surrounding neighborhood, further enhancing the weaker parts of the target features, and enabling the detecting algorithm to better perceive the local features of the target. Based on the characteristics of the target, an adaptive weighted fusion strategy with learnable parameters is employed to aggregate the global context and local context feature maps. This results in a feature map containing more complete target information, enhancing the ability of the detection algorithm to distinguish between target and background. Finally, this paper integrates the mechanism of AWFGLC into YOLOv7 for the detection of infrared aircraft targets. The experiments indicate that the proposed algorithm achieves mAP50 scores of 97.8% and 88.7% on self-made and publicly available infrared aircraft datasets, respectively. Moreover, the mAP50:95 scores reach 65.7% and 61.2%, respectively. These results outperform those of classical target detection algorithms, indicating the effective realization of infrared aircraft target detection.

Feature-Enhanced Attention and Dual-GELAN Net (FEADG-Net) for UAV Infrared Small Object Detection in Traffic Surveillance

With the rapid development of UAV and infrared imaging technology, the cost of UAV infrared imaging technology has decreased steadily. Small target detection technology in aerial infrared images has great potential for applications in many fields, especially in the field of traffic surveillance. Because of the low contrast and relatively limited feature information in infrared images compared to visible images, the difficulty involved in small road target detection in infrared aerial images has increased. To solve this problem, this study proposes a feature-enhanced attention and dual-GELAN net (FEADG-net) model. In this network model, the reliability and effectiveness of small target feature extraction is enhanced by a backbone network combined with low-frequency enhancement and a swin transformer. The multi-scale features of the target are fused using a dual-GELAN neck structure, and a detection head with the parameters of the auto-adjusted InnerIoU is constructed to improve the detection accuracy for small infrared targets. The viability of the method was proved using the HIT-UAV dataset and IRTS-AG dataset. According to a comparative experiment, the mAP50 of FEADG-net reached more than 90 percent, which was higher than that of any previous method and it met the real-time requirements. Finally, an ablation experiment was conducted to demonstrate that all three of the modules proposed in the method contributed to the improvement in the detection accuracy. This study not only designs a new algorithm for small road object detection in infrared remote sensing images from UAVs but also provides new ideas for small target detection in remote sensing images for other fields.

A Spatial Small Target Detection Method Based on a Multi-Scale Feature Fusion Pyramid Spatial Small Target Detection Method Based on Multi-scale Feature Fusion Pyramid

Small target detection has become an important part of space exploration missions. The existence of weak illumination and interference from the background of star charts in deep and distant space has brought great challenges to space target detection. In addition, the distance of space targets is usually far, so most of them are small targets in the image, and the detection of small targets is also very difficult. To solve the above problems, we propose a multi-scale feature fusion pyramid network. First, we propose the CST module of a CNN fused with Swin Transformer as the feature extraction module of the feature pyramid network to enhance the extraction of target features. Then, we improve the SE attention mechanism and construct the CSE module to find the attention region in the dense star map background. Finally, we introduce improved spatial pyramid pooling to fuse more features to increase the sensory field to obtain multi-scale object information and improve detection performance for small targets. We provide two versions and conducted a detailed ablation study to empirically validate the effectiveness and efficiency of the design of each component in our network architecture. The experimental results show that our network improved in performance compared to the existing feature pyramid.

Feature Extraction of Underwater Acoustic Signal Target Using Machine Learning Technique

Feature Extraction of Underwater Acoustic Signal Target Using Machine Learning Technique

Adaptive feature extraction of underwater target signal based on mathematical morphology feature enhancement

This paper proposes an adaptive feature extraction method based on mathematical morphology enhancement to extract effective and stable features under strong ocean noise. Firstly, the traditional mathematical morphology method is improved and a new mathematical morphology filtering method is proposed for feature enhancement of underwater target signals. Secondly, the artificial fish swarm algorithm (AFSA) is improved using weighted power spectral kurtosis (WPSK) to achieve parameter adaptivity. Five measured underwater target signals are used to validate the extracted method, and cosine similarity (CS), signal to noise ratio (SNR), and refined composite multiscale fluctuation dispersion entropy (RCMFDE) are used as evaluation metrics to assess the results and verify the effectiveness of the proposed method. Compared with average filtering (AVGF) and closing opening filtering (COF), the proposed method shows better capability in adaptive feature extraction. Therefore, the proposed mathematical morphological filtering can enhance underwater target features and is very important for adaptive feature extraction of underwater targets.

Remote Sensing Image Classification Based on Canny Operator Enhanced Edge Features.

Remote sensing image classification plays a crucial role in the field of remote sensing interpretation. With the exponential growth of multi-source remote sensing data, accurately extracting target features and comprehending target attributes from complex images significantly impacts classification accuracy. To address these challenges, we propose a Canny edge-enhanced multi-level attention feature fusion network (CAF) for remote sensing image classification. The original image is specifically inputted into a convolutional network for the extraction of global features, while increasing the depth of the convolutional layer facilitates feature extraction at various levels. Additionally, to emphasize detailed target features, we employ the Canny operator for edge information extraction and utilize a convolution layer to capture deep edge features. Finally, by leveraging the Attentional Feature Fusion (AFF) network, we fuse global and detailed features to obtain more discriminative representations for scene classification tasks. The performance of our proposed method (CAF) is evaluated through experiments conducted across three openly accessible datasets for classifying scenes in remote sensing images: NWPU-RESISC45, UCM, and MSTAR. The experimental findings indicate that our approach based on incorporating edge detail information outperforms methods relying solely on global feature-based classifications.

Full-Scale Aggregated MobileUNet: An Improved U-Net Architecture for SAR Oil Spill Detection.

Oil spills are a major threat to marine and coastal environments. Their unique radar backscatter intensity can be captured by synthetic aperture radar (SAR), resulting in dark regions in the images. However, many marine phenomena can lead to erroneous detections of oil spills. In addition, SAR images of the ocean include multiple targets, such as sea surface, land, ships, and oil spills and their look-alikes. The training of a multi-category classifier will encounter significant challenges due to the inherent class imbalance. Addressing this issue requires extracting target features more effectively. In this study, a lightweight U-Net-based model, Full-Scale Aggregated MobileUNet (FA-MobileUNet), was proposed to improve the detection performance for oil spills using SAR images. First, a lightweight MobileNetv3 model was used as the backbone of the U-Net encoder for feature extraction. Next, atrous spatial pyramid pooling (ASPP) and a convolutional block attention module (CBAM) were used to improve the capacity of the network to extract multi-scale features and to increase the speed of module calculation. Finally, full-scale features from the encoder were aggregated to enhance the network's competence in extracting features. The proposed modified network enhanced the extraction and integration of features at different scales to improve the accuracy of detecting diverse marine targets. The experimental results showed that the mean intersection over union (mIoU) of the proposed model reached more than 80% for the detection of five types of marine targets including sea surface, land, ships, and oil spills and their look-alikes. In addition, the IoU of the proposed model reached 75.85 and 72.67% for oil spill and look-alike detection, which was 18.94% and 25.55% higher than that of the original U-Net model, respectively. Compared with other segmentation models, the proposed network can more accurately classify the black regions in SAR images into oil spills and their look-alikes. Furthermore, the detection performance and computational efficiency of the proposed model were also validated against other semantic segmentation models.

Reconstruction algorithm of Gm-APD LiDAR based on synchronized pseudo-random time coding

Efficient photon counting imaging of long-range targets is challenging, especially in low signal-to-back ratio (SBR) situations. In this paper, a synchronized pseudo-random time coding detection method for Geiger-mode avalanche photodiode (Gm-APD) light detection and ranging (LiDAR) is proposed, which realizes Gm-APD LiDAR long-range detection by combining pseudo-random time coding and time of flight, and the multiple peaks are used to de-noise the image at the image level. Scenes of building with different SBR are simulated with Monte Carlo methods, and the effect of coding length on algorithm performance is discussed and compared with the performance of non-coding algorithms. The high performance of the proposed algorithm is verified by field experiments in low SBR scenes. Moreover, the proposed algorithm improves the target reconstruction correctness ratio by 70% over the other non-coding algorithms to 83% in the scene of building with SBR of 0.015, and has the smallest root mean square error (RMSE) of the distance. It improves the target integrity and provides the possibility of practical application of LiDAR target detection in very low SBR and long-range conditions, and even more support for target feature extraction and target recognition.