Small Infrared Target Research Articles

Hardware-Accelerated Infrared Small Target Recognition Based on Energy-Weighted Local Uncertainty Measure

Infrared small target detection is a key technology with a wide range of applications, and the complex background and low signal-to-noise ratio characteristics of infrared images can greatly increase the difficulty and error rate of small target detection. In this paper, an uncertainty measurement method based on local component consistency is proposed to suppress the complex background and highlight the detection target. The method analyzes the local signal consistency of the image. It then constructs a confidence assignment function and uses the mutation entropy operator to measure local uncertainty. Then, the target energy information is introduced through an energy-weighting function to further enhance the signal. Finally, the target is extracted using an adaptive threshold segmentation algorithm. The experimental results show that the algorithm can effectively detect small infrared targets in complex backgrounds. And, the algorithm is at the leading edge in terms of performance; the processing frame rate can reach 3051 FPS (frame per second), 96 FPS, and 54 FPS for image data with a resolution of 256 × 256, 1920 × 1080, and 2560 × 1440, respectively.

5-D spatial-temporal information-based infrared small target detection in complex environments

Recently, infrared (IR) small target detection problem has attracted increasing attention. Tensor component analysis-based techniques have been widely utilized, while they are faced with challenges such as tensor structures, background and target estimation, and real-time performance. In this paper, we propose a 5-D spatial–temporal factor-based completion model (5D-STFC) for IR small target detection. Specifically, a 5-D whitened spatial–temporal patch-tensor is constructed. Then, we devise a spatial–temporal factor-based low-rank background estimation norm and a Moreau envelope-derived sparsity estimation norm based on joint spatial–temporal knowledge. Furthermore, we establish a comprehensive completion model for component analysis. To efficiently solve this model, we design a multi-block alternating direction method of multipliers (multi-block ADMM)-based optimization scheme. Extensive experiments conducted on five real IR sequences demonstrate the superiority of 5D-STFC over nine state-of-the-art competitive methods. It can be concluded that 5D-STFC is excellent and practical in target detectability, background suppressibility, overall performance, and real-time performance.

Global information aware network with global interaction graph attention for infrared small target detection

AbstractDetecting small targets in infrared images is crucial for ground surveillance and air traffic control. However, distinguishing small infrared targets from similar backgrounds is challenging due to their lack of structural and textural characteristics. To address these challenges, this study proposes a novel global information‐aware network with global interaction graph attention (GIGA) for infrared small target detection. The GIGA consists of a global interaction layer (GILayer), graph attention weights (GAW), and a global relational learning (GRL) module. Specifically, the GILayer dynamically learns global inter‐pixel relationships of small target images by enhancing the dependencies between feature dimensions. The GAW component calculates pixel‐by‐pixel similarity across the entire feature map using graph attention mechanisms, while the GRL module retains critical similarity features in the feature extraction network, thereby facilitating small target detection. Additionally, the multi‐scale context fusion module utilises self‐attention and dilation convolution to complement richer feature details at different scales. Experimental results on both natural and synthetic datasets demonstrate the proposed method's superiority over other state‐of‐the‐art conventional and deep learning approaches in infrared small target detection.

Feature-Enhanced Attention and Dual-GELAN Net (FEADG-Net) for UAV Infrared Small Object Detection in Traffic Surveillance

With the rapid development of UAV and infrared imaging technology, the cost of UAV infrared imaging technology has decreased steadily. Small target detection technology in aerial infrared images has great potential for applications in many fields, especially in the field of traffic surveillance. Because of the low contrast and relatively limited feature information in infrared images compared to visible images, the difficulty involved in small road target detection in infrared aerial images has increased. To solve this problem, this study proposes a feature-enhanced attention and dual-GELAN net (FEADG-net) model. In this network model, the reliability and effectiveness of small target feature extraction is enhanced by a backbone network combined with low-frequency enhancement and a swin transformer. The multi-scale features of the target are fused using a dual-GELAN neck structure, and a detection head with the parameters of the auto-adjusted InnerIoU is constructed to improve the detection accuracy for small infrared targets. The viability of the method was proved using the HIT-UAV dataset and IRTS-AG dataset. According to a comparative experiment, the mAP50 of FEADG-net reached more than 90 percent, which was higher than that of any previous method and it met the real-time requirements. Finally, an ablation experiment was conducted to demonstrate that all three of the modules proposed in the method contributed to the improvement in the detection accuracy. This study not only designs a new algorithm for small road object detection in infrared remote sensing images from UAVs but also provides new ideas for small target detection in remote sensing images for other fields.

PHSI-RTDETR: A Lightweight Infrared Small Target Detection Algorithm Based on UAV Aerial Photography

To address the issues of low model accuracy caused by complex ground environments and uneven target scales and high computational complexity in unmanned aerial vehicle (UAV) aerial infrared image target detection, this study proposes a lightweight UAV aerial infrared small target detection algorithm called PHSI-RTDETR. Initially, an improved backbone feature extraction network is designed using the lightweight RPConv-Block module proposed in this paper, which effectively captures small target features, significantly reducing the model complexity and computational burden while improving accuracy. Subsequently, the HiLo attention mechanism is combined with an intra-scale feature interaction module to form an AIFI-HiLo module, which is integrated into a hybrid encoder to enhance the focus of the model on dense targets, reducing the rates of missed and false detections. Moreover, the slimneck-SSFF architecture is introduced as the cross-scale feature fusion architecture of the model, utilizing GSConv and VoVGSCSP modules to enhance adaptability to infrared targets of various scales, producing more semantic information while reducing network computations. Finally, the original GIoU loss is replaced with the Inner-GIoU loss, which uses a scaling factor to control auxiliary bounding boxes to speed up convergence and improve detection accuracy for small targets. The experimental results show that, compared to RT-DETR, PHSI-RTDETR reduces model parameters by 30.55% and floating-point operations by 17.10%. Moreover, detection precision and speed are increased by 3.81% and 13.39%, respectively, and mAP50, impressively, reaches 82.58%, demonstrating the great potential of this model for drone infrared small target detection.

Infrared Small Target Detection Based on Density Peak Search and Local Features

The detection of small infrared targets is still a challenging task and efficient and accurate detection plays a key role in modern infrared search and tracking military applications. However, small infrared targets are difficult to detect due to their weak brightness, small size and lack of shape, structure, texture, and other information elements. In this paper, we propose a target detection method. First, to address the problem that the proximity of targets to high-brightness clutter leads to missed detection of candidate targets, a Gaussian differential filtering preprocessed image is used to suppress high-brightness clutter. Second, a density-peaked global search method is used to determine the location of candidate targets in the preprocessed image. We then use local contrast to the candidate target points to enhance the gradient features and suppress background clutter. The Facet model is used to compute multidirectional gradient features at each point. A new efficient surrounding symmetric region partitioning scheme is constructed to capture the gradient characteristics of targets of different sizes in eight directions, followed by weighting the candidate target gradient characteristics using the standard deviation of the symmetric region difference. Finally, an adaptive threshold segmentation method is used to extract small targets. Experimental results show that the method proposed in this paper has better detection accuracy and robustness compared with other detection methods.

CSAN-UNet: Channel Spatial Attention Nested UNet for Infrared Small Target Detection

Segmenting small infrared targets presents a significant challenge for traditional image processing architectures due to the inherent lack of texture, minimal shape information, and their sparse pixel representation within images. The conventional UNet architecture, while proficient in general segmentation tasks, inadequately addresses the nuances of small infrared target segmentation due to its reliance on downsampling operations, such as pooling, which often results in the loss of critical target information. This paper introduces the Channel Spatial Attention Nested UNet (CSAN-UNet), an innovative architecture designed specifically to enhance the detection and segmentation of small infrared targets. Central to CSAN-UNet’s design is the Cascaded Channel and Spatial Convolutional Attention Module (CSCAM), a novel component that adaptively enhances multi-level features and mitigates the loss of target information attributable to downsampling processes. Additionally, the Channel-priority and Spatial Attention Cascade Module (CPSAM) represents another pivotal advancement within CSAN-UNet, prioritizing channel-level adjustments alongside spatial attention mechanisms to efficiently extract deep semantic information pertinent to small infrared targets. Empirical validation conducted on two public datasets confirms that CSAN-UNet surpasses existing state-of-the-art algorithms in segmentation performance, while simultaneously reducing computational overhead.

AIMED-Net: An Enhancing Infrared Small Target Detection Net in UAVs with Multi-Layer Feature Enhancement for Edge Computing

In the context of small unmanned aerial vehicles (UAVs), infrared imaging faces challenges such as low quality, difficulty in detecting small targets, high false alarm rates, and computational resource constraints. To address these issues, we introduce AIMED-Net, an enhancing infrared small target detection net in UAVs with multi-layer feature enhancement for edge computing. Initially, the network encompasses a multi-layer feature enhancement architecture for infrared small targets, including a generative adversarial-based shallow-feature enhancement network and a detection-oriented deep-feature enhancement network. Specifically, an infrared image-feature enhancement method is proposed for the shallow-feature enhancement network, employing multi-scale enhancement to bolster target detection performance. Furthermore, within the YOLOv7 framework, we have developed an improved object detection network integrating multiple feature enhancement techniques, optimized for infrared targets and edge computing conditions. This design not only reduces the model’s complexity but also enhances the network’s robustness and accuracy in identifying small targets. Experimental results obtained from the HIT-UAV public dataset indicate that, compared to YOLOv7s, our method achieves a 2.5% increase in F1 score, a 6.1% rise in AP for detecting OtherVehicle targets, and a 2.6% improvement in mAP across all categories, alongside a 15.2% reduction in inference time on edge devices. Compared to existing state-of-the-art approaches, our method strikes a balance between detection efficiency and accuracy, presenting a practical solution for deployment in aerial edge computing scenarios.

USES-Net: An Infrared Dim and Small Target Detection Network with Embedded Knowledge Priors

Detecting and identifying small infrared targets has always been a crucial technology for many applications. To address the low accuracy, high false-alarm rate, and poor environmental adaptability that commonly exist in infrared target detection methods, this paper proposes a composite infrared dim and small target detection model called USES-Net, which combines the target prior knowledge and conventional data-driven deep learning networks to make use of both labeled data and the domain knowledge. Based on the typical encoder–decoder structure, USES-Net firstly introduces the self-attention mechanism of Swin Transformer to replace the universal convolution kernel at the encoder end. This helps to extract potential features related to dim, small targets in a larger receptive field. In addition, USES-Net includes an embedded patch-based contrast learning module (EPCLM) to integrate the spatial distribution of the target as a knowledge prior in the training network model. This guides the training process of the constrained network model with clear physical interpretability. Finally, USES-Net also designs a bottom-up cross-layer feature fusion module (AFM) as the decoder of the network, and a data-slicing-aided enhancement and inference method based on Slicing Aided Hyper Inference (SAHI) is utilized to further improve the model’s detection accuracy. An experimental comparative analysis shows that USES-Net achieves the best results on three typical infrared weak-target datasets: NUAA-SIRST, NUDT-SIRST, and IRSTD-1K. The results of the target segmentation are complete and sufficient, which demonstrates the validity and practicality of the proposed method in comparison to others.

Direction-Coded Temporal U-Shape Module for Multiframe Infrared Small Target Detection.

Infrared small target (IRST) detection aims at separating targets from cluttered background. Although many deep learning-based single-frame IRST (SIRST) detection methods have achieved promising detection performance, they cannot deal with extremely dim targets while suppressing the clutters since the targets are spatially indistinctive. Multiframe IRST (MIRST) detection can well handle this problem by fusing the temporal information of moving targets. However, the extraction of motion information is challenging since general convolution is insensitive to motion direction. In this article, we propose a simple yet effective direction-coded temporal U-shape module (DTUM) for MIRST detection. Specifically, we build a motion-to-data mapping to distinguish the motion of targets and clutters by indexing different directions. Based on the motion-to-data mapping, we further design a direction-coded convolution block (DCCB) to encode the motion direction into features and extract the motion information of targets. Our DTUM can be equipped with most single-frame networks to achieve MIRST detection. Moreover, in view of the lack of MIRST datasets, including dim targets, we build a multiframe infrared small and dim target dataset (namely, NUDT-MIRSDT) and propose several evaluation metrics. The experimental results on the NUDT-MIRSDT dataset demonstrate the effectiveness of our method. Our method achieves the state-of-the-art performance in detecting infrared small and dim targets and suppressing false alarms. Our codes will be available at https://github.com/TinaLRJ/Multi-frame-infrared-small-target-detection-DTUM.

Towards Dense Moving Infrared Small Target Detection: New Datasets and Baseline

Towards Dense Moving Infrared Small Target Detection: New Datasets and Baseline

Hybrid Network Based on Hierarchical Multipatch Feature Encoder for Infrared Small Target Detection

Hybrid Network Based on Hierarchical Multipatch Feature Encoder for Infrared Small Target Detection

Enhanced Generalization Ability of Infrared Small Target Detection via Perturbed Training and Adaptive Test

Enhanced Generalization Ability of Infrared Small Target Detection via Perturbed Training and Adaptive Test

Hollow Side Window Filter With Saliency Prior for Infrared Small Target Detection

Hollow Side Window Filter With Saliency Prior for Infrared Small Target Detection

IRGraphSeg: Infrared Small Target Detection Based on Hierarchical GNN

IRGraphSeg: Infrared Small Target Detection Based on Hierarchical GNN

Toward Accurate Infrared Small Target Detection via Edge-Aware Gated Transformer

Toward Accurate Infrared Small Target Detection via Edge-Aware Gated Transformer

Differential Attention Orientated Cascade Network for Infrared Small Target Detection

Differential Attention Orientated Cascade Network for Infrared Small Target Detection

ISTD-diff: Infrared Small Target Detection via Conditional Diffusion Models

ISTD-diff: Infrared Small Target Detection via Conditional Diffusion Models

A Non-Local Enhanced Feature Pyramid Network for Infrared Small Target Detection

A Non-Local Enhanced Feature Pyramid Network for Infrared Small Target Detection

FATCNet : Feature Adaptive Transformer and CNN for Infrared Small Target Detection

FATCNet : Feature Adaptive Transformer and CNN for Infrared Small Target Detection