Aperture Radar Automatic Target Recognition Research Articles

Attention Heat Map-Based Black-Box Local Adversarial Attack for Synthetic Aperture Radar Target Recognition

Synthetic aperture radar (SAR) automatic target recognition (ATR) models based on deep neural networks (DNNs) are susceptible to adversarial attacks. In this study, we proposed an SAR black-box local adversarial attack algorithm named attention heat map- based black-box local adversarial attack (AH-BLAA). First, we designed an attention heat map extraction module combined with the layer-wise relevance propagation (LRP) algorithm to obtain the high concerning areas of the SAR-ATR models. Then, to gener- ate SAR adversarial attack examples, we designed a perturbation generator module, introducing the structural dissimilarity (DSSIM) metric in the loss function to limit image distortion and the dif- ferential evolution (DE) algorithm to search for optimal perturba- tions. Experimental results on the MSTAR and FUSAR-Ship datasets showed that compared with existing adversarial attack algorithms, the attack success rate of the AH-BLAA algorithm increased by 0.63% to 33.59% and 1.05% to 17.65%, respectively. Moreover, the low- est perturbation ratios reached 0.23% and 0.13%, respectively.

Enhanced Prototypical Network with Customized Region-Aware Convolution for Few-Shot SAR ATR

With the prosperous development and successful application of deep learning technologies in the field of remote sensing, numerous deep-learning-based methods have emerged for synthetic aperture radar (SAR) automatic target recognition (ATR) tasks over the past few years. Generally, most deep-learning-based methods can achieve outstanding recognition performance on the condition that an abundance of labeled samples are available to train the model. However, in real application scenarios, it is difficult and costly to acquire and to annotate abundant SAR images due to the imaging mechanism of SAR, which poses a big challenge to existing SAR ATR methods. Therefore, SAR target recognition in the situation of few-shot, where only a scarce few labeled samples are available, is a fundamental problem that needs to be solved. In this paper, a new method named enhanced prototypical network with customized region-aware convolution (CRCEPN) is put forward to specially tackle the few-shot SAR ATR tasks. To be specific, a feature-extraction network based on a customized and region-aware convolution is first developed. This network can adaptively adjust convolutional kernels and their receptive fields according to each SAR image’s own characteristics as well as the semantical similarity among spatial regions, thus augmenting its capability to extract more informative and discriminative features. To achieve accurate and robust target identity prediction under the few-shot condition, an enhanced prototypical network is proposed. This network can improve the representation ability of the class prototype by properly making use of training and test samples together, thus effectively raising the classification accuracy. Meanwhile, a new hybrid loss is designed to learn a feature space with both inter-class separability and intra-class tightness as much as possible, which can further upgrade the recognition performance of the proposed method. Experiments performed on the moving and stationary target acquisition and recognition (MSTAR) dataset, the OpenSARShip dataset, and the SAMPLE+ dataset demonstrate that the proposed method is competitive with some state-of-the-art methods for few-shot SAR ATR tasks.

Exploring Reinforced Class Separability and Discriminative Representations for SAR Target Open Set Recognition

Current synthetic aperture radar (SAR) automatic target recognition (ATR) algorithms primarily operate under the closed-set assumption, implying that all target classes have been previously learned during the training phase. However, in open scenarios, they may encounter target classes absent from the training set, thereby necessitating an open set recognition (OSR) challenge for SAR-ATR. The crux of OSR lies in establishing distinct decision boundaries between known and unknown classes to mitigate confusion among different classes. To address this issue, we introduce a novel framework termed reinforced class separability for SAR target open set recognition (RCS-OSR), which focuses on optimizing prototype distribution and enhancing the discriminability of features. First, to capture discriminative features, a cross-modal causal features enhancement module (CMCFE) is proposed to strengthen the expression of causal regions. Subsequently, regularized intra-class compactness loss (RIC-Loss) and intra-class relationship aware consistency loss (IRC-Loss) are devised to optimize the embedding space. In conjunction with joint supervised training using cross-entropy loss, RCS-OSR can effectively reduce empirical classification risk and open space risk simultaneously. Moreover, a class-aware OSR classifier with adaptive thresholding is designed to leverage the differences between different classes. Consequently, our method can construct distinct decision boundaries between known and unknown classes to simultaneously classify known classes and identify unknown classes in open scenarios. Extensive experiments conducted on the MSTAR dataset demonstrate the effectiveness and superiority of our method in various OSR tasks.

Physics-guided interpretable CNN for SAR target recognition

Deep Learning (DL) model has been widely used in the field of Synthetic Aperture Radar Automatic Target Recognition (SAR-ATR) and has achieved excellent performance. However, the black-box nature of DL models has been the focus of criticism, especially in the application of SAR-ATR, which is closely associated with the national defense and security domain. To address these issues, a new interpretable recognition model Physics-Guided BagNet (PGBN) is proposed in this article. The model adopts an interpretable convolutional neural network framework and uses time–frequency analysis to extract physical scattering features in SAR images. Based on the physical scattering features, an unsupervised segmentation method is proposed to distinguish targets from the background in SAR images. On the basis of the segmentation result, a structure is designed, which constrains the model’s spatial attention to focus more on the targets themselves rather than the background, thereby making the model’s decision-making more in line with physical principles. In contrast to previous interpretable research methods, this model combines interpretable structure with physical interpretability, further reducing the model’s risk of error recognition. Experiments on the MSTAR dataset verify that the PGBN model exhibits excellent interpretability and recognition performance, and comparative experiments with heatmaps indicate that the physical feature guidance module presented in this article can constrain the model to focus more on the target itself rather than the background.

Open-Set Recognition Model for SAR Target Based on Capsule Network with the KLD

Synthetic aperture radar (SAR) automatic target recognition (ATR) technology has seen significant advancements. Despite these advancements, the majority of research still operates under the closed-set assumption, wherein all test samples belong to classes seen during the training phase. In real-world applications, however, it is common to encounter targets not previously seen during training, posing a significant challenge to the existing methods. Ideally, an ATR system should not only accurately identify known target classes but also effectively reject those belonging to unknown classes, giving rise to the concept of open set recognition (OSR). To address this challenge, we propose a novel approach that leverages the unique capabilities of the Capsule Network and the Kullback-Leibler divergence (KLD) to distinguish unknown classes. This method begins by deeply mining the features of SAR targets using the Capsule Network and enhancing the separability between different features through a specially designed loss function. Subsequently, the KLD of features between a testing sample and the center of each known class is calculated. If the testing sample exhibits a significantly larger KLD compared to all known classes, it is classified as an unknown target. The experimental results of the SAR-ACD dataset demonstrate that our method can maintain a correct identification rate of over 95% for known classes while effectively recognizing unknown classes. Compared to existing techniques, our method exhibits significant improvements.

Towards assessing the synthetic-to-measured adversarial vulnerability of SAR ATR

Recently, there has been increasing concern about the vulnerability of deep neural network (DNN)-based synthetic aperture radar (SAR) automatic target recognition (ATR) to adversarial attacks, where a DNN could be easily deceived by clean input with imperceptible but aggressive perturbations. This paper studies the synthetic-to-measured (S2M) transfer setting, where an attacker generates adversarial perturbation based solely on synthetic data and transfers it against victim models trained with measured data. Compared with the current measured-to-measured (M2M) transfer setting, our approach does not need direct access to the victim model or the measured SAR data. We also propose the transferability estimation attack (TEA) to uncover the adversarial risks in this more challenging and practical scenario. The TEA makes full use of the limited similarity between the synthetic and measured data pairs for blind estimation and optimization of S2M transferability, leading to feasible surrogate model enhancement without mastering the victim model and data. Comprehensive evaluations based on the publicly available synthetic and measured paired labeled experiment (SAMPLE) dataset demonstrate that the TEA outperforms state-of-the-art methods and can significantly enhance various attack algorithms in computer vision and remote sensing applications. Codes and data are available at https://github.com/scenarri/S2M-TEA.

Synthetic aperture radar automatic target recognition based on cost‐sensitive awareness generative adversarial network for imbalanced data

AbstractIn military contexts, synthetic aperture radar (SAR) automatic target recognition (ATR) models frequently encounter the challenge of imbalanced data, resulting in a noticeable degradation in the recognition performance. Therefore, the authors propose a cost‐sensitive awareness generative adversarial network (CAGAN) model, aiming to improve the robustness of ATR models under imbalanced data. Firstly, the authors introduce a convolutional neural network (DCNN) to extract features. Then, the synthetic minority over‐sampling technique (SMOTE) is applied to achieve feature‐level balancing for the minority category. Finally, a CAGAN model is designed to perform the final classification task. In this process, the GAN‐based adversarial training mechanism enriches the diversity of training samples, making the ATR model more comprehensive in understanding different categories. In addition, the cost matrix increases the penalty for misclassification results and further improves the classification accuracy. Simultaneously, the cost‐sensitive awareness can accurately adjust the cost matrix through training data, thus reducing dependence on expert knowledge and improving the generalisation performance of the ATR model. This model is an end‐to‐end ATR scheme, which has been experimentally validated on the MSTAR and OpenSARship datasets. Compared to other methods, the proposed method exhibits strong robustness in dealing with various imbalanced scenarios and significant generalisation capability across different datasets.

Capsule Broad Learning System Network for Robust Synthetic Aperture Radar Automatic Target Recognition with Small Samples

The utilization of deep learning in Synthetic Aperture Radar (SAR) Automatic Target Recognition (ATR) has witnessed a recent surge owing to its remarkable feature extraction capabilities. Nonetheless, deep learning methodologies are often encumbered by inadequacies in labeled data and the protracted nature of training processes. To address these challenges and offer an alternative avenue for accurately extracting image features, this paper puts forth a novel and distinctive network dubbed the Capsule Broad Learning System Network for robust SAR ATR (CBLS-SARNET). This novel strategy is specifically tailored to cater to small-sample SAR ATR scenarios. On the one hand, we introduce a United Division Co-training (UDC) Framework as a feature filter, adeptly amalgamating CapsNet and the Broad Learning System (BLS) to enhance network efficiency and efficacy. On the other hand, we devise a Parameters Sharing (PS) network to facilitate secondary learning by sharing the weight and bias of BLS node layers, thereby augmenting the recognition capability of CBLS-SARNET. Experimental results unequivocally demonstrate that our proposed CBLS-SARNET outperforms other deep learning methods in terms of recognition accuracy and training time. Furthermore, experiments validate the generalization and robustness of our novel method under various conditions, including the addition of blur, Gaussian noise, noisy labels, and different depression angles. These findings underscore the superior generalization capabilities of CBLS-SARNET across diverse SAR ATR scenarios.

A 3-D scattering centre model-based SAR target recognition method using multi-level region matching

ABSTRACT A 3-D scattering centre model-based synthetic aperture radar (SAR) automatic target recognition (ATR) method is proposed. Multi-level dominant scattering areas (DSAs) are generated from the test sample and model predicted target images, which can describe the target region and scattering centres distribution from coarse to fine. The DSA matching is conducted at each level using the morphological erosion operation and Euclidean distance transform. Finally, the energy of the region residuals is taken as the distance measure between the test sample and different target models so as to confirm the target label. The 3-D scattering centre model can provide very complete descriptions of the target. In addition, the designed distance measure comprehensively considers the possible nonlinear transformations between the model and test image using the morphological erosion operation and Euclidean distance transform. Experiments are performed on the electromagnetic (EM) simulated data of three military targets.

Multilevel Attention Networks for Synthetic Aperture Radar Automatic Target Recognition

Multilevel Attention Networks for Synthetic Aperture Radar Automatic Target Recognition

Weighted residual network for SAR automatic target recognition with data augmentation.

Decades of research have been dedicated to overcoming the obstacles inherent in synthetic aperture radar (SAR) automatic target recognition (ATR). The rise of deep learning technologies has brought a wave of new possibilities, demonstrating significant progress in the field. However, challenges like the susceptibility of SAR images to noise, the requirement for large-scale training datasets, and the often protracted duration of model training still persist. This paper introduces a novel data augmentation strategy to address these issues. Our method involves the intentional addition and subsequent removal of speckle noise to artificially enlarge the scope of training data through noise perturbation. Furthermore, we propose a modified network architecture named weighted ResNet, which incorporates residual strain controls for enhanced performance. This network is designed to be computationally efficient and to minimize the amount of training data required. Through rigorous experimental analysis, our research confirms that the proposed data augmentation method, when used in conjunction with the weighted ResNet model, significantly reduces the time needed for training. It also improves the SAR ATR capabilities. Compared to existing models and methods tested, the combination of our data augmentation scheme and the weighted ResNet framework achieves higher computational efficiency and better recognition accuracy in SAR ATR applications. This suggests that our approach could be a valuable advancement in the field of SAR image analysis.

Crucial feature capture and discrimination for limited training data SAR ATR

Deep learning-based methods have demonstrated exceptional performance in the field of synthetic aperture radar automatic target recognition (SAR ATR). However, obtaining a sufficient number of labeled SAR images remains a significant challenge that can negatively affect the performance of these methods. This is because most deep learning models use the entire target image as input. However, but research has shown that with limited training data, the model may not be able to capture discriminative regions of the image. Instead, they might focus on more useless even harmful image regions for recognition, leading to poor recognition results. In this study, we propose a novel SAR ATR framework that addresses the limitation of limited training data. The proposed framework primarily comprises a global assisted branch, locally enhanced branch, feature capture module, and feature discrimination module. The global-assisted branch conducts an initial recognition and provides a loss based on the entire SAR image during each training epoch and the feature capture module automatically segments and captures crucial image regions for current recognition, which we refer to as the “golden key” of the image. The local enhanced branch then performs another recognition and provides another loss function based on the image parts. Instead of updating the model with two basic recognition losses to roughly search for and capture crucial image parts, a feature discrimination module is proposed to combine the global and local branches in a subtle manner to improve local feature separability or compactness for similar inter-class or dissimilar inner-class sample pairs in global features. This adaptively forced the model to capture more crucial image parts and extract more effective features. Experimental results and comparisons of the MSTAR and OpenSARship datasets indicated that the proposed method achieves superior recognition performance compared to existing methods. The effectiveness of our method was further demonstrated through the visualization of the golden key of the testing images and the recognition performance in ablation experiments. We will release our codes and more experimental results at https://github.com/cwwangSARATR/SARATR_FeaCapture_Discrimination.

Locality Preserving Property Constrained Contrastive Learning for Object Classification in SAR Imagery

Robust unsupervised feature learning is a critical yet tough task for synthetic aperture radar (SAR) automatic target recognition (ATR) with limited labeled data. The developing contrastive self-supervised learning (CSL) method, which learns informative representations by solving an instance discrimination task, provides a novel method for learning discriminative features from unlabeled SAR images. However, the instance-level contrastive loss can magnify the differences between samples belonging to the same class in the latent feature space. Therefore, CSL can dispel these targets from the same class and affect the downstream classification tasks. In order to address this problem, this paper proposes a novel framework called locality preserving property constrained contrastive learning (LPPCL), which not only learns informative representations of data but also preserves the local similarity property in the latent feature space. In LPPCL, the traditional InfoNCE loss of the CSL models is reformulated in a cross-entropy form where the local similarity of the original data is embedded as pseudo labels. Furthermore, the traditional two-branch CSL architecture is extended to a multi-branch structure, improving the robustness of models trained with limited batch sizes and samples. Finally, the self-attentive pooling module is used to replace the global average pooling layer that is commonly used in most of the standard encoders, which provides an adaptive method for retaining information that benefits downstream tasks during the pooling procedure and significantly improves the performance of the model. Validation and ablation experiments using MSTAR datasets found that the proposed framework outperformed the classic CSL method and achieved state-of-the-art (SOTA) results.

Analytical interpretation of the gap of CNN’s cognition between SAR and optical target recognition

Synthetic aperture radar (SAR) automatic target recognition (ATR) is a crucial technique utilized in various scenarios of geoscience and remote sensing. Despite the remarkable success of convolutional neural networks (CNNs) in optical vision tasks, the application of CNNs in SAR ATR is still a challenging area due to the significant differences in the imaging mechanisms of SAR and optical images. This paper analytically addresses the cognitive gap of CNNs between optical and SAR images by leveraging multi-order interactions to measure their representation capacity. Furthermore, we propose a subjective evaluation strategy to compare human interactions with those of CNNs. Our findings reveal that CNNs operate differently for optical and SAR images. Specifically, for SAR images, CNNs’ representation capacity is comparable to that of humans, as they can encode intermediate interactions better than simple and complex ones. In contrast, for optical images, CNNs excel at encoding simple and complex interactions, but not intermediate interactions.

C-RISE: A Post-Hoc Interpretation Method of Black-Box Models for SAR ATR

The integration of deep learning methods, especially Convolutional Neural Networks (CNN), and Synthetic Aperture Radar Automatic Target Recognition (SAR ATR) has been widely deployed in the field of radar signal processing. Nevertheless, these methods are frequently regarded as black-box models due to the limited visual interpretation of their internal feature representation and parameter organization. In this paper, we propose an innovative approach named C-RISE, which builds upon the RISE algorithm to provide a post-hoc interpretation technique for black-box models used in SAR Images Target Recognition. C-RISE generates saliency maps that effectively visualize the significance of each pixel. Our algorithm outperforms RISE by clustering masks that capture similar fusion features into distinct groups, enabling more appropriate weight distribution and increased focus on the target area. Furthermore, we employ Gaussian blur to process the masked area, preserving the original image structure with optimal consistency and integrity. C-RISE has been extensively evaluated through experiments, and the results demonstrate superior performance over other interpretation methods based on perturbation when applied to neural networks for SAR image target recognition. Furthermore, our approach is highly robust and transferable compared to other interpretable algorithms, including white-box methods.

Multi-Aspect SAR Target Recognition Based on Non-Local and Contrastive Learning

Synthetic aperture radar (SAR) automatic target recognition (ATR) has been widely applied in multiple fields. However, the special imaging mechanism of SAR results in different visual features of the same target at different azimuth angles, so single-aspect SAR target recognition has the limitation of observing the target from a single perspective. Multi-aspect SAR target recognition technology can overcome this limitation by utilizing information from different azimuths and effectively improve target recognition performance. Considering the order dependency and data limitation of existing methods, this paper proposes a multi-aspect SAR recognition method based on Non-Local, which applies a self-attention calculation to feature maps to learn the correlation between multi-aspect SAR images. Meanwhile, in order to improve the generalization ability of the proposed method under limited data, a network based on contrastive learning was designed to pre-train the feature extraction part of the whole network. The experimental results using the MSTAR dataset show that the proposed method has excellent recognition accuracy and good robustness.

A Multiscale Local–Global Feature Fusion Method for SAR Image Classification with Bayesian Hyperparameter Optimization Algorithm

In recent years, the advancement of deep learning technology has led to excellent performance in synthetic aperture radar (SAR) automatic target recognition (ATR) technology. However, due to the interference of speckle noise, the task of classifying SAR images remains challenging. To address this issue, a multi-scale local–global feature fusion network (MFN) integrating a convolution neural network (CNN) and a transformer network was proposed in this study. The proposed network comprises three branches: a CovNeXt-SimAM branch, a Swin Transformer branch, and a multi-scale feature fusion branch. The CovNeXt-SimAM branch extracts local texture detail features of the SAR images at different scales. By incorporating the SimAM attention mechanism to the CNN block, the feature extraction capability of the model was enhanced from the perspective of spatial and channel attention. Additionally, the Swin Transformer branch was employed to extract SAR image global semantic information at different scales. Finally, the multi-scale feature fusion branch was used to fuse local features and global semantic information. Moreover, to overcome the problem of poor accuracy and inefficiency of the model due to empirically determined model hyperparameters, the Bayesian hyperparameter optimization algorithm was used to determine the optimal model hyperparameters. The model proposed in this study achieved average recognition accuracies of 99.26% and 94.27% for SAR vehicle targets under standard operating conditions (SOCs) and extended operating conditions (EOCs), respectively, on the MSTAR dataset. Compared with the baseline model, the recognition accuracy has been improved by 12.74% and 25.26%, respectively. The results demonstrated that Bayes-MFN reduces the inter-class distance of the SAR images, resulting in more compact classification features and less interference from speckle noise. Compared with other mainstream models, the Bayes-MFN model exhibited the best classification performance.

Multitask Sparse Representation of Two-Dimensional Variational Mode Decomposition Components for SAR Target Recognition

A synthetic aperture radar (SAR) automatic target recognition (ATR) method is developed based on the two-dimensional variational mode decomposition (2D-VMD). 2D-VMD decomposes original SAR images into multiscale components, which depict the time-frequency properties of the targets. The original image and its 2D-VMD components are highly correlated, so the multitask sparse representation is chosen to jointly represent them. According to the resulted reconstruction errors of different classes, the target label of test sample can be classified. The moving and stationary target acquisition and recognition (MSTAR) dataset is used to set up the standard operating condition (SOC) and several extended operating conditions (EOCs) including configuration variants, depression angle variances, noise corruption, and partial occlusion to test and validate the proposed method. The results confirm the effectiveness and robustness of the proposed method compared with several state-of-the-art SAR ATR references.

Improving Pre-Training and Fine-Tuning for Few-Shot SAR Automatic Target Recognition

SAR-ATR (synthetic aperture radar-automatic target recognition) is a hot topic in remote sensing. This work suggests a few-shot target recognition approach (FTL) based on the concept of transfer learning to accomplish accurate target recognition of SAR images in a few-shot scenario since the classic SAR ATR method has significant data reliance. At the same time, the strategy introduces a model distillation method to improve the model’s performance further. This method is composed of three parts. First, the data engine, which uses the style conversion model and optical image data to generate image data similar to SAR style and realize cross-domain conversion, can effectively solve the problem of insufficient training data of the SAR image classification model. Second is model training, which uses SAR image data sets to pre-train the model. Here, we introduce the deep Brownian distance covariance (Deep BDC) pooling layer to optimize the image feature representation so that the model can learn the image representation by measuring the difference between the joint feature function of the embedded feature and the edge product. Third, model fine-tuning, which freezes the model structure, except the classifier, and fine-tunes it by using a small amount of novel data. The knowledge distillation approach is also introduced simultaneously to train the model repeatedly, sharpen the knowledge, and enhance model performance. According to experimental results on the MSTAR benchmark dataset, the proposed method is demonstrably better than the SOTA method in the few-shot SAR ATR issue. The recognition accuracy is about 80% in the case of 10-way 10-shot.

A new model based on multi-aspect images and complex-valued neural network for synthetic aperture radar automatic target recognition

ABSTRACT During the last decades, Synthetic Aperture Radar Automatic Target Recognition (SAR ATR) has been vastly utilized in the military services and civil studies. Because of the sensibility of the SAR images of the imaging in the azimuth dimension, using the multi-aspect SAR image sequence is more practical than the single-aspect SAR image to achieve the superior classification accuracy in an actual SAR ATR task. At present time, multi-aspect SAR ATR models mostly utilize Recurrent Neural Networks (RNN) that depend on the sequence between samples and so suffer from the lack of information. In a practical work, a huge amount of training set is needed to train a deep learning network accurately, but it is so costly work to extract multi-aspect SAR images. So, in this article, a new model of multi-aspect SAR ATR is proposed by using a self-attention model. The proposed self-attention model is utilized to calculate the internal correlation between the original SAR images. At the same time, to develop the anti-noise capability of the proposed model and decrease the dependency on a huge amount of training data, a Convolutional Auto Encoder (CAE) is designed and utilized in the feature extraction section of the proposed model. On the other hand, unlike existing traditional methods, in this work we use both amplitude and phase information of SAR images to devolve the training process of the proposed model. It should be noted that all of the parameters of the proposed network are developed to a complex domain. In addition a complex backpropagation algorithm by using the gradient based model is used for training the network. In the end, experiments is obtained by using two MSTAR data set (the MSTAR-SOC and EOC). The experimental results prove that the proposed model not only can achieve a high recognitions rate on the case of sufficient training sample but also can obtain an acceptable rate in the case of small training samples in different complex situations. In addition, the simulation results demonstrate that by using the encoder of CAE in the proposed model, the whole configuration of the proposed model achieves the anti-noise capability that is a valuable benefit of any practical SAR ATR task.