Synthetic Aperture Radar Target Recognition Research Articles

Enhanced Prototypical Network with Customized Region-Aware Convolution for Few-Shot SAR ATR

With the prosperous development and successful application of deep learning technologies in the field of remote sensing, numerous deep-learning-based methods have emerged for synthetic aperture radar (SAR) automatic target recognition (ATR) tasks over the past few years. Generally, most deep-learning-based methods can achieve outstanding recognition performance on the condition that an abundance of labeled samples are available to train the model. However, in real application scenarios, it is difficult and costly to acquire and to annotate abundant SAR images due to the imaging mechanism of SAR, which poses a big challenge to existing SAR ATR methods. Therefore, SAR target recognition in the situation of few-shot, where only a scarce few labeled samples are available, is a fundamental problem that needs to be solved. In this paper, a new method named enhanced prototypical network with customized region-aware convolution (CRCEPN) is put forward to specially tackle the few-shot SAR ATR tasks. To be specific, a feature-extraction network based on a customized and region-aware convolution is first developed. This network can adaptively adjust convolutional kernels and their receptive fields according to each SAR image’s own characteristics as well as the semantical similarity among spatial regions, thus augmenting its capability to extract more informative and discriminative features. To achieve accurate and robust target identity prediction under the few-shot condition, an enhanced prototypical network is proposed. This network can improve the representation ability of the class prototype by properly making use of training and test samples together, thus effectively raising the classification accuracy. Meanwhile, a new hybrid loss is designed to learn a feature space with both inter-class separability and intra-class tightness as much as possible, which can further upgrade the recognition performance of the proposed method. Experiments performed on the moving and stationary target acquisition and recognition (MSTAR) dataset, the OpenSARShip dataset, and the SAMPLE+ dataset demonstrate that the proposed method is competitive with some state-of-the-art methods for few-shot SAR ATR tasks.

Unveiling SAR target recognition networks: Adaptive Perturbation Interpretation for enhanced understanding

Deep neural networks (DNNs) have obtained remarkable achievements in various vision tasks. However, DNNs’ mechanism remains obscure, especially in synthetic aperture radar (SAR) target recognition. To clearly understand DNNs’ mechanism, some interpretation algorithms are proposed to provide a saliency map to visualize DNN’s decisions, which can be categorized into (1) propagation-based methods, (2) activation-based methods, and (3) perturbation-based methods. Unfortunately, each of them has some imperfection in producing saliency maps. The saliency maps produced by propagation-based methods are sensitive to SAR speckles. Activation-based methods have difficulty producing a saliency map where the highlighted region covers the entire feature. Perturbation-based methods tend to forfeit intricate details of the target in saliency map during optimization. To mitigate the above limitations, this paper proposed Adaptive Perturbation Interpretation (API), with two aims: (1) to improve the interpretability of SAR recognition networks and (2) to recover the fine-grained lost during the optimization procedures of perturbation-based methods. Specifically, we first introduce a Multi-information Perturbation Optimization Module (MPOM) to retain the target’s local characteristics while constraining saliency map’s sparsity by configuring regularization terms. Additionally, we further introduce a Feature Compensation Module (FCM) to recover the fine-grained feature lost during the optimization process in MPOM. Extensive experiments are implemented on SAR interpretation benchmark datasets, MSTAR and SARAIRcraft1.0, the results demonstrate the superiority of API to other state-of-the-art methods.

Application of adaptive fusion to attributed scattering centre-based reconstruction for SAR target recognition

ABSTRACT Synthetic aperture radar (SAR) measures backscattering characteristics of man-made targets and has the advantage of not being affected by weather and time. For target recognition in SAR images, the target reconstruction results based on attribute scattering centres are introduced for decision fusion. In comparison with original images, the reconstructed targets better relieve corruptions caused by noises, clutters, etc. A deep learning model, i.e. ResNet, is adopted as a basic classifier to classify both original and reconstructed images. According to the energy relationship between the reconstruction target and residual, the noise level of the original SAR image is defined. Then, the adaptive weights of original and reconstructed images are determined and a weighted decision fusion process is conducted to combine decisions from both images to confirm the target label. The proposed method is tested based on MSTAR dataset, and experimental results show its effectiveness.

SAR target recognition through adaptive kernel sparse representation model based on local contrast perception

Sparse representation-based methods have shown promising prospects in synthetic aperture radar (SAR) target recognition due to their robustness under complex application conditions. However, these methods are still susceptible to the feature representation of SAR images. In this paper, we propose a new SAR target recognition method using an adaptive kernel sparse representation model based on local contrast perception (LCP). The LCP method combines a specially designed random projection matrix with two-dimensional filtering to capture extensive intensity contrasts between local regions in SAR images. A response map reconstruction technique shows that LCP can obtain discriminative properties between target and background regions and improve feature representation. The LCP features are then transformed into the kernel representation to improve linear separability by defining a reproducing kernel Hilbert space (RKHS) and using a nonlinear kernel function. The kernel representation is utilized to construct a new kernel sparse representation model for classification. Furthermore, neighborhood analysis (NA) is proposed to establish the relationship between the parameter and feature distribution, with an adaptive regularization parameter selection strategy to mitigate the parameter sensitivity. Experiments conducted on the moving and stationary target acquisition and recognition dataset demonstrate the superiority and robustness of the proposed method under different application conditions.

SAR Target Recognition Method based on Adaptive Weighted Decision Fusion of Deep Features

Background: This paper proposes a synthetic aperture radar (SAR) target recognition method based on adaptive weighted decision fusion of multi-level deep features. Methods: The trained ResNet-18 is employed to extract multi-level deep features from SAR images. Afterwards, based on the joint sparse representation (JSR) model, the multi-level deep features are represented to obtain the corresponding reconstruction error vectors. Considering the differences in the abilities of different levels of features to distinguish the target, the reconstruction error vectors are analyzed based on entropy theory, and their corresponding weights are adaptively obtained. Finally, the fused reconstruction error result is obtained through adaptively weighted fusion, and the target label is determined accordingly. Results: Experiments are conducted on the Moving and Stationary Target Acquisition and Recognition (MSTAR) dataset under different conditions, and the proposed method is compared with published methods, including multi-feature decision fusion, JSR-based decision fusion and other types of ResNets. Conclusion: The experimental results under standard operating condition (SOC) and extended operating conditions (EOCs) including depression angle variance and noise corruption validate the advantages of the proposed method.

Synthetic aperture radar target recognition based on adaptive decision fusion of multiple views

Synthetic aperture radar target recognition based on adaptive decision fusion of multiple views

A 3-D scattering centre model-based SAR target recognition method using multi-level region matching

ABSTRACT A 3-D scattering centre model-based synthetic aperture radar (SAR) automatic target recognition (ATR) method is proposed. Multi-level dominant scattering areas (DSAs) are generated from the test sample and model predicted target images, which can describe the target region and scattering centres distribution from coarse to fine. The DSA matching is conducted at each level using the morphological erosion operation and Euclidean distance transform. Finally, the energy of the region residuals is taken as the distance measure between the test sample and different target models so as to confirm the target label. The 3-D scattering centre model can provide very complete descriptions of the target. In addition, the designed distance measure comprehensively considers the possible nonlinear transformations between the model and test image using the morphological erosion operation and Euclidean distance transform. Experiments are performed on the electromagnetic (EM) simulated data of three military targets.

SAR-ATR with knowledge hierarchy division and information dissemination networks

Synthetic aperture radar (SAR) images possess diverse domain characteristics that describe targets from multiple perspectives, including scattering center, intensity, phase, azimuth angle, and shadow. The imaging mechanism of SAR images significantly differs from optical images due to its use of radio waves instead of visible light for imaging purposes. However, current deep learning (DL)-based automatic target recognition (ATR) approaches for SAR primarily focus on the intensity information while neglecting the comprehensive consideration of SAR domain characteristics. This limitation results in insufficient expression of target features and hampers further improvement in SAR target recognition performance. To address these issues, this paper proposes a novel SAR target recognition method called KDNets based on information dissemination networks (IDNets) and knowledge hierarchy division (KnHD). KDNets effectively enhances the feature representation ability of SAR targets by exploiting multiple domain characteristics at sample, feature, and decision levels. Specifically, IDNets incorporates scattering center and azimuth angle at sample and feature levels to extract rich multi-scale semantic features for representing SAR targets. At the decision stage, KnHD utilizes azimuth information to rapidly search and fuse prior knowledge about targets from a knowledge base to achieve interpretable and high-precision SAR target recognition. Experimental results on the MSTAR dataset and MA-SAR dataset demonstrate that our proposed KDNets can achieve state-of-the-art performance in SAR target recognition tasks, with the accuracy of 99.75 % in the MSTAR dataset and 98.61 % in the MA-SAR dataset, validating its effectiveness and superiority. Furthermore, this study highlights the significant potential and application prospects of leveraging domain characteristics in SAR-ATR tasks.

Integrating Target and Shadow Features for SAR Target Recognition.

Synthetic aperture radar (SAR) sensor often produces a shadow in pairs with the target due to its slant-viewing imaging. As a result, shadows in SAR images can provide critical discriminative features for classifiers, such as target contours and relative positions. However, shadows possess unique properties that differ from targets, such as low intensity and sensitivity to depression angles, making it challenging to extract depth features from shadows directly using convolutional neural networks (CNN). In this paper, we propose a new SAR image-classification framework to utilize target and shadow information comprehensively. First, we design a SAR image segmentation method to extract target regions and shadow masks. Second, based on SAR projection geometry, we propose a data-augmentation method to compensate for the geometric distortion of shadows due to differences in depression angles. Finally, we introduce a feature-enhancement module (FEM) based on depthwise separable convolution (DSC) and convolutional block attention module (CBAM), enabling deep networks to fuse target and shadow features adaptively. The experimental results on the Moving and Stationary Target Acquisition and Recognition (MSTAR) dataset show that when only using target and shadow information, the published deep-learning models can still achieve state-of-the-art performance after embedding the FEM.

Target Recognition in SAR Images Using Complex-Valued Network Guided with Sub-Aperture Decomposition

Synthetic aperture radar (SAR) images have special physical scattering characteristics owing to their unique imaging mechanism. Traditional deep learning algorithms usually extract features from real-valued SAR images in a purely data-driven manner, which may ignore some important physical scattering characteristics and sacrifice some useful target information in SAR images. This undoubtedly limits the improvement in performance for SAR target recognition. To take full advantage of the physical information contained in SAR images, a complex-valued network guided with sub-aperture decomposition (CGS-Net) for SAR target recognition is proposed. According to the fact that different targets have different physical scattering characteristics at different angles, the sub-aperture decomposition is used to improve accuracy with a multi-task learning strategy. Specifically, the proposed method includes main and auxiliary tasks, which can improve the performance of the main task by learning and sharing useful information from the auxiliary task. Here, the main task is the target recognition task, and the auxiliary task is the target reconstruction task. In addition, a complex-valued network is used to extract the features from the original complex-valued SAR images, which effectively utilizes the amplitude and phase information in SAR images. The experimental results obtained using the MSTAR dataset illustrate that the proposed CGS-Net achieved an accuracy of 99.59% (without transfer learning or data augmentation) for the ten-classes targets, which is superior to the other popular deep learning methods. Moreover, the proposed method has a lightweight network structure, which is suitable for SAR target recognition tasks because SAR images usually lack a large number of labeled data. Here, the experimental results obtained using the small dataset further demonstrate the excellent performance of the proposed CGS-Net.

FCCD-SAR: A Lightweight SAR ATR Algorithm Based on FasterNet.

In recent times, the realm of remote sensing has witnessed a remarkable surge in the area of deep learning, specifically in the domain of target recognition within synthetic aperture radar (SAR) images. However, prevailing deep learning models have often placed undue emphasis on network depth and width while disregarding the imperative requirement for a harmonious equilibrium between accuracy and speed. To address this concern, this paper presents FCCD-SAR, a SAR target recognition algorithm based on the lightweight FasterNet network. Initially, a lightweight and SAR-specific feature extraction backbone is meticulously crafted to better align with SAR image data. Subsequently, an agile upsampling operator named CARAFE is introduced, augmenting the extraction of scattering information and fortifying target recognition precision. Moreover, the inclusion of a rapid, lightweight module, denoted as C3-Faster, serves to heighten both recognition accuracy and computational efficiency. Finally, in cognizance of the diverse scales and vast variations exhibited by SAR targets, a detection head employing DyHead's attention mechanism is implemented to adeptly capture feature information across multiple scales, elevating recognition performance on SAR targets. Exhaustive experimentation on the MSTAR dataset unequivocally demonstrates the exceptional prowess of our FCCD-SAR algorithm, boasting a mere 2.72 M parameters and 6.11 G FLOPs, culminating in an awe-inspiring 99.5% mean Average Precision (mAP) and epitomizing its unparalleled proficiency.

The Process Analysis Method of SAR Target Recognition in Pre-Trained CNN Models.

Recently, attention has been paid to the convolutional neural network (CNN) based synthetic aperture radar (SAR) target recognition method. Because of its advantages of automatic feature extraction and the preservation of translation invariance, the recognition accuracies are stronger than traditional methods. However, similar to other deep learning models, CNN is a "black-box" model, whose working process is vague. It is difficult to locate the decision reasons. Because of this, we focus on the process analysis of a pre-trained CNN model. The role of the processing to feature extraction and final recognition decision is discussed. The discussed components of CNN models are convolution, activation function, and full connection. Here, the convolution processing can be deemed as image filtering. The activation function provides a nonlinear element of processing. Moreover, the fully connected layers can also further extract features. In the experiment, four classical CNN models, i.e., AlexNet, VGG16, GoogLeNet, and ResNet-50, are trained by public MSTAR data, which can realize ten-category SAR target recognition. These pre-trained CNN models are processing objects of the proposed process analysis method. After the analysis, the content of the SAR image target features concerned by these pre-trained CNN models is further clarified. In summary, we provide a paradigm to process the analysis of pre-trained CNN models used for SAR target recognition in this paper. To some degree, the adaptability of these models to SAR images is verified.

Analytical interpretation of the gap of CNN’s cognition between SAR and optical target recognition

Synthetic aperture radar (SAR) automatic target recognition (ATR) is a crucial technique utilized in various scenarios of geoscience and remote sensing. Despite the remarkable success of convolutional neural networks (CNNs) in optical vision tasks, the application of CNNs in SAR ATR is still a challenging area due to the significant differences in the imaging mechanisms of SAR and optical images. This paper analytically addresses the cognitive gap of CNNs between optical and SAR images by leveraging multi-order interactions to measure their representation capacity. Furthermore, we propose a subjective evaluation strategy to compare human interactions with those of CNNs. Our findings reveal that CNNs operate differently for optical and SAR images. Specifically, for SAR images, CNNs’ representation capacity is comparable to that of humans, as they can encode intermediate interactions better than simple and complex ones. In contrast, for optical images, CNNs excel at encoding simple and complex interactions, but not intermediate interactions.

Multi-Aspect SAR Target Recognition Based on Non-Local and Contrastive Learning

Synthetic aperture radar (SAR) automatic target recognition (ATR) has been widely applied in multiple fields. However, the special imaging mechanism of SAR results in different visual features of the same target at different azimuth angles, so single-aspect SAR target recognition has the limitation of observing the target from a single perspective. Multi-aspect SAR target recognition technology can overcome this limitation by utilizing information from different azimuths and effectively improve target recognition performance. Considering the order dependency and data limitation of existing methods, this paper proposes a multi-aspect SAR recognition method based on Non-Local, which applies a self-attention calculation to feature maps to learn the correlation between multi-aspect SAR images. Meanwhile, in order to improve the generalization ability of the proposed method under limited data, a network based on contrastive learning was designed to pre-train the feature extraction part of the whole network. The experimental results using the MSTAR dataset show that the proposed method has excellent recognition accuracy and good robustness.

Multitask Sparse Representation of Two-Dimensional Variational Mode Decomposition Components for SAR Target Recognition

A synthetic aperture radar (SAR) automatic target recognition (ATR) method is developed based on the two-dimensional variational mode decomposition (2D-VMD). 2D-VMD decomposes original SAR images into multiscale components, which depict the time-frequency properties of the targets. The original image and its 2D-VMD components are highly correlated, so the multitask sparse representation is chosen to jointly represent them. According to the resulted reconstruction errors of different classes, the target label of test sample can be classified. The moving and stationary target acquisition and recognition (MSTAR) dataset is used to set up the standard operating condition (SOC) and several extended operating conditions (EOCs) including configuration variants, depression angle variances, noise corruption, and partial occlusion to test and validate the proposed method. The results confirm the effectiveness and robustness of the proposed method compared with several state-of-the-art SAR ATR references.

LSCB: a lightweight feature extraction block for SAR automatic target recognition and detection

ABSTRACT Automatic target recognition and detection in synthetic aperture radar (SAR) images is playing a significant role in military and civilian fields. Traditional methods are weak in migration capabilities and cumbersome in manual design. Existing deep learning-based methods can achieve high recognition and detection accuracy, but most of them have a very large number of parameters and slow recognition and computational efficiency, which makes it difficult for them to migrate to edge computing equipments, and computational efficiency is crucial in rapid maritime rescue and emergency military deployment. Therefore, we propose a lightweight feature extraction block, lightweight split concat block (LSCB), for SAR automatic target recognition and detection. Specifically, LSCB consists of several operators, such as split, depthwise convolution (DC), multiple kernel sizes block (MKSB), and channel-shuffle (CS). MKSB is a novel channel attention mechanism designed by us, which can make feature maps have target features of different scales and adjust their receptive field sizes adaptively. In addition, to assess the performance of LSCB, we use LSCB to build LSCNet-R and LSCNet-D for SAR target recognition and detection, respectively, and conduct extensive experiments on MSTAR, SSDD, and SAR-Ship-Dataset. The experimental results show that our LSCNet-R and LSCNet-D built with LSCB achieve higher recognition and detection accuracy and computational efficiency with few parameters compared with existing excellent methods. This further illustrates that the proposed LSCB can extract fine and stable features with few parameters.

Synthetic Aperture Radar image analysis based on deep learning: A review of a decade of research

Artificial intelligence research in the area of computer vision teaches machines to comprehend and interpret visual data. Machines can properly recognize and classify items using digital images captured by cameras and videos, deep learning models, and then respond to what they observe. Similarly, artificial intelligence has also been able to learn complex images captured by Synthetic Aperture Radar (SAR) that are widely used for various purposes but still leave room for improvements. Researchers have proposed numerous approaches in this field, from SAR target detection to SAR target recognition. This paper presents a survey on the different techniques and architectures proposed in the literature for various SAR image applications. The paper covers a survey on target detection models and target recognition models and their respective workflow to analyze the techniques involved and the performances of these models. This paper makes novel discussions, comparisons, and observations. It highlights the advantages and disadvantages of different approaches to give researchers the idea of how each technique can influence the performance for adoption in the future. The potential future directions along with hybrid models on each processing method are also highlighted based on the study.

Multiview synthetic aperture radar target recognition method using joint sparse representation and random weight matrix

Multiview synthetic aperture radar (SAR) images could provide richer information for target recognition as reported in previous works. This study exploits multiview SAR images with application to target recognition via the combination of joint sparse representation (JSR) and random weight matrix. First, the multiview SAR images are clustered into several view sets via a coarse clustering algorithm. In this way, the views in each set tend to share high correlations so they can be properly represented with JSR. For the reconstruction errors from different views, they are fused through a random weight matrix, which includes a rich set of linear weight vectors. Afterwards, the fused errors at different choices of weight vectors are analyzed to form a decision value for target recognition, which could better reflect the differences between different classes through multiview SAR images in comparison with traditional JSR-based methods. Therefore, the overall SAR target recognition performance can be effectively enhanced. Experiments are investigated on the moving and stationary target acquisition and recognition dataset under several operating conditions. The results reveal the high effectiveness of the proposed method under standard operating condition and good robustness under typical extended operating conditions including depression angle variance, configuration variants, noise corruption, partial occlusion, and resolution variance.

Modern Synergetic Neural Network for Synthetic Aperture Radar Target Recognition.

Feature extraction is an important process for the automatic recognition of synthetic aperture radar targets, but the rising complexity of the recognition network means that the features are abstractly implied in the network parameters and the performances are difficult to attribute. We propose the modern synergetic neural network (MSNN), which transforms the feature extraction process into the prototype self-learning process by the deep fusion of an autoencoder (AE) and a synergetic neural network. We prove that nonlinear AEs (e.g., stacked and convolutional AE) with ReLU activation functions reach the global minimum when their weights can be divided into tuples of M-P inverses. Therefore, MSNN can use the AE training process as a novel and effective nonlinear prototypes self-learning module. In addition, MSNN improves learning efficiency and performance stability by making the codes spontaneously converge to one-hots with the dynamics of Synergetics instead of loss function manipulation. Experiments on the MSTAR dataset show that MSNN achieves state-of-the-art recognition accuracy. The feature visualization results show that the excellent performance of MSNN stems from the prototype learning to capture features that are not covered in the dataset. These representative prototypes ensure the accurate recognition of new samples.

Scattering-Point-Guided RPN for Oriented Ship Detection in SAR Images

Ship detection in synthetic aperture radar (SAR) images has attracted widespread attention due to its significance and challenges. In recent years, numerous detectors based on deep learning have achieved good performance in the field of SAR ship detection. However, ship targets of the same type always have various representations in SAR images under different imaging conditions, while different types of ships may have a high degree of similarity, which considerably complicates SAR target recognition. Meanwhile, the ship target in the SAR image is also obscured by background and noise. To address these issues, this paper proposes a novel oriented ship detection method in SAR images named SPG-OSD. First, we propose an oriented two-stage detection module based on the scattering characteristics. Second, to reduce false alarms and missing ships, we improve the performance of the network by incorporating SAR scattering characteristics in the first stage of the detector. A scattering-point-guided region proposal network (RPN) is designed to predict possible key scattering points and make the regression and classification stages of RPN increase attention to the vicinity of key scattering points and reduce attention to background and noise. Third, supervised contrastive learning is introduced to alleviate the problem of minute discrepancies among SAR object classes. Region-of-Interest (RoI) contrastive loss is proposed to enhance inter-class distinction and diminish intra-class variance. Extensive experiments are conducted on the SAR ship detection dataset from the Gaofen-3 satellite, and the experimental results demonstrate the effectiveness of SPG-OSD and show that our method achieves state-of-the-art performance.