Synthetic Aperture Radar Target Research Articles

Vehicle Target Detection Network in SAR Images Based on Rectangle-Invariant Rotatable Convolution

In recent years, convolutional neural network (CNN)-based methods have been extensively explored for synthetic aperture radar (SAR) target detection. Nevertheless, the convolutional sampling locations of CNNs cannot accurately fit vehicle targets due to the fixed sampling mechanism in the convolutional kernel. In this paper, we focus on the vehicle target detection task in SAR images and propose a novel rectangle-invariant rotatable convolution (RIRConv) to determine more accurately the convolutional sampling locations for vehicle targets. Specifically, this paper considers the shape characteristic of vehicle targets in SAR images, which always retain a rectangular shape despite having varying sizes, aspect ratios, and rotation angles. The proposed RIRConv equips three additional learnable attribute parameters, namely, width, height, and angle attributes, to adaptively adjust the sampling locations in the convolutional kernel according to the targets. In addition, the RIRConv applies a modulation mechanism to focus on the sampling locations that significantly affect the output. Finally, the RIRConv is introduced into the single-shot multibox detector (SSD) to realize SAR vehicle target detection. In this way, the feature representation capability of SSD for vehicle targets can be enhanced, thus leading to higher detection performance. Notably, the proposed RIRConv is “plug-and-play” and can also be used with other existing advanced technologies to achieve higher detection performance. The experiments based on the measured miniSAR data validate the effectiveness of the proposed method.

SAR Recognition of Target Variants Using Channel Attention Network without Dimensionality Reduction

In implementing a robust automatic target recognition(ATR) system with synthetic aperture radar(SAR) imagery, one of the most important issues is accurate classification of target variants, which are the same targets with different serial numbers, configurations and versions, etc. In this paper, a deep learning network with channel attention modules is proposed to cope with the recognition problem for target variants based on the previous research findings that the channel attention mechanism selectively emphasizes the useful features for target recognition. Different from other existing attention methods, this paper employs the channel attention modules without dimensionality reduction along the channel direction from which direct correspondence between feature map channels can be preserved and the features valuable for recognizing SAR target variants can be effectively derived. Experiments with the public benchmark dataset demonstrate that the proposed scheme is superior to the network with other existing channel attention modules.

Automatic Target Recognition of SAR Images Using Collaborative Representation.

Synthetic aperture radar (SAR) automatic target recognition (ATR) is one of the key technologies for SAR image interpretation. This paper proposes a SAR target recognition method based on collaborative representation-based classification (CRC). The collaborative coding adopts the global dictionary constructed by training samples of all categories to optimally reconstruct the test samples and determines the target category according to the reconstruction error of each category. Compared with the sparse representation methods, the collaborative representation strategy can improve the representation ability of a small number of training samples for test samples. For SAR target recognition, the resources of training samples are very limited. Therefore, the collaborative representation is more suitable. Based on the MSTAR dataset, the experiments are carried out under a variety of conditions and the proposed method is compared with other classifiers. Experimental results show that the proposed method can achieve superior recognition performance under the standard operating condition (SOC), configuration variances, depression angle variances, and a small number of training samples, which proves its effectiveness.

SAR image simulation of sea surface targets

SAR(Synthetic Aperture Radar) images of sea targets are of great significance to the military. In view of the high cost of obtaining the measured data of sea targets SAR images, this paper implements a sea target SAR image simulation method based on electromagnetic scattering calculations. This method uses the Phillips spectrum to generate the sea surface geometric model, and combines the target model and the sea surface model; then uses the SBR(Shooting and Bouncing Rays) to calculate the electromagnetic scattering of the sea surface target; finally, the SAR image of the sea surface target is simulated by the RCS(Radar Cross Section) obtained by the calculation. Through the analysis of the results of different sea states and different incident angles, it is shown that this method can complete the SAR image simulation of sea surface targets at different sea states and different angles, and the simulation effect is relatively realistic.

Adaptive Max-Margin One-Class Classifier for SAR Target Discrimination in Complex Scenes

Synthetic aperture radar (SAR) target discrimination is an important stage that distinguishes targets from clutters in the radar automatic target recognition field. However, in complex SAR scenes, the performance of some traditional discriminators will degrade. As an effective tool for one-class classification (OCC), the max-margin one-class classifier has attracted much attention for SAR target discrimination, as it can effectively reduce the impact of multiple clutters. However, the performance of the max-margin one-class classifier is very sensitive to the values of kernel parameters. To solve the problem, this paper proposes an adaptive max-margin one-class classifier for SAR target discrimination in complex scenes. In a max-margin one-class classifier with a suitable kernel parameter, the distance between a sample and classification boundary satisfies a certain geometric relationship, i.e., edge samples in input space are transformed to the region in the kernel space close to boundary, while interior samples in input space are transformed to the region in the kernel space far away from boundary. Therefore, we define the information entropy of samples in the kernel space to measure the distance between samples and classification boundary. To automatically obtain the optimal kernel parameter of the max-margin one-class classifier, the edge and interior samples in the input space are first selected, and then the parameter optimization is performed by minimizing information entropy of interior samples and simultaneously maximizing the information entropy of edge samples. Experimental results of the synthetic datasets and measured synthetic aperture radar (SAR) datasets validate the effectiveness of our method.

A multi-view SAR target recognition method using feature fusion and joint classification

ABSTRACT To handle synthetic aperture radar (SAR) image target recognition problem, a multi-view method is proposed. For the multi-view SAR images be recognized, they are first clustered based on the correlation coefficients and divided into several view sets. Afterwards, for the view set containing two or more images, the multiset canonical correlation analysis (MCCA) is employed to fuse them as a single feature vector. For the view set with a single image, its corresponding feature vector is directly used. Finally, the joint sparse representation is used to characterize and classify the feature vectors from different view sets and determine the target label of the multi-view SAR images. Experiments and analysis on the moving and stationary target acquisition and recognition (MSTAR) dataset show that the proposed method can achieve an average recognition rate of 99.42% for 10 types of targets under the standard operating condition (SOC). Its performance is also better than several reference methods under the extended operating conditions (EOC) including noise interference and target occlusion.

A Lightweight Position-Enhanced Anchor-Free Algorithm for SAR Ship Detection

As an active microwave device, synthetic aperture radar (SAR) uses the backscatter of objects for imaging. SAR image ship targets are characterized by unclear contour information, a complex background and strong scattering. Existing deep learning detection algorithms derived from anchor-based methods mostly rely on expert experience to set a series of hyperparameters, and it is difficult to characterize the unique characteristics of SAR image ship targets, which greatly limits detection accuracy and speed. Therefore, this paper proposes a new lightweight position-enhanced anchor-free SAR ship detection algorithm called LPEDet. First, to resolve unclear SAR target contours and multiscale performance problems, we used YOLOX as the benchmark framework and redesigned the lightweight multiscale backbone, called NLCNet, which balances detection speed and accuracy. Second, for the strong scattering characteristics of the SAR target, we designed a new position-enhanced attention strategy, which suppresses background clutter by adding position information to the channel attention that highlights the target information to more accurately identify and locate the target. The experimental results for two large-scale SAR target detection datasets, SSDD and HRSID, show that our method achieves a higher detection accuracy and a faster detection speed than state-of-the-art SAR target detection methods.

SAR Target Recognition Using cGAN-Based SAR-to-Optical Image Translation

Target recognition in synthetic aperture radar (SAR) imagery suffers from speckle noise and geometric distortion brought by the range-based coherent imaging mechanism. A new SAR target recognition system is proposed, using a SAR-to-optical translation network as pre-processing to enhance both automatic and manual target recognition. In the system, SAR images of targets are translated into optical by a modified conditional generative adversarial network (cGAN) whose generator with a symmetric architecture and inhomogeneous convolution kernels is designed to reduce the background clutter and edge blur of the output. After the translation, a typical convolutional neural network (CNN) classifier is exploited to recognize the target types in translated optical images automatically. For training and testing the system, a new multi-view SAR-optical dataset of aircraft targets is created. Evaluations of the translation results based on human vision and image quality assessment (IQA) methods verify the improvement of image interpretability and quality, and translated images obtain higher average accuracy than original SAR data in manual and CNN classification experiments. The good expansibility and robustness of the system shown in extending experiments indicate the promising potential for practical applications of SAR target recognition.

Dense capsule network for SAR automatic target recognition with limited data

ABSTRACT Automatic target recognition for Synthetic Aperture Radar (SAR) images is a very challengeable problem due to the lack of enough training examples. Currently, there are two options for a network to learn on small SAR data sets: to increase the depth and width or to use the Capsule Network (CapsNet). To take advantage of both options, this paper proposes a Dense CapsNet for SAR target recognition. The contributions are mainly twofold. First, we replace the original convolutional layers with dense blocks in order to increase the depth of the network. Second, we substitute deconvolutional layers for fully connected layers to build the reconstruction network, which is beneficial for improving training efficiency. The experimental results on the MSTAR data set demonstrate that our Dense CapsNet outperforms other state-of-the-art methods upon limited data.

CRTransSar: A Visual Transformer Based on Contextual Joint Representation Learning for SAR Ship Detection

Synthetic-aperture radar (SAR) image target detection is widely used in military, civilian and other fields. However, existing detection methods have low accuracy due to the limitations presented by the strong scattering of SAR image targets, unclear edge contour information, multiple scales, strong sparseness, background interference, and other characteristics. In response, for SAR target detection tasks, this paper combines the global contextual information perception of transformers and the local feature representation capabilities of convolutional neural networks (CNNs) to innovatively propose a visual transformer framework based on contextual joint-representation learning, referred to as CRTransSar. First, this paper introduces the latest Swin Transformer as the basic architecture. Next, it introduces the CNN’s local information capture and presents the design of a backbone, called CRbackbone, based on contextual joint representation learning, to extract richer contextual feature information while strengthening SAR target feature attributes. Furthermore, the design of a new cross-resolution attention-enhancement neck, called CAENeck, is presented to enhance the characterizability of multiscale SAR targets. The mAP of our method on the SSDD dataset attains 97.0% accuracy, reaching state-of-the-art levels. In addition, based on the HISEA-1 commercial SAR satellite, which has been launched into orbit and in whose development our research group participated, we released a larger-scale SAR multiclass target detection dataset, called SMCDD, which verifies the effectiveness of our method.

Multi-Scale Ship Detection Algorithm Based on a Lightweight Neural Network for Spaceborne SAR Images

The current limited spaceborne hardware resources and the diversity of ship target scales in SAR images have led to the requirement of on-orbit real-time detection of ship targets in spaceborne synthetic aperture radar (SAR) images. In this paper, we propose a lightweight ship detection network based on the YOLOv4-LITE model. In order to facilitate the network migration to the satellite, the method uses MobileNetv2 as the backbone feature extraction network of the model. To solve the problem of ship target scale diversity in SAR images, an improved receptive field block (RFB) structure is introduced, enhancing the feature extraction ability of the network, and improving the accuracy of multi-scale ship target detection. A sliding window block method is designed to detect the whole SAR image, which can solve the problem of image input. Experiments on the SAR ship dataset SSDD show that the detection speed of the improved lightweight network could reach up to 47.16 FPS, with the mean average precision (mAP) of 95.03%, and the model size is only 49.34 M, which demonstrates that the proposed network can accurately and quickly detect ship targets. The proposed network model can provide a reference for constructing a spaceborne real-time lightweight ship detection network, which can balance the detection accuracy and speed of the network.

Deep knowledge integration of heterogeneous features for domain adaptive SAR target recognition

How to integrate various heterogeneous features for better recognition performance is increasingly critical for automatic target recognition. Existing integration methods present the following drawbacks: (1) most feature integration methods ignore the information, both common and discriminate knowledge, among different types of features; (2) most decision integration methods ignore the fact that different knowledge contributes differently; (3) the feature weights of integration model learned in the source domain cannot perform well in the target domain. To tackle these problems, we propose a deep Knowledge Integration framework by combining heterogeneous features for Domain Adaptive synthetic aperture radar (SAR) target recognition (KIDA). In the training phase, we implement deep knowledge integration at both feature and decision levels. At the feature level, to exploit the common and discriminative knowledge, multiple heterogeneous features are projected from the feature space into a unified label space by exploring the shared and specific structures simultaneously. The shared structure integrates common information in different features, while the specific structure reserves discriminative information of each type of feature. At the decision level, to reveal the relative importance of different knowledge, a decision integration strategy with feature weights is adopted in the label space. In the online testing phase, to improve the generalization of the model in dynamical environments, we employ online learning with sequential target domain knowledge to update the feature weights, thus achieving domain adaptation. Extensive experiments on different datasets validate the effectiveness and advantages of the proposed KIDA, especially in noisy environments.

Non-Cooperative SAR Automatic Target Recognition Based on Scattering Centers Models.

This article proposes an Automatic Target Recognition (ATR) algorithm to classify non-cooperative targets in Synthetic Aperture Radar (SAR) images. The scarcity or nonexistence of measured SAR data demands that classification algorithms rely only on synthetic data for training purposes. Based on a model represented by the set of scattering centers extracted from purely synthetic data, the proposed algorithm generates hypotheses for the set of scattering centers extracted from the target under test belonging to each class. A Goodness of Fit test is considered to verify each hypothesis, where the Likelihood Ratio Test is modified by a scattering center-weighting function common to both the model and target. Some algorithm variations are assessed for scattering center extraction and hypothesis generation and verification. The proposed solution is the first model-based classification algorithm to address the recently released Synthetic and Measured Paired Labeled Experiment (SAMPLE) dataset on a synthetic training data basis. As a result, an accuracy of in a 10-target test within a class experiment under Standard Operating Conditions (SOCs) was obtained. The algorithm was also pioneered in testing the SAMPLE dataset in Extend Operating Conditions (EOCs), assuming noise contamination and different target configurations. The proposed algorithm was shown to be robust for SNRs greater than dB.

SAR Target Incremental Recognition Based on Hybrid Loss Function and Class-Bias Correction

The Synthetic Aperture Radar (SAR) target recognition model usually needs to be retrained with all the samples when there are new-coming samples of new targets. Incremental learning emerges to continuously obtain new knowledge from new data while preserving most previously learned knowledge, saving both time and storage. There are still three problems in the existing incremental learning methods: (1) the recognition performance of old target classes degrades significantly during the incremental process; (2) the target classes are easily confused when similar target classes increase; (3) the model is inclined to new target classes due to class imbalance. Regarding the three problems, firstly, the old sample preservation and knowledge distillation were introduced to preserve both old representative knowledge and knowledge structure. Secondly, a class separation loss function was designed to reduce the intra-class distance and increase the inter-class distance, effectively avoiding the confusion between old and new classes. Thirdly, a bias correction layer and a linear model was designed, which enabled the model to treat the old and new target classes more fairly and eliminate the bias. The experimental results on the MSTAR dataset verified the superior performance compared with the other incremental learning methods.

Multi-Class Dual- Stream Convolutional Neural Network for Synthetic Aperture Radar Automatic Target Recognition of Ground Military Vehicle

Synthetic Aperture Radar (SAR) target classification is one of the largest branches of SAR image analysis. Despite the remarkable achievements of deep learning-based SAR target prediction algorithms, current object recognition algorithms are limited in terms of military applications. Acquisition and labeling of SAR target images are time-consuming and cumbersome. Obtaining adequate training data is also challenging in many cases. Deep learning-based models are always susceptible to overfitting because of insufficient training data. This limitation prevents them from being widely used to classify SAR targets. To overcome the problem of insufficient sampling and to learn more accurate representations for SAR image recognition, we propose a two way input of SAR images into a dual stream of DCNN. Concatenating two input SAR images representations was done using the restricted raw SAR data in order to extract the integral features from the 2 input SAR images representations for classification. The proposed methodology addressed the problem of insufficient sample in SAR target classification and improved classification accuracy without overfitting. Experimental results confirmed that the proposed method is effective in addressing the problem of insufficient sample in SAR target classification. This technique can be integrated into any SAR classification model based on convolutional neural networks (CNNs). The model MCDS-CNN results in a 99.1% recognition accuracy. Despite the limited availability of SAR image data from MSTAR, this approach provides good recognition results.

SAR Target Classification Using the Multikernel-Size Feature Fusion-Based Convolutional Neural Network

It is well-known that the convolutional neural network (CNN) is an effective method for synthetic aperture radar (SAR) target classification. In the convolutional layer of CNN, convolutional kernels of different sizes can extract different feature information of the target. The small-size kernel can extract the local texture feature information, and the large-size kernel can extract the global contour feature information. Traditional CNN methods usually use fixed-size kernels for convolution, and they generally lose part of the target’s feature information, resulting in the inaccurate classification of the SAR targets. This article proposes a novel CNN model based on multikernel-size feature fusion (MKSFF-CNN) for SAR target classification. MKSFF-CNN designs a convolutional methodology with a multichannel parallel topology, it uses convolutional kernels of different sizes to extract the multikernel-size deep features of the SAR target, and then, these features are fused in an optimal way to acquire the lowest loss. Moreover, MKSFF-CNN concatenates the fused features extracted by the convolutional layers of different dimensions to achieve the finest classification. MKSFF-CNN greatly elevates the feature representation completeness of the SAR targets so that more useful feature information can be exploited for SAR target classification. Undoubtedly, MKSFF-CNN can achieve a better classification performance compared with traditional CNN models with a fixed kernel size. The superiority of MKSFF-CNN is validated on the moving and stationary target acquisition and recognition (MSTAR) dataset with the detailed objective and subjective evaluation.

SAR Target Classification Based on Multiscale Attention Super-Class Network

The convolutional neural network (CNN) is widely used in synthetic aperture radar (SAR) target recognition, but conventional CNN mainly adopts a single-scale convolutional kernel, resulting in losing part of the feature information of targets and does not pay enough attention to significant features. On the other hand, conventional CNN approaches only assign fine-class labels to SAR targets, ignoring the high-level semantics information of similar categories, which reduces the feature differences between categories and the generalization ability of the model. Therefore, this paper proposes a multi-scale attention super-class CNN (MSA-SCNN) for SAR target classification. Firstly, MSA-SCNN combines multi-scale feature fusion with the attention module to improve the integrity of SAR target feature representation. The attention module includes channel and spatial attention modules, which realize the weighted enhancement of different scale features. Additionally, MSA-SCNN introduces super-class labels to increase the feature difference between categories. The classification stage consists of a fine-class branch and a super-class branch, and the features trained on the super-class branch are fused to the fine-class branch to improve the network's fine classification ability. Experiments on the moving and stationary target acquisition and recognition (MSTAR) dataset and the FUSAR-Ship dataset show that the proposed MSA-SCNN outperforms many current existing state-of-the-art methods.

An SAR Target Detector Based on Gradient Harmonized Mechanism and Attention Mechanism

In this letter, a target detector based on gradient harmonized mechanism (GHM) and attention mechanism is proposed to realize synthetic aperture radar (SAR) target detection in complex scenes. Considering the imbalance of positive and negative examples in SAR target detection, we use RefineDet as our backbone network. RefineDet can mitigate this imbalance problem by introducing the idea of two-step classification and regression into the one-stage detector. However, RefineDet only selects a part of examples for training and does not make full use of the information of all examples. Therefore, we apply GHM to the classification loss function of RefineDet, so that the network can make full use of all examples and increase the weights of hard examples adaptively in the loss function to reduce the false alarms and the missing alarms. In addition, to achieve a better detection performance in SAR images with complex scenes, a multiscale feature attention module (MFAM) is embedded into the network. By applying channel and spatial attention mechanisms to the multiscale feature maps, the MFAM can highlight the significant information and suppress the interference caused by clutter. The extensive experimental results based on the measured SAR dataset verify the effectiveness of the proposed method.

AFSar: An Anchor-Free SAR Target Detection Algorithm Based on Multiscale Enhancement Representation Learning

Unlike optical images, synthetic aperture radar (SAR) images have unique characteristics, such as few samples, strong scattering, sparseness, multiple scales, complex interference and background, and inconspicuous target edge contour information. Current SAR target detection algorithms have difficulty in balancing accuracy and speed, and the performance of these algorithms is relatively limited, thus making it difficult to deploy practical applications. To this end, this article proposes AFSar, an innovative anchor-free SAR target detection algorithm based on multiscale enhancement representation learning. First, we introduce the latest anchor-free architecture YOLOX as the basic framework. Second, to reduce the computational complexity of the model and to improve the ability of multiscale feature extraction, we redesigned the lightweight backbone, namely, MobileNetV2S. Furthermore, we propose an attention enhancement PAN module, called CSEMPAN, which highlights the unique strong scattering characteristics of SAR targets by integrating channel and spatial attention mechanisms. Finally, in view of the multiscale and strong sparse characteristics of SAR targets, we propose a new target detection head, namely, ESPHead. ESPHead extracts the features of targets with different scales by using dilated convolution with different dilated rates, so as to enhance the detection ability of the model for targets with different scales. The results of ablation experiments on the SSDD dataset show that the mAP of our algorithm reaches 0.977, while the Flops is only 9.86 G, achieving state of the art.

Large-Difference-Scale Target Detection Using a Revised Bhattacharyya Distance in SAR Images

Small target detection is a very challenging problem since a small target contains only a few pixels in size. At present, many deep learning-based detection algorithms for small targets have achieved remarkable results, mainly including improvements in data augmentation, multiscale images, multiscale features, training strategies, and so on. However, these deep learning-based methods cannot select the positive and negative samples for the large-difference-scale targets well in the label assignment operation. The reason is that intersection over union (IoU), which is widely used in the most target detection networks, has great limitations for small target detection. However, in practical applications, there are often some large-difference-scale targets in synthetic aperture radar (SAR) images, especially existing some tiny targets due to the limitation of resolution. To fundamentally break the limitations of IoU, we propose to use the Bhattacharyya distance (BD) instead of the IoU metric to improve the performance of small target detection. We further revise the Bhattacharyya distance (RBD) to better measure the deviation of bounding boxes for targets with large differences in size. RBD can embed anchor-based detectors to replace the IoU metric in label assignment and nonmaximum suppression (NMS). The proposed method is evaluated on the LS-SSDD-v1.0 dataset and the experimental results show that the proposed method outperforms the state-of-the-art methods.