Automatic Target Recognition Method Research Articles

Automated Recognition of Submerged Body-like Objects in Sonar Images Using Convolutional Neural Networks

The Police Robot for Inspection and Mapping of Underwater Evidence (PRIME) is an uncrewed surface vehicle (USV) currently being developed for underwater search and recovery teams to assist in crime scene investigation. The USV maps underwater scenes using sidescan sonar (SSS). Test exercises use a clothed mannequin lying on the seafloor as a target object to evaluate system performance. A robust, automated method for detecting human body-shaped objects is required to maximise operational functionality. The use of a convolutional neural network (CNN) for automatic target recognition (ATR) is proposed. SSS image data acquired from four different locations during previous missions were used to build a dataset consisting of two classes, i.e., a binary classification problem. The target object class consisted of 166 196 × 196 pixel image snippets of the underwater mannequin, whereas the non-target class consisted of 13,054 examples. Due to the large class imbalance in the dataset, CNN models were trained with six different imbalance ratios. Two different pre-trained models (ResNet-50 and Xception) were compared, and trained via transfer learning. This paper presents results from the CNNs and details the training methods used. Larger datasets are shown to improve CNN performance despite class imbalance, achieving average F1 scores of 97% in image classification. Average F1 scores for target vs background classification with unseen data are only 47% but the end result is enhanced by combining multiple weak classification results in an ensemble average. The combined output, represented as a georeferenced heatmap, accurately indicates the target object location with a high detection confidence and one false positive of low confidence. The CNN approach shows improved object detection performance when compared to the currently used ATR method.

Enhanced Prototypical Network with Customized Region-Aware Convolution for Few-Shot SAR ATR

With the prosperous development and successful application of deep learning technologies in the field of remote sensing, numerous deep-learning-based methods have emerged for synthetic aperture radar (SAR) automatic target recognition (ATR) tasks over the past few years. Generally, most deep-learning-based methods can achieve outstanding recognition performance on the condition that an abundance of labeled samples are available to train the model. However, in real application scenarios, it is difficult and costly to acquire and to annotate abundant SAR images due to the imaging mechanism of SAR, which poses a big challenge to existing SAR ATR methods. Therefore, SAR target recognition in the situation of few-shot, where only a scarce few labeled samples are available, is a fundamental problem that needs to be solved. In this paper, a new method named enhanced prototypical network with customized region-aware convolution (CRCEPN) is put forward to specially tackle the few-shot SAR ATR tasks. To be specific, a feature-extraction network based on a customized and region-aware convolution is first developed. This network can adaptively adjust convolutional kernels and their receptive fields according to each SAR image’s own characteristics as well as the semantical similarity among spatial regions, thus augmenting its capability to extract more informative and discriminative features. To achieve accurate and robust target identity prediction under the few-shot condition, an enhanced prototypical network is proposed. This network can improve the representation ability of the class prototype by properly making use of training and test samples together, thus effectively raising the classification accuracy. Meanwhile, a new hybrid loss is designed to learn a feature space with both inter-class separability and intra-class tightness as much as possible, which can further upgrade the recognition performance of the proposed method. Experiments performed on the moving and stationary target acquisition and recognition (MSTAR) dataset, the OpenSARShip dataset, and the SAMPLE+ dataset demonstrate that the proposed method is competitive with some state-of-the-art methods for few-shot SAR ATR tasks.

A Feasibility Analysis of the Use of ISAR Training Data in Machine Learning-Based SAR ATR

Processing of synthetic aperture radar (SAR) images for automatic target recognition (ATR) is a critical application especially in military surveillance. In particular, numerous machine learning-based SAR ATR methods have been proposed for this task. However, data training and testing stages of all these methods are based on the exploitation of SAR signatures of the target under investigation. Considering the high variability of radar targets, obtaining such signature data is obviously a costly and time consuming process. In this study, therefore, a feasibility analysis of the use of inverse-SAR (ISAR) training data in SAR ATR has been made for the first time. The turntable ISAR and circular SAR images of three different vehicles are used in training and testing is performed by means of SAR images of three similar targets within the publicly available MSTAR dataset. Also, three most prominent machine learning methods, namely KNN, SVM and ANN are used in conjunction with three different feature extraction algorithms namely, GLRLM, GLSZM and GLCM. The obtained results reveal that the GLCM+SVM algorithm pair is the most effective model with 85% accuracy.

An SAR Image Automatic Target Recognition Method Based on the Scattering Parameter Gaussian Mixture Model

General synthetic aperture radar (SAR) image automatic target recognition (ATR) methods perform well under standard operation conditions (SOCs). However, they are not effective in extended operation conditions (EOCs). To improve the robustness of the ATR system under various EOCs, an ATR method for SAR images based on the scattering parameter Gaussian mixture model (GMM) is proposed in this paper. First, an improved active contour model (ACM) is used for target–background segmentation, which is more robust against noise than the constant false alarm rate (CFAR) method. Then, as the extracted attributed scattering center (ASC) is sensitive to noise and resolution, the GMM is constructed using the extracted ASC set. Next, the weighted Gaussian quadratic form distance (WGQFD) is adopted to measure the similarity of GMMs for the recognition task, thereby avoiding false alarms and missed alarms caused by the varying number of scattering centers. Moreover, adaptive aspect–frame division is employed to reduce the number of templates and improve recognition efficiency. Finally, based on the public measured MSTAR dataset, different EOCs are constructed under noise, resolution change, model change, depression angle change, and occlusion of different proportions. The experimental results under different EOCs demonstrate that the proposed method exhibits excellent robustness while maintaining low computation time.

A Comprehensive Survey on SAR ATR in Deep-Learning Era

Due to the advantages of Synthetic Aperture Radar (SAR), the study of Automatic Target Recognition (ATR) has become a hot topic. Deep learning, especially in the case of a Convolutional Neural Network (CNN), works in an end-to-end way and has powerful feature-extracting abilities. Thus, researchers in SAR ATR also seek solutions from deep learning. We review the related algorithms with regard to SAR ATR in this paper. We firstly introduce the commonly used datasets and the evaluation metrics. Then, we introduce the algorithms before deep learning. They are template-matching-, machine-learning- and model-based methods. After that, we introduce mainly the SAR ATR methods in the deep-learning era (after 2017); those methods are the core of the paper. The non-CNNs and CNNs, that is, those used in SAR ATR, are summarized at the beginning. We found that researchers tend to design specialized CNN for SAR ATR. Then, the methods to solve the problem raised by limited samples are reviewed. They are data augmentation, Generative Adversarial Networks (GAN), electromagnetic simulation, transfer learning, few-shot learning, semi-supervised learning, metric leaning and domain knowledge. After that, the imbalance problem, real-time recognition, polarimetric SAR, complex data and adversarial attack are also reviewed. The principles and problems of them are also introduced. Finally, the future directions are conducted. In this part, we point out that the dataset, CNN architecture designing, knowledge-driven, real-time recognition, explainable and adversarial attack should be considered in the future. This paper gives readers a quick overview of the current state of the field.

Research on Automatic Recognition Method of Artificial Ground Target Based on Improved HED

Automatic target recognition technology is an important research direction in the field of machine vision. Artificial ground targets, such as bridges, airports and houses, are mostly composed of straight lines. The ratio of geometric primitive lines to the triangle area formed by their combination is used as the feature quantity to describe the group of lines, so as to characterize the artificial ground target. In view of the shortcomings of traditional edge detection methods, such as background suppression, non-prominent targets, missing positions, etc., this paper proposed an image edge detection method based on depth learning. By combining the traditional edge detection algorithm with the edge detection algorithm based on an improved HED network, the real-time target image edge detection was completed. An automatic target recognition method based on template matching was proposed. This method solved the problem of both homologous template matching and heterogeneous template matching, which has important theoretical value. First, the lines were combined to form the geometric primitives of the line group, and then the relationship of the lines in the group was determined by using the characteristic quantity of the line group. The best line group matching the target template was found in the image edge, and the homonymous points in the real-time image and the target template were calculated. The affine transformation matrix between the two images was obtained according to the homonymous points, and then the accurate position of the target in the real-time image was found.

Transductive Prototypical Attention Reasoning Network for Few-Shot SAR Target Recognition

Deep learning-based synthetic aperture radar (SAR) automatic target recognition (ATR) algorithms have achieved outstanding performance under the condition of hundreds or thousands of training samples in recent years. Nevertheless, it is often rare to acquire great quantities of target samples in real SAR application scenarios. This article proposes a novel ATR method called transductive prototypical attention reasoning network (TPARN) to solve the problem of SAR target recognition with only a few training samples. To be specific, a region awareness-based feature extraction model is first developed, which can effectively focus on the target region of interest and suppress the background clutter by embedding direction-aware and position-sensitive information to extract more transferable knowledge. To heighten the discrimination of the sample features, a cross-feature spatial attention module is then proposed following the feature embedding model. Finally, a transductive prototype reasoning method is presented to realize the identity reasoning of the target, which can continuously update each class prototype with training samples and test samples together, thereby improving the classification accuracy. In addition, a marginal adaptive hybrid loss is proposed to obtain a discriminative feature embedding space with intra-class compactness and inter-class divergence, aiming to facilitate subsequent target identity reasoning. Extensive experiments on the moving and stationary target acquisition and recognition (MSTAR) benchmark dataset reveal that the proposed method outperforms some state-of-the-arts under different few-shot SAR ATR tasks.

Few-Shot Class-Incremental SAR Target Recognition Based on Hierarchical Embedding and Incremental Evolutionary Network

It is difficult to realize effective synthetic aperture radar (SAR) automatic target recognition (ATR) in open scenarios because the ATR model cannot continuously learn from new classes with limited training samples. When adding new classes to the previously trained model, the capability of recognizing old classes may lose due to severe overfitting. To tackle this problem, a few-shot class-incremental SAR ATR method, namely hierarchical embedding and incremental evolutionary network (HEIEN), is proposed in this paper. Firstly, a hierarchical embedding network and a hybrid distance-based classifier is constructed for basic feature extraction and classification. Then, in order to obtain more accurate decision boundaries, an adaptive class-incremental learning module is designed to adjust the weights of classifiers in all tasks by collecting context information from the past to the present. Finally, a pseudo incremental training strategy is designed to enable effective model training with only a few samples. Experimental results on the MSTAR benchmark data set have illustrated that HEIEN performs well with remarkable advantages in few-shot class-incremental SAR ATR tasks.

Multilevel Adaptive Knowledge Distillation Network for Incremental SAR Target Recognition

The existing synthetic aperture radar (SAR) automatic target recognition (ATR) methods have shown impressive results in static scenarios, yet the performance drops sharply as new categories of targets are continuously increased. In response to this problem, this letter proposes a novel ATR method named multi-level adaptive knowledge distillation network (MLAKDN) to achieve incremental SAR target recognition. To be specific, an adaptive weighted distillation strategy is first proposed, which can alleviate the model from forgetting the knowledge of old categories by distilling multi-stage soft label information of old categories at the classification level. Then, a feature distillation method based on gradient maximum criterion is developed to filter and distill discriminative features, so as to further recall more knowledge of old categories at the feature level. Meanwhile, a model rebalancing technique is designed to effectively strike the balance of the model on new categories and old categories. Finally, a weighted incremental classification loss is presented to train the whole model. Experiments on the moving and stationary target acquisition and recognition (MSTAR) dataset and the synthetic and measured paired labeled experiment (SAMPLE) dataset illustrate that the proposed method is superior to some state-of-the-arts for incremental SAR target recognition tasks.

A Novel SAR Automatic Target Recognition Method Based on Fully Complex-Valued Networks

A Novel SAR Automatic Target Recognition Method Based on Fully Complex-Valued Networks

Synthetic Aperture Radar Target Recognition Based on Multimodule Image Enhancement Network

Synthetic aperture radar (SAR) has been widely used in recent years, and SAR automatic target recognition (ATR) has become a research hotspot. Most of the existing SAR ATR methods focus on the network structure design and increasing data volume but omit image quality and real-time processing. We design a multimodule image enhancement network (MMIE-Net) to solve these problems, which include the target extraction module, the image processing module, and convolutional neural networks (CNNs). First, we use the target extraction module and the image processing module to enhance the quality of raw SAR images. Then we design a suitable network for SAR image recognition, which is simple, lightweight, and recognizable. The experiment was mainly carried out on the MSTAR dataset, which can be divided into two categories, Standard Operating Condition (SOC) and Extended Operating Condition (EOC). The identification accuracy, the parameter storage space, and the depth of the model are considered as the criterion. The experimental results show that, compared with other methods, the proposed method not only ensures the simple structure of the network model but also has better recognition accuracy. Additionally, our method is robust and stable to large depression angle variation as well.

Automatic Target Recognition Based on RCS and Angular Diversity for Multistatic Passive Radar

Asan important means in low-altitude airspace surveillance, passive radar has been widely studied. With the increasing complexity of the low-altitude environment, the urgent need for radar's capability of automatic target recognition (ATR) emerges. In the field of ATR for passive radar, the method based on radar cross section (RCS) is an important direction for the simplicity of feature extraction. In this article, we exploit the compensated quasi-echo-power (CQEP), i.e., quasi-RCS, to realize ATR in passive radar. We propose an ATR method on the basis of the angular diversity. First, we divide the angular space, which consists of four components of the incident angle and scattering angle of electromagnetic wave, into multiple subspaces. Then, we build a subrecognizer in each angular subspace according to the CQEP distribution characteristics. Each receiving station of the multistatic passive radar recognizes targets in an angular subspace corresponding to its observation and outputs a preliminary decision. Based on the preliminary decisions of all receiving stations, a voting strategy is adopted to make the final decision on the unknown target class in the fusion center. Experimental results based on real-life target data show that the proposed method has a significant improvement on the average correct recognition rate with fusion of three receiving stations, which validates the proposed method.

Semi-Supervised SAR ATR Framework with Transductive Auxiliary Segmentation

Convolutional neural networks (CNNs) have achieved high performance in synthetic aperture radar (SAR) automatic target recognition (ATR). However, the performance of CNNs depends heavily on a large amount of training data. The insufficiency of labeled training SAR images limits the recognition performance and even invalidates some ATR methods. Furthermore, under few labeled training data, many existing CNNs are even ineffective. To address these challenges, we propose a Semi-supervised SAR ATR Framework with transductive Auxiliary Segmentation (SFAS). The proposed framework focuses on exploiting the transductive generalization on available unlabeled samples with an auxiliary loss serving as a regularizer. Through auxiliary segmentation of unlabeled SAR samples and information residue loss (IRL) in training, the framework can employ the proposed training loop process and gradually exploit the information compilation of recognition and segmentation to construct a helpful inductive bias and achieve high performance. Experiments conducted on the MSTAR dataset have shown the effectiveness of our proposed SFAS for few-shot learning. The recognition performance of 94.18% can be achieved under 20 training samples in each class with simultaneous accurate segmentation results. Facing variances of EOCs, the recognition ratios are higher than 88.00% when 10 training samples each class.

초해상화 기반 CNN을 이용한 군사용 SAR 자동표적인식 모델 연구

Herein, we propose employing the super-resolution-based convolutional neural network (CNN) to design the automatic target recognition (ATR) of military synthetic aperture radar (SAR) images. Previous SAR ATR methods showed a good recognition performance with a low depression angle, but poor performance with a high depression angle. In a warfighting environment, good recognition performance is required even with a high depression angle. To address this issue, we combine the super-resolution method and the CNN. In comparison with the conventional VGGnet with a high depression angle, the proposed super-resolution-based CNN showed a 3%-4% improvement in accuracy. The MSTAR SAR dataset was utilized for validation.

Recognition in Label and Discrimination in Feature: A Hierarchically Designed Lightweight Method for Limited Data in SAR ATR

Synthetic aperture radar (SAR) automatic target recognition (ATR) is an essential field in SAR application. However, a sufficient number of labeled training SAR images for each target type plays a crucial role in existing SAR ATR methods, while the acquisition and annotation of SAR images are difficult and time-consuming in practice. Therefore, the recognition under the limited labeled training SAR images is the basic and crucial problem in SAR application. In this paper, we propose a novel hierarchically-designed lightweight method (HDLM) by recognition in label and discrimination in feature to address the problem of limited data in SAR ATR. The proposed method is hierarchically designed from top to bottom. In the top phase, the framework is constructed by dual loss to force the deep model to optimize by label recognition and feature discrimination, which is noted as recognition in label and discrimination in feature. In the middle phase, the architecture of the network is built up using a novel lightweight extractor and multi-level cross fusion to boost the amount and diversity of the features for the framework. In the bottom phase, two modules, coordinate attention, and depth-wise separable convolution modules are employed to enhance the feature quality and density with fewer parameters for the phases above. The experimental results on MSTAR and OpenSARship showed that the proposed HDLM performs better than the existing methods under the limited training samples.

Adversarial Deception Against SAR Target Recognition Network

Synthetic Aperture Radar (SAR) automatic target recognition (ATR) technology is one of the key technologies to achieve intelligent interpretation for SAR images. With the rapid development of deep learning, deep neural networks have been successively used in SAR ATR and show priority in comparison with the conventional methods. Recently, more and more attention is paid to the robustness of deep learning based SAR ATR methods. The reason is that maliciously modified and imperceptible adversarial images can deceive the SAR ATR methods which are based on the deep neural networks. In this paper, we propose a novel SAR ATR adversarial deception algorithm, which fully considers the characteristics of SAR data. Our method can obtain the satisfactory perturbations with a higher deception success rate, a higher recognition confidence, and a smaller perturbation coverage than other state-of-the- art methods for the SAR images. Experimental results using the MSTAR dataset and OpenSARShip dataset demonstrate the effectiveness of our method. The proposed adversarial deception method can be used in the applications such as SAR dataset protection, SAR sensor design and SAR image quality evaluation.

A Novel SAR Target Recognition Method Combining Electromagnetic Scattering Information and GCN

The existing deep learning studies on synthetic aperture radar (SAR) automatic target recognition (ATR) mainly focus on the utilization of the amplitude of SAR image via convolutional neural network (CNN), while the electromagnetic scattering information is rarely considered. Given that scattering centers (SCs) can characterize the target’s electromagnetic scattering characteristics and describe the target’s physical structure information, the SC feature should be helpful for SAR ATR. Therefore, we propose a novel SAR ATR method that combines electromagnetic scattering information and graph convolutional network (GCN) effectively and directly. Specifically, we model each extracted SC as a node to convert the SCs into graph data. The constructed graph is learned via GCN to describe the target’s physical structure information, where the features of different GCN layers are fused to avoid the over-smoothing of GCN. Label smoothing is combined with GCN for the first time to alleviate the overfitting caused by the limited training data. To the best of our knowledge, this study is the first to introduce the GCN for effectively utilizing the SCs, proving that the structural characteristics of the SCs of SAR targets are remarkably beneficial for recognition. Extensive experimental results on the measured moving and stationary target acquisition and recognition (MSTAR) dataset show that our method can obtain superior recognition performance compared with the existing methods.

SAR Automatic Target Recognition Method Based on Multi-Stream Complex-Valued Networks

In synthetic aperture radar automatic target recognition (SAR-ATR), target information is usually propagated and reserved in complex-valued form, namely magnitude information and phase information. However, most of the existing SAR target recognition methods only focus on real-valued (magnitude information) calculations and ignore the phase information of targets, yielding poor recognition performance. To overcome this limitation, this paper proposes a multi-stream feature fusion SAR target recognition method based on complex-valued operations, called MS-CVNets, to utilize the phase information of the target effectively. First of all, a series of complex-valued operation blocks are constructed to satisfy the network training in the complex field, such as complex convolution, complex batch normalization, complex activation, complex pooling, complex full connection, etc. Besides, a multi-stream structure is employed by applying different convolution kernels to extract multi-scale information of targets, further enhancing the representation ability of the model. Experimental results on the MSTAR dataset illustrate that, compared with current state-of-the-art real-valued based models, MS-CVNets can achieve better recognition results under both standard operating conditions (SOC) and extended operating conditions (EOC), validating the effectiveness and superiority of the proposed method.

A Convolutional Neural Network Combined with Attributed Scattering Centers for SAR ATR

It is very common to apply convolutional neural networks (CNNs) to synthetic aperture radar (SAR) automatic target recognition (ATR). However, most of the SAR ATR methods using CNN mainly use the image features of SAR images and make little use of the unique electromagnetic scattering characteristics of SAR images. For SAR images, attributed scattering centers (ASCs) reflect the electromagnetic scattering characteristics and the local structures of the target, which are useful for SAR ATR. Therefore, we propose a network to comprehensively use the image features and the features related to ASCs for improving the performance of SAR ATR. There are two branches in the proposed network, one extracts the more discriminative image features from the input SAR image; the other extracts physically meaningful features from the ASC schematic map that reflects the local structure of the target corresponding to each ASC. Finally, the high-level features obtained by the two branches are fused to recognize the target. The experimental results on the Moving and Stationary Target Acquisition and Recognition (MSTAR) dataset prove the capability of the SAR ATR method proposed in this letter.

FEF-Net: A Deep Learning Approach to Multiview SAR Image Target Recognition

Synthetic aperture radar (SAR) is an advanced microwave imaging system of great importance. The recognition of real-world targets from SAR images, i.e., automatic target recognition (ATR), is an attractive but challenging issue. The majority of existing SAR ATR methods are designed for single-view SAR images. However, multiview SAR images contain more abundant classification information than single-view SAR images, which benefits automatic target classification and recognition. This paper proposes an end-to-end deep feature extraction and fusion network (FEF-Net) that can effectively exploit recognition information from multiview SAR images and can boost the target recognition performance. The proposed FEF-Net is based on a multiple-input network structure with some distinct and useful learning modules, such as deformable convolution and squeeze-and-excitation (SE). Multiview recognition information can be effectively extracted and fused with these modules. Therefore, excellent multiview SAR target recognition performance can be achieved by the proposed FEF-Net. The superiority of the proposed FEF-Net was validated based on experiments with the moving and stationary target acquisition and recognition (MSTAR) dataset.