Synthetic Aperture Radar Image Classification Research Articles

Optimizing synthetic aperture radar image classification and change detection: a proportional factor firefly algorithm and multilayer perceptron approach

Optimizing synthetic aperture radar image classification and change detection: a proportional factor firefly algorithm and multilayer perceptron approach

R-LRBPNet: A Lightweight SAR Image Oriented Ship Detection and Classification Method

Synthetic Aperture Radar (SAR) has the advantage of continuous observation throughout the day and in all weather conditions, and is used in a wide range of military and civil applications. Among these, the detection of ships at sea is an important research topic. Ships in SAR images are characterized by dense alignment, an arbitrary orientation and multiple scales. The existing detection algorithms are unable to solve these problems effectively. To address these issues, A YOLOV8-based oriented ship detection and classification method using SAR imaging with lightweight receptor field feature convolution, bottleneck transformers and a probabilistic intersection-over-union network (R-LRBPNet) is proposed in this paper. First, a CSP bottleneck with two bottleneck transformer (C2fBT) modules based on bottleneck transformers is proposed; this is an improved feature fusion module that integrates the global spatial features of bottleneck transformers and the rich channel features of C2f. This effectively reduces the negative impact of densely arranged scenarios. Second, we propose an angle decoupling module. This module uses probabilistic intersection-over-union (ProbIoU) and distribution focal loss (DFL) methods to compute the rotated intersection-over-union (RIoU), which effectively alleviates the problem of angle regression and the imbalance between angle regression and other regression tasks. Third, the lightweight receptive field feature convolution (LRFConv) is designed to replace the conventional convolution in the neck. This module can dynamically adjust the receptive field according to the target scale and calculate the feature pixel weights based on the input feature map. Through this module, the network can efficiently extract details and important information about ships to improve the classification performance of the ship. We conducted extensive experiments on the complex scene SAR dataset SRSDD and SSDD+. The experimental results show that R-LRBPNet has only 6.8 MB of model memory, which can achieve 78.2% detection accuracy, 64.2% recall, a 70.51 F1-Score and 71.85% mAP on the SRSDD dataset.

SAR image classification using deep features and neighborhood heterogeneity confidence refined spatial constraints

ABSTRACT Recently, frameworks fusing the convolutional neural network (CNN) and Markov random field (MRF) models have been successfully used in synthetic aperture radar (SAR) image classification. Over-smoothing of the details and the incapability to eliminate regional-level misclassification are two common drawbacks of these frameworks, which are caused by the use of conventional neighbourhood consistency based spatial constraints. To address these problems, a neighbourhood heterogeneity confidence – Markov random field (NHC-MRF) and CNN-based framework is proposed for SAR image classification. In this framework, an NHC index is constructed in the binary energy function of the NHC-MRF to refine the conventional spatial constraints by adaptively allowing the existence of heterogeneity in the neighbourhood. The NHC index consists of a label coexisting probability term and a top-2 label term, which are constructed based on the outputs of the CNN. By using the label coexisting probability term, the details can be protected by allowing heterogeneity, and the regional-level misclassification can be eliminated by adjusting the impact of the neighbourhoods by using label coexisting probability based weighting. The top-2 label term is used as a correction of the coexisting probability term considering the disturbance of speckle noise. The NHC-MRF is further fused with a CNN by constructing the unary energy term and initial labels based on the outputs of the CNN. The effectiveness and superiority of the proposed framework are experimentally demonstrated using three SAR datasets. The experimental results demonstrate that the superiority of the NHC-MRF is derived from the simultaneous realization of retaining details and eliminating regional-level misclassification.

Fusion of sentinel-1 SAR and sentinel-2 MSI data for accurate Urban land use-land cover classification in Gondar City, Ethiopia

Effective urban planning and management rely on accurate land cover mapping, which can be achieved through the combination of remote sensing data and machine learning algorithms. This study aimed to explore and demonstrate the potential benefits of integrating Sentinel-1 SAR and Sentinel-2 MSI satellite imagery for urban land cover classification in Gondar city, Ethiopia. Synthetic Aperture Radar (SAR) data from Sentinel-1A and Multispectral Instrument (MSI) data from Sentinel-2B for the year 2023 were utilized for this research work. Support Vector Machine (SVM) and Random Forest (RF) machine learning algorithms were utilized for the classification process. Google Earth Engine (GEE) was used for the processing, classification, and validation of the remote sensing data. The findings of the research provided valuable insights into the performance evaluation of the Support Vector Machine (SVM) and Random Forest (RF) algorithms for image classification using different datasets, namely Sentinel 2B Multispectral Instrument (MSI) and Sentinel 1A Synthetic Aperture Radar (SAR) data. When applied to the Sentinel 2B MSI dataset, both SVM and RF achieved an overall accuracy (OA) of 0.69, with a moderate level of agreement indicated by the Kappa score of 0.357. For the Sentinel 1A SAR data, SVM maintained the same OA of 0.69 but showed an improved Kappa score of 0.67, indicating its suitability for SAR image classification. In contrast, RF achieved a slightly lower OA of 0.66 with Sentinel 1A SAR data. However, when the datasets of Sentinel 2B MSI and Sentinel 1A SAR were combined, SVM achieved an impressive OA of 0.91 with a high Kappa score of 0.80, while RF achieved an OA of 0.81 with a Kappa score of 0.809. These findings highlight the potential of fusing satellite data from multiple sources to enhance the accuracy and effectiveness of image classification algorithms, making them valuable tools for various applications, including land use mapping and environmental monitoring.

Polarimetric Synthetic Aperture Radar Image Classification Based on Double-Channel Convolution Network and Edge-Preserving Markov Random Field

Deep learning methods have gained significant popularity in the field of polarimetric synthetic aperture radar (PolSAR) image classification. These methods aim to extract high-level semantic features from the original PolSAR data to learn the polarimetric information. However, using only original data, these methods cannot learn multiple scattering features and complex structures for extremely heterogeneous terrain objects. In addition, deep learning methods always cause edge confusion due to the high-level features. To overcome these limitations, we propose a novel approach that combines a new double-channel convolutional neural network (CNN) with an edge-preserving Markov random field (MRF) model for PolSAR image classification, abbreviated to “DCCNN-MRF”. Firstly, a double-channel convolution network (DCCNN) is developed to combine complex matrix data and multiple scattering features. The DCCNN consists of two subnetworks: a Wishart-based complex matrix network and a multi-feature network. The Wishart-based complex matrix network focuses on learning the statistical characteristics and channel correlation, and the multi-feature network is designed to learn high-level semantic features well. Then, a unified network framework is designed to fuse two kinds of weighted features in order to enhance advantageous features and reduce redundant ones. Finally, an edge-preserving MRF model is integrated with the DCCNN network. In the MRF model, a sketch map-based edge energy function is designed by defining an adaptive weighted neighborhood for edge pixels. Experiments were conducted on four real PolSAR datasets with different sensors and bands. The experimental results demonstrate the effectiveness of the proposed DCCNN-MRF method.

Object-oriented polarimetric SAR image classification via the combination of a pixel-based classifier and a region growing technique

ABSTRACT Land-cover type interpretation by the use of remote sensing image classification techniques is always a hot topic. In this paper, an object-oriented method is presented for fully polarimetric synthetic aperture radar (SAR) image classification. Differing from most of the traditional object-oriented classification algorithms, the proposed method employs an innovative classification strategy that combines a pixel-based classifier and a region growing technique. Firstly, taking each individual pixel as a seed pixel, the homogeneous areas are extracted by a region growing technique. Then, using the information of the pixel-based classification result, the pixels located in each homogeneous area are all assigned to a certain class. Finally, the majority voting strategy is deployed to determine the final class label of each pixel. The experiments conducted on two fully polarimetric SAR images reveal that the proposed classification scheme can obtain pleasing classification accuracy and can provide the classification maps with more homogeneous regions than pixel-based classification.

Knowledge transfer evolutionary search for lightweight neural architecture with dynamic inference

Relying on the availability of massive labeled samples, most neural architecture search (NAS) methods focus on searching large and complex models; and adopt fixed structures and parameters at the inference stage. Few approaches automatically design lightweight networks for label-limited tasks and further consider the inference differences between inputs. To address these issues, we introduce evolutionary computation (EC) and attention mechanism and propose a knowledge transfer evolutionary search for lightweight neural architecture with dynamic inference, then verify it using synthetic aperture radar (SAR) images. SAR image classification is a typical label-limited task due to the inherent imaging mechanism of SAR. We design the EC-based architecture search and attention-based dynamic inference for SAR image scene classification. Specifically, we build a SAR-tailored search space, explore topology pruning-based mutation operators to search lightweight architectures, and further design a dynamic Ridgelet convolution capable of adaptive reasoning to enhance the representation ability of searched lightweight networks. Moreover, we propose a knowledge transfer training strategy and hybrid evaluation criteria to ensure searching quickly and robustly. Experimental results show that the proposed method can search for superior neural architectures, thus improving the classification performance of SAR images.

A Multiscale Local–Global Feature Fusion Method for SAR Image Classification with Bayesian Hyperparameter Optimization Algorithm

In recent years, the advancement of deep learning technology has led to excellent performance in synthetic aperture radar (SAR) automatic target recognition (ATR) technology. However, due to the interference of speckle noise, the task of classifying SAR images remains challenging. To address this issue, a multi-scale local–global feature fusion network (MFN) integrating a convolution neural network (CNN) and a transformer network was proposed in this study. The proposed network comprises three branches: a CovNeXt-SimAM branch, a Swin Transformer branch, and a multi-scale feature fusion branch. The CovNeXt-SimAM branch extracts local texture detail features of the SAR images at different scales. By incorporating the SimAM attention mechanism to the CNN block, the feature extraction capability of the model was enhanced from the perspective of spatial and channel attention. Additionally, the Swin Transformer branch was employed to extract SAR image global semantic information at different scales. Finally, the multi-scale feature fusion branch was used to fuse local features and global semantic information. Moreover, to overcome the problem of poor accuracy and inefficiency of the model due to empirically determined model hyperparameters, the Bayesian hyperparameter optimization algorithm was used to determine the optimal model hyperparameters. The model proposed in this study achieved average recognition accuracies of 99.26% and 94.27% for SAR vehicle targets under standard operating conditions (SOCs) and extended operating conditions (EOCs), respectively, on the MSTAR dataset. Compared with the baseline model, the recognition accuracy has been improved by 12.74% and 25.26%, respectively. The results demonstrated that Bayes-MFN reduces the inter-class distance of the SAR images, resulting in more compact classification features and less interference from speckle noise. Compared with other mainstream models, the Bayes-MFN model exhibited the best classification performance.

Mixture Based Superpixel Segmentation and Classification of SAR Images

Abstract: The proposed approach suggests a mixture-based super pixel segmentation technique for synthetic aperture radar (SAR) images. SAR is a radar system used to generate 2D or 3D representations of objects like landscapes. This method utilizes SAR image amplitudes and pixel coordinates as features. Super pixels are large irregular-shaped regions obtained through oversegmentation of an image. While super pixel segmentation methods are commonly designed for colour images, this approach adapts a finite mixture model (FMM) for single-channel SAR images. By employing finite mixture models, the pixels are clustered into super pixels. Following the super pixel segmentation, the method employs a hierarchical decision tree clustering algorithm for classifying different land covers, such as climate monitoring and natural resources exploitation. The decision tree algorithm creates a dendrogram or tree structure to group feature vectors. The proposed super pixel method demonstrates improved classification accuracy compared to state-of-the-art methods like quick-shift, turbo pixels, simple linear iterative clustering, and pixel intensity and location similarity. The implementation of the proposed method is efficiently carried out using MATLAB software.

Synthetic Aperture Radar Remote Sensing for Crop Classification

This Study proposes the approach for crop classification using the Grey Level Co-occurrence Matrix feature of Synthetic Aperture Radar (SAR) images. The method utilizes the SAR Images acquired by Sentinel 1A SAR Data and extract textural features using GLCM. In this study, we investigate the potential of Grey Level Co-occurrence Matrix (GLCM)-based texture information for horticulture crop classification with SAR images in Kharif and cloud weather condition. A study on Synthetic Aperture Radar (SAR) satellite imagery was conducted in Chhattisgarh with the objective to evaluate the potential of different texture parameters among crop. The SAR data were pre-processed for textural analysis having entire angle and equal distance quantization. The results were categorized among different parameters showing significant variation for horticulture crops for Contrast, Dissimilarity, Homogeneity, ASM, Energy, Entropy and GLCM Mean. The statistical analysis was done for fruit crop along with major kharif crop of study area. The results shows that mean backscatter value was lowest for banana (99.12 dB) and highest for Mango (198.26 dB) regarding contrast textural property in VH Channel whereas mean backscatter value in VH Channel w.r.t to energy was maximum for banana (0.60 dB) followed by papaya (0.49 dB) and guava (0.45 dB) and least for mango (0.44 dB). The mean backscatter value for GLCM mean textural property in VH channel was shown maximum by banana (51.24 dB) followed by papaya (41.96 dB) and mango (32.98 dB). These results indicate the usefulness of texture information for classification of SAR images, particularly when acquisition of optical images is difficult in Kharif and cloud weather condition for crop classification. Thus GLCM feature of SAR Data proven to be significant for the classification of horticulture crops.

SAR Image Classification Using Markov Random Fields with Deep Learning

Classification algorithms integrated with convolutional neural networks (CNN) display high accuracies in synthetic aperture radar (SAR) image classification. However, their consideration of spatial information is not comprehensive and effective, which causes poor performance in edges and complex regions. This paper proposes a Markov random field (MRF)-based algorithm for SAR image classification which fully considers the spatial constraints between superpixel regions. Firstly, the initialization of region labels is obtained by the CNN. Secondly, a probability field is constructed to improve the distribution of spatial relationships between adjacent superpixels. Thirdly, a novel region-level MRF is employed to classify the superpixels, which combines the intensity field and probability field in one framework. In our algorithm, the generation of superpixels reduces the misclassification at the pixel level, and region-level misclassification is rectified by the improvement of spatial description. Experimental results on simulated and real SAR images confirm the efficacy of the proposed algorithm for classification.

SAR Image Classification Using Gated Channel Attention Based Convolutional Neural Network

Algorithms combining CNN (Convolutional Neural Network) and super-pixel based smoothing have been proposed in recent years for Synthetic Aperture Radar (SAR) image classification. However, the smoothing may lead to the damage of details. To solve this problem the feature fusion strategy is utilized, and a novel adaptive fusion module named Gated Channel Attention (GCA) is designed in this paper. In this module, the relevance between channels is embedded into the conventional gated attention module to emphasize the variation in contribution on classification results between channels of feature-maps, which is not well considered by the conventional gated attention module. A GCA-CNN network is then constructed for SAR image classification. In this network, feature-maps corresponding to the original image and the smoothed image are extracted, respectively, by feature-extraction layers and adaptively fused. The fused features are used to obtain the results. Classification can be performed by the GCA-CNN in an end-to-end way. By the adaptive feature fusion in GCA-CNN, the smoothing of misclassification and the detail keeping can be realized at the same time. Experiments have been performed on one elaborately designed synthetic image and three real world SAR images. The superiority of the GCA-CNN is demonstrated by comparing with the conventional algorithms and the relative state-of-the-art algorithms.

DJSPNet: Deep Joint Statistical–Spatial Pooling Network for High-Resolution SAR Image Classification

The previous approaches based on statistical features or spatial features have achieved promising performance on pixel-wise high-resolution (HR) synthetic aperture radar (SAR) image classification, but these methods always can not capture local spatial features and global statistical properties efficiently because of the complex spatial structural patterns and statistical nature in SAR patches. Inspired by this, we propose a deep joint statistical-spatial pooling network, named DJSPNet, for HR SAR image classification, which combines a group second-order statistical feature learning (GSFL) block and an efficient feature-fusion style (EFS) into an end-to-end feature learning block. GSFL block is designed with a group second-order feature learning method in two steps, where the first step divides convolutional channels into several semantic groups; The second step collects second-order feature statistics through calculating pairwise feature interactions within each group. EFS models second-order attentional statistics between statistical characteristics and spatial features by polynomial kernel approximation and guides the discriminative feature activations in SAR patches. More specifically, both GSFL and EFS are stacked and plugged into the encoder stage of conventional U-Net for distinguishable feature learning. Experimental results suggest that the proposed DJSPNet gives better classification performance compared with related deep feature learning networks on a real TerraSAR-X dataset.

Automated SAR Image Segmentation and Classification Using Modified Deep Learning

Synthetic Aperture Radar (SAR) represents a type of active remote sensing technology that uses microwave electromagnetic radiation to produce and send data to the surface of a target location. SAR imaging is frequently used in national security applications since it is unaffected by weather, geographical location, or time. In this system, many approaches are examined, to improve automation for segmentation and classification. The utilization of Deep Neural Networks (DNNs) to classify SAR images has gotten a lot of attention, and it usually requires several layers of deep models for feature learning. With insufficient training data, however, the DNN will get affected by the overfitting issue. The major purpose of this work is to make a development on introducing a new framework for SAR image segmentation and categorization using deep learning. Owing to the coherent nature of the backscattering signal, SARs create speckle noise in their images. If the image has noisy material, classification becomes more challenging. Hence, the pre-processing of the images is employed by linear spatial filtering to remove the noise. Further, the Optimized U-Net is used for the segmentation. For the segmented images, the Binary Robust Independent Elementary Features (BRIEF) concept is adopted as the feature descriptor. These features are inputted to the Convolutional Neural Network (CNN) with Tuned Weight DNN (C-TWDNN) for the classification. In both segmentation and classification, the parameter tuning is employed by the combination of Galactic Swarm Optimization (GSO) and Deer Hunting Optimization Algorithm (DHOA) called the Self-adaptive-Galactic Deer Hunting Optimization (SA-GDHO). Experiments are conducted on a variety of public datasets, demonstrating that our method is capable of outperforming various expert systems and deep structured architectures.

Curvelet Adversarial Augmented Neural Network for SAR Image Classification

Convolutional neural networks (CNNs) have superior feature learning capabilities with large numbers of labeled samples. The reality is that labeling these samples is costly in terms of human labor. Existing data augmentation methods alleviate the scarcity of labeled samples. However, these methods are not suitable for synthetic aperture radar (SAR) images, owing to special imaging mechanisms and observational objects. The generative SAR images by existing augmented methods show structure distortion. To address this issue, we introduce a curvelet adversarial augmented neural network (CA2NN) for SAR image classification. Specifically, an <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$\text{A}^{2}$ </tex-math></inline-formula> NN is established, which consists of two generative streams and one discriminative stream. In the generative stream, through the mutual transformation between the whole and partial images, more new samples with structural consistency are generated to augment the limited labeled data. In the discriminative stream, these generated samples show certain appearance variations after adversarial training based on the novel joint discriminant criterion. Simultaneously, given the multiscale and multidirectional nature of SAR images, we construct discretized curvelet in 2-D space, aiming to extract the singularity features and avoid overfitting. By integrating curvelet kernels into <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$\text{A}^{2}$ </tex-math></inline-formula> NN, CA2NN can automatically generate more representative features adapting to complex terrain, while greatly reducing the complexity of the network. Experiments are conducted on the SAR images with large-scale and complex scenes, suggesting that the proposed approach significantly improves the classification performance with few labeled samples.

A Wavelet-Driven Subspace Basis Learning Network for High-Resolution Synthetic Aperture Radar Image Classification

The feature learning strategy of convolutional neural networks (CNNs) learns the deep spatial features from high-resolution (HR) synthetic aperture radar (SAR) images while ignoring the speckle noise based on SAR imaging mechanism. In the feature learning module, the noise reduction by feature-adaptive projection guided by a powerful embedded wavelet feature reconstruction mechanism can effectively learn the deep feature statistics. In this paper, we present a Wavelet Driven Subspace Basis Learning Network (WDSBLN), following an encoder-decoder architecture, for HR SAR image classification. The powerful wavelet module (PWM), including wavelet decomposition and reconstruction, is employed for keeping the structures of learned features well under speckle noise. Specifically, a compact second-order feature enhancement mechanism is designed for improving the contour and edge information of low-frequency components in the feature decomposition stage, and a local feature attention module based on point-wise convolutional layer is adopted to aggregate the contextual information of local channel and reserves detail information in the high-frequency components. Then the reconstructed feature map is employed as a guided standard in the subspace basis learning (SBL) module. The SBL module, including basis generation (generating the subspace basis vectors) and subspace projection (transforming deep feature maps into a signal subspace), maintains the local structure of HR SAR image patches and acquires the robust feature statistics. We conduct evaluations on three real HR SAR image classification datasets, achieve superior performances as compared to other related networks.

GPCNet: global-context pyramidal and class-balanced network for high-resolution SAR remote sensing image classification

The description of context information affected by speckle and class imbalance under labeled data makes the pixelwise classification for high-resolution (HR) synthetic aperture radar (SAR) image a challenging task. To address these issues, we propose a global-context pyramidal and class-balanced network (GPCNet) for HR SAR image classification. The proposed structure follows an encoder–decoder architecture. In the encoder module, the multiscale convolutional and global-local cross-channel attention (GCA) blocks are employed to capture the global-context and distinguishable deep feature statistics, while reducing the impacts of the random fluctuation in the homogeneous region. The channel information of different scale convolutional layers is efficiently learned by local cross-channel interaction in the GCA block. Besides, a sampled class-balanced loss, associating with the effective number, is utilized for alleviating the class imbalance of HR SAR images. The experiments carried out on a TerraSAR-X image classification dataset demonstrate GPCNet is able to yield superior performance when compared with other related networks.

Assessment of Machine Learning Techniques for Oil Rig Classification in C-Band SAR Images

This article aims at performing maritime target classification in SAR images using machine learning (ML) and deep learning (DL) techniques. In particular, the targets of interest are oil platforms and ships located in the Campos Basin, Brazil. Two convolutional neural networks (CNNs), VGG-16 and VGG-19, were used for attribute extraction. The logistic regression (LR), random forest (RF), support vector machine (SVM), k-nearest neighbours (kNN), decision tree (DT), naive Bayes (NB), neural networks (NET), and AdaBoost (ADBST) schemes were considered for classification. The target classification methods were evaluated using polarimetric images obtained from the C-band synthetic aperture radar (SAR) system Sentinel-1. Classifiers are assessed by the accuracy indicator. The LR, SVM, NET, and stacking results indicate better performance, with accuracy ranging from 84.1% to 85.5%. The Kruskal–Wallis test shows a significant difference with the tested classifier, indicating that some classifiers present different accuracy results. The optimizations provide results with more significant accuracy gains, making them competitive with those shown in the literature. There is no exact combination of methods for SAR image classification that will always guarantee the best accuracy. The optimizations performed in this article were for the specific data set of the Campos Basin, and results may change depending on the data set format and the number of images.

Physically explainable CNN for SAR image classification

Integrating the special electromagnetic characteristics of Synthetic Aperture Radar (SAR) in deep neural networks is essential in order to enhance the explainability and physics awareness of deep learning. In this paper, we first propose a novel physically explainable convolutional neural network for SAR image classification, namely physics guided and injected learning (PGIL). It comprises three parts: (1) explainable models (XM) to provide prior physics knowledge, (2) physics guided network (PGN) to encode the knowledge into physics-aware features, and (3) physics injected network (PIN) to adaptively introduce the physics-aware features into classification pipeline for label prediction. A hybrid Image-Physics SAR dataset format is proposed for evaluation, with both Sentinel-1 and Gaofen-3 SAR data being experimented. The results show that the proposed PGIL substantially improve the classification performance in case of limited labeled data compared with the counterpart data-driven CNN and other pre-training methods. Additionally, the physics explanations are discussed to indicate the interpretability and the physical consistency preserved in the predictions. We deem the proposed method would promote the development of physically explainable deep learning in SAR image interpretation field.

Synthetic Aperture Radar image classification based on constrictive learning with limited data

It is difficult to obtain a large number of high-quality labelled Synthetic Aperture Radar (SAR) image data. In order to solve the classification task of an SAR image with limited data, this paper proposes a dual-network classification model of pre-training and fine-tuning based on contrastive learning and pseudo-label training strategy. The algorithm firstly obtains the initial weight of the network through unsupervised pre-training and then takes advantage of the pseudo-label information to realise the fine tuning of the dual network. It effectively reduces the number of samples required during classification. Compared with the classification network without optimisation strategy, the proposed algorithm achieves higher classification accuracy in the ablation study.