High-resolution Synthetic Aperture Radar Images Research Articles

Matching UAV-Based Simulated High-Resolution SAR and Real SAR Images

Abstract. Our experiment focuses on generating simulated high-resolution (HR) Synthetic Aperture Radar (SAR) images from the photogrammetric 3D model derived from Unmanned Aerial Vehicle (UAV) imagery. The goal is to match these simulated images with real SAR data of complex scenes containing vegetation, buildings, roads, and the construction of receiving antennas. Simulated SAR reflectivity map was based on ray tracing techniques.Two feature matching algorithms, namely Scale-Invariant Feature Transform (SIFT) and Oriented FAST and Rotated BRIEF (ORB) were employed for co-registration of the simulated to the real SAR images. The effectiveness of these algorithms is evaluated by their matching rates. The experiment results of the matching process highlight the superior performance of ORB over SIFT, attributed to its robustness against rotation variations and noise. ORB emerges as a versatile choice for high-resolution real and simulated SAR registration tasks.

JPSSL: SAR Terrain Classification Based on Jigsaw Puzzles and FC-CRF

Effective features play an important role in synthetic aperture radar (SAR) image interpretation. However, since SAR images contain a variety of terrain types, it is not easy to extract effective features of different terrains from SAR images. Deep learning methods require a large amount of labeled data, but the difficulty of SAR image annotation limits the performance of deep learning models. SAR images have inevitable geometric distortion and coherence speckle noise, which makes it difficult to extract effective features from SAR images. If effective semantic context features cannot be learned for SAR images, the extracted features struggle to distinguish different terrain categories. Some existing terrain classification methods are very limited and can only be applied to some specified SAR images. To solve these problems, a jigsaw puzzle self-supervised learning (JPSSL) framework is proposed. The framework comprises a jigsaw puzzle pretext task and a terrain classification downstream task. In the pretext task, the information in the SAR image is learned by completing the SAR image jigsaw puzzle to extract effective features. The terrain classification downstream task is trained using only a small number of labeled data. Finally, fully connected conditional random field processing is performed to eliminate noise points and obtain a high-quality terrain classification result. Experimental results on three large-scene high-resolution SAR images confirm the effectiveness and generalization of our method. Compared with the supervised methods, the features learned in JPSSL are highly discriminative, and the JPSSL achieves good classification accuracy when using only a small amount of labeled data.

A Segmentation-Based Optimal Seamline Generation Method for SAR Image Mosaic

In the mosaic creation of multiple high-resolution synthetic aperture radar (SAR) images, achieving an optimal seamline in overlapping areas is crucial for seamless and visually satisfactory results. Many existing seamline generation methods are designed primarily for optical remote sensing images, but due to the differing characteristics of SAR images and optical images, applying these methods directly to SAR images poses challenges in finding the optimal seamline. In response, this paper proposes a segmentation-based optimal seamline generation (SOSG) method for SAR image mosaics. The SOSG method involves a multi-step process. First, SAR image joint segmentation is performed within the overlapping areas. Subsequently, homogeneous areas are identified based on the segmentation results. Following this, a pixel cost matrix is constructed, incorporating homogeneous areas and intensity differences. Finally, the minimum path cost from the starting pixel to the end pixel is computed using the Dijkstra algorithm to determine the optimal path. To assess the feasibility and effectiveness of the proposed method, experiments are conducted using multiple SAR images from the Chinese Gaofen-3 01 satellite as datasets. The experimental results demonstrate that the proposed method yields seamless mosaic images when compared to other methods, while delivering satisfactory outcomes. This indicates the potential of the proposed method in addressing the unique challenges posed by SAR images and enhancing the quality of SAR image mosaics.

GPU Acceleration for SAR Satellite Image Ortho-Rectification

Synthetic Aperture Radar (SAR) satellite image ortho-rectification requires pixel-level calculations, which are time-consuming. Moreover, for SAR images with large overlapping areas, the processing time for ortho-rectification increases linearly, significantly reducing the efficiency of SAR satellite image mosaic. This paper thoroughly analyzes two geometric positioning models for SAR images. In order to address the high computation time of pixel-by-pixel ortho-rectification in SAR satellite images, a GPU-accelerated pixel-by-pixel correction method based on a rational polynomial coefficients (RPCs) model is proposed, which improves the efficiency of SAR satellite image ortho-rectification. Furthermore, in order to solve the problem of linearly increasing processing time for the ortho-rectification of multiple SAR images in large overlapping areas, a multi-GPU collaborative acceleration strategy for the ortho-rectification of multiple SAR images in large overlapping areas is proposed, achieving efficient ortho-rectification processing of multiple SAR image data in large overlapping areas. By conducting ortho-rectification experiments on 20 high-resolution SAR images from the Gaofen-3 satellite, the feasibility and efficiency of the multi-GPU collaborative acceleration processing algorithm are verified.

Detecting rotated ships in SAR images using a streamlined ship detection network and gliding phases

ABSTRACT Deep learning methods have greatly promoted the ship detection performance in synthetic aperture radar (SAR) images. However, due to the different imaging mechanisms and target characteristics, detecting ships in SAR imagery precisely and efficiently is still challenging. To address this issue, a streamlined rotational ship detection network (SRSD-Net) is proposed in this letter. First, we construct a lightweight network using one-level feature and a receptive field block (RFB) to extract ship features with rich context. Second, a simple and effective representation for rotated ship bounding boxes using the minimum external horizontal box and two phase factors is proposed. Finally, to reduce the missed detections of small ships, k-nearest label assignment (KNLA) is designed to make all targets equally contribute to the network training. Extensive experiments are conducted on high-resolution SAR images dataset (HRSID) and the results show that the proposed method can achieve high detection accuracy with low computational cost.

ADF-Net: An Attention-Guided Dual-Branch Fusion Network for Building Change Detection near the Shanghai Metro Line Using Sequences of TerraSAR-X Images

Building change detection (BCD) plays a vital role in city planning and development, ensuring the timely detection of urban changes near metro lines. Synthetic Aperture Radar (SAR) has the advantage of providing continuous image time series with all-weather and all-time capabilities for earth observation compared with optical remote sensors. Deep learning algorithms have extensively been applied for BCD to realize the automatic detection of building changes. However, existing deep learning-based BCD methods with SAR images suffer limited accuracy due to the speckle noise effect and insufficient feature extraction. In this paper, an attention-guided dual-branch fusion network (ADF-Net) is proposed for urban BCD to address this limitation. Specifically, high-resolution SAR images collected by TerraSAR-X have been utilized to detect building changes near metro line 8 in Shanghai with the ADF-Net model. In particular, a dual-branch structure is employed in ADF-Net to extract heterogeneous features from radiometrically calibrated TerraSAR-X images and log ratio images (i.e., difference images (DIs) in dB scale). In addition, the attention-guided cross-layer addition (ACLA) blocks are used to precisely locate the features of changed areas with the transformer-based attention mechanism, and the global attention mechanism with the residual unit (GAM-RU) blocks is introduced to enhance the representation learning capabilities and solve the problems of gradient fading. The effectiveness of ADF-Net is verified using evaluation metrics. The results demonstrate that ADF-Net generates better building change maps than other methods, including U-Net, FC-EF, SNUNet-CD, A2Net, DMINet, USFFCNet, EATDer, and DRPNet. As a result, some building area changes near metro line 8 in Shanghai have been accurately detected by ADF-Net. Furthermore, the prediction results are consistent with the changes derived from high-resolution optical remote sensing images.

Multi-Level Feature-Refinement Anchor-Free Framework with Consistent Label-Assignment Mechanism for Ship Detection in SAR Imagery

Deep learning-based ship-detection methods have recently achieved impressive results in the synthetic aperture radar (SAR) community. However, numerous challenging issues affecting ship detection, such as multi-scale characteristics of the ship, clutter interference, and densely arranged ships in complex inshore, have not been well solved so far. Therefore, this article puts forward a novel SAR ship-detection method called multi-level feature-refinement anchor-free framework with a consistent label-assignment mechanism, which is capable of boosting ship-detection performance in complex scenes. First, considering that SAR ship detection is susceptible to complex background interference, we develop a stepwise feature-refinement backbone network to refine the position and contour of the ship object. Next, we devise an adjacent feature-refined pyramid network following the backbone network. The adjacent feature-refined pyramid network consists of the sub-pixel sampling-based adjacent feature-fusion sub-module and adjacent feature-localization enhancement sub-module, which can improve the detection capability of multi-scale objects by mitigating multi-scale high-level semantic loss and enhancing low-level localization features. Finally, to solve the problems of unbalanced positive and negative samples and densely arranged ship detection, we propose a consistent label-assignment mechanism based on consistent feature scale constraints to assign more appropriate and consistent labels to samples. Extensive qualitative and quantitative experiments on three public datasets, i.e., SAR Ship-Detection Dataset (SSDD), High-Resolution SAR Image Dataset (HRSID), and SAR-Ship-Dataset illustrate that the proposed method is superior to many state-of-the-art SAR ship-detection methods.

An efficient YOLO for ship detection in SAR images via channel shuffled reparameterized convolution blocks and dynamic head

Synthetic aperture radar (SAR) is a crucial active imaging technology in remote sensing, offering valuable information for applications like climate monitoring, environmental analysis, and ship surveillance. Ship detection in SAR images remains challenging due to diverse vessel types and environmental interference, especially in inshore areas, despite the proven effectiveness of deep learning-based algorithms. This paper presents an efficient deep learning method named you only look once-shuffle reparameterized blocks with dynamic head (YOLO-SRBD) based on YOLOv8. Additionally, post-processing incorporates the soft non-maximum suppression to enhance precision. Experiments conducted on SAR image datasets demonstrate that the proposed method surpasses the original YOLOv8 both qualitatively and quantitatively, highlighting its feasibility for practical applications. The detection accuracy of the proposed YOLO-SRBD in the high resolution SAR images dataset rose from 89.9% to 91.3%, and the average precision increased from 66.7% to 74.3%, showing significant performance enhancement.

Studies on High-Resolution Airborne Synthetic Aperture Radar Image Formation with Pseudo-Random Agility of Interpulse Waveform Parameters

By means of alteration of the transmitted linear frequency modulation (LFM) signal waveform parameters, such as pulse width or chirp rate, initial phase, pulse repetition interval (PRI), and chirp rate polarity at every position of synthetic apertures, the pseudo-random agility technology of interpulse waveform parameters in airborne Synthetic Aperture Radar (SAR) actively increases the complexity and uncertainty of radar waveforms. This technology confuses jamming interception receivers, thus improving its anti-interference ability for active coherent jamming, which is one of the main research interests of airborne SAR technology. But the pseudo-random agility technology for interpulse waveform parameters faces certain challenges of large computation and complex system design, which need to be further studied and solved. To address these issues, a processing scheme of high-resolution SAR image formation which is appropriate for agile interpulse waveform parameters is proposed in this paper. This method can deal with multiple agile parameters, not only single ones as in most existing literature. Its computation load is nearly comparable to that of traditional SAR image formation with constant waveform parameters. The high-resolution SAR imaging results obtained by processing SAR raw data with agile interpulse waveform parameters demonstrate the effectiveness of the proposed method. In addition, real SAR images with resolutions of 0.5 m and 0.15 m, which are rarely found in the public literature, are shown under the circumstance of randomly changing the transmitted wideband LFM signal pulse parameters one by one.

Comparative Analysis of Pixel-Level Fusion Algorithms and a New High-Resolution Dataset for SAR and Optical Image Fusion

Synthetic aperture radar (SAR) and optical images often present different geometric structures and texture features for the same ground object. Through the fusion of SAR and optical images, it can effectively integrate their complementary information, thus better meeting the requirements of remote sensing applications, such as target recognition, classification, and change detection, so as to realize the collaborative utilization of multi-modal images. In order to select appropriate methods to achieve high-quality fusion of SAR and optical images, this paper conducts a systematic review of current pixel-level fusion algorithms for SAR and optical image fusion. Subsequently, eleven representative fusion methods, including component substitution methods (CS), multiscale decomposition methods (MSD), and model-based methods, are chosen for a comparative analysis. In the experiment, we produce a high-resolution SAR and optical image fusion dataset (named YYX-OPT-SAR) covering three different types of scenes, including urban, suburban, and mountain. This dataset and a publicly available medium-resolution dataset are used to evaluate these fusion methods based on three different kinds of evaluation criteria: visual evaluation, objective image quality metrics, and classification accuracy. In terms of the evaluation using image quality metrics, the experimental results show that MSD methods can effectively avoid the negative effects of SAR image shadows on the corresponding area of the fusion result compared with CS methods, while model-based methods exhibit relatively poor performance. Among all of the fusion methods involved in the comparison, the non-subsampled contourlet transform method (NSCT) presents the best fusion results. In the evaluation using image classification, most experimental results show that the overall classification accuracy after fusion is better than that before fusion. This indicates that optical-SAR fusion can improve land classification, with the gradient transfer fusion method (GTF) yielding the best classification results among all of these fusion methods.

Enhanced Detection Method for Small and Occluded Targets in Large-Scene Synthetic Aperture Radar Images

Ship detection in large-scene offshore synthetic aperture radar (SAR) images is crucial in civil and military fields, such as maritime management and wartime reconnaissance. However, the problems of low detection rates, high false alarm rates, and high missed detection rates of offshore ship targets in large-scene SAR images are due to the occlusion of objects or mutual occlusion among targets, especially for small ship targets. To solve this problem, this study proposes a target detection model (TAC_CSAC_Net) that incorporates a multi-attention mechanism for detecting marine vessels in large-scene SAR images. Experiments were conducted on two public datasets, the SAR-Ship-Dataset and high-resolution SAR image dataset (HRSID), with multiple scenes and multiple sizes, and the results showed that the proposed TAC_CSAC_Net model achieves good performance for both small and occluded target detection. Experiments were conducted on a real large-scene dataset, LS-SSDD, to obtain the detection results of subgraphs of the same scene. Quantitative comparisons were made with classical and recently developed deep learning models, and the experiments demonstrated that the proposed model outperformed other models for large-scene SAR image target detection.

A conventional and non-conventional analysis of SAR image despeckling technique

The importance of high-resolution Synthetic Aperture Radar (SAR) imaging is undeniable in applications for Earth monitoring since it offers useful data for analysis. Post-image processing methods including edge and object detection, segmentation, and speckle noise removal are important to performed to find the information of images. The key technique that makes images aesthetically pleasing and understandable is despeckling. The presented study assays the latest trends & state of the art techniques for SAR image despeckling to gauge the performance & agility of existing techniques by performing a contemporary combination of theoretical & experimental analysis. This study analyses various techniques used in literature. The quantitative & qualitative analysis is done using Peak Signal-to-Noise Ratio (PSNR) and Universal Image Quality Index (UIQI) indices to find the better approach

Global and Local Context-Aware Ship Detector for High-Resolution SAR Images

Due to the large sizes of synthetic aperture radar (SAR) images, traditional deep learning-based ship detection methods usually utilize the sliding window preprocessing strategy to obtain the small-sized sub-images. However, there are amounts of background clutter areas without ships in SAR images. Thus, traditional sliding window-based methods may generate numerous sub-images without ships, which can bring high computation redundancy and numerous false alarms. To deal with the above problems, in this paper, a novel detection method called global and local context-aware ship detector (GLC-Det) for high-resolution SAR images is proposed. The proposed method mainly contains three parts: the global context-aware based sub-images selection (GCSS) module, the deep learning module, and the local context-aware based false alarms suppression (LCFS) module. The GCSS module employs the global context information to eliminate the sub-images without ships, which can enhance detection efficiency and avoid generating numerous false alarms. The deep learning module is used to further obtain the preliminary detection boxes. The LCFS module is a postprocessing step, which employs the local context information around the detection boxes to further eliminate the false alarms. The experimental results on the measured data of AIR-SARShip-1.0 and 2.0 high-resolution SAR images demonstrate that the proposed method has higher precision and efficiency than the original deep learning methods.

DAFCNN: A Dual-Channel Feature Extraction and Attention Feature Fusion Convolution Neural Network for SAR Image and MS Image Fusion

In the field of image fusion, spatial detail blurring and color distortion appear in synthetic aperture radar (SAR) images and multispectral (MS) during the traditional fusion process due to the difference in sensor imaging mechanisms. To solve this problem, this paper proposes a fusion method for SAR images and MS images based on a convolutional neural network. In order to make use of the spatial information and different scale feature information of high-resolution SAR image, a dual-channel feature extraction module is constructed to obtain a SAR image feature map. In addition, different from the common direct addition strategy, an attention-based feature fusion module is designed to achieve spectral fidelity of the fused images. In order to obtain better spectral and spatial retention ability of the network, an unsupervised joint loss function is designed to train the network. In this paper, the Sentinel 1 SAR images and Landsat 8 MS images are used as datasets for experiments. The experimental results show that the proposed algorithm has better performance in quantitative and visual representation when compared with traditional fusion methods and deep learning algorithms.

PPA-Net: Pyramid Pooling Attention Network for Multi-Scale Ship Detection in SAR Images

In light of recent advances in deep learning and Synthetic Aperture Radar (SAR) technology, there has been a growing adoption of ship detection models that are based on deep learning methodologies. However, the efficiency of SAR ship detection models is significantly impacted by complex backgrounds, noise, and multi-scale ships (the number of pixels occupied by ships in SAR images varies significantly). To address the aforementioned issues, this research proposes a Pyramid Pooling Attention Network (PPA-Net) for SAR multi-scale ship detection. Firstly, a Pyramid Pooled Attention Module (PPAM) is designed to alleviate the influence of background noise on ship detection while its parallel component favors the processing of multiple ship sizes. Different from the previous attention module, the PPAM module can better suppress the background noise in SAR images because it considers the saliency of ships in SAR images. Secondly, an Adaptive Feature Balancing Module (AFBM) is developed, which can automatically balance the conflict between ship semantic information and location information. Finally, the detection capabilities of the ship detection model for multi-scale ships are further improved by introducing the Atrous Spatial Pyramid Pooling (ASPP) module. This innovative module enhances the detection model’s ability to detect ships of varying scales by extracting features from multiple scales using atrous convolutions and spatial pyramid pooling. PPA-Net achieved detection accuracies of 95.19% and 89.27% on the High-Resolution SAR Images Dataset (HRSID) and the SAR Ship Detection Dataset (SSDD), respectively. The experimental results demonstrate that PPA-Net outperforms other ship detection models.

Cross-scene target detection based on feature adaptation and uncertainty-aware pseudo-label learning for high resolution SAR images

The characteristics of synthetic aperture radar (SAR) images are easily affected by factors such as sensor parameters, imaging scenes, etc., which may lead to data distributional discrepancies between the ideal training phase and the practical application phase, resulting in generalization performance degradation of deep learning based detectors in practice. In this paper, an accurate and fast domain adaptive detection method is proposed to address the performance degradation problem of cross-scene detection without requiring additional manual annotations. The cross-scene detection performance is gradually improved by confidence-induced unsupervised feature adaptation (CUFA) and uncertainty-aware adaptive pseudo-label learning (UAPL). In CUFA, image-level and instance-level feature adaptation are progressively implemented to bridge the distribution discrepancies between the source and the target domain in the latent feature space. Then, UAPL is performed to adaptively introduce accurate and stable supervisions of target domain according to the learning status of the detector, avoiding error accumulations and further improving the cross-scene target detection performance. The proposed cross-scene detection method is validated on airborne and spaceborne SAR image datasets of different imaging scenes. The experimental results show that by combining both CUFA and UAPL, compared with the second-best comparison method, the proposed method significantly improves the cross-scene target detection performance in SAR images (at least + 6.5% AP50 and F1 in miniSAR and FARAD cross-scene tasks, and at least + 7.5% AP50 and F1 in Gaofen-3 and Sentinel-1 cross-scene tasks), which facilitates application of the deep learning based detectors in the realistic scenarios.

SAR Image Aircraft Target Recognition Based on Improved YOLOv5

Synthetic aperture radar (SAR) is an active ground-surveillance radar system, which can observe targets regardless of time and weather. Passenger aircrafts are important targets for SAR, as it is of great importance for accurately recognizing the type of aircraft. SAR can provide dynamic monitoring of aircraft flights in civil aviation, which is helpful for the efficient management of airports. Due to the unique imaging characteristics of SAR, traditional target-detection algorithms have poor generalization ability, low detection accuracy, and a cumbersome recognition process. Target detection in high-resolution SAR images based on deep-learning methods is currently a major research hotspot. You Only Look Once v5 (YOLOv5) has the problems of missed detection and false alarms. In this study, we propose an improved version of YOLOv5. A multiscale feature adaptive fusion module is proposed to adaptively assign different weights to each scale of the feature layers, which can extract richer semantic and textural information. The SIOU loss function is proposed to replace the original CIOU loss function to speed up the convergence of the algorithm. The improved Ghost structure is proposed to optimize the YOLOv5 network to decrease the parameters of the model and the amount of computation. A coordinate attention (CA) module is incorporated into the backbone section to help extract useful information. The experimental results demonstrate that the improved YOLOv5 performs better in terms of detection without affecting calculation speed. The mean average precision (mAP) value of the improved YOLOv5 increased by 5.8% compared with the original YOLOv5.

High-Resolution and Wide-Swath SAR Imaging with Space–Time Coding Array

To achieve high-resolution and wide-swath (HRWS) synthetic aperture radar (SAR) images, this paper focuses on resolving the problem of separating range-ambiguous echoes with the space–time coding (STC) array. At the modeling stage, the transmit elements and pulses of the STC array are configured with time delay and phase coding modulation, which introduces extra degrees of freedom (DOFs) in the transmit domain. To separate the echoes corresponding to different range-ambiguity regions, the equivalent transmit beamforming is performed in the two-dimensional space–frequency domain. Moreover, in order to compensate for the loss of range resolution during the beamforming progress, the frequency splicing method is proposed. At the analysis stage, the distributed target simulation is provided to demonstrate the effectiveness of obtaining HRWS SAR images in the STC radar. Additionally, the performance of resolving range ambiguity is compared with the traditional radar in terms of the range-ambiguity-to-signal ratio (RASR).

An Effective Multi-Layer Attention Network for SAR Ship Detection

The use of deep learning-based techniques has improved the performance of synthetic aperture radar (SAR) image-based applications, such as ship detection. However, all existing methods have limited object detection performance under the conditions of varying ship sizes and complex background noise, to the best of our knowledge. In this paper, to solve both the multi-scale problem and the noisy background issues, we propose a multi-layer attention approach based on the thorough analysis of both location and semantic information. The solution works by exploring the richness of spatial information of the low-level feature maps generated by a backbone and the richness of semantic information of the high-level feature maps created by the same method. Additionally, we integrate an attention mechanism into the network to exclusively extract useful features from the input maps. Tests involving multiple SAR datasets show that our proposed solution enables significant improvements to the accuracy of ship detection regardless of vessel size and background complexity. Particularly for the widely-adopted High-Resolution SAR Images Dataset (HRSID), the new method provides a 1.3% improvement in the average precision for detection. The proposed new method can be potentially used in other feature-extraction-based classification, detection, and segmentation.

Two-Way Generation of High-Resolution EO and SAR Images via Dual Distortion-Adaptive GANs

Synthetic aperture radar (SAR) provides an all-weather and all-time imaging platform, which is more reliable than electro-optical (EO) remote sensing imagery under extreme weather/lighting conditions. While many large-scale EO-based remote sensing datasets have been released for computer vision tasks, there are few publicly available SAR image datasets due to the high costs associated with acquisition and labeling. Recent works have applied deep learning methods for image translation between SAR and EO. However, the effectiveness of those techniques on high-resolution images has been hindered by a common limitation. Non-linear geometric distortions, induced by different imaging principles of optical and radar sensors, have caused insufficient pixel-wise correspondence between an EO-SAR patch pair. Such a phenomenon is not prominent in low-resolution EO-SAR datasets, e.g., SEN1-2, one of the most frequently used datasets, and thus has been seldom discussed. To address this issue, a new dataset SN6-SAROPT with sub-meter resolution is introduced, and a novel image translation algorithm designed to tackle geometric distortions adaptively is proposed in this paper. Extensive experiments have been conducted to evaluate the proposed algorithm, and the results have validated its superiority over other methods for both SAR to EO (S2E) and EO to SAR (E2S) tasks, especially for urban areas in high-resolution images.