Analyzing the Separability of SAR Classification Dataset in Open Set Conditions

Abstract

In synthetic aperture radar (SAR) image classification applications, there are three categories of data, including training and benchmark data with fixed classes, as well as actual data in practical applications. A real problem comes that there exist unknown classes not included in training and benchmark data, which is defined as the open set condition. However, little work on recognizing unknown classes and analyzing the separability of SAR datasets has been developed. Motivated by this observation, this article demonstrates the difficulty of practical classification and analyzes SAR dataset separability in open set conditions. In this article, the SAR separability analyzer (SAR-SA) is proposed to model each known class as a multivariate Gaussian distribution. SAR-SA can classify the known classes and recognize the samples locating in each known distribution with low probabilities as unknown. Besides, SAR datasetwise separability index (DSI) and classwise separability index (CSI) are defined to quantify the separability in open set conditions at the dataset level and class level. DSI and CSI are effective indicators of the difficulty of SAR classification datasets. Extensive experimental results demonstrate that the DSI in open set conditions is nearly half of that in supervised conditions. Dataset with low DSI is hard to realize accurate classification in open set conditions. At the class level, even though the SAR image classes are semantically different from each other, there exists more or less overlap between the distributions of supervised known classes and unknown classes. Classes with low CSI are harder to be correctly classified and recognized.