Evaluation of a Neural Network With Uncertainty for Detection of Ice and Water in SAR Imagery

Abstract

Synthetic aperture radar (SAR) sea ice imagery is a promising source of data for sea ice data assimilation. Classification of SAR sea ice imagery into ice and water is of particular relevance due to its relationship with ice concentration, a key variable in sea ice data assimilation systems. With increasing volumes of SAR data, automated methods to carry out these classifications are of particular importance. Although several automated approaches have been proposed, none look at the impact of including an estimate of uncertainty of the model parameters and input features on the classification output. This article uses an established database of SAR image features to train a multilayer perceptron (MLP) neural network to classify pixel locations as either ice, water, or unknown. The classification accuracies are benchmarked using a recently developed logistic regression approach for the same database. The two methods are found to be comparable. The MLP approach is then enhanced to allow uncertainty to be estimated at each pixel location. Following methods proposed in the deep learning community, two kinds of uncertainty are considered. The first, epistemic uncertainty, is that due to uncertainty in the MLP weights. The second kind of uncertainty, aleatoric uncertainty, is that which cannot be explained by the model, and is therefore associated with the input data. It is found that including these uncertainties in the MLP models reduces their accuracies slightly, but also reduces misclassification rates. This is of particular importance for data assimilation applications, where misclassifications could severely degrade the analysis.