Coastal image interpretation using background knowledge and semantics

Abstract

In this paper, we present a framework to model and to use knowledge provided by experts for remote sensing image interpretation of coastal area. The goal of this approach is to associate semantic to regions issued from the segmentation of an image. The idea is to start with a raw description of the knowledge given by the expert on the different thematic object classes present in the image. This knowledge is then decomposed and formalized to be usable during the classification process. A first interpretation of the image is computed through an ontology with spectral information about the classes. Then, a set of Knowledge Functions (KFs) are defined according to the description of the expert's knowledge. These KFs are then used to check the consistency of the spectral interpretation and to detect potentially mislabeled regions. The interpretation of these regions is revised in an iterative process to produce a more accurate final result. Experiments on remote sensing images of a coastal zone of Normandy, France are presented to show the relevance of the method.