Multiclass Labeling of Very High-Resolution Remote Sensing Imagery by Enforcing Nonlocal Shared Constraints in Multilevel Conditional Random Fields Model

Abstract

In this study, we investigate the problem of multiclass pixel labeling of very high-resolution (VHR) optical remote sensing images. We propose a novel higher order potential function based on nonlocal shared constraints within the framework of a three-level conditional random field (CRF) model. The proposed approach combines classification knowledge discovery from labeled data with unsupervised segmentation cues derived from the cosegmentation of test data. The cosegmentation of unannotated test data incorporates nonlocal constraints, which are encoded in a novel truncated robust consistency potential function. The class labels are then updated iteratively by alternating between estimating semantic segmentations using CRF and integrating cosegmentation-derived labels in higher order potential functions to refine labeling results. We experimentally demonstrate the improved labeling accuracy of our approach compared with state-of-the-art multilevel CRF approaches based on quantitative and qualitative results. We also show that our approach can address the issue of lacking accurately labeled training data.