Evaluation of data fusion and image segmentation in earth observation based rapid mapping workflows

Abstract

This paper is an exploratory study, which aimed to discover the synergies of data fusion and image segmentation in the context of EO-based rapid mapping workflows. Our approach pillared on the geographic object-based image analysis (GEOBIA) focusing on multiscale, internally-displaced persons’ (IDP) camp information extraction from very high spatial resolution (VHSR) images. We applied twelve pansharpening algorithms to two subsets of a GeoEye-1 image scene that was taken over a former war-induced ephemeral settlement in Sri Lanka. A multidimensional assessment was employed to benchmark pansharpening algorithms with respect to their spectral and spatial fidelity. The multiresolution segmentation (MRS) algorithm of the eCognition Developer software served as the key algorithm in the segmentation process. The first study site was used for comparing segmentation results produced from the twelve fused products at a series of scale, shape, and compactness settings of the MRS algorithm. The segmentation quality and optimum parameter settings of the MRS algorithm were estimated by using empirical discrepancy measures. Non-parametric statistical tests were used to compare the quality of image object candidates, which were derived from the twelve pansharpened products. A wall-to-wall classification was performed based on a support vector machine (SVM) classifier to classify image objects candidates of the fused images. The second site simulated a more realistic crisis information extraction scenario where the domain expertise is crucial in segmentation and classification. We compared segmentation and classification results of the original images (non-fused) and twelve fused images to understand the efficacy of data fusion. We have shown that the GEOBIA has the ability to create meaningful image objects during the segmentation process by compensating the fused image’s spectral distortions with the high-frequency information content that has been injected during fusion. Our findings further questioned the necessity of the data fusion step in rapid mapping context. Bypassing time-intensive data fusion helps to actuate EO-based rapid mapping workflows. We, however, emphasize the fact that data fusion is not limited to VHSR image data but expands over many different combinations of multi-date, multi-sensor EO-data. Thus, further research is needed to understand the synergies of data fusion and image segmentation with respect to multi-date, multi-sensor fusion scenarios and extrapolate our findings to other remote sensing application domains beyond EO-based crisis information retrieval.