New MPEG-7 Scalable Color Descriptor Based on Polar Coordinates for Multispectral Earth Observation Image Analysis

Abstract

Continuously expanding high-resolution and very high resolution multispectral image collections, provided by remote sensing satellites, require specific methods and techniques for data analysis and understanding. Even though there are several patch-based approaches for image classification and indexing, none of them are integrated within a standard. Having the goal to develop an MPEG-7 compliant descriptor for patch-based multispectral earth observation image classification and indexing, we propose a new feature extraction method able to extract maximum information from all the available spectral bands that Sentinel 2, the last generation of remote sensing satellites, provides. Using the polar coordinate transformation of the reflectance values, we obtain illumination invariant features, which can be used along with the scalable color descriptor present in MPEG-7 standard. Also, our method proves to enhance land cover classification of the areas affected by clouds and their shadows and provide similar classification results compared with the homogeneous texture descriptor (HTD), spectral histogram (SH), concatenated HTD with SH features, spectral indices (SIs), and bag-of-words-based descriptors, such as bag-of-SIs and bag-of-spectral-values on cloud-free areas.