Predicting Classification Performance for Benchmark Hyperspectral Datasets

Abstract

The classification of hyperspectral images (HSIs) is an essential application of remote sensing and it is addressed by numerous publications every year. A large body of these papers present new classification algorithms and benchmark them against established methods on public hyperspectral datasets. The metadata contained in these research papers (i.e., the size of the image, the number of classes, the type of classifier, etc.) present an unexploited source of information that can be used to estimate the performance of classifiers before doing the actual experiments. In this paper, we propose a novel approach to investigate to what degree HSIs can be classified by using only metadata. This can guide remote sensing researchers to identify optimal classifiers and develop new algorithms. In the experiments, different linear and nonlinear prediction methods are trained and tested by using data on classification accuracy and metadata from 100 HSIs classification papers. The experimental results demonstrate that the proposed ensemble learning voting method outperforms other comparative methods in quantitative assessments.