2SRS: Two-Stream Residual Separable Convolution Neural Network for Hyperspectral Image Classification

Abstract

Typically, hyperspectral image suffers from redundant information, data scarcity, and class imbalance problems. This letter proposes a hyperspectral image classification framework named as Two-Stream Residual Separable Convolution (2SRS) network that aims to mitigate these problems. Principal Component Analysis (PCA) is first employed to reduce the spectral dimension of the hyperspectral image. Subsequently, the data scarcity and class imbalance problems are overcome via spatial and spectral data augmentations. A novel spectral data creation from image patches is proposed. The augmented samples are fed into the proposed 2SRS network for hyperspectral image classification. We evaluated the proposed method on three benchmark datasets, namely (1) Indian Pines, (2) Pavia University, and (3) Salinas Scene. The proposed method achieved state-of-the-art performance in terms of Overall Accuracy (OA), Average Accuracy (AA), and Kappa Coefficient (Kappa) for both 30% and 10% training set ratio.