High Spatial Resolution Hyperspectral Image Research Articles

Hyperspectral and multispectral images fusion based on pyramid swin transformer

Remote sensing image fusion aims to generate a high spatial resolution hyperspectral image (HR-HSI) by integrating a low spatial resolution hyperspectral image (LR-HSI) and a high spatial resolution multispectral image (HR-MSI). While Convolutional Neural Networks (CNNs) have been widely employed in addressing the HSI-MSI fusion problem, their limited receptive field poses challenges in capturing global relationships within the feature maps. On the other hand, the computational complexity of Transformers hinders their application, especially in dealing with high-dimensional data like hyperspectral images (HSIs). To overcome this challenge, we propose an HSI-MSI fusion method based on the Pyramid Swin Transformer (PSTF). The pyramid design of the PSTF effectively extracts multi-scale information from images. The Spatial-Spectral Crossed Attention (SSCA) module, comprising the Cross Spatial Attention (CSA) and the Spectral Feature Integration (SFI) modules. The CSA module employs a cross-shaped self-attention mechanism, providing greater modeling flexibility for different spatial scales and non-local structures compared to traditional convolutional layers. Meanwhile, the SFI module introduces a global memory block (MB) to select the most relevant low-rank spectral vectors, integrating global spectral information with local spatial–spectral correlation to better extract and preserve spectral information. Additionally, the Separate Feature Extraction (SFE) module enhances the network’s ability to represent image features by independently processing positive and negative parts of shallow features, thus capturing details and structures more effectively and preventing the vanishing gradient problem. Compared with the state-of-the-art (SOTA) methods, experimental results demonstrate the effectiveness of the PSTF method.

Unsupervised Hyperspectral and Multispectral Image Blind Fusion Based on Deep Tucker Decomposition Network With Spatial-Spectral Manifold Learning.

Hyperspectral image (HSI) and multispectral image (MSI) fusion aims to generate high spectral and spatial resolution hyperspectral image (HR-HSI) by fusing high-resolution multispectral image (HR-MSI) and low-resolution hyperspectral image (LR-HSI). However, existing fusion methods encounter challenges such as unknown degradation parameters, and incomplete exploitation of the correlation between high-dimensional structures and deep image features. To overcome these issues, in this article, an unsupervised blind fusion method for LR-HSI and HR-MSI based on Tucker decomposition and spatial-spectral manifold learning (DTDNML) is proposed. We design a novel deep Tucker decomposition network that maps LR-HSI and HR-MSI into a consistent feature space, achieving reconstruction through decoders with shared parameters. To better exploit and fuse spatial-spectral features in the data, we design a core tensor fusion network (CTFN) that incorporates a spatial-spectral attention mechanism for aligning and fusing features at different scales. Furthermore, to enhance the capacity to capture global information, a Laplacian-based spatial-spectral manifold constraint is introduced in shared-decoders. Sufficient experiments have validated that this method enhances the accuracy and efficiency of hyperspectral and multispectral fusion on different remote sensing datasets. The source code is available at https://github.com/Shawn-H-Wang/DTDNML.

Optical design and development of an underwater dual-channel microlens array integral field snapshot hyperspectral imager

Compared to push-scan hyperspectral imagers, snapshot hyperspectral imagers offer an advantage by minimizing sensitivity to attitude jitter in underwater mobile platforms. Here we present the optical design and development of an underwater microlens array integral field hyperspectral imager. The system comprises a panchromatic imaging channel with a high spatial resolution and a spectral imaging channel with a lower spatial resolution. Through the fusion of high-resolution panchromatic images and low-resolution spectral images, we achieve high spatial resolution hyperspectral images. Both the panchromatic imaging channel and the spectral imaging channel share a common front objective, featuring a 25 mm focal length and a wide 36° field of view angle. Utilizing prism dispersion, the spectral imaging system spans a band range from 465 to 700 nm with a spectral resolution of less than 10 nm. Specialized algorithms for spectral image reconstruction and image fusion have been developed. The experimental results across diverse scenes confirm the exemplary spectral imaging performance of the system, positioning it as a robust solution for underwater snapshot hyperspectral imaging.

Multispectral and hyperspectral images fusion based on subspace representation and nonlocal low-rank regularization

ABSTRACT Multispectral image (MSI) and hyperspectral image (HSI) fusion is a popular method for HSI super-resolution reconstruction (HSI-SR). MSI-HSI fusion problem is ill-posed and demands several image priors or regularization terms to solve accurately, which is a challenging issue. In this paper, we propose an MSI-HSI fusion model via subspace representation and nonlocal low-rank regularization (SRNLRR). SRNLRR model incorporates the global spectral correlations and spatial nonlocal similarities of HSI to improve the fusion results, where the priors complement each other. First, we use the mode-n tensor-matrix product to project latent high spatial resolution HSI (HR-HSI) into spectral subspace, which can capture spectral low-rankness and reduce computational complexity. Then, based on low-rank representation (LRR) and nonlocal processing strategy, we design a spatial nonlocal LRR regularization (spa-NLRR) and a spectral global LRR regularization (spe-GLRR). These two regularizations analyze the spatial nonlocal similarities and spectral global correlations from intermediate-level vision. Finally, we use the residual regularization program to obtain more image information and input it into the fusion model. We use alternate minimization (AM) methods to optimize the SRNLRR model and employ the alternating direction method (ADM) on spatial/spectral LRR learning. Comparison experiments between the SRNLRR method and six advanced methods on three HSI datasets indicate the superiority of our method.

Semi-blind hyperspectral and multispectral image fusion via generalized inverse matrix optimization

Combining a low spatial resolution hyperspectral image (HSI) with a high spatial resolution multispectral image (MSI) is an economical way to obtain a high spatial resolution hyperspectral image (HR-HSI). However, existing fusion methods often rely on a critical variable, the point spread function (PSF), which is difficult to obtain in practice. Additionally, these methods often require a long fusion time and have many parameters that need re-debugging on different datasets to achieve satisfactory results. Many existing methods lack robustness in handling complex scenarios, such as complex PSF, changing spatial downsampling factors, and large-scale datasets. These issues can result in degraded performance or render the methods inapplicable to practical scenarios. Therefore, we propose an efficient and parameterless semi-blind fusion method based on generalized inverse matrix optimization (GIMO), which is robust for multiple complex situations. Our method uses the definition of generalized inverse matrix and the relationship among HSI, MSI, and HR-HSI to approximate the function module of PSF. Then, we calculate the generalized inverse matrix of the spectral response function (SRF). Finally, we optimize the generalized inverse matrix of SRF using the Sylvester equation and multiply it with MSI to obtain HR-HSI. This is the first proposed method to achieve hyperspectral image super-resolution by optimizing the inverse matrix of the spectral response function. Experiments on multiple simulated datasets and one real dataset have validated that our GIMO method outperforms existing state-of-the-art methods, especially regarding fusion time and robustness for various complex scenarios.

CS2DIPs: Unsupervised HSI Super-Resolution Using Coupled Spatial and Spectral DIPs.

In recent years, fusing high spatial resolution multispectral images (HR-MSIs) and low spatial resolution hyperspectral images (LR-HSIs) has become a widely used approach for hyperspectral image super-resolution (HSI-SR). Various unsupervised HSI-SR methods based on deep image prior (DIP) have gained wide popularity thanks to no pre-training requirement. However, DIP-based methods often demonstrate mediocre performance in extracting latent information from the data. To resolve this performance deficiency, we propose a coupled spatial and spectral deep image priors (CS2DIPs) method for the fusion of an HR-MSI and an LR-HSI into an HR-HSI. Specifically, we integrate the nonnegative matrix-vector tensor factorization (NMVTF) into the DIP framework to jointly learn the abundance tensor and spectral feature matrix. The two coupled DIPs are designed to capture essential spatial and spectral features in parallel from the observed HR-MSI and LR-HSI, respectively, which are then used to guide the generation of the abundance tensor and spectral signature matrix for the fusion of the HSI-SR by mode-3 tensor product, meanwhile taking some inherent physical constraints into account. Free from any training data, the proposed CS2DIPs can effectively capture rich spatial and spectral information. As a result, it exhibits much superior performance and convergence speed over most existing DIP-based methods. Extensive experiments are provided to demonstrate its state-of-the-art overall performance including comparison with benchmark peer methods.

Hyperspectral Image Super-Resolution via Adaptive Factor Group Sparsity Regularization-Based Subspace Representation

Hyperspectral image (HSI) super-resolution is a vital technique that generates high spatial-resolution HSI (HR-HSI) by integrating information from low spatial-resolution HSI with high spatial-resolution multispectral image (MSI). However, existing subspace representation-based methods face challenges, including adaptive subspace dimension determination, inadequate spectral correlation capture, and expensive computation. In this paper, we propose a novel factor group sparsity regularized subspace representation (FGSSR)-based method for HSI super-resolution that can simultaneously address these issues encountered in previous methods. Specifically, by incorporating the factor group sparsity regularization into the subspace representation model, we first propose an FGSSR model to capture the spectral correlation property of the HR-HSI. The key advantage of FGSSR lies in its equivalence to the Schatten-p norm and its adaptive determination of the accurate subspace dimension, enabling it to capture spectral correlation more effectively. To preserve the spatial self-similarity prior in the HR-HSI, the tensor nuclear norm regularization on the low-dimensional coefficients is also incorporated into the proposed FGSSR-based model. Finally, an effective proximal alternating minimization-based algorithm is developed to solve the FGSSR-based model. Experimental results on the simulated and real datasets demonstrate that the proposed FGSSR-based method outperforms several state-of-the-art fusion methods with significant improvements.

Multiband Image Fusion via Regularization on a Riemannian Submanifold

Multiband image fusion aims to generate high spatial resolution hyperspectral images by combining hyperspectral, multispectral or panchromatic images. However, fusing multiband images remains a challenge due to the identifiability and tracking of the underlying subspace across varying modalities and resolutions. In this paper, an efficient multiband image fusion model is proposed to investigate the latent structures and intrinsic physical properties of a multiband image, which is characterized by the Riemannian submanifold regularization method, nonnegativity and sum-to-one constraints. An alternating minimization scheme is proposed to recover the latent structures of the subspace via the manifold alternating direction method of multipliers (MADMM). The subproblem with Riemannian submanifold regularization is tackled by the projected Riemannian trust-region method with guaranteed convergence. The effectiveness of the proposed method is demonstrated on two multiband image fusion problems: (1) hyperspectral and panchromatic image fusion and (2) hyperspectral, multispectral and panchromatic image fusion. The experimental results confirm that our method demonstrates superior fusion performance with respect to competitive state-of-the-art fusion methods.

Multispectral and hyperspectral image fusion based on low-rank unfolding network

Recently, deep unfolding networks (DUNs) have been applied to the fusion of low spatial resolution hyperspectral (LR HS) and high spatial resolution multispectral (HR MS) images and achieved satisfactory high spatial resolution hyperspectral (HR HS) images. However, the low-rank and sparse priors in these networks are not exploited sufficiently. In this paper, we establish an LR HS and HR MS image fusion model based on robust principal component analysis (RPCA), which simultaneously captures the low-rank and sparse properties in HS images. Then, the fusion model is optimized with the alternating direction method of multipliers (ADMM). To make full use of the representation capacity of DUNs, we unfold the derived ADMM algorithm as a network, named low-rank unfolding network (LRU-Net). Specifically, each iteration in ADMM is unfolded as one stage in LRU-Net, in which the low-rank and sparse priors are learned by singular value thresholding (SVT) and sparse module, respectively. Finally, all features from all stages are integrated to produce the desired HR HS image. Three benchmark datasets were chosen for comparison to demonstrate the effectiveness of the proposed LRU-Net. The experimental results demonstrate that LRU-Net performs better in terms of both qualitative and quantitative results compared to state-of-the-art fusion methods. The source code is publicly available at https://github.com/RSMagneto/LRU-Net.

Correlation Matrix-Based Fusion of Hyperspectral and Multispectral Images

The fusion of the hyperspectral image (HSI) and the multispectral image (MSI) is commonly employed to obtain a high spatial resolution hyperspectral image (HR-HSI); however, existing methods often involve complex feature extraction and optimization steps, resulting in time-consuming fusion processes. Additionally, these methods typically require parameter adjustments for different datasets. Still, reliable references for parameter adjustment are often unavailable in practical scenarios, leading to subpar fusion results compared to simulated scenarios. To address these challenges, this paper proposes a fusion method based on a correlation matrix. Firstly, we assume the existence of a correlation matrix that effectively correlates the spectral and spatial information of HSI and MSI, enabling fast fusion. Subsequently, we derive a correlation matrix that satisfies the given assumption by deducing the generative relationship among HR-HSI, HSI, and MSI. Finally, we optimize the fused result using the Sylvester equation. We tested our proposed method on two simulated datasets and one real dataset. Experimental results demonstrate that our method outperforms existing state-of-the-art methods. Particularly, in terms of fusion time, our method achieves fusion in less than 0.1 seconds in some cases. This method provides a practical and feasible solution for the fusion of hyperspectral and multispectral images, overcoming the challenges of complex fusion processes and parameter adjustment while ensuring a quick fusion process.

Universal high spatial resolution hyperspectral imaging using hybrid-resolution image fusion

By fusing a low spatial resolution hyperspectral image (LR-HSI) and a high spatial resolution RGB image (HR-RGB), hybrid-resolution hyperspectral imaging has been a popular framework for acquiring high spatial resolution hyperspectral images (HR-HSIs). Existing fusion methods always employ a known spectral response function (SRF) of the RGB camera to reconstruct the HR-HSI. The SRF is often limited or unavailable in practice, restricting the performance of existing methods. To address this problem, we propose a color space transfer-based fusion strategy that obtains HR-HSIs based on a hybrid resolution hyperspectral imaging system without measuring the SRF. Specifically, using a clustered-based backpropagation neural network, the HR-RGB is mapped into the CIE XYZ color space, and the HR-XYZ is obtained. In the CIE XYZ color space, its SRF is known; thus, the the SRF measurement is successfully skipped. To efficiently fuse the HR-XYZ and the LR-HSI, we propose a polynomial fusion model that estimates the ratio matrix between the target HR-HSI and the upsampled LR-HSI. Finally, the target HR-HSI is reconstructed by combining the ratio matrix and the unsampled LR-HSI. Experimental results on two public data sets and our real-world data sets show that the proposed method outperforms five state-of-the-art fusion methods.

Enhanced Deep Blind Hyperspectral Image Fusion.

The goal of hyperspectral image fusion (HIF) is to reconstruct high spatial resolution hyperspectral images (HR-HSI) via fusing low spatial resolution hyperspectral images (LR-HSI) and high spatial resolution multispectral images (HR-MSI) without loss of spatial and spectral information. Most existing HIF methods are designed based on the assumption that the observation models are known, which is unrealistic in many scenarios. To address this blind HIF problem, we propose a deep learning-based method that optimizes the observation model and fusion processes iteratively and alternatively during the reconstruction to enforce bidirectional data consistency, which leads to better spatial and spectral accuracy. However, general deep neural network inherently suffers from information loss, preventing us to achieve this bidirectional data consistency. To settle this problem, we enhance the blind HIF algorithm by making part of the deep neural network invertible via applying a slightly modified spectral normalization to the weights of the network. Furthermore, in order to reduce spatial distortion and feature redundancy, we introduce a Content-Aware ReAssembly of FEatures module and an SE-ResBlock model to our network. The former module helps to boost the fusion performance, while the latter make our model more compact. Experiments demonstrate that our model performs favorably against compared methods in terms of both nonblind HIF fusion and semiblind HIF fusion.

A method for detecting underground natural gas pipeline micro-leakage in vegetated areas using high spatial resolution hyperspectral imagery

Natural gas is an important clean energy source that is mainly transported through buried pipelines. However, slight leakage during transportation is inevitable and needs to be identified in time to reduce the risk of related accidents. For this purpose, remote sensing can be used as an indirect and non-destructive technique to detect natural gas leakage through vegetation. Abundant spectral and detailed spatial information enables the high spatial resolution hyperspectral imagery to capture subtle stress responses from vegetation. In this study, we designed a simulation experiment of natural gas leakage in vegetated areas, and collected the high spatial resolution hyperspectral images of three plant species. Considering the shadow problem contained in high spatial resolution images, a new vegetation pixel extraction method to eliminate the influence of background shadows was proposed. Then, two spectral transformation methods, continuum removal (CR) and variational mode decomposition (VMD), were integrated to analyze the vegetation spectra, and a spectral index which could reflect the degree of vegetation stress was designed based on the spectral characteristics, named CVI (Continuum removal - Variational mode decomposition Index). Finally, the threshold segmentation methods and the cumulative minimum circumscribed circle method were used to extract the range and location of natural gas leakage. The study demonstrated the potential of using high spatial hyperspectral imagery to map and monitor natural gas leakage through its stress on vegetation. Results of this research can be a reference for the fine identification of stressed plants and are expected to be applied to provide support for related departments and stakeholders.

Dynamic Hyperspectral Pansharpening CNNs

Hyperspectral (HS) pansharpening seeks to integrate low spatial resolution HS (LRHS) images with connected panchromatic (PAN) images to produce high spatial resolution HS (HRHS) images. Traditional pansharpening convolutional neural networks (CNNs) directly map LRHS and PAN images into HRHS images under fixed network parameters, which imply static pansharpening rules. However, real-world HS data are often characterized by spatial variations and intuitively the pansharpening rules should be dynamic. To deal with the dilemma, in this paper we develop dynamic HS pansharpening CNNs. We first specify the concepts of dynamic pansharpening and static pansharpening. Then, we propose a learn-to-learn oriented pansharpening CNN paradigm, which aims to learn a how-to-learn rule to produce spatially adaptive pansharpening rules and comprises three stages of preliminary fusion, scene-sensitive modulation and spectral reconstruction. Finally, following the paradigm, we design two groups of dynamic pansharpening CNNs (DyPNNs), i.e., internal-connection-based and external-connection-based. They involve various spatial modulations, including spatial affine transform (AT), spatial dynamic convolution (DC) or improved spatial attention (SA), and thus consist of six specific DyPNNs: IC-AT-DyPNN, IC-DC-DyPNN, IC-SA-DyPNN, EC-AT-DyPNN, EC-DC-DyPNN and EC-SA-DyPNN. Experimental results on several HS datasets verify the effectiveness of the proposed DyPNNs in terms of both the spatial reconstruction and spectral fidelity.

Hyperspectral Image Super-Resolution Network Based on Cross-Scale Nonlocal Attention

Hyperspectral image (HSI) super-resolution generally means the fusion of low-spatial resolution hyperspectral image (LRHSI) and high-spatial resolution multi-spectral (MSI)/panchromatic (PAN) image (HRMPI) to get high-spatial resolution HSI (HRHSI). Existing fusion methods have not sufficiently considered the huge spectral and spatial resolution difference between the LRHSI and HRMPI. In addition, most DL-based methods that adopt the CNN structure are limited by its local feature learning, and it is difficult to exploit the global dependency of image features. To fully adapt to the huge modality difference between LRHSI and HRMPI and release the limitation of local feature learning, we design the cross spectral-scale and shift-window based cross spatial-scale non-local attention networks (CSSNet) to effectively fuse the LRHSI and HRMPI. These two networks could explicitly learn the spectral and spatial correlations between two input images. These correlations are then used to reconstruct the HRHSI feature, which makes the obtained HRHSI feature to maintain the spectral and spatial feature consistency with the input images. Finally, a ‘feature aggregation module’ is designed to aggregate the image features from these two networks and output the fused HRHSI. Extensive experimental results on both HM-fusion (fusion with MSI) and HP-fusion (fusion with PAN image) tasks demonstrate CSSNet’s state-of-the-art (SOTA) performance compared to other fusion methods. (The codes could be available at https://github.com/rs-lsl/CSSNet).

Lightweight Multiresolution Feature Fusion Network for Spectral Super-Resolution

Spectral super-resolution (SR), which reconstructs high spatial-resolution hyperspectral images (HSIs) from RGB inputs, has been demonstrated to be one of the effective computational imaging techniques to acquire HSIs. Though deep neural networks have shown their superiority in such a complex mapping problem, existing networks generally involve a very complex structure with huge amounts of parameters, resulting in giant memory occupation. In this article, a lightweight multiresolution feature fusion network (MRFN) is proposed, which adopts a multiresolution feature extraction and fusion framework to fully explore RGB inputs in different scales of resolution. Specifically, a lightweight feature extraction module (LFEM), which adopts cheap convolution and attention mechanisms, is constructed to explore different scales of features under a lightweight structure. Moreover, a hybrid loss function is proposed by encountering not only pixel-value level reconstruction error but also spectral continuity and fidelity. Experiments over three benchmark datasets, i.e., CAVE, Interdisciplinary Computational Vision Laboratory (ICVL), and NTIRE2022 datasets, have demonstrated that the proposed MRFN can reconstruct HSIs from RGB inputs in higher quality with fewer parameters and computational floating-point operations (FLOPs) compared with several state-of-the-art networks.

Spectral Reconstruction From Satellite Multispectral Imagery Using Convolution and Transformer Joint Network

Spectral reconstruction based on satellite multispectral (MS) images can produce high spatial resolution hyperspectral (HS) images at a reasonable cost, significantly expanding the application of satellite-based HS remote sensing. As a challenging ill-posed problem, existing methods have difficulty making full use of local and global information of space and spectra to guide the reconstruction, resulting in limited accuracy in large-scale scenes with complex ground features and severe spectral mixing. In this article, we propose a novel convolution and Transformer joint network (CTJN) to address the challenge of high-accuracy spectral reconstruction in complex scenes. The CTJN is cascaded with shallow feature extraction modules (SFEMs) and deep feature extraction modules (DFEMs), which can explore local spatial features and global spectral features. Besides, a high-frequency Transformer block (HF-TB) is designed to highlight the detailed features of the images to prevent significant high-frequency information loss, which could improve the reconstruction results in regions with drastic feature changes. Moreover, a spatial–spectral recalibration block (SSRB) is proposed to perform explicit constraints on the reconstructed points by exploiting the correlation among neighboring pixels and adjacent spectra. Extensive experimental results on four HS–MS datasets and one MS dataset demonstrate that the proposed CTJN outperforms the state-of-the-art methods in large-scale and small-scale scenes.

Hyperspectral Multispectral Image Fusion via Fast Matrix Truncated Singular Value Decomposition

Recently, methods for obtaining a high spatial resolution hyperspectral image (HR-HSI) by fusing a low spatial resolution hyperspectral image (LR-HSI) and high spatial resolution multispectral image (HR-MSI) have become increasingly popular. However, most fusion methods require knowing the point spread function (PSF) or the spectral response function (SRF) in advance, which are uncertain and thus limit the practicability of these fusion methods. To solve this problem, we propose a fast fusion method based on the matrix truncated singular value decomposition (FTMSVD) without using the SRF, in which our first finding about the similarity between the HR-HSI and HR-MSI is utilized after matrix truncated singular value decomposition (TMSVD). We tested the FTMSVD method on two simulated data sets, Pavia University and CAVE, and a real data set wherein the remote sensing images are generated by two different spectral cameras, Sentinel 2 and Hyperion. The advantages of FTMSVD method are demonstrated by the experimental results for all data sets. Compared with the state-of-the-art non-blind methods, our proposed method can achieve more effective fusion results while reducing the fusing time to less than 1% of such methods; moreover, our proposed method can improve the PSNR value by up to 16 dB compared with the state-of-the-art blind methods.

Multispectral and Hyperspectral Image Fusion Based on Regularized Coupled Non-Negative Block-Term Tensor Decomposition

The problem of multispectral and hyperspectral image fusion (MHF) is to reconstruct images by fusing the spatial information of multispectral images and the spectral information of hyperspectral images. Focusing on the problem that the hyperspectral canonical polyadic decomposition model and the Tucker model cannot introduce the physical interpretation of the latent factors into the framework, it is difficult to use the known properties and abundance of endmembers to generate high-quality fusion images. This paper proposes a new fusion algorithm. In this paper, a coupled non-negative block-term tensor model is used to estimate the ideal high spatial resolution hyperspectral images, its sparsity is characterized by adding 1-norm, and total variation (TV) is introduced to describe piecewise smoothness. Secondly, the different operators in two directions are defined and introduced to characterize their piecewise smoothness. Finally, the proximal alternating optimization (PAO) algorithm and the alternating multiplier method (ADMM) are used to iteratively solve the model. Experiments on two standard datasets and two local datasets show that the performance of this method is better than the state-of-the-art methods.

Hyperspectral image super-resolution using cluster-based deep convolutional networks

In recent years, deep convolutional neural networks (CNNs) have been widely exploited for the hyperspectral image (HSI) super-resolution and obtained remarkable performance. However, most of the existing CNN-based methods have two main problems. One is to use two-dimension (2D) convolution to extract spatial information without paying attention to the mining of spectral information of hyperspectral images. The other is to use three-dimension (3D) convolution, which reduces the efficiency of the model when the network parameters increase. To address the above issues, we propose clustering deep residual neural network (CDRNN) for hyperspectral image super-resolution in this paper. The proposed CDRNN learns the complex, nonlinear mappings between low spatial resolution HSI and high spatial resolution HSI. At first, an unsupervised clustering method is used to divide a low spatial resolution HSI into several classes according to spectral correlation. Then, the spectrum-pairs from the classified low spatial resolution HSI and the corresponding high spatial resolution HSI are used to train the CDRNN to establish the nonlinear mapping for each class. Finally, we classify the given low spatial resolution HSI into the determined category and use the trained CDRNN to reconstruct the final high spatial resolution HSI from the classified low spatial resolution HSI. We conduct extensive experiments on three simulated benchmark datasets and a real HSI to evaluate the super-resolution performance of the proposed method. Experimental results show that our proposed method achieves significant improvement over state-of-the-art methods.