For-backward LSTM-based missing data reconstruction for time-series Landsat images

Abstract

ABSTRACT Reconstructing the missing data for cloud/shadow-covered optical satellite images has great significance for enhancing the data availability and multi-temporal analysis. In this study, we proposed a deep-learning-based method for cloud/shadow-covered missing data reconstruction for time-series Landsat images. Central to this method is the combined use of autoencoder, long-short-term memory (AE-LSTM)-based similar pixel clustering and for backward LSTM-based time-series prediction. First, manually delineated cloud/shadow-covered masks were overlaid onto multi-temporal satellite images to produce pixel-wise time-series data with masking values. Second, these pixel-wise time series were clustered by an AE-LSTM-based unsupervised method into multiple clusters, for searching similar pixels. Third, for each cluster of target images, a for-backward-LSTM-based model was established to restore missing values in time series data. Finally, reconstructed data were merged with cloud-free (image) regions to produce cloud-free time-series images. The proposed method was applied onto three datasets of multi-temporal Landsat-8 OLI images to restore cloud/shadow-covered images. The reconstruction results, showing an improvement of greater than 10% in normalized mean-square error compared to the state-of-the-art methods, demonstrated the effectiveness of the proposed method in time-series reconstruction for satellite images.