Spatiotemporal Mechanism-Based Spacetimeformer Network for InSAR Deformation Prediction and Identification of Retrogressive Thaw Slumps in the Chumar River Basin

Abstract

The increasing incidence of retrogressive thaw slumps (RTSs) in permafrost regions underscores the need for detailed spatial and temporal analysis using InSAR technology to monitor and predict dynamic changes in the process of RTSs. Nevertheless, current InSAR deformation forecasting methods employing deep learning strategies such as the traditional long short-term memory (LSTM) and recent transformer models encounter difficulties in effectively capturing temporal features. Moreover, they are limited in their ability to directly integrate spatial information. In this paper, an innovative deep learning approach named Spacetimeformer is proposed for predicting medium- and short-term InSAR deformation of RTSs in the Chumar River area. This method employs a transformer architecture with a spatiotemporal attention mechanism, which enhances the long-term prediction capabilities of time series models and dynamic spatial modeling. It is applicable to multivariate InSAR spatiotemporal deformation prediction problems. The findings include a list of 72 RTSs compiled based on derived InSAR deformation maps and Sentinel-2 optical images, of which 64 have an average deformation rate exceeding 10 mm/year, indicating signs of permafrost degradation. The density distribution of the displacement maps predicted by the Spacetimeformer model aligned well with the InSAR deformation maps obtained from the small baseline subset (SBAS) method, with the overall prediction deviation controlled within 20 mm. In addition, the point-scale prediction results were compared with LSTM and transformer models. This study indicates that the Spacetimeformer network achieved good results in predicting the deformation of RTSs, with a root mean square error of 1.249 mm. The Spacetimeformer method for deformation prediction with the spacetime mechanism presented in this study can serve as a general framework for multivariate deformation prediction based on InSAR results. It can also quantitatively assess the spatial deformation characteristics and deformation trends of RTSs.