Terrain displacement due to the seasonal thaw of the active layer above permafrost can be sensitive to climate change; however, its accurate characterization remains a challenge. This study aimed to improve the measurement of the subsidence or vertical ground surface displacement using differential synthetic aperture radar interferometry (InSAR). Existing methods for reliable phase unwrapping are hindered by the decorrelation between time-series of SAR acquisitions that can result due to the heterogeneity and structural sensitivity of permafrost landscapes to external conditions. In this study, an advanced phase unwrapping method was proposed, in which three types of regions, namely non-residue, sparse residue, and dense residue objects, were obtained from wrapped interferogram and residue map using a segmentation method. Two variants of Polynomial-Based Region Growing Phase Unwrapping (PBRGPU) were developed, which are sparse-residue Object-based PBRGPU(SOP) and dense-residue Object-based PBRGPU(DOP). The results demonstrated that the proposed method outperformed the existing phase unwrapping methods by partially suppressing the decorrelation phase and enhancing robustness for complex terrain deformation in the absence of measured field data. Both the PBRGPU variants and segmentation strategies compose the object-based unwrapping method for permafrost, and also provide a new framework by combining the segmentations and scenarios for phase unwrapping for permafrost regions.