The Coherent Pixels Technique Interferometry Synthetic Aperture Radar (CPT-InSAR) method of inverting surface deformation parameters by using high-quality measuring points possesses the flaw inducing sparse measuring points in non-urban areas. In this paper, we propose the Adaptive Coherent Distributed Pixel InSAR (ACDP-InSAR) method, which is an adaptive method used to extract Distributed Scattering Pixel (DSP) based on statistically homogeneous pixel (SHP) cluster tests and improves the phase quality of DSP through phase optimization, which cooperates with Coherent Pixel (CP) for the retrieval of ground surface deformation parameters. For a region with sparse CPs, DSPs and its SHPs are detected by double-layer windows in two steps, i.e., multilook windows and spatial filtering windows, respectively. After counting the pixel number of maximum SHP cluster (MSHPC) in the multilook window based on the Anderson–Darling (AD) test and filtering out unsuitable pixels, the candidate DSPs are selected. For the filtering window, the SHPs of MSHPC’ pixels within the new window, which is different compared with multilook windows, were detected, and the SHPs of DSPs were obtained, which were used for coherent estimation. In phase-linking, the results of Eigen decomposition-based Maximum likelihood estimator of Interferometric phase (EMI) results are used as the initial values of the phase triangle algorithm (PTA) for the purpose of phase estimation (hereafter called as PTA-EMI). The DSPs and estimated phase are then combined with CPs in order to retrievesurface deformation parameters. The method was validated by two cases. The results show that the density of measuring points increased approximately 6–10 times compared with CPT-InSAR, and the quality of the interferometric phase significantly improved after phase optimization. It was demonstrated that the method is effective in increasing measuring point density and improving phase quality, which increases significantly the detectability of the low coherence region. Compared with the Distributed Scatterer InSAR (DS-InSAR) technique, ACDP-InSAR possesses faster processing speed at the cost of resolution loss, which is crucial for Earth surface movement monitoring at large spatial scales.