Synthetic aperture radar (SAR) interferometry is a high-resolution microwave remote sensing imaging method. Over the past two decades, many researchers working on remote sensing have applied this technology in various disciplines, including environmental monitoring, disaster monitoring, and elevation mapping. However, due to the existence of many influencing factors in the acquisition stage, such as atmospheric humidity and temperature, the reflected wave signals from the ground will be disturbed when received by remote sensing satellites. The presence of noise in interferograms is inevitable. Therefore, the accuracy of interferometric SAR phase denoising and coherence estimation has a decisive impact on the validity of subsequent processing results. In this paper, we pioneer the use of a nested U-net as a feature extractor for interferometric SAR phase and coherence. In addition, we build a phase filter and a coherence estimator by using the residual learning module. With the aim of determining the unique non-local similarity of InSAR images, we use non-local convolution and channel attention mechanisms to extract features in different dimensions of the interferogram. Through quantitative and qualitative experiments, the proposed method performs better in phase denoising and coherence estimation than state-of-the-art methods.