Detection and measurement of partial discharge (PD) phenomena combined with the separation and identification of PD sources is the way to achieve effective insulation integrity assessment. However, during measurement, PD signals are coupled with interferences (discrete spectral, pulsive, and white noises). Recovering PD signals from such interferences would improve PD source separation (thus identification), but still remains a challenging task. Several denoising methods have been proposed to suppress interferences. However, using a universal method to achieve interference removal is probably impossible, as the characteristics of the interferences are distinct. This study proposes a novel low-rank H-Matrix-based singular value decomposition (SVD) filter (H-SVD) that removes different types of interferences. Denoising is done by projecting the measured pulse in a lower dimensional signal space. To assess the effectiveness of the proposed method, H-SVD filter is first applied to simulated PD data and later on real-time PD data with the introduction of three different types of synthetic noises. The results of the evaluation metrics confirm that H-SVD has significant performance improvements compared to existing state-of-the-art PD denoising methods.