Eddy current pulsed thermography (ECPT) technique is a research focus in non-destructive testing (NDT) area for defect inspection. Defect feature extraction for defect information analysis in ECPT is limited by image contrast, heat diffusion, background interference etc.. In this paper, a novel defect feature extraction approach in ECPT based on image partition, local sparse component evaluation and feature fusion has been proposed to improve the quality of defect features. This method can extract complete defect features by enhancing the defect area and removing background interference such as noises, heating coil. Two typical steel specimens are utilized to testify the validity of the proposed approach. Compared with other three common feature extraction algorithms in ECPT, the proposed method can reserve more complete defect features and suppress more background interference.