Eddy current pulsed thermography (ECPT) is used to detect rolling contact fatigue (RCF) cracks on the rail. It is observed that some of the cracks disappear in the thermal image with the increase of heating time. Based on the finite element method, with double cracks as the basic unit, three different crack models are established, and the mutual disturbance relationship between the double cracks is discussed based on the eddy current distribution and thermal diffusion process. The simulation and experimental results show that different crack models are affected by thermal diffusion in different heating stages to different degrees, and the time of the crack thermal image disappearance is obtained. According to the above conclusions, the RCF cracks are extracted and classified based on the influence of thermal diffusion. The possibility of rail condition assessment and maintenance based on the disappearance time is explained.