Fast and accurate frequency estimation is difficult for grid-interfaced inverter under distorted grid conditions with off-nominal frequency. A popular solution considers the multiple second-order generalized integrator-based frequency-locked loop yet can hardly achieve a fast dynamic response under significant phase jump and voltage sag. Another solution uses an adaptive sliding window filter with an additional frequency estimator. However, it is challenging to handle numerical instability due to the adjusting marginally-stable resonator and the accumulation error. This letter proposes a delay-tracking loop to overcome these problems. This loop allows the delay length to track the frequency with an inherent harmonics rejection at off-nominal frequency. At the same time, the fast response speed is maintained, and the marginally stable resonator is avoided. Comparative experimental results validate the above claims.