Hong-Ou-Mandel (HOM) interferometry is a powerful quantum metrology technique to reconstruct the surface-depth profile of transparent samples with complementary benefits of measurement precision and experimental robustness. It is generally assumed that a trade-off exists between the standard HOM interferometry sensitivity and its ambiguity-free dynamic range. Here we challenge this ``well-known'' assumption through the implementation of spectrally resolved HOM interferometry with discrete color entanglement, and show that the well-separated frequencies embedded in a quantum state suffices to achieve great advantages in enhancing the temporal resolution but without limiting its ambiguity-free dynamic range. Backed by the Fisher-information analysis, spectrally resolved coincidence detection is an optimal measurement strategy as it enables us to recover the quantum Cram\'er-Rao bound. These results may significantly facilitate the use of spectrally resolved quantum interference for real-time quantum information processing, such as ultrafast phase transition and spectral-temporal photography.