Surface phonon polaritons (SPhPs) supported by polar dielectrics have been a promising platform for nanophotonics in mid-infrared spectral range. In this work, the temporal dynamic behavior of polar dielectric nanoparticles without (or with) spatial dispersion/nonlocality driven by the ultrashort Gaussian pulses is carried out. We demonstrate that three possible scenarios for the temporal evolutions of the dipole moment including ultrafast oscillations with the decay, exponential decay, and keeping a Gaussian shape exist, when the pulse duration of the incident field is much shorter than, similar to, and much longer than the localized SPhP lifetime. Once the nonlocal effect is considered, the oscillation period becomes large slightly, and the exponential decay turns fast. Furthermore, nonlocality-induced novel temporal behavior is found such as the decay with long-period oscillations when the center frequency of the incident pulse lies at the frequency of adjacent longitudinal resonant modes. The positive and negative time-shifts of the dielectric response reveal that the excitation of the dipole moment will be delayed or advanced. These temporal evolutions can pave the way towards potential applications in the modulation of ultrafast signals for the mid-infrared optoelectronic nanodevices.