As a platform for active nanophotonics, localized surface plasmon resonance (LSPR) switching via interaction with a chalcogenide phase change material (GeSbTe) was investigated. We performed single-particle spectroscopy of gold nanoparticles placed on a GeSbTe thin film. By irradiation with a femtosecond pulsed laser for amorphization and a continuous wave laser for crystallization, significant switching behavior of the LSPR band due to the interaction of GeSbTe was observed. The switching mechanism was explained in terms of both a change in the refractive index and a modification of surface morphology accompanying volume expansion and reduction of GeSbTe.