In the paper, a Q-switched temperature sensing device is proposed and verified, which consists of a modulator based on a large core multimode fiber and a graded index multimode optical fiber (LMF-GIMF), and a sensing unit formed by sandwiching a D-shaped multimode fiber (MMF) between two single mode fibers (SMF). Utilizing the modulator to transform continuous light into pulsed laser, a stable Er3+-doped Q-switched laser with a repetition frequency of 23.04 kHz and a modulation depth of 7.47 % has been achieved. Under its pumping, the SMF-MMF-SMF sensing structure performed thermal detection with a sensitivity of −81.5 pm/℃ as temperature varies in the range of 25 °C to 65 °C. The temperature sensing device based on Q-switching can be used as an independent pulse laser to realize the switch between the light source and the sensing device. At the same time, the sensing device can provide real-time feedback according to the change of the central wavelength, which allows for immediate adjustments in the operational state, enhancing the flexibility and responsiveness. In addition, the characteristics of the sensor based on Q-switched laser can reduce thermal damage and extends the service life of the sensor. As far as we know, this is the first report on Q-switched temperature sensing based on the LMF-GIMF modulator. The proposed sensing device has the advantages of high signal-to-noise ratio, low operating threshold, minimal thermal damage, and serves as an independent Q-switched laser source, which can be applied to pulse laser measurement with high precision and time resolution in the future.