Passive scattering-type, scanning near-field optical microscopy (s-SNOM) has been employed to study localized, long-wavelength infrared (LWIR) surface waves without external illumination. Here, we develop a cryogenic passive s-SNOM instrument in a vacuum chamber with 4K liquid-helium cooling. Notably, the extremely low-temperature environment inside the chamber enables the realization of passive near-field detection with low background thermal noise. The technique mainly utilizes a highly sensitive LWIR confocal optical system and a tuning fork-based atomic force microscope, and the near-field detection was performed at a wavelength of 10.2 ± 0.9 µm. In this paper, we discuss the cryogenic s-SNOM implementation in detail and report the investigation of thermally excited surface electromagnetic fields on a self-heated NiCr wire deposited on SiO2 at a temperature of 5K. The origin of the surface electromagnetic fields was established to be the thermally excited fluctuating charges of the conduction electrons. The cryogenic s-SNOM method presented herein shows significant promise for application in a variety of spheres, including hot-carrier dissipation in ballistic conductors.