This letter presents the design and performance of a noise source module for in-situ noise temperature measurements at cryogenic temperatures. The noise source module operates from DC up to 50 GHz and is suitable for measurements of noise temperatures as low as a few Kelvin, achieving a measurement accuracy of about $\pm {1.2}~{\rm K}$ . The GaAs MMIC used in the module includes a well matched 50 $\Omega$ termination with better than 20 dB return loss, a heating element and an on-chip temperature sensor, hence the noise source module can directly be connected to the device under test (DUT) with no additional elements or transitions needed. The measurement can then be taken with standard noise measurement equipment. Noise temperatures as low as 13 K have been measured in Ka-band with this device. Due to the ease of use, the good matching, the extraordinary bandwidth and the less involved calibration technique, the noise source module outperforms the conventional measurement setup using a noise diode in conjunction with a cooled attenuator.