In this Letter, we report for the first time to our knowledge a 2 mJ-level 2.09 µm Ho:YAG regenerative amplifier (RA) seeded by the first-stage Ho-doped fiber (HDF) preamplifier of a gain-switched laser diode (GSLD). After the single-pass power amplifier (SPPA), the output of a 2.09 µm pulse laser with 1 kHz, 570 ps, and >10 mJ was achieved. The overall gain of the whole amplifier system was greater than 90 dB, providing a novel, stable, and reliable sub-nanosecond (sub-ns) pump source operating at a pulse repetition frequency (PRF) of 1 kHz for an optical parametric generator (OPG) based on ZnGeP2 (ZGP). Specifically, for the ZGP OPG structure, a maximum pulse energy of 1.82 mJ at 3-5 µm had been achieved with an injected pump pulse energy of 5.47 mJ, corresponding to a slope efficiency of 39.5% and an optical-to-optical conversion efficiency (OOCE) of 33.27%.