Developing highly active hydrogen evolution reaction (HER) electrocatalysts possesses great significance for the green renewable energy conversion and storage. Here, through the electrostatic attraction between polyoxometalate (PMo12) and ammonium polyphosphate (APP) and the coordination with polyallylamine hydrochloride (PAH), the precursor was constructed, and then nitrogen-doped graphite carbon layer-coated MoP active particles (MoP@NC) were successfully prepared by high temperature carbonization. For HER, the overpotential of η10 for MoP@NC is 119 and 126 mV in acidic and alkaline electrolyte. Furthermore, in alkaline solution, when the current density reaches a certain degree (≥110 mA cm−2), the hydrogen production activity of the catalysts are the same as that of the industrial Pt/C catalysts, or even have a slight advantage. The synergistic interaction of active particles (MoP) and graphitic carbon layers and high specific surface area ensure the excellent activity of HER. N-doped porous carbon layers also protect MoP@NC working for 24 h. Moreover, the catalysts prepared in the same experimental environment with ammonium molybdate as metal source also showed good HER performance in acidic and alkaline environments. This study opens a general way to develop earth-rich Mo-based phosphide electrocatalysts with high activity for hydrolysis applications.