Nitrification inhibitors (NIs) dicyandiamide (DCD) and 3,4-dimethylpyrazole phosphate (DMPP) showed significant effects in the inhibition of nitrification and the improvement of the utilization efficiency of nitrogen fertilizer in agricultural soils. However, the effects of different NIs on ammonia-oxidizing bacteria (AOB) and archaea (AOA) is still unclear. To verify the inhibitory effect of DCD and DMPP on AOB and AOA, a pot experiment was performed, including Urea, Urea+DCD, and Urea+DMPP treatments. The dynamics of NH4+-N and NO3--N and nitrification potential among different treatments were measured. In addition, real-time PCR and high-throughput sequencing approaches were applied to investigate the changes in the AOB and AOA population abundance and composition. The results revealed that the concentrations of NH4+-N in Urea+DCD and Urea+DMPP treatments were 213% and 675% higher than that in the CK treatment, respectively. However, the concentrations of NO3--N and the nitrification potentials were 13.3% and 37.2%, and 20.4% and 82.4% lower than that in CK treatment, respectively; Furthermore, the copy numbers of the bacterial and archaeal amoA gene were 51.2% and 56.5%, and 6.0% and 27.0% lower than that in the CK treatment, respectively. However, the diversity indexes of AOB and AOA communities, including evenness and richness, exhibited no significant differences after addition of DCD and DMPP. The nork-environmental-samples, unclassified-Nitrosomonadaceae, unclassified-Bacteria, and Nitrosospira, were the predominant genera of the AOB community. The no rank-Crenarchaeota, no rank-environmental-samples and Nitrososphaera were the predominant groups in the AOA community. Summarily, application of DCD and DMPP significantly delayed the transformation of NH4+-N, decreased the formation of NO3--N, inhibited the abundance and changed the composition of AOB and AOA communities. DMPP had a stronger inhibitory effect on nitrification, and on AOB and AOA than DCD. Therefore, compared with DCD, DMPP had a better application prospect regarding the improvement of the nitrogen utilization efficiency in vegetable soil.