Recovery efficiency of nitrogen fertilizers has always been an important issue, especially for N fertilizer recommendation rate in cropping systems. Based on the equilibrium of N in the soil–plant system, apparent accumulated N fertilizer recovery (NREac) was determined for long-term (15-years) experiments in wheat (Triticum aestivum L.) and maize (Zea mays L.) rotations at five field sites with various soils and climate characteristics in China. The result showed that the frequency of cropping and the content of soil clay affected NREac positively and negatively, respectively. In the absence of nutrient deficiencies and other soil constraints (from NPK (nitrogen, phosphorus and potassium) in S2-CP (site2-Changping) in Beijing, S3-ZZ (site3-Zhengzhou) in Henan province and S4-YL (site4-Yangling) in Shaanxi province), NREac had a narrow range from 70% to 78% with the highest average of 75% in wheat and maize cropping system. Meanwhile, the value 75% of NERac is a rational value proved by 3414 experiments. Additionally, the nitrate-N approach suggested that nitrate-N could be utilized by subsequent crops, the amount of which is calculated by the equation −1.23 × [(NO3−-N) − 87]. Furthermore, another simpler and feasible method was proposed to maintain basic soil fertility while achieving a rational grain yield and maintaining a safe environmental upper threshold of nitrate. The present study provided a suit of methods for N fertilizer recommendations for the optimization of N applications in wheat and maize cropping system in China.