Improving production efficiency of existing agricultural systems is key to promoting sustainable agricultural production. Energy use efficiency in crop production is a key and widely applied index used to measure agricultural production efficiency. Understanding the current status of energy use efficiency in crop production at high spatial resolutions is requisite for developing energy-saving and efficient crop production optimization strategies. This study provides a first attempt at systematically evaluating the county-level energy use efficiency status of China’s three staple food crops (i.e., wheat, maize, and rice) and their associated improvement potential based on the Energy Return on Investment (EROI) method. Results show that average EROI values of wheat, maize, and rice production (i.e., 0.94, 1.1, and 1.3, respectively) substantiate low energy use efficiency under a high improvement potential. Moreover, the energy use efficiency of staple food crop production exhibits considerable spatial heterogeneity. The top 25% counties with the highest EROI values are mainly concentrated in wheat-producing areas of the North China Plain, maize-producing areas of northeastern China and Inner Mongolia, and rice-producing areas of the central Yangtze River region. Crop yields and agricultural machinery inputs are the main EROI driving factors. Furthermore, scenario analysis shows that regional EROI gaps in wheat, maize, and rice production could be narrowed by increasing yields and improving agricultural machinery operation efficiency. Overall, this study provides an improved understanding of the current energy use efficiency status of staple food crop production in China. Recommended solutions are also proposed to improve the EROI of staple food crops. This provides scientific support in formulating regional optimal management strategies for crop production and guidance for farmers to conduct more efficient production practices. Additionally, our framework can also be adopted and built upon in regions throughout the world that experience similar low energy use efficiency conditions in agricultural production.