The terrain in the loess hilly area of western Henan is fragmented, with steep slopes and weak soil erosion resistance. The substantial soil erosion in this region results in plenty of problems, including decreased soil productivity and ecological degradation. These problems significantly hinder the social and economic development in the region. Soil conservation planning and ecological development require accurate soil erosion surveys. However, the studies of spatio-temporal patterns, evolution, and the driving force of soil erosion in this region are insufficient. Therefore, based on a multi-stage, unequal probability, systematic area sampling method and field investigation, the soil erosion of the loess hilly area of western Henan was quantitatively evaluated by the Chinese Soil Loss Equation (CSLE) in 2022. The impact forces of soil erosion were analyzed by means of a geographic detector and multiple linear regression analysis, and the key driving factors of the spatio-temporal evolution of soil erosion in this region were revealed. The results were as follows. (1) The average soil erosion rate of the loess hilly area in western Henan in 2022 was 5.94 t⋅ha−1⋅a−1, with a percentage of soil erosion area of 29.10%. (2) High soil erosion rates mainly appeared in the west of Shangjie, Xingyang, and Jiyuan, which are related to the development of production and construction projects in these areas. The areas with a high percentage of soil erosion area were in the north (Xinan and Yima), west (Lushi), and southeast (Songxian and Ruyang) of the study area. Moreover, areas with the most erosion were found in forest land, cultivated land, and areas with a slope above 25°. (3) At the landscape level, the number and density of patches of all land types, except orchard land, increased significantly, and the boundary perimeter, landscape pattern segmentation, and degree of fragmentation increased. (4) The geographical detector and multiple linear regression analysis indicated that the driving forces of soil erosion are mainly topographic and climatic (slope length, elevation, precipitation, and temperature). Soil erosion was significantly influenced by the density of landscape patches. These maps and factors influencing soil erosion can serve as valuable sources of information for regional soil conservation plans and ecological environment improvements.