Scientifically evaluating China’s black soil protection policy and exploring its evolution characteristics are crucial for promoting high-quality and efficient black soil protection projects worldwide. Utilizing the Policy Modeling Consistency (PMC) index model, the effectiveness of China’s black soil protection policy system is assessed. Building upon this evaluation, the research delves into the evolution process of the black soil protection policy system, examining its dynamic characteristics across different government levels. Through the application of text mining technology and visual analysis techniques, the study explores four dimensions: keyword co-occurrence, vertical synergy calculation, policy theme identification, and policy tool analysis. The results show the following: (1) The PMC index showed a phased growth trend, and various indicators gradually improved and tended to be stable. (2) Government policies at the same level exhibit progressive evolution patterns in terms of policy keywords and themes. (3) Across different levels of government, there are hierarchical lag evolution rules observed in policy keywords and provincial policy tools. Additionally, policy keywords display vertical synergy evolution patterns. In conclusion, future black soil conservation policies need to reduce hierarchical delays, enhance the coverage and comprehensiveness of policy content, and establish a sound policy feedback mechanism. The conclusions of the study are significant for improving management approaches throughout the black soil zones of the world.