To control soil erosion, the intensity, area, and distribution of regional soil erosion must be determined to accurately plan and implement corresponding soil conservation measures. Therefore, regional soil erosion assessment has received extensive attention worldwide. At present, a sampling survey approach and full-coverage grid-based calculation are mainly applied in regional soil erosion assessment. The quantitative evaluation of the entire region depends on the quality of the data source. Furthermore, owing to the greatness of the evaluation object, the difficulty of data acquisition, the high cost, and poor usability, the present approach is bound to be at the expense of data accuracy, spatial resolution, time resolution, etc. The sampling survey approach can obtain high-precision data of soil erosion factors. Therefore, it can accurately quantify soil erosion in a field investigation unit. However, the sampling method, sampling density, and extrapolation methods have a significant impact on regional soil erosion assessments. This study considers the case of Baiquan County in the rolling hills of Northeast China as an example. Regional soil erosion evaluation using sampling survey and grid computing were compared. The impact of the data source accuracy on the soil erosion assessment was also quantitatively evaluated. The results of grid method showed a phenomenon of large rates of soil erosion and the ratio of the soil erosion area (the share of areas above the mild level), which were overestimated by 20% and 6%, respectively. A digital elevation model (DEM) with a resolution of 30 m can be used for soil erosion evaluation in plain areas, but that with the same resolution in hilly areas has insufficient calculation accuracy and provides large errors. The grid method can be adopted when land use and soil conservation measures are accurate. Otherwise, the sampling method is recommended. Interpolation of the ratio of the soil erosion area in the survey unit based on land use can better evaluate regional soil erosion.