Exploring the driving effects of control factors on changes in sediment yield from a watershed perspective is of paramount importance for refined watershed management. The objective of this research is to unveil the spatiotemporal variation of sediment yield in the Coarse Sandy Hilly Catchments (CSHC) region from 1956 to 2019 and further investigate the relationship between sediment yield and driving factors. The findings revealed that the mutation years of sediment load (SL) at Toudaoguai and Longmen stations were 1986 and 1996, respectively, with annual SL declining by 66.75 % and 79.04 % after the mutation. Water and sediment discharge at Toudaoguai station exhibited more consistent fluctuations over time, while water and sediment discharge at Longmen station remained relatively consistent before 1967, followed by an entirely inconsistent trend. The spatial pattern of the annual average specific sediment yield (SSY) indicated that the northwest watersheds had a relatively higher erosion rate compared to the southeast. Over time, the SSY of each watershed exhibited a decreasing trend. The SSY showed significant negative correlations with terrace, afforestation, topographic position index (TPI), grass planting (GP), and elevation, while demonstrating significant positive correlations with rainfall indicators and runoff depth. Changes in precipitation, topography, vegetation and engineering measures accounted for 58.5 % of the variance in SSY. The total impact of precipitation on SSY change was positive (standard path coefficient (SPC) = 0.567, P < 0.01), whereas the total impact of topography, vegetation measures, and engineering measures on SSY change was negative (SPC = -0.282, −0.231, and −0.087, respectively). This study quantified the impact of different types of controlling factors on sediment yield at the watershed level. The insights provided by these results can contribute to sustainable watershed management and the optimal allocation of soil and water conservation measures (SWCMs).