Slope erosion in the Loess Plateau region has long been a concern, and vegetation plays an important role in slowing down erosion and controlling sedimentation. However, a single vegetation model shows some limitations when facing complex natural conditions and variable rainfall events. Therefore, this study investigated the influence mechanism of vegetation configuration on slope sand production at different slopes through theoretical analyses and indoor experiments. The results of the study showed that certain factors, such as vegetation configuration mode, flow rate, runoff power, runoff velocity, and runoff shear, are closely related to slope runoff sand production. The specific findings are as follows: (1) Under the condition of slope gradient of 2°, the sand reduction effect of the rigid–flexible single-row staggered configuration is the most significant, and the sediment production is reduced by 29.89%. (2) With the increase in the slope gradient and flow rate, the sand production on the slope surface rises significantly, and when the slope gradient is increased from 2° to 6°, the average sand production is increased from 1.43 kg to 2.51 kg.(3) The erosion reduction effects of different vegetation configurations were in the order of rigid–flexible single-row staggered combination > flexible vegetation single combination > rigid–flexible double-row staggered combination > rigid vegetation single combination > upstream rigid downstream flexible combination > bare slope. This study provides a theoretical basis for optimizing the vegetation configuration for effective sand reduction and provides an important reference for the sustainable development of the Yellow River Basin.