To address the problem of serious soil erosion on the Loess Plateau, under the conditions of limited vegetation measures, the runoff erosion characteristics and erosion sediment sorting characteristics of vegetation at different positions on the upper slope of convex hillslopes are investigated, and the optimal vegetation spatial pattern is proposed according to the benefits of water storage and sediment reduction at different vegetation positions. The fluctuation degree of flow discharge per unit area of different vegetation spatial patterns is small, and the variation process of sediment discharge per unit area of each vegetation spatial pattern fluctuated sharply with the increase of runoff time. After planting vegetation on the slope, the total runoff yield and sediment yield were reduced. The runoff yield reduction benefit was 19.65% when the grass belt was 6 m away from the slope top; and the sediment yield reduction benefit was more than 70% when the grass belt was 2 m away from the slope top. Under the condition of hydraulic erosion on the slope covered with vegetation, the erosion particles are mainly fine particles, with high silt content and relatively small sand content. The farther the vegetation is arranged from the slope top, the more easily silt of size 0.002–0.05 mm is eroded. The higher effectiveness in terms of reductions of both runoff and sediment yields were obtained when the vegetation is planted in the proximity of the end of the length of the slope.