In this paper, indoor model tests were conducted using image analysis, pore pressure, and displacement measurement methods to investigate the failure evolution process and modes of loess spoil slopes with various components under the influence of rainfall and artificial excavation. The results of the experiments reveal that, under the action of rainfall, there are two types of cracks-to-failure modes for pure loess spoil slopes. One involves the formation of a large gully through the dominant channel, while the other is characterized by step-by-step retreating soil damage between cracks. The failure exhibits three distinct stages, and after failure, the slope angle is relatively large (>45°). The process of rainfall-induced destruction affecting loess spoil containing 25% coarse-grained content similarly unfolds in three stages, ultimately resulting in the formation of a regional landslide. This landslide typically encompasses a broader damage range compared to pure loess spoil, albeit with a shallower depth of damage. After the landslide stops and stabilizes, a tiny slope (45°) is created (<45°). The excavation at the toe of the slope induces loess spoil damage in a progressive multi-stage receding manner. This study provides a reference and basis for disaster prevention and warning of spoiled ground in loess areas.