Rill erosion is a widespread form of soil erosion on loess slope surfaces. The rill formation, evolutionary mechanism, and the quantitative expression of rill erosion dynamic changes in a micro-topographic level are currently lacking, primarily owing to lack of finer-scale measurements. This work presented the rill erosion evolutionary process and their dynamic changes at different slope gradients, (12°, 18°) in a millimeter-scale analysis. We achieved it by constructing an artificial excavation in the field and performed a soil pan with dimensions of 8 m in length and 2 m in width, which were subjected to a constant rainfall intensity of 100 mm h−1. The multiphase micro-geomorphologic changes during each rainfall phase were monitored using high-resolution terrestrial laser scanner (TLS). We noticed that the larger overland flow in the rill corresponded to more pronounced fluctuations in the cross-section lines of the rill bed. Also, with more the number of rills, the more easily the overland flow was dispersed, which required a larger slope gradient to resume the erosion and fill processes. Erosion rate and fill rate were highly correlated in general, and they increased abruptly at 70–90°. Due to the presence of swelling minerals, the loess surface expanded rapidly after encountering water in the early stage of rainfall. Therefore, the amount and rate of erosion on the slopes were underestimated. Understanding the detailed evolution process of rill erosion from a micro-perspective can provide a valuable reference for the development law of the initial stage of slope erosion in the loess region where erosion is extremely serious.