Landslide disasters are associated with severe losses on the Loess Plateau of China. Although early warning systems and susceptibility mapping have mitigated this issue to some extent, most methods are qualitative or semi-quantitative in the site-specific range. In this paper, a quantitative spatial distribution model is presented for site-specific loess landslide hazard assessment. Coupled with multi-temporal remote sensing images and high-precision UAV cloud point data, a total of 98 loess landslides that have occurred since 2004 on the Heifangtai terrace were collected to establish a landslide volume-date and retreating distance database. Eleven loess landslides are selected to construct a numerical model for parameter back analysis, and the accuracy of the simulation results is quantitatively evaluated by the centroid distance and overlapping area. Different volumes and receding distance rates of landslides are fitted to determine the relationship between cracks and potential volume, and different volumes and parameters are combined to simulate the spatial distribution of potential loess landslides. The results of this study reveal that landslide volumes mainly range between 1 × 103 and 5 × 105 m3, and the historical occurrence probability reaches 0.551. The optimal parameters are estimated by the maximum likelihood method to obtain a uniform distribution parameter value probability model, and the results show that the error of the estimated length within a range of 0.05 from the optimal parameter does not exceed 15%. In the selected slope slide case, farmland near the toe of the slope primarily includes exposed hazards with probabilities greater than 0.7. This work provides a useful reference for local disaster reduction and a theoretical methodology for hazard assessments.