This study develops a model to assess building vulnerability across Xinxing County by integrating quantitative derivation with machine learning techniques. Building vulnerability is characterized as a function of landslide hazard risk and building resistance, wherein landslide hazard risk is derived using CNN (1D) for nine hazard-causing factors (elevation, slope, slope shape, geotechnical body type, geological structure, vegetation cover, watershed, and land-use type) and landslide sites; building resistance is determined through quantitative derivation. After evaluating the building susceptibility of all the structures, the susceptibility of each village is then calculated through subvillage statistics, which are aimed at identifying the specific needs of each area. Simultaneously, different landslide hazard classes are categorized, and an analysis of the correlation between building resistance and susceptibility reveals that building susceptibility exhibits a positive correlation with landslide hazard and a negative correlation with building resistance. Following a comprehensive assessment of building susceptibility in Xinxing County, a sample encompassing different landslide intensity areas and susceptibility classes of buildings was chosen for on-site validation, thus yielding an accuracy rate of the results as high as 94.5%.