The detection of landslide areas and surface characteristics is the prerequisite and basis of landslide hazard risk assessment. The traditional method relies mainly on manual field identification, and discrimination is based on the lack of unified quantitative standards. Thus, the use of neural networks for the quantitative identification and prediction of landslide surface deformation is explored. By constructing an integrated model based on YOLO X-CNN and Mask R-CNN, a deep learning-based feature detection method for landslide surface images is proposed. First, the method superimposes Unmanned Aerial Vehicle (UAV) oblique photography data (UOPD) and Internet heterosource image data (IHID) to construct a landslide surface image dataset and landslide surface deformation database. Second, an integrated model suitable for small- and medium-scale target detection and large-scale target edge extraction is constructed to automatically identify and extract landslide surface features and to achieve rapid detection of landslide surface features and accurate segmentation and deformation recognition of landslide areas. The results show that the detection accuracy for small rock targets is greater than 80% and that the speed is 57.04 FPS. The classification and mask segmentation accuracies of large slope targets are approximately 90%. A speed of 7.89 FPS can meet the needs of disaster emergency response; this provides a reference method for the accurate identification of landslide surface features.