UAVs have been widely used in deformation monitoring because of their high availability and flexibility. However, the quality of UAV images is affected by changing attitude and surveying environments, resulting in a low monitoring accuracy. Cross-shaped markers are used to improve the accuracy of UAV monitoring due to their distinct center contrast and absence of eccentricity. However, existing methods cannot rapidly and precisely detect these markers in UAV images. To address these problems, this paper proposes an adaptive Radon-transform-based marker detection and localization method for UAV displacement measurements, focusing on two critical detection parameters, namely, the radius of marker information acquisition and the edge width of the cross-shaped scoring template. The experimental results show that the marker detection rate is 97.2% under different combinations of flight altitudes, radius ratios of marker information acquisition, and marker sizes. Furthermore, the root mean square error of detection and localization is 0.57 pixels, significantly surpassing the performance and accuracy of other methods. We also derive the critical detection radius and appropriate parameter combinations for different heights to further improve the practicality of the method.