Accurately measuring visible cracks in bridges is crucial for their structural health diagnosis, damage detection, performance evaluation, and maintenance planning. The primary means of visual crack detection still relies heavily on manual visual inspection, an inefficient process that can pose significant safety risks. This article develops a unmanned aerial vehicle (UAV) vision-based surface crack measurement methodology and visualization scheme for the bridges that can detect and measure cracks automatically with improved efficiency. The surface crack measurement methodology is achieved by designing a three-stage crack sensing system including the You Only Look Once-based crack recognition, U-shaped network-based crack segmentation, and deep-vision-based crack width calculation. This workflow is integrated into a comprehensive UAV inspection system, which is intended for operation at the field. The surface crack visualization scheme is accomplished by taking advantage of time-series image fusion, GPS information migration, and three-dimensional (3D) point cloud technique to reconstruct the 3D geometrical model of the tested bridge, which is convenient for unveiling the crack information in the bridge. The proposed methodology was successfully validated by a case study on an arch bridge. The achievement of this article promotes the UAV vision-based bridge’s surface crack inspection technology to a new status that no preparation for pasting calibration marker is needed, and crack identification, segmentation, and width calculation are realized promptly during the UAV flying on-site, as well as damage evaluation for bridges is visually fulfilled based on the reconstructed digital-graphical 3D model. The working environments and influencing factors to the developed system are sufficiently discussed. Certain limitations in the current application are pointed out for future improvements.