As the primary variable load of bridges, vehicle load is an important parameter for bridge health monitoring. However, traditional Weigh-in-Motion (WIM) systems and the commonly used method of placing sensors on the bridge are challenging to apply in load monitoring for many small and medium-sized bridges. Therefore, this paper proposes a bridge vehicle load identification method based on traffic surveillance video data. Leveraging the surveillance video data on the bridge, without introducing additional hardware devices, the displacement of target points is detected through sub-pixel level image detection algorithms, enabling non-contact measurement of bridge structural response through imaging. A spatiotemporal relationship model of structural displacement, vehicle load, and load distribution is established to solve for vehicle load. Finally, model bridge tests under various loading conditions and engineering practice experiments are conducted to validate the feasibility of the method. The results of the model bridge tests show that the structural displacement measured using traffic video measurement has a deviation of less than 10% compared to the measurements obtained using contact displacement sensors (LVDT), and it can accurately reflect the displacement characteristics of the structure. The results of the field tests demonstrate that the average estimation deviation for heavy vehicle loads ranging from 12 to 18 tons is approximately 18%, meeting the engineering requirements. The proposed method can provide load statistical information for the extensive health monitoring of small and medium-sized bridges and offer a new technical pathway for obtaining bridge load information.