Multi‐camera traffic scene mosaic based on camera calibration

Abstract

Recently, the traffic application based on vision in the single traffic-monitoring scene has been widely studied and developed. However, cross-regional research is still in its infancy. In order to help solve the application of cross-regional traffic surveillance scenarios, this paper proposes a more reliable and accurate road scene mosaic method under multi-camera surveillance. The mosaic road panorama contains physical information, which can be used to achieve a cross-regional measurement. It also lays the foundation for vehicle spatial location, vehicle speed and traffic incident detection across regions. First, the mapping relationship between the three-dimensional sub-world coordinates and their corresponding two-dimensional image coordinates is established by camera calibration. Second, the projection transformation relationship between two cameras is established by two sub-world coordinate systems and their common information. Finally, we use the proposed inverse projection idea and translation vector relationship to complete the mosaic of two traffic-monitoring road scenes. The experimental results show that the camera calibration accuracy can reach more than 97% in a single scene. The measurement accuracy of the mosaic block is over 95%. The experimental results show that the proposed method has a higher accuracy, which has great value in related theoretical research and practical applications.