Camera calibration and vehicle tracking: Highway traffic video analytics

Abstract

We describe a real-time highway surveillance system (RHSS), which operates autonomously to collect statistics (speed and volume) and generates incident alerts (e.g., stopped vehicles). The system is designed to optimize long-term real-time performance accuracy. It also provides convenient integration to an existing surveillance infrastructure with different levels of service. Innovations include a novel 3-D Hungarian algorithm which is utilized for object tracking and a practical, hands-off mechanism for camera calibration. Speed is estimated based on trajectories after mapping/alignment with respect to dominant paths learned based on an evolutionary dynamics model. The system, RHSS, is intensively evaluated under different scenarios such as rain, low-contrast and high-contrast lightings. Performance is presented in comparison to a current commercial product. The contribution is innovation of new technologies that enable hands-off calibration (i.e., automatic detection of vanishing points) and improved accuracy (i.e., illumination balancing, tracking via a new 3-D Hungarian algorithm, and re-initialization of background detection on-the-fly). Results indicate the capability and applicability of the proposed system in real-time and real-world settings.