Quantitative comparison of metrics for change detection in video patrolling applications

Abstract

This paper provides a comprehensive quantitative comparison of metrics for detecting visual anomalies between two videos that are recorded along same path but at different times by a camera on a patrolling platform. The metrics used in this paper are histogram based metrics, statistic based metrics and pixel differences based metrics. We test the metrics for the detection of mobile and stationary anomalies between videos. The two videos are brought to spatial temporal alignment by a two step process. For each frame in the first video the closest matching frame from the second video is found manually and the matched pair of frames are registered using a feature based registration method. Laws texture kernels are used to extract texture energy measures from the images and nine different metrics are applied to generate a difference image sequence which is followed by thresholding to get a binary image sequence. The binary images are compared with the actual ground truth and the performance of each metric are presented for four videos taken in different environments.