A Multi-view Learning Approach to Foreground Detection for Traffic Surveillance Applications

Abstract

This paper proposes an effective multi-view learning approach to foreground detection for traffic surveillance applications. This approach involves three main steps. First, a reference background image is generated via temporal median filtering, and multiple heterogeneous features (including brightness variation, chromaticity variation, and texture variation, each of which represents a unique view) are extracted from the video sequence. Then, a multi-view learning strategy is devised to online estimate the conditional probability densities for both the foreground and the background. The probability densities of three features are approximately conditionally independent and are estimated with kernel density estimation. Pixel soft labeling is conducted by using Bayes rule, and the pixelwise foreground posteriors are computed. Finally, a Markov random field is constructed to incorporate the spatiotemporal context into the foreground/background decision model. The belief propagation algorithm is used to label each pixel of the current frame. Experimental results verify that the proposed approach is effective to detect foreground objects from challenging traffic environments and outperforms some state-of-the-art methods.