Satellite imagery based adaptive background models and shadow suppression

Abstract

Accurate segmentation of foreground objects in video scenes is critical for assuring reliable performance of vision systems for object tracking and situational awareness in outdoor scenes. Most existing techniques for background modeling and shadow suppression require that a number of parameters be “hand-tuned” based on environmental conditions. This paper presents two contributions to overcome such limitations. First, we develop and demonstrate a satellite imagery based approach for selecting appropriate background and shadow models. It is shown that the illumination conditions (i.e. cloud cover) of a scene can be reliably inferred from visible satellite images in the local region of the camera. The second contribution presented in the paper is introduction and evaluation of a Hybrid Cone-Cylinder Codebook (HC3) model which combines an adaptive efficient background model with HSV-color space shadow suppression into a single coherent framework. The structure of the HC3 model allows for seamless fusion of the satellite data. We are thereby able to exploit the fact that, for example, shadows are more pronounced on sunny days than cloudy days, allowing for more sensitive detection. The paper presents a set of experiments using day long sequences of videos from an operational surveillance system testbed. Results of these experimental analyses quantitatively illustrate the benefits of using satellite imagery to inform and adaptively adjust background and shadow modeling.