A Hierarchical Multiresolution Video Shot Transition Detection Scheme

Abstract

The problem of digital video segmentation occurs in many different applications. It is the first step toward automatic video indexing, automatic video editing, perceptual coding, etc. We developed a hierarchical multiresolution shot transition detection scheme which takes advantage of the production aspect of video for high precision shot transition detection. New features are proposed to capture the changing statistics of different kinds of shot transitions so as to identify, not only abrupt shot transitions, but also gradual transitions accordingly. Identifying complex transitions—dissolves and wipes—is important due to their use as visual cues to story structure in narrative film. In this paper, a two-pass algorithm, collection and verification, is proposed to study dissolve and wipe transition detection problems, the most difficult shot transition detection problems. Wavelet transformation is utilized for image multiresolution decomposition. Experiment results show that our methodology has much higher precision compared to conventional algorithms.