Scene detection by audio-visual features

Abstract

Compared with cut detection of video data, scene boundary detection is more complicated since the transition of an atmosphere and/or visual scenery need to be recognized. Scene boundary detection by video processing may contain ambiguity because scenes are not always classified with clear distinction. We propose the noble way of scene boundary detection by audio and video features, which takes editing pattern of movies and audio features into account. Back-ground noise extraction and its classification is cooperatively evaluated with visual feature extraction in order to detect the sequence of shots as a single scene. In this paper, we show that the audio analysis to detect the transition of scene improves the accuracy of scene boundary detection as well.