Scene Boundary Detection by using Shot Clustering and Music Detection

Abstract

Scene boundary detection is an essential research field in content-based video summary, retrieval, and browsing. In this paper, we propose an efficient and robust scene extraction algorithm by using both video and audio information. The proposed algorithm consists of three stages: shot boundary detection, scene boundary detection, and scene boundary correction. Low level features based on visual information are used in shot and scene boundary detection method. To correct extracted scene boundary in the last stage, music detection is performed by using audio information on the assumption that if a shot contains background music, most of all shots in a scene which includes corresponding shot have same background music in general