An Energy Minimization Approach for Automatic Video Shot and Scene Boundary Detection

Abstract

Shot and scene boundary detection is a primary and an important step towards all the video condensation techniques. In this paper a simple but automatic and efficient scene and shot boundary detection is proposed based on energy minimization approach. A shot differs in its background from another. The background has a temporal continuity throughout the shot, we have invoked this fact in our algorithm. We formulate the extraction of Video shot as an energy minimization problem in which the desire to extract the shot with the common background is represented by an energy term. The energy minimized approach optimizes to minimize the discontinuity in the background edges and color. We have proposed different algorithms for different kinds of shot transitions(cut, fade-in, fade-out, dissolve and wipe) to help us to get a better solution for shot boundary detection problem. We have demonstrated our method with a variety of videos which is capable of accurately detecting shot transitions.