Accelerating Shot Boundary Detection by reducing spatial and temporal redundant information

Abstract

Shot Boundary Detection (SBD) is the fundamental process in video processing area. However, according to the most existing SBD methods [1], [2], researchers have paid much attention to detect the shot boundaries as accurately as possible with expensive computation cost. In this paper, we propose an approach to accelerate the SBD process by reducing both spatial pixels and temporal frames while keeping satisfactory performance. Our method accelerates the SBD process mainly from two points of view. In spatial domain, the proposed approach only uses the pixels falling into the defined focus region rather than all pixels in a frame; in temporal domain, a step-skip method is employed to reduce the processed frames. Through reducing both detection region and scope, using the corner distribution of frames to remove most of false boundaries, the speed of our SBD approach is improved obviously. We conduct extensive experiments to evaluate the proposed approach, and the results show that our approach can obviously accelerate the SBD process by reducing the computation complexity while keeping satisfactory performance.