An adaptive shot change detection algorithm and its implementation on portable multimedia player

Abstract

Shot change detection is a main technique for automatic temporal segmentation of video, which requires adaptive adjustment of thresholds and real-time operation in actual applications. To date, few researches have been conducted on real-time shot change detection to be applied to hardware terminals with low performance such as PMPs (portable media player) and cellular phones. In this paper, we propose an adaptive real-time shot change detection algorithm and implement it on an actual PMP. The proposed algorithm consists of the following elements: sub-sampling, weighting variance, and adaptive thresholds. Our experiments obtained the detection rate of about 94.4% in overall accuracy, demonstrating a higher detection rate and a computational amount 1/256 less than the conventional algorithms which have optimal fixed thresholds adjusted by humans for each video. We verified the real-time operation of shot change detection by implementing our algorithm on the PMP of Homecast, a PMP company. The proposed algorithm will be helpful in searching video data on portable media players such as PMPs and cellular phones.