Chapter 8 - Conclusions

Abstract

This chapter provides the overall conclusion of the book. The goal of this book is to develop novel techniques for constructing the video table of contents (ToC), video highlights, the video index, and how to integrate them into a unified framework. To achieve these goals, this book introduced a hierarchical representation that includes key frames, shots, groups, and scenes for scripted video and another hierarchical representation that includes play/break, audio-visual markers, highlight candidates, and highlight groups for unscripted video. Different video indexing techniques based on color, texture, shape, spatial layout, and motion activity have been reviewed. A unique and unified framework is presented for video summarization, browsing, and retrieval to support going back and forth between the video ToC and the video index for scripted video, and between video highlights and video index for unscripted video. For sports highlights extraction, it is shown that detection of audience reaction using audio markers is a reasonable solution. For video highlight extraction, success in detecting objects is shown by using some of the domain constraints.