International broadcasting convention

Abstract

The proliferation of new capabilities in affordable smart devices capable of capturing, processing and rendering audio-visual media content triggers a need for coordination and orchestration between these devices and their capabilities, and of the content flowing from and to such devices. The upcoming Moving Picture Experts Group (MPEG) Media Orchestration (‘MORE’, ISO/IEC 23001-13) standard enables the temporal and spatial orchestration of multiple media and metadata streams. Temporal orchestration is about time synchronisation of media and sensor captures, processing and renderings, for which the MORE standard uses and extends a DVB standard. Spatial orchestration is about the alignment of (global) position, altitude and orientation, for which the MORE standard provides dedicated timed metadata. Other types of orchestration involve timed metadata for region of interest, perceptual quality of media, audio-feature extraction and media timeline correlation. This study presents the status of the MORE standard, as well as associated technical and experimental support materials. The authors also link MORE to the recently initiated MPEG-I (MPEG Immersive) project.