MPEG-21 Digital Item Adaptation Framework Research Articles

MPEG-21 및 H.264/AVC SVC 기반 동적 비디오 적응 방법

근래의 이종 네트워크 환경에서 비디오를 안정되게 전송하기 위해서는 네트워크 특성, 단말기 성능, 사용자 선호도 등의 소비 환경을 고려한 비디오 적응 방법이 요구되며, 비디오 부호화에서의 스케일러빌러티는 그 요구조건을 만족시키기 위한 좋은 해결책이다. 본 논문에서는 H.264/AVC SVC 스트림을 MPEG-21 디지털 아이템 적응(Digital Item Adaptation, DIA) 도구를 이용하여 네트워크 환경, 단말의 성능, 사용자 선호도에 따라 동적(dynamic)으로 비디오 콘텐츠를 적응시키는 방법을 제안한다. 실험에서는 이종망 네트워크 환경을 모델링하여 대역폭이 최대 62%의 변화가 있는 경우에도 제안한 방법으로 지연이 거의 없이 실시간으로 비트율을 적응할 수 있음을 보인다. Seamless streaming of multimedia content that ensures Quality of Service over heterogeneous networks has been a desire for many multimedia services, for which the multimedia contents should be adapted to usage environments such as network characteristics, terminal capabilities, and user preferences. Scalability in video coding is a good feature to meet the requirement of heterogeneous networks. In this paper, we propose a dynamic adaptation scheme of H.264/AVC SVC bit-stream using the MPEG-21 Digital Item Adaptation (DIA) tool. MPEG-21 DIA framework provides systematic solutions in choosing an adaptation operation to given conditions and supports interoperable video adaptation. The experiment results show that the proposed adaptation scheme provides QoS-enabled delivery and consumption of SVC with time-varying constraints of network, terminal, and user preference, in a robust and efficient way. In particular, the proposed adaptation scheme is proved to work well with very low delay under the condition that the variation rate of the given network bandwidth is upto 62%.

Dynamic and interoperable adaptation of SVC for QoS-enabled streaming

Seamless streaming of multimedia content that ensures Quality of Service (QoS) over heterogeneous networks has been a desire for many multimedia services, for which the multimedia contents should be adapted to usage environments such as network characteristics, terminal capabilities, and user preferences. Scalability in video coding is a good feature to meet the requirement of heterogeneous networks. Currently, the Joint Video Team (JVT) of the ISO/IEC Moving Picture Experts Group (MPEG) and the ITU-T Video Coding Experts Group (VCEG) is standardizing a new scalable video coding standardization, called as SVC, which will become an extension to H.264/MPEG-4 AVC. In this paper, we propose a dynamic adaptation scheme of SVC bit-stream using the MPEG-21 Digital Item Adaptation (DIA) tool. MPEG-21 DIA framework provides systematic solutions in choosing the optimal adaptation operation to given conditions and supports interoperable video adaptation. The experiment results showed that the proposed adaptation scheme provides QoS-enabled delivery and consumption of SVC with time-varying constraints of network, terminal, and user preference, in a robust and efficient way. In addition, session mobility, in which a session is movable from one type of device to another type of device, was performed using switching spatial layer of SVC stream'.

Visual content adaptation according to user perception characteristics

Adapting multimedia content to users' preferences and perceptual characteristics is a key direction for enabling personalized multimedia services. In this paper, we address the problem of tailoring visual content within the MPEG-21 Digital Item Adaptation (DIA) framework to meet users' visual perception characteristics. In particular, we present methods for adapting visual content to accommodate color vision deficiency and low-vision capabilities. In addition, we present methods for adapting visual content according to user preferences for color temperature. Finally, we report on experiments that adapt visual content within the MPEG-21 DIA framework.