3D Video Delivery Research Articles

3DQoE-Oriented and Energy-Efficient 2D plus Depth Based 3D Video Streaming Over Centrally Controlled Networks

IP networks have become the dominant platform for video delivery. However, bandwidth-hungry video is pushing networks to their limits: costs are rising for the operators and the viewing experience is not always satisfactory for the users. When considering 3D video delivery, the previous problems are exacerbated because of the higher volume of data that must be communicated, and the difficulty in characterizing the viewing experience of the end user. Consequently, network operators may be reluctant to deliver 3D video due to costs and unclear quality improvements to their users. In this setting, the true immersive experience of 3D video remains elusive. In this paper, we focus on the efficient delivery of 3D video in terms of quality and energy cost over centrally controlled networks. As a representative example of a centrally controlled network, a software-defined network (SDN) is assumed. Our approach is based on a comprehensive network-dependent 3D quality of experience (3DQoE) model and an energy cost model for 3D video streaming. By using the developed models, we formulate the problem of energy-efficient and 3DQoE-optimized 3D video flow path routing. The particular characteristic of video/depth rate allocation presented in 3D video is embedded seamlessly into the selection of the optimal routing paths for multiple 3D video streams. The formulated problem is NP-hard and is solved with a heuristic algorithm based on the branch-and-bound method after significant reduction of the solution search space. Extensive 3D video streaming experiments are conducted over an OpenFlow-based SDN with subjective and objective evaluations and they highlight the significant benefits of the proposed approach.

Cloud-Assisted Smart Camera Networks for Energy-Efficient 3D Video Streaming

Despite current obstacles, smart camera networks that offload computationally intensive tasks to remote servers could allow energy-efficient 3D and multiview video encoding and delivery yet still ensure high-quality multiple-device video streaming.

Peer-to-peer system design for adaptive 3D video streaming

3D video is destined to be available in homes and mobile devices. Stereoscopic TV broadcasts have already begun in frame-compatible format for stereoscopic 3D. The natural next step is to deliver 3D content in the form of multiview video (MVV) that enables a natural glasses-free 3D experience. Unfortunately, the number of views needed to drive multiview displays varies depending on the price vs. quality trade-off. Therefore, the bitrate requirement of MVV content changes according to users' display technology, making transmission over fixed bit rate channels inefficient. IP provides a flexible transport mechanism for 3D content; however, wellknown problems such as fluctuations in available link capacity and varying transmission delays pose challenges to 3D video services over the Internet. In this study, we discuss quality-ofexperience- aware rate adaptation methods specific to 3D video and efficient encoding schemes. Then, we introduce a framework to design P2P overlays to deliver 3D video. P2P overlays offer a promising approach to alleviate the high bandwidth requirement of MVV. Furthermore, two use case scenarios are provided to show the discussed methods can help to make 3D video delivery practical over the Internet.

3D 비디오의 HTTP 적응적 스트리밍을 위한 전송규격 설계

최근 멀티미디어 서비스 관련 업계 및 시장에서는 콘텐츠로서의 3D 입체영상과, 전송기술로서의 HTTP 적응적 스트리밍 기법이 큰 관심을 받고 있다. 주목받고 있는 두 기술을 통해 유망하고 시장성 있는 멀티미디어 서비스 모델을 창출할 수 있을 것으로 기대되나, 현재의 표준기술에서는 두 기술의 유기적인 결합 방법을 제공하고 있지 않다. 3D 콘텐츠 서비스는 대역폭이 보장되거나 구애받지 않는 방송 및 저장 서비스 위주로 편중되어 있고, 적응적 스트리밍 서비스는 특정 코덱에 의존적이며, 단순한 영상구성 정보만을 제공하는 기초적 형태의 3D 서비스 제공 방법만을 제공하고 있다. 이에, 본 논문은 인터넷망을 기반으로 안정적이고 끊김 없는 스트리밍 서비스를 다양한 형태의 스테레오스코픽 비디오를 통해 호환성 있는 형태로 제공하기 위한 3D 비디오의 적응적 스트리밍 전송규격을 제안하고자한다. 제안하는 기술은 스테레오스코픽 비디오의 저장에 대한 서비스 지향적 표준기술인 스테레오스코픽 비디오 어플리케이션 포맷을 기반으로, 적응적 스트리밍에 대한 대표적 표준기술인 DASH를 통해 직접 적용 가능하도록 설계되었다. 본 논문의 제안 기술은 MPEG에서 작업표준안으로 채택되어 표준기술로 고려되고 있어, 향후 관련 분야에서의 실용적인 산업화를 위한 기틀을 제공할 수 있을 것으로 기대된다. Recently, 3D stereoscopic video and HTTP adaptive streaming technologies have received a lot of attention from relevant industrial fields and markets in terms of multimedia contents and delivery services, respectively. It is expected that promising and marketable service models can be created by means of these noticeable two technologies. However, current standard specifications do not provide a method for organized connection between those two technologies. 3D stereoscopic video services are weighted in broadcasting and storage services that are only available under environments in which the network bandwidth is guaranteed or free. Also, HTTP adaptive streaming technologies only provide plain 3D service methods that are dependent on particular Codec. Therefore, this paper proposes 3D video delivery format for HTTP adaptive streaming service which enables stable and seamless display for various stereoscopic video sequences over internet networks. The proposed technology is designed on the basis of Stereoscopic Video Application Format which is a service-oriented standard specification for storing stereoscopic video sequences. Also, this delivery format is directly applicable over DASH that is the representative standard technology for HTTP adaptive streaming services. The delivery format proposed in this paper has been submitted to MPEG and it has been accepted as a working draft, thus it expected to pave the way for practical industrialization in relevant fields from now on.