Toward Low-Latency and High-Quality Adaptive 360$^\circ$ Streaming

Abstract

Advanced 360-degree video streaming is essential for high-quality communication and industrial video applications, supporting novel and interactive visual experiences that promote consumption. However, due to the inherent fluctuations in communication networks, hardware resources, and power costs, a trade-off needs to be achieved between occupying network bandwidth and guaranteeing 360-degree visual quality. To address this issue, this paper proposes a quality-aware global optimization solution that combines different types of sensory characteristics to further enhance the 360-degree streaming efficiency in cellular networks. First, considering the characteristics of 360-degree video, each frame is divided into three different regions based on a proposed field-of-view (FoV) prediction method. Second, a new region-based rate-distortion model reflecting the bitrate-quality relationship is proposed. The divided regions are represented by different rate-distortion models. In addition, a rate-distortion model parameter update strategy with robustness to region changes is proposed to further guarantee transmission performance. Finally, we propose a globally optimized adaptive bitrate allocation algorithm to optimize 360-degree mobile streaming, which uses both the rate-distortion models and viewpoint prediction results. Evaluation results indicate that the proposed method outperforms state-of-the-art approaches in terms of several quality of experience (QoE) objectives under various network conditions.