PSTile: Perception-Sensitivity-Based 360$^\circ$ Tiled Video Streaming for Industrial Surveillance

Abstract

360 <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$^\circ$</tex-math></inline-formula> video becomes increasingly attractive in smart factories due to its immersive experience for industrial surveillance. However, transmitting this kind of video requires a fairly large demand on the bandwidth due to its high-resolution and panoramic view. Moreover, low-latency responses of the video to users' head movements are required. This leads to the tradeoff between high video quality and low-latency response under limited bandwidth in factories. This paper proposes a perception-sensitivity (PS) based 360 <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$^\circ$</tex-math></inline-formula> tiled video streaming method called PSTile for industrial surveillance. Specifically, a PS tiling strategy is constructed for valid tile grouping based on the designed PS index. Then a tile bitrate adaptation problem is formulated to allocate bitrates to valid tiles. It jointly optimizes surveillance accuracy, end-to-end latency, and quality-of-experience (QoE) of users under accuracy, latency, and bandwidth constraints. Simulations demonstrate that PSTile achieves at least 32.6% lower end-to-end latency and 19.3% higher average video bitrate than grid-tiling and clus-tiling methods.