Video quality adaptation using CNN and RNN models for cost-effective and scalable video streaming Services

Abstract

AbstractVideo streaming services require adaptive bit rate strategies that optimize video quality based on network conditions and user preferences to provide a cost-effective and scalable solution. In this manuscript, we present a novel architecture that utilizes a combination of Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs) to extract features from the video stream and predict optimal bit rates for each frame. The CNN feature extractor extracts relevant features from the input video stream, which are then passed on to the RNN predictor, where the optimal bit rate is predicted to ensure a personalized viewing experience tailored to the current network conditions and specific user preferences. Our experimental results demonstrate that the proposed architecture achieves significant improvements in video quality while minimizing bandwidth usage and providing a better user experience. Specifically, our results show a 37.1% improvement in average bit rate, indicating that the proposed architecture optimizes the video quality and reduces bandwidth usage by 37.1% on average. We also observed a 16.6% improvement in Quality of Experience (QoE), meaning that users will perceive the video quality as better. Additionally, rebuffering was reduced by 87.5%, indicating that users enjoy smoother video playback without interruptions. Importantly, our architecture is optimized for Dynamic Adaptive Streaming over HTTP (DASH), addressing the need for efficient streaming over the most widely used protocol in the industry.