An effective deep-Q learning scheme for QoS improvement in physical layer of software-defined networks

Abstract

The demands of diverse applications necessitate specific communication requirements, such as jitter, packet loss ratio (PLR), and latency, at the end-to-end (E2E) level within the physical layer of software-defined networking (SDN). In heterogeneous network environments, E2E routes traverse multiple domains with varying quality-of-service (QoS) classes of traffic, posing challenges in meeting unique E2E QoS criteria. Hence the performance on the E2E path is significant to meet the needs of applications. Hence, the issue of providing services on the E2E route is challenging due to several QoS classes in a domain on the source-to-destination route. This paper presents an SDN architecture leveraging Deep Q-learning (DQL) to ascertain the appropriate QoS class for E2E routes in software-defined heterogeneous networks, thereby reducing overall E2E delay. The proposed model with DQL is compared with benchmark reinforcement learning. The proposed framework is validated using various real Internet topologies such as Abilene, USNet, and OS3E, assessing not only E2E delay but also jitter, PLR, and throughput, showcasing its efficacy in optimizing network performance regarding these performance metrics.