The exponential surge in IoT devices has presented significant challenges in managing network traffic and maintaining Quality of Service (QoS) in IoT networks. To tackle these challenges, ongoing efforts are focused on developing innovative solutions that leverage advanced traffic management techniques, robust QoS mechanisms, and enhanced security protocols. Addressing these obstacles is crucial for the continued growth and success of the IoT system, enabling seamless integration of smart devices and revolutionizing multiple industries and sectors by providing unparalleled connectivity and intelligence. This article proposes an innovative approach to enhance the management of heterogeneous IoT devices and ensure Quality of Service (QoS) in IoT networks. Integrating device categories into the QoS policy aims to optimize overall performance while addressing the diverse QoS requirements of different device categories. The benefits of considering device categories include tailored resource allocation, improved user satisfaction, customized QoS handling, and scalability. The proposed approach utilizes the Monte Carlo Control algorithm to learn an optimal QoS policy through simulations of traffic scenarios. Our paper highlights Monte Carlo Control’s (MCC) rapid learning in diverse IoT settings, peaking at 50 episodes, compared to Q-learning’s 100 episodes and dynamic programming’s 200 episodes. Specifically, in audio IoT, MCC achieved 730 packets/second throughput with a 50 ms delay, outperforming QL (723 packets/second, 134 ms) and DP (700 packets/second, 171 ms). These results underscore MCC’s vital role in elevating IoT Quality of Service, making it pivotal for system performance and user experience optimization.
Read full abstract