Abstract
Low Earth Orbit (LEO) satellite networking has been an indispensable and promising concept for extending the Internet coverage of future space-air-ground integrated networks to oceanic and remote airspace. However, the topology dynamics of the LEO Satellite Network (LEO-SN) for network state perception (Li <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">et al.</i> , 2019) and the intermittent nature of the Inter-Satellite Links (ISLs) for multipath routing discovery (Wang <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">et al.</i> , 2019, Jiang <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">et al.</i> , 2019) both induce new complicated challenges to multipath traffic scheduling for the sake of improving the utility of the LEO-SN facility (Song <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">et al.</i> , 2014, Zhang <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">et al.</i> , 2018, and Yang <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">et al.</i> , 2020). Motivated by these challenges, this paper aims to develop an AI aided intelligent multipath traffic scheduling approach for bolstering autonomous and efficient communications of LEO-SN. To achieve this, we formulate the multipath traffic scheduling problem into a pheromone incentivized Markov Decision Process (MDP) by considering ant routing protocol and adapting pheromone to LEO-SN. Employing enhanced pheromone characterizing network state, we propose ant-inspired multipath routing discovery, which is capable of promptly discovering routing paths available in the dynamic topology. To improve the utility of these discovered routing paths, we employ deep deterministic policy gradient into the pheromone-incentivized MDP-based scheduling problem to derive an intelligent multipath traffic scheduling strategy. The experimental results are further presented to show the achievable performance improvement.
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.