Deep Reinforcement Learning for Handover-Aware MPTCP Congestion Control in Space-Ground Integrated Network of Railways

Abstract

Space-ground integrated networks (SGINs) have been recently regarded as a promising way to provide resilient, dependable as well as efficient data transmission in the high-speed railway (HSR) scenario. Applying multipath transmission control protocol (MPTCP) to SGIN can realize data transmission simultaneously via terrestrial and satellite networks. However, since the existing congestion control (CC) mechanisms of MPTCP fail to distinguish between adverse influences (such as packet loss and/or round-trip time increase) caused by congestion and those caused by handovers, it suffers severe performance degradation in the HSR scenario where handover frequently occurs. In this article, we first present the SGIN oriented HSR (SGIN-HSR) with MPTCP. Then leveraging cross-layer information (i.e., reference signal received power), we design a novel cross-layer aided MPTCP CC mechanism targeted at SGIN-HSR based on deep reinforcement learning, which is referred to as HSR-CC, to alleviate performance degradation problems induced by handover. The experimental results show that HSR-CC significantly enhances the goodput and outperforms state-of-the-art MPTCP CC algorithms in SGIN-HSR environments where handover frequently occurs.