Learning-Based Reconfigurable-Intelligent-Surface-Aided Rate-Splitting Multiple Access Networks

Abstract

Rate-splitting multiple access (RSMA) and reconfigurable intelligent surface (RIS) techniques show promise in enhancing spectral efficiency in sixth-generation Internet of Things (IoT) networks. However, optimizing the synergy between these two methods is challenging due to the complex and dynamic environment. This study focuses on maximizing the sum-rate metric in RIS-assisted uplink multiantenna RSMA IoT networks to address this problem. We jointly optimized the base station beamforming design, power allocation, and RIS phase shifts to enhance the spectral efficiency with multiple mobile IoT devices present. The controlled parameters are continuous variables and the mathematical problem is non-concave, Therefore, we formulated the problem as a Markov decision process and used the deep deterministic policy gradient (DDPG) to determine the optimal joint actions. We proposed a safe action shaping process for the decision-making actor network to address constraint violations. Through a rigorous performance evaluation, we demonstrated that the DDPG approach with action shaping outperforms the current DDPG algorithm regarding the maximum achievable sum rate.