Abstract
In the fifth generation (5G) wireless system, a closed-loop power control (CLPC) scheme based on deep Q learning network (DQN) is introduced to intelligently adjust the transmit power of the base station (BS), which can improve the user equipment (UE) received signal to interference plus noise ratio (SINR) to a target threshold range. However, the selected power control (PC) action in DQN is not accurately matched the fluctuations of the wireless environment. Since the experience replay characteristic of the conventional DQN scheme leads to a possibility of insufficient training in the target deep neural network (DNN). As a result, the Q-value of the sub-optimal PC action exceed the optimal one. To solve this problem, we propose the improved DQN scheme. In the proposed scheme, we add an additional DNN to the conventional DQN, and set a shorter training interval to speed up the training of the DNN in order to fully train it. Finally, the proposed scheme can ensure that the Q value of the optimal action remains maximum. After multiple episodes of training, the proposed scheme can generate more accurate PC actions to match the fluctuations of the wireless environment. As a result, the UE received SINR can achieve the target threshold range faster and keep more stable. The simulation results prove that the proposed scheme outperforms the conventional schemes.
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.