Abstract
In this paper, we consider the design of online policies in a backscatter assisted wireless powered communication system, aiming at maximizing the longterm average throughput. We consider a complete data life cycle, from sampling, compression, transmission to reception and decompression. Practical constraints including finite battery capacity, time-varying uplink channel and nonlinear energy harvesting model are considered. An optimization problem is formulated in a Markov decision process framework to maximize the longterm average throughput by a hybrid of mode switching, time and power allocation, and compression ratio selection. Capitalizing on this, we first adopt value iteration (VI) algorithm to find offline optimal solution as benchmark. Then, we propose Q-learning (QL) and deep Q-learning (DQL) algorithms to obtain online solutions without prior information. Simulation results demonstrate the effectiveness of the hybrid transmission mode with flexible data compression. Furthermore, DQL-based online solution performs the closest to the optimal VI-based offline solution and significantly outperforms the other two baseline schemes QL and random policy. Insight analysis on the structure of the optimal policy is also provided.
Sign-in/Register to access full text options 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
