We consider a continuous-time energy harvesting (EH) communication system consisting of an EH transmitter with random lifetime and a receiver. We assume that neither the fading channel state nor the EH state is available to the transmitter and the transmitter can only observe its battery level, based on which it adjusts its transmit power. Specifically, we quantize the battery capacity of the transmitter into a number of levels, and whenever the energy in the battery hits a certain level, the EH transmitter updates its transmit power. Our main objective is to find the optimal battery-level-triggered (BLT) control policy to maximize the expected total throughput of the transmitter in its lifetime. We model the system as an extended two-dimensional stochastic fluid model (2D-SFM), and derive the Laplace-Stieltjes Transform (LST) matrices of the imbedded process on the decision time sequence, based on which, we formulate the power control problem as a Markov decision process (MDP). We obtain the BLT control policy and the maximum expected throughput by solving the 2D-SFM induced MDP. We evaluate the performance of the BLT policy by comparing it with the conventional uniform-in-time control policies, and results show that the proposed BLT power control policy provides significantly higher expected throughput under the same total energy consumption and the same average control frequency.
Read full abstract