HP3O algorithm-based all electric ship energy management strategy integrating demand-side adjustment

Abstract

To tackle the energy management challenge that integrates power generation scheduling and demand-side adjustment for all-electric ship in uncertain marine environment, a hybrid penalized proximal policy optimization algorithm (HP3O)-based energy management strategy is proposed. First, demand-side adjustment, which involves adjusting the power of the ship's electric propulsion motors and flexible service loads, is integrated into the energy management problem. Second, HP3O algorithm is employed to obtain both continuous and discrete variables simultaneously. It utilizes a continuous actor network to obtain continuous variables, such as the generator's power and ship cruising speed, while employing a discrete actor network to determine discrete variables, i.e., the on/off status of the generators. Third, to handle complex constraints reasonably, the energy management problem is formulated as a constrained Markov decision process (CMDP), and an action mask mechanism is also integrated into the energy management framework to make agent's actions more reliable. The simulation results of an all-electric cruise ship validate the effectiveness and superiority of the proposed strategy in achieving near-optimal scheduling while satisfying operation constraints. Furthermore, a case study on a hybrid diesel-electric ferry confirms its generalization performance.