Hierarchical Energy Management Strategy Based On M-DQN for Fuel Cell Hybrid Electric Vehicle

Abstract

For fuel cell hybrid electric vehicles equipped with a fuel cell (FC), battery (BAT), and supercapacitor (UC), this paper proposes a hierarchical energy management strategy (EMS) based on the improved M-DQN algorithm to reduce hydrogen consumption, enhance the efficiency of the FC, and maintain the state of charge (SoC) of the BAT. Firstly, an adaptive fuzzy low-pass filter is employed to achieve the frequency decoupling of power demand, enabling the UC to provide/absorb the peak power demand. Secondly, an energy management framework based on M-DQN is designed, and the concept of an equivalent consumption minimization strategy is applied to construct the reward function, which includes penalty factors related to the efficiency of the FC and SoC deviation of the BAT, aiming at optimizing the power allocation between the FC and BAT. Simulations and platform tests were conducted under various typical driving cycles. The results indicate that, compared with the traditional M-DQN-based EMS, the proposed EMS can significantly maintain the SoC of the BAT, improve the efficiency of the FC, reduce hydrogen consumption, and even achieve an average improvement of 5.2% in fuel economy.