Optimal Rule-Interposing Reinforcement Learning-Based Energy Management of Series—Parallel-Connected Hybrid Electric Vehicles

Abstract

P2–P3 series–parallel hybrid electric vehicles exhibit complex configurations with multiple power sources and operational modes, presenting a difficulty in developing efficient energy management strategies. This paper takes a P2–P3 series–parallel hybrid power system-KunTye 2DHT system as the research object and proposes a deep reinforcement learning framework based on pre-optimized energy management to improve the energy consumption performance of the hybrid electric vehicles. Firstly, a control-oriented model is established based on its system configuration and characteristics. Then, the optimal distribution of the motor energy under different operating modes is pre-optimized, which aims to reduce the energy management task’s dimensionality by equating two motors as an equivalent motor. Subsequently, based on real-time traffic information under connected conditions, deep reinforcement learning is utilized to optimize the optimal operating modes of the hybrid system and the optimal distribution between the engine and equivalent motors. Combining the pre-optimized results, the optimal energy distribution between the engine and the two motors in the system is achieved. Finally, performance comparisons are made between the predictive control and the traditional Dynamic Programming and Adaptive Equivalent Consumption Minimization Strategy, revealing the proposed optimization algorithm’s promising potential in reducing fuel consumption.