Multi-area integrated energy systems (MA-IES) with a high proportion of renewable energy have become a trend in social development. The access to a large number of distributed energy sources makes the safe, stable, and economic operation of MA-IES suffer serious challenges. To reduce the frequency deviation and area control error (ACE) of MA-IES and to improve the economy of operation, this study proposed a hybrid modeling with data enhanced driven learning algorithm, which combines model-driven and data-driven algorithms, named combined proportion-integral-derivative and deep reinforcement learning (CPIDDRL). Firstly, the frequency deviation signals are collected and judged, and the smaller frequency deviation signals, which are sent to the model-driven part, are regulated by proportion-integral-derivative (PID) controllers. Then, the ACE and large frequency deviation signals are collected and transmitted to the data-driven part, and the Transformer deep learning network is applied to predict the multi-feature timeseries, which are applied to strategy selection for state-action-reward-state-action reinforcement learning. Finally, the model-driven part and data-driven part work together to generate adjustment commands every 4 s. The control effects of CPIDDRL, PID, Q-learning, and sliding model control algorithms are compared in two and four areas integrated energy systems. The results show that, compared to the comparison algorithms, the CPIDDRL reduces the mean values of frequency deviation and ACEs by at least 46.78% and 6.83%, respectively, and the total generation cost by at least 8.20%. CPIDDRL has practical significance in improving system stability, enhancing renewable energy integration capabilities, and promoting the development of smart grids.
Read full abstract