A Generation-Storage Coordination Dispatch Strategy for Power System Based on Causal Reinforcement Learning: Article No. 101427

Hang Zhao, Peidong Xu, Jun Zhang, Jian Xu, Tianlu Gao, Siyuan Chen, Yuyang Bai, Jun Hao, Xinhu Zheng, David Gao

Research output: Contribution to journalArticlepeer-review

Abstract

In the backdrop of global energy transformation, power systems integrating high proportions of renewable energy sources are facing unprecedented challenges in operational stability and dispatch efficiency. To address these challenges, this study introduces a generation-storage coordination real-time dispatch strategy based on Causal Power System Dynamic Reinforcement Learning (CPSDRL). Diverging from traditional reinforcement learning approaches, CPSDRL innovatively incorporates causal inference within the state prediction model - the crux of model-based reinforcement learning - thereby establishing the Power Causal Dynamic Model (PCDM). Assisted by the prior knowledge of power systems, the model significantly enhances prediction accuracy and reliability through a two-stage training process. Utilizing PCDM, this study further applies a direct policy search algorithm to optimize the real-time dispatch strategy. Experimental results indicate that the proposed method improves the stability of generation-storage coordination real-time dispatch and exhibits competitive advantages in sample efficiency and computational speed, compared to traditional model-based and model-free reinforcement learning algorithms. This method is expected to enhance the practicality and adaptability of causal reinforcement learning techniques in power system scheduling and control.
Original languageAmerican English
Number of pages16
JournalSustainable Energy, Grids and Networks
Volume39
DOIs
StatePublished - 2024

NREL Publication Number

  • NREL/JA-5D00-90289

Keywords

  • causal reinforcement learning
  • dynamic model learning
  • generation and energy storage coordination
  • high penetration of renewable energy
  • power real-time dispatch

Fingerprint

Dive into the research topics of 'A Generation-Storage Coordination Dispatch Strategy for Power System Based on Causal Reinforcement Learning: Article No. 101427'. Together they form a unique fingerprint.

Cite this