IDEAS home Printed from https://ideas.repec.org/a/eee/renene/v218y2023ics0960148123011898.html

DDPG-based load frequency control for power systems with renewable energy by DFIM pumped storage hydro unit

Author

Listed:
  • Shi, Linjun
  • Lao, Wenjie
  • Wu, Feng
  • Lee, Kwang Y.
  • Li, Yang
  • Lin, Keman

Abstract

—By exploring the frequency regulation capability of doubly-fed induction machine pumped storage hydro (DFIM-PSH) unit in pumping mode, an improved load frequency control (LFC) strategy is proposed based on deep deterministic policy gradient (DDPG) algorithm for a power system with high penetration of renewable energy and power electronics devices. Using the unit frequency control module of DFIM-PSH in pumping mode, LFC model of regional grid with DFIM-PSH is further established combined with the characteristics of the novel power system. Taking the operation constraints of DFIM-PSH into consideration, DDPG is introduced to optimize the frequency regulation instructions of different units with the goal of minimizing system's frequency deviation and units' regulation power change. By introducing random changes of model parameters and various external disturbances in the pre-learning stage, the adaptability of the proposed LFC strategy in environments with strong uncertainty is further improved. Finally, based on the verification of frequency regulation performance of DFIM-PSH in pumping mode, simulations under scenarios of different wind power penetration and disturbances are carried out. The simulation results show that the proposed LFC strategy can effectively improve the frequency characteristics of the novel power system and has strong robustness.

Suggested Citation

  • Shi, Linjun & Lao, Wenjie & Wu, Feng & Lee, Kwang Y. & Li, Yang & Lin, Keman, 2023. "DDPG-based load frequency control for power systems with renewable energy by DFIM pumped storage hydro unit," Renewable Energy, Elsevier, vol. 218(C).
    • Handle: RePEc:eee:renene:v:218:y:2023:i:c:s0960148123011898
    DOI: 10.1016/j.renene.2023.119274
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0960148123011898
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.renene.2023.119274?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Huang, Yifan & Yang, Weijia & Zhao, Zhigao & Han, Wenfu & Li, Yulan & Yang, Jiandong, 2023. "Dynamic modeling and favorable speed command of variable-speed pumped-storage unit during power regulation," Renewable Energy, Elsevier, vol. 206(C), pages 769-783.
    2. Harrold, Daniel J.B. & Cao, Jun & Fan, Zhong, 2022. "Renewable energy integration and microgrid energy trading using multi-agent deep reinforcement learning," Applied Energy, Elsevier, vol. 318(C).
    3. Wang, Zheng & Zeng, Tiansheng & Chu, Xuening & Xue, Deyi, 2023. "Multi-objective deep reinforcement learning for optimal design of wind turbine blade," Renewable Energy, Elsevier, vol. 203(C), pages 854-869.
    4. Li, Jiawen & Yu, Tao & Zhang, Xiaoshun, 2022. "Coordinated load frequency control of multi-area integrated energy system using multi-agent deep reinforcement learning," Applied Energy, Elsevier, vol. 306(PA).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Liu, Muyang & Wang, Pengliang & Ge, Chenchen & Mao, Shanxiang & Liang, Shaohui & Chen, Junru, 2025. "An additional guide vane opening control for doubly-fed variable-speed pumped hydro storage to improve frequency response," Energy, Elsevier, vol. 324(C).
    2. Yuzhe Chen & Feng Wu & Linjun Shi & Yang Li & Xu Guo & Peng Qi, 2024. "Analysis and Suppression of Oscillations in Doubly Fed Variable Speed Pumped Storage Hydropower Plants Considering the Water Conveyance System," Sustainability, MDPI, vol. 16(19), pages 1-20, October.
    3. Wang, He & Tan, Xiaoqiang & Li, Chaoshun & Presas, Alexandre, 2025. "A composite robust adaptive control for double-fed variable-speed pumped storage units considering stochastic uncertainty," Energy, Elsevier, vol. 329(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lan, Penghang & Chen, She & Li, Qihang & Li, Kelin & Wang, Feng & Zhao, Yaoxun, 2024. "Intelligent hydrogen-ammonia combined energy storage system with deep reinforcement learning," Renewable Energy, Elsevier, vol. 237(PB).
    2. Nasir, M. & Bansal, R.C. & Saloumi, M., 2025. "Reinforcement learning algorithms in AC, DC, and hybrid microgrids applications: A comprehensive review," Applied Energy, Elsevier, vol. 401(PC).
    3. Mian, H.H. & Machot, F.A. & Ullah, H. & Keprate, A. & Siddiqui, M.S., 2025. "Advances in computational intelligence for floating offshore wind turbines aerodynamics: Current state review and future potential," Renewable and Sustainable Energy Reviews, Elsevier, vol. 224(C).
    4. Wu, Long & Yin, Xunyuan & Pan, Lei & Liu, Jinfeng, 2023. "Distributed economic predictive control of integrated energy systems for enhanced synergy and grid response: A decomposition and cooperation strategy," Applied Energy, Elsevier, vol. 349(C).
    5. Xi, Lei & Shi, Yu & Quan, Yue & Liu, Zhihong, 2024. "Research on the multi-area cooperative control method for novel power systems," Energy, Elsevier, vol. 313(C).
    6. Bhargav Appasani & Amitkumar V. Jha & Deepak Kumar Gupta & Nicu Bizon & Phatiphat Thounthong, 2023. "PSO α : A Fragmented Swarm Optimisation for Improved Load Frequency Control of a Hybrid Power System Using FOPID," Energies, MDPI, vol. 16(5), pages 1-17, February.
    7. Wu, Siyuan & Cai, Chang & Zhang, Lei & Hu, Zhiqiang & Sun, Xiangyu & Zhong, Xiaohui & Peng, Chaoyi & Meng, Keqilao & Kou, Jianyu & Li, Qing’an, 2025. "Optimizing wind turbine blade performance: A multi-objective approach for power, load and stall characteristics," Energy, Elsevier, vol. 331(C).
    8. Savino, Sabrina & Minella, Tommaso & Nagy, Zoltán & Capozzoli, Alfonso, 2025. "A scalable demand-side energy management control strategy for large residential districts based on an attention-driven multi-agent DRL approach," Applied Energy, Elsevier, vol. 393(C).
    9. Wang, Huan & Liao, Shengli & Cheng, Chuntian & Liu, Benxi & Fang, Zhou & Wu, Huijun, 2025. "Short-term scheduling strategies for hydro-wind-solar-storage considering variable-speed unit of pumped storage," Applied Energy, Elsevier, vol. 377(PA).
    10. Muhammed, Abdullahi Oboh & El Moursi, Mohamed Shawki & Hatziargyriou, Nikos, 2026. "Review of deep learning techniques applications in modern power systems stability and cyber security," Applied Energy, Elsevier, vol. 402(PB).
    11. Seongwoo Lee & Joonho Seon & Byungsun Hwang & Soohyun Kim & Youngghyu Sun & Jinyoung Kim, 2024. "Recent Trends and Issues of Energy Management Systems Using Machine Learning," Energies, MDPI, vol. 17(3), pages 1-24, January.
    12. Yin, Linfei & Ge, Wei, 2024. "Mobileception-ResNet for transient stability prediction of novel power systems," Energy, Elsevier, vol. 309(C).
    13. Gao, Chunyang & Wu, Haikun & Li, JiQing & Yu, Xiangyang & Nan, Haipeng & Guo, Pengcheng & Meng, Zhijie & Liu, Weixing & Shen, Shikang, 2025. "Mechanism analysis and suppression strategy of reverse flow phenomenon in variable speed pumped storage units under pump mode," Energy, Elsevier, vol. 325(C).
    14. Chen, Wei & Qin, Haoxuan & Zhu, Qing & Bai, Jianshu & Xie, Ningning & Wang, Yazhou & Zhang, Tong & Xue, Xiaodai, 2024. "Optimal design and performance assessment of a proposed constant power operation mode for the constant volume discharging process of advanced adiabatic compressed air energy storage," Renewable Energy, Elsevier, vol. 221(C).
    15. Lydia Tsiami & Christos Makropoulos & Dragan Savic, 2025. "Rethinking Urban Water Network Design: A Reinforcement Learning Framework for Long-Term Flexible Planning," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 39(13), pages 7155-7174, October.
    16. Wu, Haochi & Qiu, Dawei & Zhang, Liyu & Sun, Mingyang, 2024. "Adaptive multi-agent reinforcement learning for flexible resource management in a virtual power plant with dynamic participating multi-energy buildings," Applied Energy, Elsevier, vol. 374(C).
    17. Chang Soon Kim & Van Quan Dao & Jinje Park & Byungho Jang & Seok-Ju Lee & Minwon Park, 2023. "Combining finite element and reinforcement learning methods to design superconducting coils of saturated iron-core superconducting fault current limiter in the DC power system," PLOS ONE, Public Library of Science, vol. 18(11), pages 1-24, November.
    18. Cephas Samende & Zhong Fan & Jun Cao & Renzo Fabián & Gregory N. Baltas & Pedro Rodriguez, 2023. "Battery and Hydrogen Energy Storage Control in a Smart Energy Network with Flexible Energy Demand Using Deep Reinforcement Learning," Energies, MDPI, vol. 16(19), pages 1-20, September.
    19. Mahmud, Sakib & Sayed, Aya Nabil & Himeur, Yassine & Nhlabatsi, Armstrong & Bensaali, Faycal, 2026. "A comprehensive review of deep reinforcement learning applications from centralized power generation to modern energy internet frameworks," Renewable and Sustainable Energy Reviews, Elsevier, vol. 226(PE).
    20. Paudel, Diwas & Das, Tapas K., 2023. "A deep reinforcement learning approach for power management of battery-assisted fast-charging EV hubs participating in day-ahead and real-time electricity markets," Energy, Elsevier, vol. 283(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:renene:v:218:y:2023:i:c:s0960148123011898. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/renewable-energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.