IDEAS home Printed from https://ideas.repec.org/a/eee/renene/v256y2026ipes0960148125019263.html

Energy optimization scheduling of grid-connected renewable energy hydrogen production system based on RGHS-PPO algorithm

Author

Listed:
  • Liang, Tao
  • Yang, Jiale
  • Chen, Mengjing
  • Cao, Xin
  • Tan, Jianxin
  • Jing, Yanwei
  • Lv, Liangnian

Abstract

To address the issue of "wind and solar curtailment" caused by the intermittency and volatility of wind and photovoltaic (PV) power in renewable-based hydrogen production, this study develops an integrated framework and equipment model for a power grid-coupled renewable hydrogen system (RGHS). The core contribution lies in proposing a novel economic dispatch approach based on deep reinforcement learning (DRL), which effectively overcomes the limitations of traditional CPLEX methods that rely heavily on accurate forecasting and underperform in dynamic state monitoring. Specifically, this study: (1) introduces, for the first time, an economic dispatch model framework for RGHS; (2) innovatively designs an RGHS-PPO approach based on Proximal Policy Optimization (PPO), leveraging its low-complexity advantage to efficiently optimize system performance; and (3) formulates a scheduling strategy aiming to maximize system profit and minimize environmental cost. The real-time dispatch problem is modeled as a Markov Decision Process (MDP), with a carefully designed state space, action space, and reward function, and the RGHS-PPO algorithm is employed for training. Simulation results demonstrate that the RGHS-PPO algorithm not only closely approximates the performance of traditional day-ahead optimization strategies using CPLEX but also significantly reduces total system operating costs compared to state-monitoring-based strategies. Moreover, it improves the utilization of wind and solar energy and exhibits strong robustness and adaptability under forecast uncertainty.

Suggested Citation

  • Liang, Tao & Yang, Jiale & Chen, Mengjing & Cao, Xin & Tan, Jianxin & Jing, Yanwei & Lv, Liangnian, 2026. "Energy optimization scheduling of grid-connected renewable energy hydrogen production system based on RGHS-PPO algorithm," Renewable Energy, Elsevier, vol. 256(PE).
  • Handle: RePEc:eee:renene:v:256:y:2026:i:pe:s0960148125019263
    DOI: 10.1016/j.renene.2025.124262
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0960148125019263
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.renene.2025.124262?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Khosravi, Nima, 2025. "Enhancing operational efficiency through a control-based approach for hydrogen and battery energy storage systems integration in renewable energy networks," Renewable Energy, Elsevier, vol. 248(C).
    2. Qi, Yunying & Xu, Xiao & Liu, Youbo & Pan, Li & Liu, Junyong & Hu, Weihao, 2024. "Intelligent energy management for an on-grid hydrogen refueling station based on dueling double deep Q network algorithm with NoisyNet," Renewable Energy, Elsevier, vol. 222(C).
    3. Zahedi, A., 2011. "Maximizing solar PV energy penetration using energy storage technology," Renewable and Sustainable Energy Reviews, Elsevier, vol. 15(1), pages 866-870, January.
    4. Valencia-Díaz, Alejandro & Toro, Eliana M. & Hincapié, Ricardo A., 2025. "Optimal planning and management of the energy–water–carbon nexus in hybrid AC/DC microgrids for sustainable development of remote communities," Applied Energy, Elsevier, vol. 377(PB).
    5. Li, Nan & Zhao, Xunwen & Shi, Xunpeng & Pei, Zhenwei & Mu, Hailin & Taghizadeh-Hesary, Farhad, 2021. "Integrated energy systems with CCHP and hydrogen supply: A new outlet for curtailed wind power," Applied Energy, Elsevier, vol. 303(C).
    6. Lan, Penghang & Chen, She & Li, Qihang & Li, Kelin & Wang, Feng & Zhao, Yaoxun, 2024. "Intelligent hydrogen-ammonia combined energy storage system with deep reinforcement learning," Renewable Energy, Elsevier, vol. 237(PB).
    7. Zhao, Liyuan & Yang, Ting & Li, Wei & Zomaya, Albert Y., 2022. "Deep reinforcement learning-based joint load scheduling for household multi-energy system," Applied Energy, Elsevier, vol. 324(C).
    8. Wang, Liying & Lin, Jialin & Dong, Houqi & Wang, Yuqing & Zeng, Ming, 2023. "Demand response comprehensive incentive mechanism-based multi-time scale optimization scheduling for park integrated energy system," Energy, Elsevier, vol. 270(C).
    9. Zhang, Guozhou & Hu, Weihao & Zhao, Yincheng & Cui, Zhengjie & Chen, Jianjun & Tang, Chao & Chen, Zhe, 2024. "Meta-learning and proximal policy optimization driven two-stage emergency allocation strategy for multi-energy system against typhoon disasters," Renewable Energy, Elsevier, vol. 237(PC).
    10. Uchman, Wojciech & Kotowicz, Janusz & Sekret, Robert, 2022. "Investigation on green hydrogen generation devices dedicated for integrated renewable energy farm: Solar and wind," Applied Energy, Elsevier, vol. 328(C).
    11. Abunima, Hamza & Park, Woan-Ho & Glick, Mark B. & Kim, Yun-Su, 2022. "Two-Stage stochastic optimization for operating a Renewable-Based Microgrid," Applied Energy, Elsevier, vol. 325(C).
    12. Harrold, Daniel J.B. & Cao, Jun & Fan, Zhong, 2022. "Renewable energy integration and microgrid energy trading using multi-agent deep reinforcement learning," Applied Energy, Elsevier, vol. 318(C).
    13. Wu, Tao & Wang, Jianhui & Lu, Xiaonan & Du, Yuhua, 2022. "AC/DC hybrid distribution network reconfiguration with microgrid formation using multi-agent soft actor-critic," Applied Energy, Elsevier, vol. 307(C).
    14. Rehman, Anis Ur & Ullah, Zia & Qazi, Hasan Saeed & Hasanien, Hany M. & Khalid, Haris M., 2024. "Reinforcement learning-driven proximal policy optimization-based voltage control for PV and WT integrated power system," Renewable Energy, Elsevier, vol. 227(C).
    15. Khaizaran Abdulhussein Al Sumarmad & Nasri Sulaiman & Noor Izzri Abdul Wahab & Hashim Hizam, 2022. "Microgrid Energy Management System Based on Fuzzy Logic and Monitoring Platform for Data Analysis," Energies, MDPI, vol. 15(11), pages 1-19, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lan, Penghang & Chen, She & Li, Qihang & Li, Kelin & Wang, Feng & Zhao, Yaoxun, 2024. "Intelligent hydrogen-ammonia combined energy storage system with deep reinforcement learning," Renewable Energy, Elsevier, vol. 237(PB).
    2. Nasir, M. & Bansal, R.C. & Saloumi, M., 2025. "Reinforcement learning algorithms in AC, DC, and hybrid microgrids applications: A comprehensive review," Applied Energy, Elsevier, vol. 401(PC).
    3. Jinping Li & Xiaotong Han, 2025. "Comprehensive Evaluation of Cogeneration Biogas Multiple Supply System for Rural Communities in Northwest China," Energies, MDPI, vol. 18(12), pages 1-27, June.
    4. Mahmud, Sakib & Sayed, Aya Nabil & Himeur, Yassine & Nhlabatsi, Armstrong & Bensaali, Faycal, 2026. "A comprehensive review of deep reinforcement learning applications from centralized power generation to modern energy internet frameworks," Renewable and Sustainable Energy Reviews, Elsevier, vol. 226(PE).
    5. Lei Zhang & Yuxing Yuan & Su Yan & Hang Cao & Tao Du, 2025. "Advances in Modeling and Optimization of Intelligent Power Systems Integrating Renewable Energy in the Industrial Sector: A Multi-Perspective Review," Energies, MDPI, vol. 18(10), pages 1-50, May.
    6. Zhao, Yunlong & Han, Fengwu & Zeng, Jianfeng & Zhang, Shengnan & Wu, Tianyu & Zhou, Luming & Gao, Jianwei, 2024. "Coordinated optimization of integrated rural multiple regional energy systems considering electricity to ammonia and improved Shapley value revenue allocation," Energy, Elsevier, vol. 313(C).
    7. Michael J. Fell & Alexandra Schneiders & David Shipworth, 2019. "Consumer Demand for Blockchain-Enabled Peer-to-Peer Electricity Trading in the United Kingdom: An Online Survey Experiment," Energies, MDPI, vol. 12(20), pages 1-25, October.
    8. Kordi, Mehrdad & Ertz, Myriam, 2026. "Deciphering technological advancements for efficient disaster management and community resilience," Technology in Society, Elsevier, vol. 84(C).
    9. He, Jiaming & Tan, Qinliang & Lv, Hanyu, 2025. "Data-driven climate resilience assessment for distributed energy systems using diffusion transformer and polynomial expansions," Applied Energy, Elsevier, vol. 380(C).
    10. Razavi, Seyed-Ehsan & Rahimi, Ehsan & Javadi, Mohammad Sadegh & Nezhad, Ali Esmaeel & Lotfi, Mohamed & Shafie-khah, Miadreza & Catalão, João P.S., 2019. "Impact of distributed generation on protection and voltage regulation of distribution systems: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 105(C), pages 157-167.
    11. Wang, Yi & Qiu, Dawei & Sun, Mingyang & Strbac, Goran & Gao, Zhiwei, 2023. "Secure energy management of multi-energy microgrid: A physical-informed safe reinforcement learning approach," Applied Energy, Elsevier, vol. 335(C).
    12. Sifat, Md. Mhamud Hussen & Choudhury, Safwat Mukarrama & Das, Sajal K. & Pota, Hemanshu & Yang, Fuwen, 2025. "Novel abstractions and experimental validation for digital twin microgrid design: Lab scale studies and large scale proposals," Applied Energy, Elsevier, vol. 377(PC).
    13. Yao, Yue & Ma, Yue & Wang, Chenpeng & Ye, Hao & Liu, Yinglong & Liu, Jiawei & Zhao, Xiaobo & Tao, Tao & Yao, Yingbang & Lu, Shengguo & Yang, Huazheng & Liang, Bo, 2022. "A cofuel channel microtubular solid oxide fuel/electrolysis cell," Applied Energy, Elsevier, vol. 327(C).
    14. Melendez, Kevin A. & Matamala, Yolanda, 2025. "Adversarial attacks in demand-side electricity markets," Applied Energy, Elsevier, vol. 377(PD).
    15. Baihao Qiao & Hui Xu & Yitong Liu & Jinglong Ye & Hejuan Hu & Li Yan & Tao Wei, 2025. "Economic, Low-Carbon Dispatch of Seasonal Park Integrated Energy System Based on Adjustable Cooling–Heating–Power Ratio," Energies, MDPI, vol. 18(19), pages 1-25, September.
    16. Liu, Zhi-Feng & Luo, Xing-Fu & Hou, Xiao-Xin & Yu, Jia-Li & Li, Ji-Xiang, 2025. "Generalized energy pool-driven regional integrated energy system dispatch considering multi-time scale synergy carbon-storage game," Renewable and Sustainable Energy Reviews, Elsevier, vol. 217(C).
    17. Shi, Mengshu & Wang, Weiye & Han, Yaxuan & Huang, Yuansheng, 2022. "Research on comprehensive benefit of hydrogen storage in microgrid system," Renewable Energy, Elsevier, vol. 194(C), pages 621-635.
    18. Tan, Bifei & Lin, Zhenjia & Zheng, Xiaodong & Xiao, Fu & Wu, Qiuwei & Yan, Jinyue, 2023. "Distributionally robust energy management for multi-microgrids with grid-interactive EVs considering the multi-period coupling effect of user behaviors," Applied Energy, Elsevier, vol. 350(C).
    19. Mostafa Ahmed & Mohamed Abdelrahem & Ibrahim Harbi & Ralph Kennel, 2020. "An Adaptive Model-Based MPPT Technique with Drift-Avoidance for Grid-Connected PV Systems," Energies, MDPI, vol. 13(24), pages 1-25, December.
    20. Mahmud, Nasif & Zahedi, A., 2016. "Review of control strategies for voltage regulation of the smart distribution network with high penetration of renewable distributed generation," Renewable and Sustainable Energy Reviews, Elsevier, vol. 64(C), pages 582-595.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:renene:v:256:y:2026:i:pe:s0960148125019263. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/renewable-energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.