IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v313y2024ics0360544224035412.html
   My bibliography  Save this article

Design and optimization of a modular hydrogen-based integrated energy system to maximize revenue via nuclear-renewable sources

Author

Listed:
  • Mahmud, Sadab
  • Ponkiya, Binaka
  • Katikaneni, Sravya
  • Pandey, Srijana
  • Mattimadugu, Kranthikiran
  • Yi, Zonggen
  • Walker, Victor
  • Wang, Congjian
  • Westover, Tyler
  • Javaid, Ahmad Y.
  • Heben, Michael
  • Khanna, Raghav

Abstract

This paper demonstrates a novel modular distributed framework that uses optimal energy-dispatching strategies to enable greater flexibility and profitability in nuclear-renewable integrated energy systems (NR-IES). Hydrogen is used as a commodity in this framework since its production can improve grid stability and system operational flexibility, decarbonize heavy industry, and create an additional revenue stream for electricity generators, particularly nuclear power plants with high operational expenses. The proposed solution addresses the challenges associated with merging multiple software and services from various domains by using functional mock-up units (FMU) to co-simulate diverse subsystems designed in various platforms. The tightly coupled integrated energy system (IES) is optimized to maximize revenue by utilizing the deep reinforcement learning (DRL) technique to make smart dispatching decisions based on variable electricity prices and the availability of renewable energy. Proximal policy optimization (PPO) algorithm is used in training and testing the DRL agent. Over a period of 120 days, the proposed hydrogen-based IES framework showed about 10% revenue boost compared to a non-hydrogen generating baseline IES while also providing an easily-adoptable framework which can help to improve the flexibility of future generation nuclear power plants.

Suggested Citation

  • Mahmud, Sadab & Ponkiya, Binaka & Katikaneni, Sravya & Pandey, Srijana & Mattimadugu, Kranthikiran & Yi, Zonggen & Walker, Victor & Wang, Congjian & Westover, Tyler & Javaid, Ahmad Y. & Heben, Michael, 2024. "Design and optimization of a modular hydrogen-based integrated energy system to maximize revenue via nuclear-renewable sources," Energy, Elsevier, vol. 313(C).
    • Handle: RePEc:eee:energy:v:313:y:2024:i:c:s0360544224035412
    DOI: 10.1016/j.energy.2024.133763
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544224035412
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.energy.2024.133763?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Türkay, Belgin Emre & Telli, Ali Yasin, 2011. "Economic analysis of standalone and grid connected hybrid energy systems," Renewable Energy, Elsevier, vol. 36(7), pages 1931-1943.
    2. Vitale, F. & Rispoli, N. & Sorrentino, M. & Rosen, M.A. & Pianese, C., 2021. "On the use of dynamic programming for optimal energy management of grid-connected reversible solid oxide cell-based renewable microgrids," Energy, Elsevier, vol. 225(C).
    3. Bischi, Aldo & Taccari, Leonardo & Martelli, Emanuele & Amaldi, Edoardo & Manzolini, Giampaolo & Silva, Paolo & Campanari, Stefano & Macchi, Ennio, 2014. "A detailed MILP optimization model for combined cooling, heat and power system operation planning," Energy, Elsevier, vol. 74(C), pages 12-26.
    4. Ali Feliachi & Talha Iqbal & Muhammad Choudhry & Hasan Ul Banna, 2022. "A Multi-Layer Data-Driven Security Constrained Unit Commitment Approach with Feasibility Compliance," Energies, MDPI, vol. 15(20), pages 1-19, October.
    5. Kim, Jong Suk & Boardman, Richard D. & Bragg-Sitton, Shannon M., 2018. "Dynamic performance analysis of a high-temperature steam electrolysis plant integrated within nuclear-renewable hybrid energy systems," Applied Energy, Elsevier, vol. 228(C), pages 2090-2110.
    6. Liu, Jinhui & Xu, Zhanbo & Wu, Jiang & Liu, Kun & Guan, Xiaohong, 2021. "Optimal planning of distributed hydrogen-based multi-energy systems," Applied Energy, Elsevier, vol. 281(C).
    7. Stoppato, Anna & Cavazzini, Giovanna & Ardizzon, Guido & Rossetti, Antonio, 2014. "A PSO (particle swarm optimization)-based model for the optimal management of a small PV(Photovoltaic)-pump hydro energy storage in a rural dry area," Energy, Elsevier, vol. 76(C), pages 168-174.
    8. Hua, Haochen & Qin, Yuchao & Hao, Chuantong & Cao, Junwei, 2019. "Optimal energy management strategies for energy Internet via deep reinforcement learning approach," Applied Energy, Elsevier, vol. 239(C), pages 598-609.
    9. Lee, Woo-Sung & Kang, Jun-Ho & Lee, Jae-Cheol & Lee, Chang-Ha, 2020. "Enhancement of energy efficiency by exhaust gas recirculation with oxygen-rich combustion in a natural gas combined cycle with a carbon capture process," Energy, Elsevier, vol. 200(C).
    10. Pan, Guangsheng & Gu, Wei & Qiu, Haifeng & Lu, Yuping & Zhou, Suyang & Wu, Zhi, 2020. "Bi-level mixed-integer planning for electricity-hydrogen integrated energy system considering levelized cost of hydrogen," Applied Energy, Elsevier, vol. 270(C).
    11. Gude, Veera Gnaneswar, 2015. "Energy storage for desalination processes powered by renewable energy and waste heat sources," Applied Energy, Elsevier, vol. 137(C), pages 877-898.
    12. Yi, Zonggen & Luo, Yusheng & Westover, Tyler & Katikaneni, Sravya & Ponkiya, Binaka & Sah, Suba & Mahmud, Sadab & Raker, David & Javaid, Ahmad & Heben, Michael J. & Khanna, Raghav, 2022. "Deep reinforcement learning based optimization for a tightly coupled nuclear renewable integrated energy system," Applied Energy, Elsevier, vol. 328(C).
    13. Guo, Chenyu & Wang, Xin & Zheng, Yihui & Zhang, Feng, 2022. "Real-time optimal energy management of microgrid with uncertainties based on deep reinforcement learning," Energy, Elsevier, vol. 238(PC).
    14. Nowotny, Janusz & Dodson, John & Fiechter, Sebastian & Gür, Turgut M. & Kennedy, Brendan & Macyk, Wojciech & Bak, Tadeusz & Sigmund, Wolfgang & Yamawaki, Michio & Rahman, Kazi A., 2018. "Towards global sustainability: Education on environmentally clean energy technologies," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P2), pages 2541-2551.
    15. Vilardi, Giorgio & Verdone, Nicola, 2022. "Exergy analysis of municipal solid waste incineration processes: The use of O2-enriched air and the oxy-combustion process," Energy, Elsevier, vol. 239(PB).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Sushanta Gautam & Austin Szczublewski & Aidan Fox & Sadab Mahmud & Ahmad Javaid & Temitayo O. Olowu & Tyler Westover & Raghav Khanna, 2025. "Digital Real-Time Simulation and Power Quality Analysis of a Hydrogen-Generating Nuclear-Renewable Integrated Energy System," Energies, MDPI, vol. 18(4), pages 1-22, February.
    2. Asal, Sulenur & Acır, Adem & Dincer, Ibrahim, 2025. "Development and assessment of a nuclear-based hydrogen production facility operated on a boron-based magnesium chloride cycle," Energy, Elsevier, vol. 316(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wilson Pavon & Esteban Inga & Silvio Simani & Maddalena Nonato, 2021. "A Review on Optimal Control for the Smart Grid Electrical Substation Enhancing Transition Stability," Energies, MDPI, vol. 14(24), pages 1-15, December.
    2. Wang, Yijian & Cui, Yang & Li, Yang & Xu, Yang, 2023. "Collaborative optimization of multi-microgrids system with shared energy storage based on multi-agent stochastic game and reinforcement learning," Energy, Elsevier, vol. 280(C).
    3. Qi, Yunying & Xu, Xiao & Liu, Youbo & Pan, Li & Liu, Junyong & Hu, Weihao, 2024. "Intelligent energy management for an on-grid hydrogen refueling station based on dueling double deep Q network algorithm with NoisyNet," Renewable Energy, Elsevier, vol. 222(C).
    4. Zhu, Ziqing & Hu, Ze & Chan, Ka Wing & Bu, Siqi & Zhou, Bin & Xia, Shiwei, 2023. "Reinforcement learning in deregulated energy market: A comprehensive review," Applied Energy, Elsevier, vol. 329(C).
    5. Kang, Dongju & Kang, Doeun & Hwangbo, Sumin & Niaz, Haider & Lee, Won Bo & Liu, J. Jay & Na, Jonggeol, 2023. "Optimal planning of hybrid energy storage systems using curtailed renewable energy through deep reinforcement learning," Energy, Elsevier, vol. 284(C).
    6. Guo, Chenyu & Wang, Xin & Zheng, Yihui & Zhang, Feng, 2022. "Real-time optimal energy management of microgrid with uncertainties based on deep reinforcement learning," Energy, Elsevier, vol. 238(PC).
    7. Ma, Tengfei & Pei, Wei & Deng, Wei & Xiao, Hao & Yang, Yanhong & Tang, Chenghong, 2022. "A Nash bargaining-based cooperative planning and operation method for wind-hydrogen-heat multi-agent energy system," Energy, Elsevier, vol. 239(PE).
    8. Dong, Xiangxiang & Wu, Jiang & Xu, Zhanbo & Liu, Kun & Guan, Xiaohong, 2022. "Optimal coordination of hydrogen-based integrated energy systems with combination of hydrogen and water storage," Applied Energy, Elsevier, vol. 308(C).
    9. Shi, Mengshu & Wang, Weiye & Han, Yaxuan & Huang, Yuansheng, 2022. "Research on comprehensive benefit of hydrogen storage in microgrid system," Renewable Energy, Elsevier, vol. 194(C), pages 621-635.
    10. Xu, Xuesong & Xu, Kai & Zeng, Ziyang & Tang, Jiale & He, Yuanxing & Shi, Guangze & Zhang, Tao, 2024. "Collaborative optimization of multi-energy multi-microgrid system: A hierarchical trust-region multi-agent reinforcement learning approach," Applied Energy, Elsevier, vol. 375(C).
    11. Ghilardi, Lavinia Marina Paola & Castelli, Alessandro Francesco & Moretti, Luca & Morini, Mirko & Martelli, Emanuele, 2021. "Co-optimization of multi-energy system operation, district heating/cooling network and thermal comfort management for buildings," Applied Energy, Elsevier, vol. 302(C).
    12. Zhang, Bin & Wu, Xuewei & Ghias, Amer M.Y.M. & Chen, Zhe, 2023. "Coordinated carbon capture systems and power-to-gas dynamic economic energy dispatch strategy for electricity–gas coupled systems considering system uncertainty: An improved soft actor–critic approach," Energy, Elsevier, vol. 271(C).
    13. Yang, Jingxian & Liu, Junyong & Qiu, Gao & Liu, Jichun & Jawad, Shafqat & Zhang, Shuai, 2023. "A spatio-temporality-enabled parallel multi-agent-based real-time dynamic dispatch for hydro-PV-PHS integrated power system," Energy, Elsevier, vol. 278(PB).
    14. Zhou, Yanting & Ma, Zhongjing & Zhang, Jinhui & Zou, Suli, 2022. "Data-driven stochastic energy management of multi energy system using deep reinforcement learning," Energy, Elsevier, vol. 261(PA).
    15. Soleimanzade, Mohammad Amin & Kumar, Amit & Sadrzadeh, Mohtada, 2022. "Novel data-driven energy management of a hybrid photovoltaic-reverse osmosis desalination system using deep reinforcement learning," Applied Energy, Elsevier, vol. 317(C).
    16. Mousavi, Navid & Kothapalli, Ganesh & Habibi, Daryoush & Das, Choton K. & Baniasadi, Ali, 2020. "A novel photovoltaic-pumped hydro storage microgrid applicable to rural areas," Applied Energy, Elsevier, vol. 262(C).
    17. Guelpa, Elisa & Bischi, Aldo & Verda, Vittorio & Chertkov, Michael & Lund, Henrik, 2019. "Towards future infrastructures for sustainable multi-energy systems: A review," Energy, Elsevier, vol. 184(C), pages 2-21.
    18. Rajbongshi, Rumi & Borgohain, Devashree & Mahapatra, Sadhan, 2017. "Optimization of PV-biomass-diesel and grid base hybrid energy systems for rural electrification by using HOMER," Energy, Elsevier, vol. 126(C), pages 461-474.
    19. Zhao, Tingting & Jiang, Weitao & Niu, Dong & Liu, Hongzhong & Chen, Bangdao & Shi, Yongsheng & Yin, Lei & Lu, Bingheng, 2017. "Flexible pyroelectric device for scavenging thermal energy from chemical process and as self-powered temperature monitor," Applied Energy, Elsevier, vol. 195(C), pages 754-760.
    20. Arkadiusz Adamczyk, 2020. "Sizing and Control Algorithms of a Hybrid Energy Storage System Based on Fuel Cells," Energies, MDPI, vol. 13(19), pages 1-15, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:313:y:2024:i:c:s0360544224035412. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.