IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v316y2025ics0360544225000489.html

Feasibility-guaranteed unsupervised deep learning for real-time energy management in integrated electricity and gas systems

Author

Listed:
  • Sayed, Ahmed
  • Jaafari, Khaled Al
  • Eldin, Hatem Zein
  • Al-Durra, Ahmed
  • Elsaadany, Ehab

Abstract

With the increasing integration of renewable energy sources and the shift toward a low-carbon economy, managing the complexities of integrated electric and gas systems (IEGS) has become more challenging. Traditional methods often struggle in real-time applications due to their computational intensity and inability to handle uncertainties effectively. This paper proposes a feasibility-guaranteed, unsupervised deep learning approach for the real-time operation of IEGS. Leveraging advancements in IEGS modeling and machine learning, the method addresses challenges related to pre-training datasets, policy gradient approximation, iterative energy flow solvers, and real-time feasibility. The approach integrates neural networks with non-learnable, physics-driven layers to predict control actions while reconstructing the remaining decisions based on energy flow equations, ensuring exact gradient computations. To enhance solution feasibility, an augmented Lagrangian method is adopted, circumventing the ill-conditioning of penalty methods. The model incorporates LSTM layers to handle dynamic constraints, and a convex safety layer ensures online feasibility. Simulation results on three IEGS systems validate the approach, demonstrating superior learning performance and computational efficiency compared to state-of-the-art methods, achieving over 97% time savings. Results position the approach as a promising tool for addressing the complexities of modern energy systems and energy market clearing and adapting to system changes.

Suggested Citation

  • Sayed, Ahmed & Jaafari, Khaled Al & Eldin, Hatem Zein & Al-Durra, Ahmed & Elsaadany, Ehab, 2025. "Feasibility-guaranteed unsupervised deep learning for real-time energy management in integrated electricity and gas systems," Energy, Elsevier, vol. 316(C).
  • Handle: RePEc:eee:energy:v:316:y:2025:i:c:s0360544225000489
    DOI: 10.1016/j.energy.2025.134406
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544225000489
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2025.134406?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Kwak, Juhyeon & Lee, Yongryeong & Choi, Minje & Lee, Seungjae, 2024. "Deep learning based approaches to enhance energy efficiency in autonomous driving systems," Energy, Elsevier, vol. 307(C).
    2. Jiang, Yunpeng & Ren, Zhouyang & Lu, Chunhao & Li, Hui & Yang, Zhixue, 2024. "A region-based low-carbon operation analysis method for integrated electricity-hydrogen-gas systems," Applied Energy, Elsevier, vol. 355(C).
    3. Sun, Jing & Xia, Yanghong & Peng, Yonggang & Wang, Anqi & Xiong, Jia & Wei, Wei, 2024. "Optimal operation for P2H system with 100% renewable energy concerning thermal-electric properties," Energy, Elsevier, vol. 308(C).
    4. Sayed, Ahmed R. & Wang, Cheng & Bi, Tianshu, 2019. "Resilient operational strategies for power systems considering the interactions with natural gas systems," Applied Energy, Elsevier, vol. 241(C), pages 548-566.
    5. Yun, Yunyun & Zhang, Dahai & Yang, Shengchun & Li, Yaping & Yan, Jiahao, 2023. "Low-carbon optimal dispatch of integrated energy system considering the operation of oxy-fuel combustion coupled with power-to-gas and hydrogen-doped gas equipment," Energy, Elsevier, vol. 283(C).
    6. Kou, Peng & Liang, Deliang & Wang, Chen & Wu, Zihao & Gao, Lin, 2020. "Safe deep reinforcement learning-based constrained optimal control scheme for active distribution networks," Applied Energy, Elsevier, vol. 264(C).
    7. Zhou, Liangsong & Wei, Xiaolong & Suvorov, Anton & Safaraliev, Murodbek, 2024. "Operation of coupled power-gas networks with hydrogen refueling stations, responsive demands and storage systems: A novel stochastic framework," Energy, Elsevier, vol. 309(C).
    8. Zhou, Yujie & Huang, Yin & Mao, Xuping & Kang, Zehao & Huang, Xuejin & Xuan, Dongji, 2024. "Research on energy management strategy of fuel cell hybrid power via an improved TD3 deep reinforcement learning," Energy, Elsevier, vol. 293(C).
    9. Li, Jiawen & Yu, Tao & Zhang, Xiaoshun & Li, Fusheng & Lin, Dan & Zhu, Hanxin, 2021. "Efficient experience replay based deep deterministic policy gradient for AGC dispatch in integrated energy system," Applied Energy, Elsevier, vol. 285(C).
    10. Zhang, Xu & Xu, Wenting & Rauf, Abdul & Ozturk, Ilhan, 2024. "Transitioning from conventional energy to clean renewable energy in G7 countries: A signed network approach," Energy, Elsevier, vol. 307(C).
    11. Zhang, Bin & Hu, Weihao & Xu, Xiao & Zhang, Zhenyuan & Chen, Zhe, 2023. "Hybrid data-driven method for low-carbon economic energy management strategy in electricity-gas coupled energy systems based on transformer network and deep reinforcement learning," Energy, Elsevier, vol. 273(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Selim, Alaa & Mo, Huadong & Pota, Hemanshu & Dong, Daoyi, 2026. "Adaptive optimization of BESS and grid set points: A model-free framework for energy management under dynamic tariff pricing," Energy, Elsevier, vol. 346(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gao, Xianhui & Wang, Sheng & Sun, Ying & Zhai, Junyi & Chen, Nan & Zhang, Xiao-Ping, 2024. "Low-carbon energy scheduling for integrated energy systems considering offshore wind power hydrogen production and dynamic hydrogen doping strategy," Applied Energy, Elsevier, vol. 376(PA).
    2. Gao, Xianhui & Wang, Sheng & Sun, Ying & Zhai, Junyi, 2024. "Low-carbon operation of integrated electricity–gas system with hydrogen injection considering hydrogen mixed gas turbine and laddered carbon trading," Applied Energy, Elsevier, vol. 374(C).
    3. Shen, Rendong & Zhong, Shengyuan & Wen, Xin & An, Qingsong & Zheng, Ruifan & Li, Yang & Zhao, Jun, 2022. "Multi-agent deep reinforcement learning optimization framework for building energy system with renewable energy," Applied Energy, Elsevier, vol. 312(C).
    4. Yu, Peipei & Zhang, Hongcai & Song, Yonghua & Wang, Zhenyi & Dong, Huiyu & Ji, Liang, 2025. "Safe reinforcement learning for power system control: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 223(C).
    5. Oh, Seok Hwa & Yoon, Yong Tae & Kim, Seung Wan, 2020. "Online reconfiguration scheme of self-sufficient distribution network based on a reinforcement learning approach," Applied Energy, Elsevier, vol. 280(C).
    6. Wang, Yi & Qiu, Dawei & Sun, Mingyang & Strbac, Goran & Gao, Zhiwei, 2023. "Secure energy management of multi-energy microgrid: A physical-informed safe reinforcement learning approach," Applied Energy, Elsevier, vol. 335(C).
    7. Wang, Jiakang & Qiu, Ruixian & Wang, Zhiheng & Xi, Guang, 2026. "Low carbon economic dispatch of electric-hydrogen-blended natural gas integrated energy system with multi-energy coupling and integrated demand response," Energy, Elsevier, vol. 344(C).
    8. Wang, Bohong & Klemeš, Jiří Jaromír & Liang, Yongtu & Yuan, Meng & Zhang, Haoran & Liu, Jiayi, 2020. "Implementing hydrogen injection in coal-dominated regions: Supply chain optimisation and reliability analysis," Energy, Elsevier, vol. 201(C).
    9. Anjie Lu & Jianguo Zhou & Minglei Qin & Danchen Liu, 2024. "Considering Carbon–Hydrogen Coupled Integrated Energy Systems: A Pathway to Sustainable Energy Transition in China Under Uncertainty," Sustainability, MDPI, vol. 16(21), pages 1-32, October.
    10. Li, Yuzhe & Ni, Song & Li, Sina & He, Sihong & Cheng, Chung Ki & Dong, Kejian & Zhao, Jiyun, 2026. "A mechanistic wall heat flux partitioning model for the CRUD-affected surface flow boiling under PWR conditions," Energy, Elsevier, vol. 347(C).
    11. Fang Yao & Xinan Zhang & Tat Kei Chau & Herbert Ho-ching Iu, 2023. "Robustly Cooperative Control of Transient Stability for Power System Considering Wind Power and Load Uncertainty by Distribution Preserving Graph Representation Learning (DPG)," Energies, MDPI, vol. 16(5), pages 1-16, March.
    12. Kumar Jadoun, Vinay & Rahul Prashanth, G & Suhas Joshi, Siddharth & Narayanan, K. & Malik, Hasmat & García Márquez, Fausto Pedro, 2022. "Optimal fuzzy based economic emission dispatch of combined heat and power units using dynamically controlled Whale Optimization Algorithm," Applied Energy, Elsevier, vol. 315(C).
    13. Chen, Wei & Kang, Zengrui & Ma, Yongkai & Xiang, Yining, 2025. "Selection of carbon emission reduction cooperation models in existing communities with the participation of electricity enterprises and consumers," Energy, Elsevier, vol. 339(C).
    14. Pengcheng Ni & Zhiyuan Ye & Can Cao & Zhimin Guo & Jian Zhao & Xing He, 2023. "Cooperative Game-Based Collaborative Optimal Regulation-Assisted Digital Twins for Wide-Area Distributed Energy," Energies, MDPI, vol. 16(6), pages 1-17, March.
    15. Feng, Jianbing & Ren, Zhouyang & Li, Wenyuan, 2025. "A robust safe reinforcement learning-based operation method for hybrid electric-hydrogen energy system risk-based dispatch considering dynamic efficiency characteristics of electrolysers," Renewable Energy, Elsevier, vol. 254(C).
    16. Zhang, Tong & Qadrdan, Meysam & Wu, Jianzhong & Couraud, Benoit & Stringer, Martin & Walker, Sara & Hawkes, Adam & Allahham, Adib & Flynn, David & Pudjianto, Danny & Dodds, Paul & Strbac, Goran, 2025. "A systematic review of modelling methods for studying the integration of hydrogen into energy systems," Renewable and Sustainable Energy Reviews, Elsevier, vol. 208(C).
    17. Wang, Ziren & Zhang, Yuyuan & Li, Wei, 2026. "A bi-level optimization operation method for hydrogen-enriched integrated energy systems incorporating dynamic carbon emission factors," Renewable Energy, Elsevier, vol. 256(PD).
    18. Xi, Lei & Shi, Yu & Quan, Yue & Liu, Zhihong, 2024. "Research on the multi-area cooperative control method for novel power systems," Energy, Elsevier, vol. 313(C).
    19. Zhu, Ziqing & Hu, Ze & Chan, Ka Wing & Bu, Siqi & Zhou, Bin & Xia, Shiwei, 2023. "Reinforcement learning in deregulated energy market: A comprehensive review," Applied Energy, Elsevier, vol. 329(C).
    20. Zhang, Yiwen & Lin, Rui & Mei, Zhen & Lyu, Minghao & Jiang, Huaiguang & Xue, Ying & Zhang, Jun & Gao, David Wenzhong, 2024. "Interior-point policy optimization based multi-agent deep reinforcement learning method for secure home energy management under various uncertainties," Applied Energy, Elsevier, vol. 376(PA).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:316:y:2025:i:c:s0360544225000489. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.