An energy trajectory-based reinforcement learning framework with meta-adaptation for robust energy management in solar-powered electricity–heat–hydrogen integrated energy system
Author
Abstract
Suggested Citation
DOI: 10.1016/j.energy.2026.140666
Download full text from publisher
As the access to this document is restricted, you may want to
for a different version of it.References listed on IDEAS
- Gao, Yuan & Matsunami, Yuki & Miyata, Shohei & Akashi, Yasunori, 2022. "Multi-agent reinforcement learning dealing with hybrid action spaces: A case study for off-grid oriented renewable building energy system," Applied Energy, Elsevier, vol. 326(C).
- Li, Peng & Wang, Zixuan & Wang, Jiahao & Yang, Weihong & Guo, Tianyu & Yin, Yunxing, 2021. "Two-stage optimal operation of integrated energy system considering multiple uncertainties and integrated demand response," Energy, Elsevier, vol. 225(C).
- Yang, Zhixue & Li, Hui & Zhang, Hongcai, 2025. "A power-to-methanol-based chemical industry system-aided decarbonization approach for power distribution networks," Applied Energy, Elsevier, vol. 384(C).
- Biglarian, Hassan & Abbaspour, Madjid & Saidi, Mohammad Hassan, 2018. "Evaluation of a transient borehole heat exchanger model in dynamic simulation of a ground source heat pump system," Energy, Elsevier, vol. 147(C), pages 81-93.
- Yang, Yuqing & Bremner, Stephen & Menictas, Chris & Kay, Merlinde, 2022. "Modelling and optimal energy management for battery energy storage systems in renewable energy systems: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 167(C).
- Gao, Xiang & Lin, Hua & Jing, Dengwei & Zhang, Xiongwen, 2025. "A novel framework for optimal design of solar-powered integrated energy system considering long timescale characteristics," Energy, Elsevier, vol. 325(C).
- Sorrenti, Ilaria & Harild Rasmussen, Theis Bo & You, Shi & Wu, Qiuwei, 2022. "The role of power-to-X in hybrid renewable energy systems: A comprehensive review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 165(C).
- Yim, Jaeyun & You, Sesun & Blaabjerg, Frede & Lee, Youngwoo & Gui, Yonghao & Kim, Wonhee, 2024. "Energy management systems for forecasted demand error compensation using hybrid energy storage system in nanogrid," Renewable Energy, Elsevier, vol. 221(C).
- Fan, Junqiu & Yan, Rujing & He, Yu & Zhang, Jing & Zhao, Weixing & Liu, Mingshun & An, Su & Ma, Qingfeng, 2025. "Stochastic optimization of combined energy and computation task scheduling strategies of hybrid system with multi-energy storage system and data center," Renewable Energy, Elsevier, vol. 242(C).
- Jendoubi, Imen & Bouffard, François, 2023. "Multi-agent hierarchical reinforcement learning for energy management," Applied Energy, Elsevier, vol. 332(C).
- Lan, Penghang & Chen, She & Li, Qihang & Li, Kelin & Wang, Feng & Zhao, Yaoxun, 2024. "Intelligent hydrogen-ammonia combined energy storage system with deep reinforcement learning," Renewable Energy, Elsevier, vol. 237(PB).
- Wu, Shengcheng & Pang, Aiping, 2025. "Two-stage optimal scheduling strategy for community integrated energy system based on uncertainty and integrated demand response model," Renewable Energy, Elsevier, vol. 251(C).
- Fan, Wei & Ju, Liwei & Tan, Zhongfu & Li, Xiangguang & Zhang, Amin & Li, Xudong & Wang, Yueping, 2023. "Two-stage distributionally robust optimization model of integrated energy system group considering energy sharing and carbon transfer," Applied Energy, Elsevier, vol. 331(C).
- Chen, Zhang & Yiliang, Xie & Hongxia, Zhang & Yujie, Gu & Xiongwen, Zhang, 2023. "Optimal design and performance assessment for a solar powered electricity, heating and hydrogen integrated energy system," Energy, Elsevier, vol. 262(PA).
- G., Varathan & J., Belwin Edward, 2024. "A review of uncertainty management approaches for active distribution system planning," Renewable and Sustainable Energy Reviews, Elsevier, vol. 205(C).
- Zhou, Yizhou & Li, Xiang & Han, Haiteng & Wei, Zhinong & Zang, Haixiang & Sun, Guoqiang & Chen, Sheng, 2024. "Resilience-oriented planning of integrated electricity and heat systems: A stochastic distributionally robust optimization approach," Applied Energy, Elsevier, vol. 353(PA).
- Wang, Yuwei & Yang, Yuanjuan & Fei, Haoran & Song, Minghao & Jia, Mengyao, 2022. "Wasserstein and multivariate linear affine based distributionally robust optimization for CCHP-P2G scheduling considering multiple uncertainties," Applied Energy, Elsevier, vol. 306(PA).
- Sun, Qie & Fu, Yu & Lin, Haiyang & Wennersten, Ronald, 2022. "A novel integrated stochastic programming-information gap decision theory (IGDT) approach for optimization of integrated energy systems (IESs) with multiple uncertainties," Applied Energy, Elsevier, vol. 314(C).
- Fodstad, Marte & Crespo del Granado, Pedro & Hellemo, Lars & Knudsen, Brage Rugstad & Pisciella, Paolo & Silvast, Antti & Bordin, Chiara & Schmidt, Sarah & Straus, Julian, 2022. "Next frontiers in energy system modelling: A review on challenges and the state of the art," Renewable and Sustainable Energy Reviews, Elsevier, vol. 160(C).
- Wang, Yongzhen & Zhang, Lanlan & Song, Yi & Han, Kai & Zhang, Yan & Zhu, Yilin & Kang, Ligai, 2024. "State-of-the-art review on evaluation indicators of integrated intelligent energy from different perspectives," Renewable and Sustainable Energy Reviews, Elsevier, vol. 189(PA).
- Fan, Guozhu & Peng, Chunhua & Wang, Xuekui & Wu, Peng & Yang, Yifan & Sun, Huijuan, 2024. "Optimal scheduling of integrated energy system considering renewable energy uncertainties based on distributionally robust adaptive MPC," Renewable Energy, Elsevier, vol. 226(C).
- Liang, Tao & Chai, Lulu & Tan, Jianxin & Jing, Yanwei & Lv, Liangnian, 2024. "Dynamic optimization of an integrated energy system with carbon capture and power-to-gas interconnection: A deep reinforcement learning-based scheduling strategy," Applied Energy, Elsevier, vol. 367(C).
- Huang, Ruchen & He, Hongwen & Gao, Miaojue, 2023. "Training-efficient and cost-optimal energy management for fuel cell hybrid electric bus based on a novel distributed deep reinforcement learning framework," Applied Energy, Elsevier, vol. 346(C).
- Nirbheram, Joshi Sukhdev & Mahesh, Aeidapu & Bhimaraju, Ambati, 2023. "Techno-economic analysis of grid-connected hybrid renewable energy system adapting hybrid demand response program and novel energy management strategy," Renewable Energy, Elsevier, vol. 212(C), pages 1-16.
- Pinciroli, Luca & Baraldi, Piero & Compare, Michele & Zio, Enrico, 2023. "Optimal operation and maintenance of energy storage systems in grid-connected microgrids by deep reinforcement learning," Applied Energy, Elsevier, vol. 352(C).
- Wang, Yi & Qiu, Dawei & Sun, Mingyang & Strbac, Goran & Gao, Zhiwei, 2023. "Secure energy management of multi-energy microgrid: A physical-informed safe reinforcement learning approach," Applied Energy, Elsevier, vol. 335(C).
- Seger, Pedro V.H. & Rigo-Mariani, Rémy & Thivel, Pierre-Xavier & Riu, Delphine, 2023. "A storage degradation model of Li-ion batteries to integrate ageing effects in the optimal management and design of an isolated microgrid," Applied Energy, Elsevier, vol. 333(C).
- Wei, Ying'an & Fan, Jingjing & Meng, Qinglong & Debnath, Kumar Biswajit & Yang, Yuqin & Liu, Jiao & Lei, Yu, 2025. "EOLD: A reinforcement learning-based energy-optimised load disaggregation framework for demand-side energy management," Renewable Energy, Elsevier, vol. 252(C).
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Gao, Xiang & Lin, Hua & Jing, Dengwei & Zhang, Xiongwen, 2025. "A novel framework for optimal design of solar-powered integrated energy system considering long timescale characteristics," Energy, Elsevier, vol. 325(C).
- Gao, Yuan & Hu, Zehuan & Matsunami, Yuki & Qu, Ming & Chen, Wei-An & Liu, Mingzhe, 2026. "Optimizing renewable energy systems with hybrid action space reinforcement learning: A case study on achieving net zero energy in Japan," Renewable Energy, Elsevier, vol. 256(PG).
- Wang, Zhewei & Yuan, Jie & Li, Yang & Zhang, Leiqi & Xie, Changjun & Zhu, Wenchao & Yang, Yang & Wang, Han, 2026. "A two-stage distributionally robust optimization approach for integrated energy systems: coordinated configuration of CCUS and hydrogen utilization," Energy, Elsevier, vol. 347(C).
- Cai, Pengcheng & Wen, Chuanbo & Cao, Baosen & Qiao, Jinpeng, 2025. "A Wasserstein metric distributionally robust chance-constrained peer aggregation energy sharing mechanism for hydrogen-based microgrids considering low-carbon drivers," Energy, Elsevier, vol. 325(C).
- Yu, Peipei & Zhang, Hongcai & Song, Yonghua & Wang, Zhenyi & Dong, Huiyu & Ji, Liang, 2025. "Safe reinforcement learning for power system control: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 223(C).
- Zhang, Yunyi & Zhou, Dengli & Lin, Boqiang, 2026. "Paving the way for sustainable energy solutions: A real-time pricing mechanism in integrated energy systems with electric vehicles," Renewable Energy, Elsevier, vol. 256(PI).
- Wang, Zizhao & Li, Yang & Wu, Feng & Shi, Linjun & Ding, Renshan & He, Shengming, 2026. "Deep reinforcement learning real-time dispatch approach for cascade hydropower with hybrid pumped-storage mitigating photovoltaic uncertainties," Applied Energy, Elsevier, vol. 408(C).
- Liu, Zhiqiang & Cui, Yanping & Wang, Jiaqiang & Yue, Chang & Agbodjan, Yawovi Souley & Yang, Yu, 2022. "Multi-objective optimization of multi-energy complementary integrated energy systems considering load prediction and renewable energy production uncertainties," Energy, Elsevier, vol. 254(PC).
- Li, Wenzhuo & Li, Donghe & Hou, Shuo & Xi, Huan & Xiao, Yu & Yang, Qingyu, 2026. "Dual-scale optimization of integrated energy systems: a novel MAPPO-based approach for hybrid game equilibrium," Applied Energy, Elsevier, vol. 409(C).
- Lv, You & Tian, Helu & Liao, Conglin & Fang, Fang & Liu, Jizhen, 2026. "Multi-time scale optimal scheduling of green energy data centers considering Carnot batteries," Renewable Energy, Elsevier, vol. 257(C).
- Li, Jie & Liu, Jizhen & Hu, Yong & Zhu, Yansong & Zeng, Deliang & Li, Yunzhi, 2026. "Two-stage distributionally robust optimization model of integrated energy system considering wind–solar joint uncertainties and flexible resources management," Renewable Energy, Elsevier, vol. 262(C).
- Yang, Yu & Liu, Zhiqiang & Xie, Nan & Wang, Jiaqiang & Cui, Yanping & Agbodjan, Yawovi Souley, 2023. "Multi-criteria optimization of multi-energy complementary systems considering reliability, economic and environmental effects," Energy, Elsevier, vol. 269(C).
- Yang, Dongfeng & Zhan, Tong & Liu, Xiaojun & Jiang, Chao & Huang, Gang & Wang, Hui, 2025. "Scenario information gap planning for electricity-gas-hydrogen integrated energy systems considering the impact of grid interaction locations," Energy, Elsevier, vol. 335(C).
- Han, Dongho & Heo, Seongmin, 2025. "End-effect mitigation in renewable energy systems with energy storage using value function approximation of terminal energy level," Applied Energy, Elsevier, vol. 401(PC).
- Ren, Xin-Yu & Wang, Zhi-Hua & Li, Ling-Ling, 2025. "Coordinated optimization of a novel integrated energy system considering ground source heat pump, organic Rankine cycle and power-to-gas," Renewable Energy, Elsevier, vol. 244(C).
- Maria Symeonidou & Agis M. Papadopoulos, 2022. "Selection and Dimensioning of Energy Storage Systems for Standalone Communities: A Review," Energies, MDPI, vol. 15(22), pages 1-28, November.
- Wang, Qi & Liu, Yankui, 2025. "Planning a robust echelon utilization network for used electric vehicle batteries based on two decision-making criteria," Applied Energy, Elsevier, vol. 384(C).
- Mahmud, Sakib & Sayed, Aya Nabil & Himeur, Yassine & Nhlabatsi, Armstrong & Bensaali, Faycal, 2026. "A comprehensive review of deep reinforcement learning applications from centralized power generation to modern energy internet frameworks," Renewable and Sustainable Energy Reviews, Elsevier, vol. 226(PE).
- Wang, Jindian & Zhang, Zhonglian & Tao, Changwang & Wang, Zhaojun & Zheng, Xinze & Zhang, Kaitong & Zhang, Jingyu, 2025. "Optimized multi-stage configuration of an improved carbon-neutral energy system through hybrid excess energy utilization and carbon transfer," Energy, Elsevier, vol. 335(C).
- Fan, Guozhu & Peng, Chunhua & Wang, Xuekui & Wu, Peng & Yang, Yifan & Sun, Huijuan, 2024. "Optimal scheduling of integrated energy system considering renewable energy uncertainties based on distributionally robust adaptive MPC," Renewable Energy, Elsevier, vol. 226(C).
Corrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:349:y:2026:i:c:s0360544226007693. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.
Printed from https://ideas.repec.org/a/eee/energy/v349y2026ics0360544226007693.html