IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v401y2025ipbs0306261925014631.html

Large-scale model driven real-time economic generation control for integrated energy systems

Author

Listed:
  • Huang, Wenxuan
  • Yin, Linfei

Abstract

As a result of the growing integration of renewable energy generation units into integrated energy systems (IESs), the coupling configurations of equipment within the IESs are constantly changing, and the fluctuations of renewable energy sources (RESs) are even more drastic. To mitigate frequency deviations and area control errors (ACEs) in IESs, this paper proposes a transformer-soft actor-critic (T-SAC) algorithm, which integrates the efficient feature extraction capability of the large-scale model transformer with the online learning capability of deep reinforcement learning, and enables the mining of rich feature information from frequency deviation and ACE signals to generate accurate control commands. Furthermore, this paper constructs the cyber-physical-social systems-centralized real-time economic intelligent generation control (CPSS-CREIGC) framework built upon the T-SAC algorithm, which employs virtual parallel systems to optimize the parameters of T-SAC and thereby enhances training efficiency. By issuing control commands every 4 s, the CPSS-CREIGC framework effectively mitigating the reverse regulation phenomenon. The T-SAC algorithm is simulated and compared with seven different comparison algorithms in two-area and four-area IESs under high RESs penetration. Compared to the comparison algorithms, the T-SAC algorithm reduces frequency deviations by at least 46.67 %. The numerical results confirm the effectiveness and feasibility of the CPSS-CREIGC framework

Suggested Citation

  • Huang, Wenxuan & Yin, Linfei, 2025. "Large-scale model driven real-time economic generation control for integrated energy systems," Applied Energy, Elsevier, vol. 401(PB).
    • Handle: RePEc:eee:appene:v:401:y:2025:i:pb:s0306261925014631
    DOI: 10.1016/j.apenergy.2025.126733
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261925014631
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.apenergy.2025.126733?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Jiang, Wenjun & Liu, Bo & Liang, Yang & Gao, Huanxiang & Lin, Pengfei & Zhang, Dongqin & Hu, Gang, 2024. "Applicability analysis of transformer to wind speed forecasting by a novel deep learning framework with multiple atmospheric variables," Applied Energy, Elsevier, vol. 353(PB).
    2. Zhang, Shulei & Jia, Runda & Pan, Hengxin & Cao, Yankai, 2023. "A safe reinforcement learning-based charging strategy for electric vehicles in residential microgrid," Applied Energy, Elsevier, vol. 348(C).
    3. Yin, Linfei & He, Xiaoyu, 2023. "Artificial emotional deep Q learning for real-time smart voltage control of cyber-physical social power systems," Energy, Elsevier, vol. 273(C).
    4. Zhao, Jingyuan & Feng, Xuning & Wang, Junbin & Lian, Yubo & Ouyang, Minggao & Burke, Andrew F., 2023. "Battery fault diagnosis and failure prognosis for electric vehicles using spatio-temporal transformer networks," Applied Energy, Elsevier, vol. 352(C).
    5. Lu, Quan & Huang, Wenxuan & Yin, Linfei, 2025. "Decomposition prediction fractional-order active disturbance rejection control deep Q network for generation control of integrated energy systems," Applied Energy, Elsevier, vol. 377(PD).
    6. Li, Jiawen & Zhou, Tao & Keke, He & Yu, Hengwen & Du, Hongwei & Liu, Shuangyu & Cui, Haoyang, 2023. "Distributed quantum multiagent deep meta reinforcement learning for area autonomy energy management of a multiarea microgrid," Applied Energy, Elsevier, vol. 343(C).
    7. Huang, Ruchen & He, Hongwen & Su, Qicong, 2024. "An intelligent full-knowledge transferable collaborative eco-driving framework based on improved soft actor-critic algorithm," Applied Energy, Elsevier, vol. 375(C).
    8. Liu, Changchun & Su, Xu & Yin, Zhao & Sheng, Yong & Zhou, Xuezhi & Xu, Yujie & Wang, Xudong & Chen, Haisheng, 2024. "Experimental study on the feasibility of isobaric compressed air energy storage as wind power side energy storage," Applied Energy, Elsevier, vol. 364(C).
    9. Lu, Quan & Zeng, Haozheng & Yin, Linfei, 2025. "Dynamic distributed multi-objective mantis search algorithm based on Transformer hybrid strategy for novel power system dispatch," Energy, Elsevier, vol. 324(C).
    10. Yin, Linfei & Zhang, Bin, 2023. "Relaxed deep generative adversarial networks for real-time economic smart generation dispatch and control of integrated energy systems," Applied Energy, Elsevier, vol. 330(PA).
    11. Li, Jiawen & Zhou, Tao, 2023. "Active fault-tolerant coordination energy management for a proton exchange membrane fuel cell using curriculum-based multiagent deep meta-reinforcement learning," Renewable and Sustainable Energy Reviews, Elsevier, vol. 185(C).
    12. Yin, Linfei & Li, Yu, 2022. "Hybrid multi-agent emotional deep Q network for generation control of multi-area integrated energy systems," Applied Energy, Elsevier, vol. 324(C).
    13. Yin, Linfei & Zhao, Lulin, 2021. "Rejectable deep differential dynamic programming for real-time integrated generation dispatch and control of micro-grids," Energy, Elsevier, vol. 225(C).
    14. Xu, Hang & Zhang, Juntao & Cheng, Chuntian & Cao, Hui & Lu, Jia & Zhang, Zheng, 2024. "A novel metric for evaluating hydro-wind-solar energy complementarity," Applied Energy, Elsevier, vol. 373(C).
    15. Sui, Yunren & Lin, Haosheng & Ding, Zhixiong & Li, Fuxiang & Sui, Zengguang & Wu, Wei, 2024. "Compact, efficient, and affordable absorption Carnot battery for long-term renewable energy storage," Applied Energy, Elsevier, vol. 357(C).
    16. Li, Jiawen & Yu, Tao & Zhang, Xiaoshun & Li, Fusheng & Lin, Dan & Zhu, Hanxin, 2021. "Efficient experience replay based deep deterministic policy gradient for AGC dispatch in integrated energy system," Applied Energy, Elsevier, vol. 285(C).
    17. Ji, Weiming & Hong, Feng & Zhao, Yuzheng & Liang, Lu & Du, Hao & Hao, Junhong & Fang, Fang & Liu, Jizhen, 2024. "Applications of flywheel energy storage system on load frequency regulation combined with various power generations: A review," Renewable Energy, Elsevier, vol. 223(C).
    18. Xu, Jianxi & Zeng, Jiabing & Huang, Jinyong, 2024. "A management system for energy storage," Applied Energy, Elsevier, vol. 368(C).
    19. Li, Boda & Chen, Ying & Wei, Wei & Hou, Yunhe & Mei, Shengwei, 2022. "Enhancing resilience of emergency heat and power supply via deployment of LNG tube trailers: A mean-risk optimization approach," Applied Energy, Elsevier, vol. 318(C).
    20. Yin, Linfei & Zheng, Da, 2024. "Decomposition prediction fractional-order PID reinforcement learning for short-term smart generation control of integrated energy systems," Applied Energy, Elsevier, vol. 355(C).
    21. Zhong, Jin & Bollen, Math & Rönnberg, Sarah, 2021. "Towards a 100% renewable energy electricity generation system in Sweden," Renewable Energy, Elsevier, vol. 171(C), pages 812-824.
    22. Yuan, Meng & Sorknæs, Peter & Lund, Henrik & Liang, Yongtu, 2022. "The bidding strategies of large-scale battery storage in 100% renewable smart energy systems," Applied Energy, Elsevier, vol. 326(C).
    23. Yin, Linfei & Xiong, Yi, 2024. "Fast-apply deep autoregressive recurrent proximal policy optimization for controlling hot water systems," Applied Energy, Elsevier, vol. 367(C).
    24. Yan, Jie & Liu, Shan & Yan, Yamin & Liu, Yongqian & Han, Shuang & Zhang, Haoran, 2024. "How to choose mobile energy storage or fixed energy storage in high proportion renewable energy scenarios: Evidence in China," Applied Energy, Elsevier, vol. 376(PB).
    25. Li, Jiawen & Yu, Tao & Zhang, Xiaoshun, 2022. "Coordinated load frequency control of multi-area integrated energy system using multi-agent deep reinforcement learning," Applied Energy, Elsevier, vol. 306(PA).
    26. Ren, Kezheng & Liu, Jun & Wu, Zeyang & Liu, Xinglei & Nie, Yongxin & Xu, Haitao, 2024. "A data-driven DRL-based home energy management system optimization framework considering uncertain household parameters," Applied Energy, Elsevier, vol. 355(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lu, Quan & Huang, Wenxuan & Yin, Linfei, 2025. "Decomposition prediction fractional-order active disturbance rejection control deep Q network for generation control of integrated energy systems," Applied Energy, Elsevier, vol. 377(PD).
    2. Xi, Lei & Shi, Yu & Quan, Yue & Liu, Zhihong, 2024. "Research on the multi-area cooperative control method for novel power systems," Energy, Elsevier, vol. 313(C).
    3. Yin, Linfei & Zheng, Da, 2024. "Decomposition prediction fractional-order PID reinforcement learning for short-term smart generation control of integrated energy systems," Applied Energy, Elsevier, vol. 355(C).
    4. Quan, Yue & Xi, Lei, 2024. "Smart generation system: A decentralized multi-agent control architecture based on improved consensus algorithm for generation command dispatch of sustainable energy systems," Applied Energy, Elsevier, vol. 365(C).
    5. Yin, Linfei & Ge, Wei, 2024. "Mobileception-ResNet for transient stability prediction of novel power systems," Energy, Elsevier, vol. 309(C).
    6. Zhao, Lulin & Yin, Linfei, 2024. "Knowledge-shareable adaptive deep dynamic programming for hierarchical generation control of distributed high-percentage renewable energy systems," Renewable Energy, Elsevier, vol. 228(C).
    7. Lu, Xin & Qiu, Jing & Zhang, Cuo & Lei, Gang & Zhu, Jianguo, 2024. "Seizing unconventional arbitrage opportunities in virtual power plants: A profitable and flexible recruitment approach," Applied Energy, Elsevier, vol. 358(C).
    8. Ahmed, Ijaz & Um-e-Habiba, & Hossain, Md. Alamgir & Khalid, Muhammad, 2025. "Assessment of smart district heating–cooling networks considering renewable and zero-carbon strategies," Renewable and Sustainable Energy Reviews, Elsevier, vol. 224(C).
    9. Li, Qingyang & Li, Zhongwei & Jin, Xianji & Chen, Yongxu & Lei, Qian & Wu, Qianying & Guan, Huaiming, 2025. "Multi-agent deep reinforcement learning based low-carbon Economy energy planning strategy in IES connected with microgrid," Energy, Elsevier, vol. 337(C).
    10. Cui, Feifei & An, Dou & Xi, Huan, 2024. "Integrated energy hub dispatch with a multi-mode CAES–BESS hybrid system: An option-based hierarchical reinforcement learning approach," Applied Energy, Elsevier, vol. 374(C).
    11. Lu, Quan & Zeng, Haozheng & Yin, Linfei, 2025. "Dynamic distributed multi-objective mantis search algorithm based on Transformer hybrid strategy for novel power system dispatch," Energy, Elsevier, vol. 324(C).
    12. Mansour, Shaza H. & Azzam, Sarah M. & Hasanien, Hany M. & Tostado-Véliz, Marcos & Alkuhayli, Abdulaziz & Jurado, Francisco, 2025. "Deep reinforcement learning-based plug-in electric vehicle charging/discharging scheduling in a home energy management system," Energy, Elsevier, vol. 316(C).
    13. Li, Jiawen & Zhou, Tao & Keke, He & Yu, Hengwen & Du, Hongwei & Liu, Shuangyu & Cui, Haoyang, 2023. "Distributed quantum multiagent deep meta reinforcement learning for area autonomy energy management of a multiarea microgrid," Applied Energy, Elsevier, vol. 343(C).
    14. Yin, Linfei & Ye, Yongzi, 2025. "Distributed multi-objective African vulture accelerated optimization intelligent algorithm for multi-objective economic dispatch of power systems," Applied Energy, Elsevier, vol. 398(C).
    15. Hao, Zian & He, Guogeng & Wu, Aihua & Lin, Yangyang & Cai, Dehua, 2025. "Dynamic characteristics and performance enhancement of a novel hybrid system integrating transcritical CO2 heat pump and absorption thermal energy storage," Energy, Elsevier, vol. 330(C).
    16. Yao, Lei & Deng, Juzheng & Dai, Huilin & Dai, Fuyou & Chen, Shiwei & Xiao, Yanqiu & Cui, Guangzhen & Fei, Zhigen, 2026. "Multi-level collaborative fault diagnosis and self-healing framework for proton exchange membrane fuel cell," Renewable and Sustainable Energy Reviews, Elsevier, vol. 226(PE).
    17. He, Jiaming & Tan, Qinliang & Lv, Hanyu, 2025. "Data-driven climate resilience assessment for distributed energy systems using diffusion transformer and polynomial expansions," Applied Energy, Elsevier, vol. 380(C).
    18. Panagiotis Michailidis & Iakovos Michailidis & Elias Kosmatopoulos, 2025. "Reinforcement Learning for Electric Vehicle Charging Management: Theory and Applications," Energies, MDPI, vol. 18(19), pages 1-50, October.
    19. Yin, Linfei & Xiong, Yi, 2024. "Incremental learning user profile and deep reinforcement learning for managing building energy in heating water," Energy, Elsevier, vol. 313(C).
    20. Zheng, Bowen & Deng, Zhichao & Luo, Zhenhao & Mao, Shuoyuan & Ouyang, Minggao & Han, Xuebing & Wang, Hewu & Li, Yalun & Sun, Yukun & Wang, Depeng & Yuan, Yuebo & He, Liangxi & Yang, Zhi & Zhu, Yanlin, 2025. "A comprehensive review of lithium-ion battery modelling research and prospects: in-depth analysis of current research and future directions," Applied Energy, Elsevier, vol. 401(PB).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:401:y:2025:i:pb:s0306261925014631. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.