IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v263y2023ipbs036054422202597x.html

Application of multi-agent EADRC in flexible operation of combined heat and power plant considering carbon emission and economy

Author

Listed:
  • Hou, Guolian
  • Huang, Ting
  • Zheng, Fumeng
  • Gong, Linjuan
  • Huang, Congzhi
  • Zhang, Jianhua

Abstract

Flexibility enhancement of combined heat and power (CHP) plant is extremely urgent to accommodate renewable energy and maintain the stability of power grid. In this paper, a new control strategy seamlessly integrates the error-based active disturbance rejection control (EADRC), Kalman filter and reinforcement learning algorithm is proposed and applied to CHP plant for operational flexibility promotion. Firstly, in EADRC, load fluctuation, uncertainties and heating supply interference are regarded as a total disturbance precisely estimated and compensated in real-time. Secondly, the optimal parameters of controller are obtained via the twin delayed deep deterministic policy gradient algorithm based multi-agent system. Under the demand of flexible operation, a comprehensive optimization objective including general control objectives and carbon reduction requirements is constructed for CHP plant. By setting the multi-objective function as the reward function of multi-agent system, plant is guided to the Utopia point which emblems the flexible, economic and low-carbon operation. The new controller effectively fuses the features from each component, namely state estimation, dynamic optimization, and continuous learning. Thirdly, the stability analysis of proposed controller based on singular perturbation theory is provided. Finally, the flexible and low–carbon operation capacity of CHP plant with the new control scheme under wide-load operating conditions is successfully verified through extensive simulations.

Suggested Citation

  • Hou, Guolian & Huang, Ting & Zheng, Fumeng & Gong, Linjuan & Huang, Congzhi & Zhang, Jianhua, 2023. "Application of multi-agent EADRC in flexible operation of combined heat and power plant considering carbon emission and economy," Energy, Elsevier, vol. 263(PB).
  • Handle: RePEc:eee:energy:v:263:y:2023:i:pb:s036054422202597x
    DOI: 10.1016/j.energy.2022.125711
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S036054422202597X
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2022.125711?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Jia, Chengzhen & Wang, Lingmei & Meng, Enlong & Chen, Liming & Liu, Yushan & Jia, Wenqiang & Bao, Yutao & Liu, Zhenguo, 2021. "Combining LIDAR and LADRC for intelligent pitch control of wind turbines," Renewable Energy, Elsevier, vol. 169(C), pages 1091-1105.
    2. Wu, Zhenlong & Li, Donghai & Xue, Yali & Chen, YangQuan, 2019. "Gain scheduling design based on active disturbance rejection control for thermal power plant under full operating conditions," Energy, Elsevier, vol. 185(C), pages 744-762.
    3. Yadegari, Saeed & Abdi, Hamdi & Nikkhah, Saman, 2020. "Risk-averse multi-objective optimal combined heat and power planning considering voltage security constraints," Energy, Elsevier, vol. 212(C).
    4. Hou, Guolian & Gong, Linjuan & Hu, Bo & Su, Huilin & Huang, Ting & Huang, Congzhi & Fan, Wei & Zhao, Yuanzhu, 2022. "Application of fast adaptive moth-flame optimization in flexible operation modeling for supercritical unit," Energy, Elsevier, vol. 239(PA).
    5. Wang, Jiangjiang & Liu, Yi & Ren, Fukang & Lu, Shuaikang, 2020. "Multi-objective optimization and selection of hybrid combined cooling, heating and power systems considering operational flexibility," Energy, Elsevier, vol. 197(C).
    6. Lio, Wai Hou & Larsen, Gunner Chr. & Thorsen, Gunhild R., 2021. "Dynamic wake tracking using a cost-effective LiDAR and Kalman filtering: Design, simulation and full-scale validation," Renewable Energy, Elsevier, vol. 172(C), pages 1073-1086.
    7. Wang, Jiawei & You, Shi & Zong, Yi & Cai, Hanmin & Træholt, Chresten & Dong, Zhao Yang, 2019. "Investigation of real-time flexibility of combined heat and power plants in district heating applications," Applied Energy, Elsevier, vol. 237(C), pages 196-209.
    8. Hou, Guolian & Xiong, Jian & Zhou, Guiping & Gong, Linjuan & Huang, Congzhi & Wang, Shunjiang, 2021. "Coordinated control system modeling of ultra-supercritical unit based on a new fuzzy neural network," Energy, Elsevier, vol. 234(C).
    9. Zhao, Yongliang & Liu, Ming & Wang, Chaoyang & Li, Xin & Chong, Daotong & Yan, Junjie, 2018. "Increasing operational flexibility of supercritical coal-fired power plants by regulating thermal system configuration during transient processes," Applied Energy, Elsevier, vol. 228(C), pages 2375-2386.
    10. Li, Jiawen & Yu, Tao & Zhang, Xiaoshun & Li, Fusheng & Lin, Dan & Zhu, Hanxin, 2021. "Efficient experience replay based deep deterministic policy gradient for AGC dispatch in integrated energy system," Applied Energy, Elsevier, vol. 285(C).
    11. Liu, Ming & Ma, Guofeng & Wang, Shan & Wang, Yu & Yan, Junjie, 2021. "Thermo-economic comparison of heat–power decoupling technologies for combined heat and power plants when participating in a power-balancing service in an energy hub," Renewable and Sustainable Energy Reviews, Elsevier, vol. 152(C).
    12. Hou, Guolian & Gong, Linjuan & Hu, Bo & Huang, Ting & Su, Huilin & Huang, Congzhi & Zhou, Guiping & Wang, Shunjiang, 2022. "Flexibility oriented adaptive modeling of combined heat and power plant under various heat-power coupling conditions," Energy, Elsevier, vol. 242(C).
    13. Meng, Anbo & Wang, Peng & Zhai, Guangsong & Zeng, Cong & Chen, Shun & Yang, Xiaoyi & Yin, Hao, 2022. "Electricity price forecasting with high penetration of renewable energy using attention-based LSTM network trained by crisscross optimization," Energy, Elsevier, vol. 254(PA).
    14. Yin, Junjie & Liu, Ming & Zhao, Yongliang & Wang, Chaoyang & Yan, Junjie, 2021. "Dynamic performance and control strategy modification for coal-fired power unit under coal quality variation," Energy, Elsevier, vol. 223(C).
    15. Hou, Guolian & Ke, Yin & Huang, Congzhi, 2021. "A flexible constant power generation scheme for photovoltaic system by error-based active disturbance rejection control and perturb & observe," Energy, Elsevier, vol. 237(C).
    16. Bloess, Andreas, 2020. "Modeling of combined heat and power generation in the context of increasing renewable energy penetration," Applied Energy, Elsevier, vol. 267(C).
    17. Wang, Wanrong & Ma, Yingjie & Maroufmashat, Azadeh & Zhang, Nan & Li, Jie & Xiao, Xin, 2022. "Optimal design of large-scale solar-aided hydrogen production process via machine learning based optimisation framework," Applied Energy, Elsevier, vol. 305(C).
    18. Zhou, Jianhao & Xue, Siwu & Xue, Yuan & Liao, Yuhui & Liu, Jun & Zhao, Wanzhong, 2021. "A novel energy management strategy of hybrid electric vehicle via an improved TD3 deep reinforcement learning," Energy, Elsevier, vol. 224(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hou, Guolian & Ye, Lingling & Huang, Ting & Huang, Congzhi, 2024. "Intelligent modeling of combined heat and power unit under full operating conditions via improved crossformer and precise sparrow search algorithm," Energy, Elsevier, vol. 308(C).
    2. Hou, Guolian & Huang, Ting & Huang, Congzhi, 2023. "Flexibility improvement of 1000 MW ultra-supercritical unit under full operating conditions by error-based ADRC and fast pigeon-inspired optimizer," Energy, Elsevier, vol. 270(C).
    3. Liu, Zefeng & Wang, Chaoyang & Fan, Mengyang & Wang, Zhu & Fang, Fang & Liu, Ming & Yan, Junjie, 2025. "Investigation on the allowable load ramping-up rate and wet-to-dry conversion time of a 660 MW supercritical coal-fired power plant with deep peak-shaving work conditions," Energy, Elsevier, vol. 314(C).
    4. Li, Xuehan & Wang, Wei & Ye, Lingling & Ren, Guorui & Fang, Fang & Liu, Jizhen & Chen, Zhe & Zhou, Qiang, 2024. "Improving frequency regulation ability for a wind-thermal power system by multi-objective optimized sliding mode control design," Energy, Elsevier, vol. 300(C).
    5. Zhang, Hao & Wang, Xiaozhe & Guo, Haowei & Zang, Pengchao & Wang, Lei & Zhao, Haorao & Dong, Yong, 2025. "A novel route for coal-fired power plants flexibility through the integration of H2/O2 burning and solid oxide electrolysis cells: Design and performance evaluation," Energy, Elsevier, vol. 314(C).
    6. Li, Xuehan & Wang, Wei & Fang, Fang & Liu, Jizhen & Chen, Zhe, 2025. "Improving active power regulation for wind turbine by phase leading cascaded error-based active disturbance rejection control and multi-objective optimization," Renewable Energy, Elsevier, vol. 243(C).
    7. Hou, Guolian & Huang, Ting & Zheng, Fumeng & Huang, Congzhi, 2024. "A hierarchical reinforcement learning GPC for flexible operation of ultra-supercritical unit considering economy," Energy, Elsevier, vol. 289(C).
    8. Hou, Guolian & Huang, Wenchuan & Ye, Lingling, 2025. "A flexible operation scheme for ultra-supercritical unit under wide load variations based on improved EADRC and modified northern goshawk optimizer," Energy, Elsevier, vol. 334(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hou, Guolian & Huang, Ting & Huang, Congzhi, 2023. "Flexibility improvement of 1000 MW ultra-supercritical unit under full operating conditions by error-based ADRC and fast pigeon-inspired optimizer," Energy, Elsevier, vol. 270(C).
    2. Pang, Dawei & Niu, Yuguang & Du, Ming, 2025. "Phase lead error-based active disturbance rejection control for 1000 MW ultra-supercritical unit under flexible operation," Energy, Elsevier, vol. 319(C).
    3. Hou, Guolian & Ye, Lingling & Huang, Ting & Huang, Congzhi, 2024. "Intelligent modeling of combined heat and power unit under full operating conditions via improved crossformer and precise sparrow search algorithm," Energy, Elsevier, vol. 308(C).
    4. Huang, Congzhi & Li, Zhuoyong, 2023. "Data-driven modeling of ultra-supercritical unit coordinated control system by improved transformer network," Energy, Elsevier, vol. 266(C).
    5. Zhu, Keyan & Zhang, Guangming & Zhu, Chen & Niu, Yuguang & Liu, Jizhen, 2025. "A bi-level optimization strategy for flexible and economic operation of the CHP units based on reinforcement learning and multi-objective MPC," Applied Energy, Elsevier, vol. 391(C).
    6. Chen, Chen & Liu, Ming & Li, Mengjie & Wang, Yu & Wang, Chaoyang & Yan, Junjie, 2024. "Digital twin modeling and operation optimization of the steam turbine system of thermal power plants," Energy, Elsevier, vol. 290(C).
    7. Yan, Hui & Liu, Ming & Wang, Zhu & Zhang, Kezhen & Chong, Daotong & Yan, Junjie, 2023. "Flexibility enhancement of solar-aided coal-fired power plant under different direct normal irradiance conditions," Energy, Elsevier, vol. 262(PA).
    8. Hou, Guolian & Liu, Zeyu, 2025. "Data-driven modeling for ultra-supercritical unit based on bidirectional test-time training and improved temporal convolutional network," Energy, Elsevier, vol. 326(C).
    9. Liu, Zefeng & Wang, Chaoyang & Fan, Jianlin & Liu, Ming & Xing, Yong & Yan, Junjie, 2024. "Enhancing the flexibility and stability of coal-fired power plants by optimizing control schemes of throttling high-pressure extraction steam," Energy, Elsevier, vol. 288(C).
    10. Hou, Guolian & Fan, Yuzhen & Wang, Junjie, 2024. "Application of a novel dynamic recurrent fuzzy neural network with rule self-adaptation based on chaotic quantum pigeon-inspired optimization in modeling for gas turbine," Energy, Elsevier, vol. 290(C).
    11. Du, Zeyu & Liu, Ming & Wang, Yang & Zhou, Yu & Zhao, Yongliang & Yan, Junjie, 2025. "Energy consumption characteristics and energy saving potential of thermal power plants under ultra-low power load ratio conditions," Energy, Elsevier, vol. 330(C).
    12. Hou, Guolian & Gong, Linjuan & Hu, Bo & Huang, Ting & Su, Huilin & Huang, Congzhi & Zhou, Guiping & Wang, Shunjiang, 2022. "Flexibility oriented adaptive modeling of combined heat and power plant under various heat-power coupling conditions," Energy, Elsevier, vol. 242(C).
    13. Wang, Yuanhui & Zhang, Hanfei & Ji, Shuaiyu & Frate, Guido Francesco & Duan, Liqiang & Desideri, Umberto & Yang, Yongping, 2025. "Techno-economic analysis of a novel heat-power decoupling system of molten salt coupled steam accumulator used in gas-steam combined cycle CHP unit," Applied Energy, Elsevier, vol. 400(C).
    14. Zhu, Hengyi & Tan, Peng & He, Ziqian & Zhang, Cheng & Fang, Qingyan & Chen, Gang, 2022. "Nonlinear model predictive control of USC boiler-turbine power units in flexible operations via input convex neural network," Energy, Elsevier, vol. 255(C).
    15. Wang, Jiangjiang & Deng, Hongda & Qi, Xiaoling, 2022. "Cost-based site and capacity optimization of multi-energy storage system in the regional integrated energy networks," Energy, Elsevier, vol. 261(PA).
    16. Yin, Linfei & Xie, Jiaxing, 2022. "Multi-feature-scale fusion temporal convolution networks for metal temperature forecasting of ultra-supercritical coal-fired power plant reheater tubes," Energy, Elsevier, vol. 238(PA).
    17. Wang, Zhenpu & Xu, Jing & Ma, Suxia & Zhao, Guanjia & Wang, Jianfei & Gu, Yujiong, 2025. "Comparative investigation on heat pump solutions for peak shaving and heat-power decoupling in combined heat and power plants," Renewable and Sustainable Energy Reviews, Elsevier, vol. 216(C).
    18. Chen, Xu & Li, Mince & Chen, Zonghai, 2023. "Meta rule-based energy management strategy for battery/supercapacitor hybrid electric vehicles," Energy, Elsevier, vol. 285(C).
    19. Zhou, Yuan & Wang, Jiangjiang & Dong, Fuxiang & Qin, Yanbo & Ma, Zherui & Ma, Yanpeng & Li, Jianqiang, 2021. "Novel flexibility evaluation of hybrid combined cooling, heating and power system with an improved operation strategy," Applied Energy, Elsevier, vol. 300(C).
    20. Cai, Hanmin & You, Shi & Wu, Jianzhong, 2020. "Agent-based distributed demand response in district heating systems," Applied Energy, Elsevier, vol. 262(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:263:y:2023:i:pb:s036054422202597x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.