IDEAS home Printed from https://ideas.repec.org/a/eee/rensus/v182y2023ics1364032123002368.html
   My bibliography  Save this article

Model-data-event based community integrated energy system low-carbon economic scheduling

Author

Listed:
  • Xue, Lin
  • Wang, Jianxue
  • Zhang, Yao
  • Yong, Weizhen
  • Qi, Jie
  • Li, Haotian

Abstract

With environmental pollution becoming an increasingly serious problem, it is crucial to develop renewable energy and improve energy utilization efficiency. Integrated energy system realizes complementary utilization of various energies by integrating various heterogeneous energies. However, the uncertainty of generation and load causes random fluctuation, making it difficult to accurately and quickly adapt to the dynamic environment. Therefore, this research designs a model-data-event based low-carbon economic scheduling framework for the community integrated energy system. Firstly, the low-carbon economic scheduling problem is mathematically described, then the decision-making problem is expressed as a reinforcement learning framework. An improved DDPG algorithm which can cope with the uncertainty is used to make real-time scheduling decisions. Considering the instability of reinforcement learning algorithm, this research proposes a heuristic real-time power allocation strategy, which comprehensively considers the degree of imbalance and the schedulable ability of the responders. The event-driven mechanism enables the responders to respond quickly and accurately to the energy compensation requirements. Simulation results indicate that the proposed scheduling framework can adapt to different parameters and reduce energy costs up to 6.65% and 3.85% compared to the deep Q network and soft actor critic algorithms, with the computational efficiency 11 times higher than that of model predictive control algorithm.

Suggested Citation

  • Xue, Lin & Wang, Jianxue & Zhang, Yao & Yong, Weizhen & Qi, Jie & Li, Haotian, 2023. "Model-data-event based community integrated energy system low-carbon economic scheduling," Renewable and Sustainable Energy Reviews, Elsevier, vol. 182(C).
  • Handle: RePEc:eee:rensus:v:182:y:2023:i:c:s1364032123002368
    DOI: 10.1016/j.rser.2023.113379
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1364032123002368
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.rser.2023.113379?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Zhou, Chenghan & Jia, Hongjie & Jin, Xiaolong & Mu, Yunfei & Yu, Xiaodan & Xu, Xiandong & Li, Binghui & Sun, Weichen, 2023. "Two-stage robust optimization for space heating loads of buildings in integrated community energy systems," Applied Energy, Elsevier, vol. 331(C).
    2. Ganesh, Akhil Hannegudda & Xu, Bin, 2022. "A review of reinforcement learning based energy management systems for electrified powertrains: Progress, challenge, and potential solution," Renewable and Sustainable Energy Reviews, Elsevier, vol. 154(C).
    3. Wang, Chengshan & Lv, Chaoxian & Li, Peng & Song, Guanyu & Li, Shuquan & Xu, Xiandong & Wu, Jianzhong, 2018. "Modeling and optimal operation of community integrated energy systems: A case study from China," Applied Energy, Elsevier, vol. 230(C), pages 1242-1254.
    4. Hua, Haochen & Qin, Yuchao & Hao, Chuantong & Cao, Junwei, 2019. "Optimal energy management strategies for energy Internet via deep reinforcement learning approach," Applied Energy, Elsevier, vol. 239(C), pages 598-609.
    5. Jing, Rui & Kuriyan, Kamal & Kong, Qingyuan & Zhang, Zhihui & Shah, Nilay & Li, Ning & Zhao, Yingru, 2019. "Exploring the impact space of different technologies using a portfolio constraint based approach for multi-objective optimization of integrated urban energy systems," Renewable and Sustainable Energy Reviews, Elsevier, vol. 113(C), pages 1-1.
    6. Qiu, Dawei & Dong, Zihang & Zhang, Xi & Wang, Yi & Strbac, Goran, 2022. "Safe reinforcement learning for real-time automatic control in a smart energy-hub," Applied Energy, Elsevier, vol. 309(C).
    7. Leonzio, Grazia, 2017. "Solar systems integrated with absorption heat pumps and thermal energy storages: state of art," Renewable and Sustainable Energy Reviews, Elsevier, vol. 70(C), pages 492-505.
    8. Fattahi, A. & Sijm, J. & Faaij, A., 2020. "A systemic approach to analyze integrated energy system modeling tools: A review of national models," Renewable and Sustainable Energy Reviews, Elsevier, vol. 133(C).
    9. Qin, Yuxiao & Liu, Pei & Li, Zheng, 2022. "Multi-timescale hierarchical scheduling of an integrated energy system considering system inertia," Renewable and Sustainable Energy Reviews, Elsevier, vol. 169(C).
    10. Rocchetta, R. & Bellani, L. & Compare, M. & Zio, E. & Patelli, E., 2019. "A reinforcement learning framework for optimal operation and maintenance of power grids," Applied Energy, Elsevier, vol. 241(C), pages 291-301.
    11. Kumar, K. Prakash & Saravanan, B., 2017. "Recent techniques to model uncertainties in power generation from renewable energy sources and loads in microgrids – A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 71(C), pages 348-358.
    12. Aien, Morteza & Hajebrahimi, Ali & Fotuhi-Firuzabad, Mahmud, 2016. "A comprehensive review on uncertainty modeling techniques in power system studies," Renewable and Sustainable Energy Reviews, Elsevier, vol. 57(C), pages 1077-1089.
    13. Zhang, Menglin & Wu, Qiuwei & Wen, Jinyu & Lin, Zhongwei & Fang, Fang & Chen, Qun, 2021. "Optimal operation of integrated electricity and heat system: A review of modeling and solution methods," Renewable and Sustainable Energy Reviews, Elsevier, vol. 135(C).
    14. Afzal, Asif & Buradi, Abdulrajak & Jilte, Ravindra & Shaik, Saboor & Kaladgi, Abdul Razak & Arıcı, Muslum & Lee, Chew Tin & Nižetić, Sandro, 2023. "Optimizing the thermal performance of solar energy devices using meta-heuristic algorithms: A critical review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 173(C).
    15. Xia, Tian & Li, Yaowang & Zhang, Ning & Kang, Chongqing, 2022. "Role of compressed air energy storage in urban integrated energy systems with increasing wind penetration," Renewable and Sustainable Energy Reviews, Elsevier, vol. 160(C).
    16. Cho, Heejin & Smith, Amanda D. & Mago, Pedro, 2014. "Combined cooling, heating and power: A review of performance improvement and optimization," Applied Energy, Elsevier, vol. 136(C), pages 168-185.
    17. Alqahtani, Mohammed & Hu, Mengqi, 2022. "Dynamic energy scheduling and routing of multiple electric vehicles using deep reinforcement learning," Energy, Elsevier, vol. 244(PA).
    18. Wei, Shangshang & Gao, Xianhua & Zhang, Yi & Li, Yiguo & Shen, Jiong & Li, Zuyi, 2021. "An improved stochastic model predictive control operation strategy of integrated energy system based on a single-layer multi-timescale framework," Energy, Elsevier, vol. 235(C).
    19. Wang, Zekai & Ding, Tao & Jia, Wenhao & Huang, Can & Mu, Chenggang & Qu, Ming & Shahidehpour, Mohammad & Yang, Yongheng & Blaabjerg, Frede & Li, Li & Wang, Kang & Chi, Fangde, 2022. "Multi-stage stochastic programming for resilient integrated electricity and natural gas distribution systems against typhoon natural disaster attacks," Renewable and Sustainable Energy Reviews, Elsevier, vol. 159(C).
    20. Nazari-Heris, M. & Mohammadi-Ivatloo, B. & Gharehpetian, G.B., 2018. "A comprehensive review of heuristic optimization algorithms for optimal combined heat and power dispatch from economic and environmental perspectives," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P2), pages 2128-2143.
    21. Yang, Ting & Zhao, Liyuan & Li, Wei & Zomaya, Albert Y., 2021. "Dynamic energy dispatch strategy for integrated energy system based on improved deep reinforcement learning," Energy, Elsevier, vol. 235(C).
    22. Yin, Linfei & Li, Yu, 2022. "Hybrid multi-agent emotional deep Q network for generation control of multi-area integrated energy systems," Applied Energy, Elsevier, vol. 324(C).
    23. Tarragona, Joan & Pisello, Anna Laura & Fernández, Cèsar & de Gracia, Alvaro & Cabeza, Luisa F., 2021. "Systematic review on model predictive control strategies applied to active thermal energy storage systems," Renewable and Sustainable Energy Reviews, Elsevier, vol. 149(C).
    24. Mirakyan, Atom & De Guio, Roland, 2015. "Modelling and uncertainties in integrated energy planning," Renewable and Sustainable Energy Reviews, Elsevier, vol. 46(C), pages 62-69.
    25. Li, Guoqing & Zhang, Rufeng & Jiang, Tao & Chen, Houhe & Bai, Linquan & Li, Xiaojing, 2017. "Security-constrained bi-level economic dispatch model for integrated natural gas and electricity systems considering wind power and power-to-gas process," Applied Energy, Elsevier, vol. 194(C), pages 696-704.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zheng, Lingwei & Wu, Hao & Guo, Siqi & Sun, Xinyu, 2023. "Real-time dispatch of an integrated energy system based on multi-stage reinforcement learning with an improved action-choosing strategy," Energy, Elsevier, vol. 277(C).
    2. Wang, Jiawei & You, Shi & Zong, Yi & Træholt, Chresten & Dong, Zhao Yang & Zhou, You, 2019. "Flexibility of combined heat and power plants: A review of technologies and operation strategies," Applied Energy, Elsevier, vol. 252(C), pages 1-1.
    3. Zhou, Yanting & Ma, Zhongjing & Zhang, Jinhui & Zou, Suli, 2022. "Data-driven stochastic energy management of multi energy system using deep reinforcement learning," Energy, Elsevier, vol. 261(PA).
    4. Lv, Chaoxian & Yu, Hao & Li, Peng & Wang, Chengshan & Xu, Xiandong & Li, Shuquan & Wu, Jianzhong, 2019. "Model predictive control based robust scheduling of community integrated energy system with operational flexibility," Applied Energy, Elsevier, vol. 243(C), pages 250-265.
    5. Wang, Zekai & Ding, Tao & Jia, Wenhao & Huang, Can & Mu, Chenggang & Qu, Ming & Shahidehpour, Mohammad & Yang, Yongheng & Blaabjerg, Frede & Li, Li & Wang, Kang & Chi, Fangde, 2022. "Multi-stage stochastic programming for resilient integrated electricity and natural gas distribution systems against typhoon natural disaster attacks," Renewable and Sustainable Energy Reviews, Elsevier, vol. 159(C).
    6. Mingshan Mo & Xinrui Xiong & Yunlong Wu & Zuyao Yu, 2023. "Deep-Reinforcement-Learning-Based Low-Carbon Economic Dispatch for Community-Integrated Energy System under Multiple Uncertainties," Energies, MDPI, vol. 16(22), pages 1-18, November.
    7. Zhu, Ziqing & Hu, Ze & Chan, Ka Wing & Bu, Siqi & Zhou, Bin & Xia, Shiwei, 2023. "Reinforcement learning in deregulated energy market: A comprehensive review," Applied Energy, Elsevier, vol. 329(C).
    8. Hossein Shayeghi & Elnaz Shahryari & Mohammad Moradzadeh & Pierluigi Siano, 2019. "A Survey on Microgrid Energy Management Considering Flexible Energy Sources," Energies, MDPI, vol. 12(11), pages 1-26, June.
    9. Hao, Zhaojun & Di Maio, Francesco & Zio, Enrico, 2023. "A sequential decision problem formulation and deep reinforcement learning solution of the optimization of O&M of cyber-physical energy systems (CPESs) for reliable and safe power production and supply," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    10. Yi Kuang & Xiuli Wang & Hongyang Zhao & Yijun Huang & Xianlong Chen & Xifan Wang, 2020. "Agent-Based Energy Sharing Mechanism Using Deep Deterministic Policy Gradient Algorithm," Energies, MDPI, vol. 13(19), pages 1-20, September.
    11. Morteza Nazari-Heris & Behnam Mohammadi-Ivatloo & Somayeh Asadi, 2020. "Optimal Operation of Multi-Carrier Energy Networks Considering Uncertain Parameters and Thermal Energy Storage," Sustainability, MDPI, vol. 12(12), pages 1-20, June.
    12. Raheli, Enrica & Wu, Qiuwei & Zhang, Menglin & Wen, Changyun, 2021. "Optimal coordinated operation of integrated natural gas and electric power systems: A review of modeling and solution methods," Renewable and Sustainable Energy Reviews, Elsevier, vol. 145(C).
    13. Zhang, Bin & Wu, Xuewei & Ghias, Amer M.Y.M. & Chen, Zhe, 2023. "Coordinated carbon capture systems and power-to-gas dynamic economic energy dispatch strategy for electricity–gas coupled systems considering system uncertainty: An improved soft actor–critic approach," Energy, Elsevier, vol. 271(C).
    14. Guo, Jiacheng & Liu, Zhijian & Li, Ying & Wu, Di & Liu, Xuan & Zhang, Shicong & Yang, Xinyan & Ge, Hua & Zhang, Peiwen, 2022. "Thermodynamic performance analyses and optimization design method of a novel distributed energy system coupled with hybrid-energy storage," Renewable Energy, Elsevier, vol. 182(C), pages 1182-1200.
    15. Sakki, G.K. & Tsoukalas, I. & Kossieris, P. & Makropoulos, C. & Efstratiadis, A., 2022. "Stochastic simulation-optimization framework for the design and assessment of renewable energy systems under uncertainty," Renewable and Sustainable Energy Reviews, Elsevier, vol. 168(C).
    16. Kang, Jing & Wang, Shengwei, 2018. "Robust optimal design of distributed energy systems based on life-cycle performance analysis using a probabilistic approach considering uncertainties of design inputs and equipment degradations," Applied Energy, Elsevier, vol. 231(C), pages 615-627.
    17. Du, Yan & Zandi, Helia & Kotevska, Olivera & Kurte, Kuldeep & Munk, Jeffery & Amasyali, Kadir & Mckee, Evan & Li, Fangxing, 2021. "Intelligent multi-zone residential HVAC control strategy based on deep reinforcement learning," Applied Energy, Elsevier, vol. 281(C).
    18. Yao, Leyi & Liu, Zeyuan & Chang, Weiguang & Yang, Qiang, 2023. "Multi-level model predictive control based multi-objective optimal energy management of integrated energy systems considering uncertainty," Renewable Energy, Elsevier, vol. 212(C), pages 523-537.
    19. Yu, Songyuan & Fang, Fang & Liu, Yajuan & Liu, Jizhen, 2019. "Uncertainties of virtual power plant: Problems and countermeasures," Applied Energy, Elsevier, vol. 239(C), pages 454-470.
    20. Harri Aaltonen & Seppo Sierla & Ville Kyrki & Mahdi Pourakbari-Kasmaei & Valeriy Vyatkin, 2022. "Bidding a Battery on Electricity Markets and Minimizing Battery Aging Costs: A Reinforcement Learning Approach," Energies, MDPI, vol. 15(14), pages 1-19, July.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:rensus:v:182:y:2023:i:c:s1364032123002368. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/600126/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.