IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v16y2023i22p7669-d1283898.html
   My bibliography  Save this article

Deep-Reinforcement-Learning-Based Low-Carbon Economic Dispatch for Community-Integrated Energy System under Multiple Uncertainties

Author

Listed:
  • Mingshan Mo

    (School of Electrical and Electronic Engineering, Huazhong University of Science and Technology, Wuhan 430074, China)

  • Xinrui Xiong

    (School of Electrical and Electronic Engineering, Huazhong University of Science and Technology, Wuhan 430074, China)

  • Yunlong Wu

    (School of Electrical and Electronic Engineering, Huazhong University of Science and Technology, Wuhan 430074, China)

  • Zuyao Yu

    (School of Naval Architecture and Ocean Engineering, Huazhong University of Science and Technology, Wuhan 430074, China)

Abstract

A community-integrated energy system under a multiple-uncertainty low-carbon economic dispatch model based on the deep reinforcement learning method is developed to promote electricity low carbonization and complementary utilization of community-integrated energy. A demand response model based on users’ willingness is proposed for the uncertainty of users’ demand response behavior; a training scenario set of a reinforcement learning agent is generated with a Latin hypercube sampling method for the uncertainties of power, load, temperature, and electric vehicle trips. Based on the proposed demand response model, low-carbon economic dispatch of the community-integrated energy system under multiple uncertainties is achieved by training the agent to interact with the environment in the training scenario set and reach convergence after 250 training rounds. The simulation results show that the reinforcement learning agent achieves low-carbon economic dispatch under 5%, 10%, and 15% renewable energy/load fluctuation scenarios, temperature fluctuation scenarios, and uncertain scenarios of the number of trips, time periods, and mileage of electric vehicles, with good generalization performance under uncertain scenarios.

Suggested Citation

  • Mingshan Mo & Xinrui Xiong & Yunlong Wu & Zuyao Yu, 2023. "Deep-Reinforcement-Learning-Based Low-Carbon Economic Dispatch for Community-Integrated Energy System under Multiple Uncertainties," Energies, MDPI, vol. 16(22), pages 1-18, November.
  • Handle: RePEc:gam:jeners:v:16:y:2023:i:22:p:7669-:d:1283898
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/16/22/7669/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/1996-1073/16/22/7669/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Wang, Chengshan & Lv, Chaoxian & Li, Peng & Song, Guanyu & Li, Shuquan & Xu, Xiandong & Wu, Jianzhong, 2018. "Modeling and optimal operation of community integrated energy systems: A case study from China," Applied Energy, Elsevier, vol. 230(C), pages 1242-1254.
    2. Luo, X.J. & Fong, K.F., 2019. "Development of integrated demand and supply side management strategy of multi-energy system for residential building application," Applied Energy, Elsevier, vol. 242(C), pages 570-587.
    3. Mei, Fei & Zhang, Jiatang & Lu, Jixiang & Lu, Jinjun & Jiang, Yuhan & Gu, Jiaqi & Yu, Kun & Gan, Lei, 2021. "Stochastic optimal operation model for a distributed integrated energy system based on multiple-scenario simulations," Energy, Elsevier, vol. 219(C).
    4. Li, Guoqing & Zhang, Rufeng & Jiang, Tao & Chen, Houhe & Bai, Linquan & Li, Xiaojing, 2017. "Security-constrained bi-level economic dispatch model for integrated natural gas and electricity systems considering wind power and power-to-gas process," Applied Energy, Elsevier, vol. 194(C), pages 696-704.
    5. Li, Yang & Wang, Bin & Yang, Zhen & Li, Jiazheng & Chen, Chen, 2022. "Hierarchical stochastic scheduling of multi-community integrated energy systems in uncertain environments via Stackelberg game," Applied Energy, Elsevier, vol. 308(C).
    6. Zhou, Yizhou & Wei, Zhinong & Sun, Guoqiang & Cheung, Kwok W. & Zang, Haixiang & Chen, Sheng, 2018. "A robust optimization approach for integrated community energy system in energy and ancillary service markets," Energy, Elsevier, vol. 148(C), pages 1-15.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Li, Yang & Han, Meng & Shahidehpour, Mohammad & Li, Jiazheng & Long, Chao, 2023. "Data-driven distributionally robust scheduling of community integrated energy systems with uncertain renewable generations considering integrated demand response," Applied Energy, Elsevier, vol. 335(C).
    2. Lv, Chaoxian & Yu, Hao & Li, Peng & Wang, Chengshan & Xu, Xiandong & Li, Shuquan & Wu, Jianzhong, 2019. "Model predictive control based robust scheduling of community integrated energy system with operational flexibility," Applied Energy, Elsevier, vol. 243(C), pages 250-265.
    3. Xue, Lin & Wang, Jianxue & Zhang, Yao & Yong, Weizhen & Qi, Jie & Li, Haotian, 2023. "Model-data-event based community integrated energy system low-carbon economic scheduling," Renewable and Sustainable Energy Reviews, Elsevier, vol. 182(C).
    4. Han, Fengwu & Zeng, Jianfeng & Lin, Junjie & Zhao, Yunlong & Gao, Chong, 2023. "A stochastic hierarchical optimization and revenue allocation approach for multi-regional integrated energy systems based on cooperative games," Applied Energy, Elsevier, vol. 350(C).
    5. Yang, Jie & Ma, Tieding & Ma, Kai & Yang, Bo & Guerrero, Josep M. & Liu, Zhixin, 2021. "Trading mechanism and pricing strategy of integrated energy systems based on credit rating and Bayesian game," Energy, Elsevier, vol. 232(C).
    6. Tan, Jinjing & Pan, Weiqi & Li, Yang & Hu, Haoming & Zhang, Can, 2023. "Energy-sharing operation strategy of multi-district integrated energy systems considering carbon and renewable energy certificate trading," Applied Energy, Elsevier, vol. 339(C).
    7. Zhang, Chaoyi & Jiao, Zaibin & Liu, Junshan & Ning, Keer, 2023. "Robust planning and economic analysis of park-level integrated energy system considering photovoltaic/thermal equipment," Applied Energy, Elsevier, vol. 348(C).
    8. Guan, Zhimin & Lu, Chunyan & Li, Yiming & Wang, Jiangjiang, 2023. "Chance-constrained optimization of hybrid solar combined cooling, heating and power system considering energetic, economic, environmental, and flexible performances," Renewable Energy, Elsevier, vol. 212(C), pages 908-920.
    9. Wang, Yongli & Wang, Yudong & Huang, Yujing & Yang, Jiale & Ma, Yuze & Yu, Haiyang & Zeng, Ming & Zhang, Fuwei & Zhang, Yanfu, 2019. "Operation optimization of regional integrated energy system based on the modeling of electricity-thermal-natural gas network," Applied Energy, Elsevier, vol. 251(C), pages 1-1.
    10. Xinxin Liu & Nan Li & Feng Liu & Hailin Mu & Longxi Li & Xiaoyu Liu, 2021. "Optimal Design on Fossil-to-Renewable Energy Transition of Regional Integrated Energy Systems under CO 2 Emission Abatement Control: A Case Study in Dalian, China," Energies, MDPI, vol. 14(10), pages 1-25, May.
    11. Aunedi, Marko & Pantaleo, Antonio Marco & Kuriyan, Kamal & Strbac, Goran & Shah, Nilay, 2020. "Modelling of national and local interactions between heat and electricity networks in low-carbon energy systems," Applied Energy, Elsevier, vol. 276(C).
    12. Xu, Bin & Lin, Boqiang, 2018. "Do we really understand the development of China's new energy industry?," Energy Economics, Elsevier, vol. 74(C), pages 733-745.
    13. Cheng, Yaohua & Zhang, Ning & Kirschen, Daniel S. & Huang, Wujing & Kang, Chongqing, 2020. "Planning multiple energy systems for low-carbon districts with high penetration of renewable energy: An empirical study in China," Applied Energy, Elsevier, vol. 261(C).
    14. Wang, Yongli & Li, Jiapu & Wang, Shuo & Yang, Jiale & Qi, Chengyuan & Guo, Hongzhen & Liu, Ximei & Zhang, Hongqing, 2020. "Operational optimization of wastewater reuse integrated energy system," Energy, Elsevier, vol. 200(C).
    15. Yang, Ting & Zhao, Liyuan & Li, Wei & Zomaya, Albert Y., 2021. "Dynamic energy dispatch strategy for integrated energy system based on improved deep reinforcement learning," Energy, Elsevier, vol. 235(C).
    16. Luo, X.J. & Oyedele, Lukumon O. & Ajayi, Anuoluwapo O. & Akinade, Olugbenga O. & Owolabi, Hakeem A. & Ahmed, Ashraf, 2020. "Feature extraction and genetic algorithm enhanced adaptive deep neural network for energy consumption prediction in buildings," Renewable and Sustainable Energy Reviews, Elsevier, vol. 131(C).
    17. Man Yiu Tsang & Tony Sit & Hoi Ying Wong, 2022. "Adaptive Robust Online Portfolio Selection," Papers 2206.01064, arXiv.org.
    18. Wang, Zibo & Yu, Xiaodan & Mu, Yunfei & Jia, Hongjie, 2020. "A distributed Peer-to-Peer energy transaction method for diversified prosumers in Urban Community Microgrid System," Applied Energy, Elsevier, vol. 260(C).
    19. Yan, Rujing & Wang, Jiangjiang & Wang, Jiahao & Tian, Lei & Tang, Saiqiu & Wang, Yuwei & Zhang, Jing & Cheng, Youliang & Li, Yuan, 2022. "A two-stage stochastic-robust optimization for a hybrid renewable energy CCHP system considering multiple scenario-interval uncertainties," Energy, Elsevier, vol. 247(C).
    20. Qu, Kaiping & Shi, Shouyuan & Yu, Tao & Wang, Wenrui, 2019. "A convex decentralized optimization for environmental-economic power and gas system considering diversified emission control," Applied Energy, Elsevier, vol. 240(C), pages 630-645.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:16:y:2023:i:22:p:7669-:d:1283898. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.