IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v379y2025ics0306261924023274.html
   My bibliography  Save this article

Joint peak power and carbon emission shaving in active distribution systems using carbon emission flow-based deep reinforcement learning

Author

Listed:
  • Lee, Sangyoon
  • Prabawa, Panggah
  • Choi, Dae-Hyun

Abstract

Distribution optimal power flow (D-OPF) with peak load shaving function is crucial for guaranteeing economical and reliable operations of active distribution grids with various distributed energy resources. However, conventional D-OPF methods reduce only the power operation cost without considering carbon emission reduction, which may lead to a slowdown in achieving global carbon neutrality. To resolve this issue, this study proposes a deep reinforcement learning (DRL)-assisted D-OPF framework realizing dual-peak shaving of power and carbon emission for low-carbon active distribution system operations based on the notion of carbon emission flow (CEF). The proposed framework aims to minimize the total power operation costs of substation and gas-turbine (GT) generators. It also aims to reduce the total carbon emission cost via mitigation of peak power and carbon emission in the CEF-based D-OPF framework with both power and carbon emission peak constraints. A key feature of the proposed framework is the adoption of the DRL method for the CEF-based D-OPF problem to determine economical and eco-friendly peaks of power and carbon emission under dynamically changing distribution system operations. Furthermore, a D-OPF optimization-based reward function for the DRL agent is designed to yield no constraint violations for the D-OPF problem during the agent’s training phase. Numerical examples conducted on the IEEE 33-node and IEEE 69-node distribution systems with GT generators, solar photovoltaic systems, and energy storage systems demonstrate that, in contrast with CEF-free and CEF-integrated optimization methods with fixed power and/or carbon emission peaks, the proposed method further reduces the total carbon emission and cost.

Suggested Citation

  • Lee, Sangyoon & Prabawa, Panggah & Choi, Dae-Hyun, 2025. "Joint peak power and carbon emission shaving in active distribution systems using carbon emission flow-based deep reinforcement learning," Applied Energy, Elsevier, vol. 379(C).
    • Handle: RePEc:eee:appene:v:379:y:2025:i:c:s0306261924023274
    DOI: 10.1016/j.apenergy.2024.124944
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261924023274
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.apenergy.2024.124944?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lyu, Yizheng & Gao, Hanbo & Yan, Kun & Liu, Yingjie & Tian, Jinping & Chen, Lyujun & Wan, Mei, 2022. "Carbon peaking strategies for industrial parks: Model development and applications in China," Applied Energy, Elsevier, vol. 322(C).
    2. Cheng Yang & Yupeng Sun & Yujie Zou & Fei Zheng & Shuangyu Liu & Bochao Zhao & Ming Wu & Haoyang Cui, 2023. "Optimal Power Flow in Distribution Network: A Review on Problem Formulation and Optimization Methods," Energies, MDPI, vol. 16(16), pages 1-42, August.
    3. De Mel, Ishanki & Klymenko, Oleksiy V. & Short, Michael, 2024. "Discrete optimal designs for distributed energy systems with nonconvex multiphase optimal power flow," Applied Energy, Elsevier, vol. 353(PB).
    4. Huang, Yan & Ju, Yuntao & Ma, Kang & Short, Michael & Chen, Tao & Zhang, Ruosi & Lin, Yi, 2022. "Three-phase optimal power flow for networked microgrids based on semidefinite programming convex relaxation," Applied Energy, Elsevier, vol. 305(C).
    5. Pfenninger, Stefan & Staffell, Iain, 2016. "Long-term patterns of European PV output using 30 years of validated hourly reanalysis and satellite data," Energy, Elsevier, vol. 114(C), pages 1251-1265.
    6. Guo, Chenyu & Wang, Xin & Zheng, Yihui & Zhang, Feng, 2022. "Real-time optimal energy management of microgrid with uncertainties based on deep reinforcement learning," Energy, Elsevier, vol. 238(PC).
    7. Wang, Yunqi & Qiu, Jing & Tao, Yuechuan, 2022. "Robust energy systems scheduling considering uncertainties and demand side emission impacts," Energy, Elsevier, vol. 239(PD).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Plain, N. & Hingray, B. & Mathy, S., 2019. "Accounting for low solar resource days to size 100% solar microgrids power systems in Africa," Renewable Energy, Elsevier, vol. 131(C), pages 448-458.
    2. Marko Hočevar & Lovrenc Novak & Primož Drešar & Gašper Rak, 2022. "The Status Quo and Future of Hydropower in Slovenia," Energies, MDPI, vol. 15(19), pages 1-13, September.
    3. Lukas Kriechbaum & Philipp Gradl & Romeo Reichenhauser & Thomas Kienberger, 2020. "Modelling Grid Constraints in a Multi-Energy Municipal Energy System Using Cumulative Exergy Consumption Minimisation," Energies, MDPI, vol. 13(15), pages 1-23, July.
    4. Reinhold Lehneis & Daniela Thrän, 2024. "In 50 Shades of Orange: Germany’s Photovoltaic Power Generation Landscape," Energies, MDPI, vol. 17(16), pages 1-12, August.
    5. Steinegger, Josef & Hammer, Andreas & Wallner, Stefan & Kienberger, Thomas, 2024. "Revolutionizing heat distribution: A method for harnessing industrial waste heat with supra-regional district heating networks," Applied Energy, Elsevier, vol. 372(C).
    6. Behrang Shirizadeh, Quentin Perrier, and Philippe Quirion, 2022. "How Sensitive are Optimal Fully Renewable Power Systems to Technology Cost Uncertainty?," The Energy Journal, International Association for Energy Economics, vol. 0(Number 1).
    7. Omoyele, Olalekan & Hoffmann, Maximilian & Koivisto, Matti & Larrañeta, Miguel & Weinand, Jann Michael & Linßen, Jochen & Stolten, Detlef, 2024. "Increasing the resolution of solar and wind time series for energy system modeling: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 189(PB).
    8. Matija Kostelac & Lin Herenčić & Tomislav Capuder, 2022. "Planning and Operational Aspects of Individual and Clustered Multi-Energy Microgrid Options," Energies, MDPI, vol. 15(4), pages 1-17, February.
    9. Liu, Hailiang & Andresen, Gorm Bruun & Greiner, Martin, 2018. "Cost-optimal design of a simplified highly renewable Chinese electricity network," Energy, Elsevier, vol. 147(C), pages 534-546.
    10. Alberto Flores & Rafael Zárate-Miñano & Miguel Carrión, 2023. "Capability Curve Modeling for Hydro-Power Generators in Optimal Power Flow Problems," Sustainability, MDPI, vol. 15(24), pages 1-9, December.
    11. Theofilos A. Papadopoulos & Kalliopi D. Pippi & Georgios A. Barzegkar-Ntovom & Eleftherios O. Kontis & Angelos I. Nousdilis & Christos L. Athanasiadis & Georgios C. Kryonidis, 2023. "Validation of a Holistic System for Operational Analysis and Provision of Ancillary Services in Active Distribution Networks," Energies, MDPI, vol. 16(6), pages 1-27, March.
    12. Lu, Yu & Xiang, Yue & Huang, Yuan & Yu, Bin & Weng, Liguo & Liu, Junyong, 2023. "Deep reinforcement learning based optimal scheduling of active distribution system considering distributed generation, energy storage and flexible load," Energy, Elsevier, vol. 271(C).
    13. Géremi Gilson Dranka & Paula Ferreira, 2020. "Electric Vehicles and Biofuels Synergies in the Brazilian Energy System," Energies, MDPI, vol. 13(17), pages 1-22, August.
    14. Shirizadeh, Behrang & Quirion, Philippe, 2022. "The importance of renewable gas in achieving carbon-neutrality: Insights from an energy system optimization model," Energy, Elsevier, vol. 255(C).
    15. Wang, Yi & Qiu, Dawei & Sun, Mingyang & Strbac, Goran & Gao, Zhiwei, 2023. "Secure energy management of multi-energy microgrid: A physical-informed safe reinforcement learning approach," Applied Energy, Elsevier, vol. 335(C).
    16. Boohyun Shin & Hyeseon Lee & Sungyun Choi, 2024. "Analysis of Underground Distribution System Models for Secondary Substations," Energies, MDPI, vol. 17(17), pages 1-22, August.
    17. Langer, Lissy & Volling, Thomas, 2022. "A reinforcement learning approach to home energy management for modulating heat pumps and photovoltaic systems," Applied Energy, Elsevier, vol. 327(C).
    18. Zhao, Yincheng & Zhang, Guozhou & Hu, Weihao & Huang, Qi & Chen, Zhe & Blaabjerg, Frede, 2023. "Meta-learning based voltage control strategy for emergency faults of active distribution networks," Applied Energy, Elsevier, vol. 349(C).
    19. Ramirez Camargo, Luis & Gruber, Katharina & Nitsch, Felix, 2019. "Assessing variables of regional reanalysis data sets relevant for modelling small-scale renewable energy systems," Renewable Energy, Elsevier, vol. 133(C), pages 1468-1478.
    20. Lan, Penghang & Chen, She & Li, Qihang & Li, Kelin & Wang, Feng & Zhao, Yaoxun, 2024. "Intelligent hydrogen-ammonia combined energy storage system with deep reinforcement learning," Renewable Energy, Elsevier, vol. 237(PB).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:379:y:2025:i:c:s0306261924023274. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.