IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v379y2025ics0306261924023687.html
   My bibliography  Save this article

Distributed voltage control for multi-feeder distribution networks considering transmission network voltage fluctuation based on robust deep reinforcement learning

Author

Listed:
  • Wu, Zhi
  • Li, Yiqi
  • Zhang, Xiao
  • Zheng, Shu
  • Zhao, Jingtao

Abstract

In the multi-feeder distribution network, the power balance between photovoltaics generations and load demands across regions is more complex. To solve the above problems, this paper proposes a multi-agent distributed voltage control strategy based on robust deep reinforcement learning to reduce voltage deviation. The whole multi-feeder distribution network is divided into a main agent and several sub-agents, and a multi-agent distributed voltage control model considering the transmission network voltage fluctuations and the corresponding power fluctuations is established. Based on the information uploaded by sub-agents, the main agent models the uncertainty of the transmission network voltage fluctuations and the corresponding power fluctuations as a disturbance to the state, and a RDRL method is employed to determine the tap position of on-load tap changer. Furtherly, each sub-agent uses the second-order cone relaxation technique to adjust the reactive power outputs of the inverters on each feeder. The effectiveness of the proposed method has been verified in two real-world multi-feeder systems. The results show that the proposed method can achieve millisecond-level decision-making, with a voltage deviation only 1.28 % higher than the global optimal results, achieving near-optimal control. The proposed method also demonstrates robustness in handling transmission network uncertainties and partial measurement loss.

Suggested Citation

  • Wu, Zhi & Li, Yiqi & Zhang, Xiao & Zheng, Shu & Zhao, Jingtao, 2025. "Distributed voltage control for multi-feeder distribution networks considering transmission network voltage fluctuation based on robust deep reinforcement learning," Applied Energy, Elsevier, vol. 379(C).
    • Handle: RePEc:eee:appene:v:379:y:2025:i:c:s0306261924023687
    DOI: 10.1016/j.apenergy.2024.124984
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261924023687
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.apenergy.2024.124984?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kou, Peng & Liang, Deliang & Wang, Chen & Wu, Zihao & Gao, Lin, 2020. "Safe deep reinforcement learning-based constrained optimal control scheme for active distribution networks," Applied Energy, Elsevier, vol. 264(C).
    2. Mojgan Hojabri & Ulrich Dersch & Antonios Papaemmanouil & Peter Bosshart, 2019. "A Comprehensive Survey on Phasor Measurement Unit Applications in Distribution Systems," Energies, MDPI, vol. 12(23), pages 1-23, November.
    3. Wu, Tao & Wang, Jianhui & Lu, Xiaonan & Du, Yuhua, 2022. "AC/DC hybrid distribution network reconfiguration with microgrid formation using multi-agent soft actor-critic," Applied Energy, Elsevier, vol. 307(C).
    4. Gao, Yuanqi & Yu, Nanpeng, 2022. "Model-augmented safe reinforcement learning for Volt-VAR control in power distribution networks," Applied Energy, Elsevier, vol. 313(C).
    5. Cao, Di & Zhao, Junbo & Hu, Weihao & Ding, Fei & Yu, Nanpeng & Huang, Qi & Chen, Zhe, 2022. "Model-free voltage control of active distribution system with PVs using surrogate model-based deep reinforcement learning," Applied Energy, Elsevier, vol. 306(PA).
    6. Jing Zhang & Yiqi Li & Zhi Wu & Chunyan Rong & Tao Wang & Zhang Zhang & Suyang Zhou, 2021. "Deep-Reinforcement-Learning-Based Two-Timescale Voltage Control for Distribution Systems," Energies, MDPI, vol. 14(12), pages 1-15, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Qingyan Li & Tao Lin & Qianyi Yu & Hui Du & Jun Li & Xiyue Fu, 2023. "Review of Deep Reinforcement Learning and Its Application in Modern Renewable Power System Control," Energies, MDPI, vol. 16(10), pages 1-23, May.
    2. Zhang, Xiao & Wu, Zhi & Sun, Qirun & Gu, Wei & Zheng, Shu & Zhao, Jingtao, 2024. "Application and progress of artificial intelligence technology in the field of distribution network voltage Control：A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 192(C).
    3. Wang, Yi & Qiu, Dawei & Sun, Mingyang & Strbac, Goran & Gao, Zhiwei, 2023. "Secure energy management of multi-energy microgrid: A physical-informed safe reinforcement learning approach," Applied Energy, Elsevier, vol. 335(C).
    4. Zhao, Yincheng & Zhang, Guozhou & Hu, Weihao & Huang, Qi & Chen, Zhe & Blaabjerg, Frede, 2023. "Meta-learning based voltage control strategy for emergency faults of active distribution networks," Applied Energy, Elsevier, vol. 349(C).
    5. Zhang, Ziqi & Li, Peng & Ji, Haoran & Zhao, Jinli & Xi, Wei & Wu, Jianzhong & Wang, Chengshan, 2024. "Combined central-local voltage control of inverter-based DG in active distribution networks11The short version of the paper was presented at CUE2023. This paper is a substantial extension of the short," Applied Energy, Elsevier, vol. 372(C).
    6. Jude Suchithra & Amin Rajabi & Duane A. Robinson, 2024. "Enhancing PV Hosting Capacity of Electricity Distribution Networks Using Deep Reinforcement Learning-Based Coordinated Voltage Control," Energies, MDPI, vol. 17(20), pages 1-27, October.
    7. Chen, Yongdong & Liu, Youbo & Zhao, Junbo & Qiu, Gao & Yin, Hang & Li, Zhengbo, 2023. "Physical-assisted multi-agent graph reinforcement learning enabled fast voltage regulation for PV-rich active distribution network," Applied Energy, Elsevier, vol. 351(C).
    8. Mudhafar Al-Saadi & Maher Al-Greer & Michael Short, 2023. "Reinforcement Learning-Based Intelligent Control Strategies for Optimal Power Management in Advanced Power Distribution Systems: A Survey," Energies, MDPI, vol. 16(4), pages 1-38, February.
    9. Prabawa, Panggah & Choi, Dae-Hyun, 2024. "Safe deep reinforcement learning-assisted two-stage energy management for active power distribution networks with hydrogen fueling stations," Applied Energy, Elsevier, vol. 375(C).
    10. Jude Suchithra & Duane A. Robinson & Amin Rajabi, 2024. "A Model-Free Deep Reinforcement Learning-Based Approach for Assessment of Real-Time PV Hosting Capacity," Energies, MDPI, vol. 17(9), pages 1-12, April.
    11. Guo, Guodong & Zhang, Mengfan & Gong, Yanfeng & Xu, Qianwen, 2023. "Safe multi-agent deep reinforcement learning for real-time decentralized control of inverter based renewable energy resources considering communication delay," Applied Energy, Elsevier, vol. 349(C).
    12. Jude Suchithra & Duane Robinson & Amin Rajabi, 2023. "Hosting Capacity Assessment Strategies and Reinforcement Learning Methods for Coordinated Voltage Control in Electricity Distribution Networks: A Review," Energies, MDPI, vol. 16(5), pages 1-28, March.
    13. Yu, Peipei & Zhang, Hongcai & Hu, Zechun & Song, Yonghua, 2025. "Voltage control of distribution grid with district cooling systems based on scenario-classified reinforcement learning," Applied Energy, Elsevier, vol. 377(PB).
    14. Zhipeng Jing & Lipo Gao & Chengao Wu & Dong Liang, 2025. "Linear Quadratic Regulator-Based Coordinated Voltage and Power Control for Flexible Distribution Networks," Energies, MDPI, vol. 18(2), pages 1-16, January.
    15. Oh, Seok Hwa & Yoon, Yong Tae & Kim, Seung Wan, 2020. "Online reconfiguration scheme of self-sufficient distribution network based on a reinforcement learning approach," Applied Energy, Elsevier, vol. 280(C).
    16. Zhu, Xingxu & Hou, Xiangchen & Li, Junhui & Yan, Gangui & Li, Cuiping & Wang, Dongbo, 2023. "Distributed online prediction optimization algorithm for distributed energy resources considering the multi-periods optimal operation," Applied Energy, Elsevier, vol. 348(C).
    17. Yin, Linfei & He, Xiaoyu, 2023. "Artificial emotional deep Q learning for real-time smart voltage control of cyber-physical social power systems," Energy, Elsevier, vol. 273(C).
    18. Mohammad Javad Bordbari & Fuzhan Nasiri, 2024. "Networked Microgrids: A Review on Configuration, Operation, and Control Strategies," Energies, MDPI, vol. 17(3), pages 1-28, February.
    19. Kabir, Farzana & Yu, Nanpeng & Gao, Yuanqi & Wang, Wenyu, 2023. "Deep reinforcement learning-based two-timescale Volt-VAR control with degradation-aware smart inverters in power distribution systems," Applied Energy, Elsevier, vol. 335(C).
    20. Zhang, Bin & Hu, Weihao & Ghias, Amer M.Y.M. & Xu, Xiao & Chen, Zhe, 2022. "Multi-agent deep reinforcement learning-based coordination control for grid-aware multi-buildings," Applied Energy, Elsevier, vol. 328(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:379:y:2025:i:c:s0306261924023687. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.