IDEAS home Printed from https://ideas.repec.org/a/eee/renene/v256y2026ipfs0960148125020099.html

Enhancing economic efficiency and operational stability of high-penetration renewable distribution networks: A multi-timescale coordinated optimization method leveraging multi-agent graph reinforcement learning

Author

Listed:
  • Jiang, Changxu
  • Guo, Chen
  • Lin, Junchi
  • Lin, Junjie
  • Zheng, Shunlin

Abstract

The increasing integration of distributed generation into high-penetration renewable distribution networks challenges conventional single-dimensional optimization strategies. These strategies struggle to balance multi-objective requirements, such as reducing network losses, ensuring voltage stability, and accommodating renewable energy. Existing approaches often neglect critical interactions among network topology, reactive power compensation, and active power regulation, leading to compromised performance under high DG penetration. This paper proposes a multi-agent graph reinforcement learning framework for multi-timescale coordinated rolling optimization of topology, reactive power, and active power. Our method integrates graph convolutional networks to model grid-structured data and double deep Q-networks to address complex decision-making. By hierarchically coordinating slow- and fast-timescale resources through rolling optimization, it adaptively manages stochastic fluctuations in DG outputs and loads. Case studies demonstrate enhanced cross-timescale coordination, achieving higher renewable utilization, stabilized voltage profiles, improved operational flexibility, and robust uncertainty handling capabilities. Furthermore, the framework exhibits excellent scalability and computational efficiency, enabling effective optimization even for large-scale distribution networks, which is critical for practical deployments in complex high-renewable scenarios. The framework offers a scalable solution for intelligent grid management in high-renewable scenarios.

Suggested Citation

  • Jiang, Changxu & Guo, Chen & Lin, Junchi & Lin, Junjie & Zheng, Shunlin, 2026. "Enhancing economic efficiency and operational stability of high-penetration renewable distribution networks: A multi-timescale coordinated optimization method leveraging multi-agent graph reinforcement learning," Renewable Energy, Elsevier, vol. 256(PF).
  • Handle: RePEc:eee:renene:v:256:y:2026:i:pf:s0960148125020099
    DOI: 10.1016/j.renene.2025.124345
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0960148125020099
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.renene.2025.124345?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Madjid Tavana & Mehdi Soltanifar & Francisco J. Santos-Arteaga, 2023. "Analytical hierarchy process: revolution and evolution," Annals of Operations Research, Springer, vol. 326(2), pages 879-907, July.
    2. Song, Jianzhao & Wang, Na & Zhang, Zhong & Wu, Hao & Ding, Yi & Pan, Qingze & Pan, Xingzuo & Shui, Siyuan & Chen, Haipeng, 2025. "Fuzzy optimal scheduling of hydrogen-integrated energy systems with uncertainties of renewable generation considering hydrogen equipment under multiple conditions," Applied Energy, Elsevier, vol. 393(C).
    3. He, Xin & Zhang, BaoLai & Jia, HaoYang & Xin, Kaixuan & Wang, Youpeng & Yu, Cheng & Zhang, BenXi, 2025. "Regret-aware optimization of hydrogen-assisted congestion control in a renewable-dominated reconfigurable distribution network," Renewable Energy, Elsevier, vol. 250(C).
    4. Meng, Qinglin & He, Ying & Gao, Yuan & Hussain, Sheharyar & Lu, Jinghang & Guerrero, Josep M., 2025. "Bi-level four-stage optimization scheduling for Active Distribution Networks with Electric Vehicle integration using multi-mode dynamic pricing," Energy, Elsevier, vol. 327(C).
    5. Huang, Zhanghao & Zhang, Yachao & Xie, Shiwei, 2022. "Data-adaptive robust coordinated optimization of dynamic active and reactive power flow in active distribution networks," Renewable Energy, Elsevier, vol. 188(C), pages 164-183.
    6. Kabir, Farzana & Yu, Nanpeng & Gao, Yuanqi & Wang, Wenyu, 2023. "Deep reinforcement learning-based two-timescale Volt-VAR control with degradation-aware smart inverters in power distribution systems," Applied Energy, Elsevier, vol. 335(C).
    7. Habib, Salman & El-Ferik, Sami & Gulzar, Muhammad Majid & Chauhdary, Sohaib Tahir & Ahmad, Hasnain & Ahmed, Emad M., 2025. "Optimizing integrated energy systems with a robust MISOCP model and C&CG algorithm for enhanced grid efficiency and profitability," Energy, Elsevier, vol. 318(C).
    8. Kumar, Vinit & Singh, Mukesh, 2021. "Reactive power compensation using derated power generation mode of modified P&O algorithm in grid-interfaced PV system," Renewable Energy, Elsevier, vol. 178(C), pages 108-117.
    9. Pang, Kaiyuan & Dimeas, Aris L. & Hatziargyriou, Nikos D. & Wang, Chongyu & Wen, Fushuan, 2025. "Collaborative switch placement and operational measures to enhance distribution system flexibility considering uncertain operation costs," Energy, Elsevier, vol. 320(C).
    10. Yu, Bolin & Fang, Debin & Xiao, Kun & Pan, Yuling, 2023. "Drivers of renewable energy penetration and its role in power sector's deep decarbonization towards carbon peak," Renewable and Sustainable Energy Reviews, Elsevier, vol. 178(C).
    11. Zhu, Jiaoyiling & Hu, Weihao & Xu, Xiao & Liu, Haoming & Pan, Li & Fan, Haoyang & Zhang, Zhenyuan & Chen, Zhe, 2022. "Optimal scheduling of a wind energy dominated distribution network via a deep reinforcement learning approach," Renewable Energy, Elsevier, vol. 201(P1), pages 792-801.
    12. Zhao, Zhonghao & Lee, Carman K.M. & Yan, Xiaoyuan & Wang, Haonan, 2024. "Reinforcement learning for electric vehicle charging scheduling: A systematic review," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 190(C).
    13. Álvarez-Arroyo, César & Vergine, Salvatore & de la Nieta, Agustín Sánchez & Alvarado-Barrios, Lázaro & D’Amico, Guglielmo, 2024. "Optimising microgrid energy management: Leveraging flexible storage systems and full integration of renewable energy sources," Renewable Energy, Elsevier, vol. 229(C).
    14. Chen Guo & Changxu Jiang & Chenxi Liu, 2025. "Dynamic Reconfiguration Method of Active Distribution Networks Based on Graph Attention Network Reinforcement Learning," Energies, MDPI, vol. 18(8), pages 1-26, April.
    15. Rehman, Anis Ur & Ullah, Zia & Qazi, Hasan Saeed & Hasanien, Hany M. & Khalid, Haris M., 2024. "Reinforcement learning-driven proximal policy optimization-based voltage control for PV and WT integrated power system," Renewable Energy, Elsevier, vol. 227(C).
    16. Li, Pan & Wang, Feng & Ma, Teng & Zhang, Shuqing, 2023. "Two-stage cooperative real-time autonomy control strategy considering vulnerability of active distribution networks," Renewable Energy, Elsevier, vol. 219(P1).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Busola D. Akintayo & Oluwafemi E. Ige & Olubayo M. Babatunde & Oludolapo A. Olanrewaju, 2023. "Evaluation and Prioritization of Power-Generating Systems Using a Life Cycle Assessment and a Multicriteria Decision-Making Approach," Energies, MDPI, vol. 16(18), pages 1-18, September.
    2. Wang, Jin & Zhao, Zhipeng & Zhou, Jinglin & Cheng, Chuntian & Su, Huaying, 2024. "Co-optimization for day-ahead scheduling and flexibility response mode of a hydro–wind–solar hybrid system considering forecast uncertainty of variable renewable energy," Energy, Elsevier, vol. 311(C).
    3. Park, Joungho & Kang, Sungho & Kim, Sunwoo & Kim, Hana & Cho, Hyun-Seok & Lee, Changsoo & Kim, MinJoong & Lee, Jay H., 2025. "The impact of degradation on the economics of green hydrogen," Renewable and Sustainable Energy Reviews, Elsevier, vol. 213(C).
    4. Qinqin Xia & Yao Zou & Qianggang Wang, 2024. "Optimal Capacity Planning of Green Electricity-Based Industrial Electricity-Hydrogen Multi-Energy System Considering Variable Unit Cost Sequence," Sustainability, MDPI, vol. 16(9), pages 1-20, April.
    5. Rafał Nagaj & Bożena Gajdzik & Radosław Wolniak & Wieslaw Wes Grebski, 2024. "The Impact of Deep Decarbonization Policy on the Level of Greenhouse Gas Emissions in the European Union," Energies, MDPI, vol. 17(5), pages 1-23, March.
    6. Boscaino, Valeria & Ditta, Vito & Marsala, Giuseppe & Panzavecchia, Nicola & Tinè, Giovanni & Cosentino, Valentina & Cataliotti, Antonio & Di Cara, Dario, 2024. "Grid-connected photovoltaic inverters: Grid codes, topologies and control techniques," Renewable and Sustainable Energy Reviews, Elsevier, vol. 189(PA).
    7. Qi Wei & Rui Wang & Chuan-Yang Ruan, 2024. "Similarity Measures of Probabilistic Interval Preference Ordering Sets and Their Applications in Decision-Making," Mathematics, MDPI, vol. 12(20), pages 1-26, October.
    8. Zhao, Yincheng & Zhang, Guozhou & Hu, Weihao & Huang, Qi & Chen, Zhe & Blaabjerg, Frede, 2023. "Meta-learning based voltage control strategy for emergency faults of active distribution networks," Applied Energy, Elsevier, vol. 349(C).
    9. Cao, Wenqiang & Yu, Junqi & Ru, Chengyi & Wang, Meng & Wang, Ke, 2025. "A two-stage distributionally robust optimization operation scheduling model for solar PT-PV systems based on integrated load consumption prediction," Energy, Elsevier, vol. 332(C).
    10. Wang, Huan & Liu, Benxi & Cheng, Chuntian & Wu, Huijun & Zhao, Hongye & Liao, Shengli, 2026. "Short-term joint scheduling model of hydro-wind-PV-storage dominated by hydropower considering the cascade output matching and decomposition strategies," Renewable Energy, Elsevier, vol. 257(C).
    11. Zhang, Yunyi & Zhou, Dengli & Lin, Boqiang, 2026. "Paving the way for sustainable energy solutions: A real-time pricing mechanism in integrated energy systems with electric vehicles," Renewable Energy, Elsevier, vol. 256(PI).
    12. Xi Chen & Jiancun Liu & Pengfei Li & Junzhi Ren & Delong Zhang & Xuesong Zhou, 2025. "A Multi-Stage Resilience Enhancement Method for Distribution Networks Employing Transportation and Hydrogen Energy Systems," Sustainability, MDPI, vol. 17(19), pages 1-19, September.
    13. Bożena Gajdzik & Radosław Wolniak & Wiesław Grebski, 2025. "An Econometric Analysis of CO 2 Emission Intensity in Poland’s Blast Furnace–Basic Oxygen Furnace Steelmaking Process," Sustainability, MDPI, vol. 17(9), pages 1-30, April.
    14. Aleksandra Kuzior & Yevhen Kovalenko & Inna Tiutiunyk & Larysa Hrytsenko, 2025. "Assessment of the Energy Security of EU Countries in Light of the Expansion of Renewable Energy Sources," Energies, MDPI, vol. 18(8), pages 1-24, April.
    15. Han, Zhixin & Fang, Debin & Yang, Peiwen & Lei, Leyao, 2023. "Cooperative mechanisms for multi-energy complementarity in the electricity spot market," Energy Economics, Elsevier, vol. 127(PB).
    16. Zhao, Weihan & Wang, Jianguo & Huang, Wenxin & Li, Yifan & Zhou, Mi & Cao, Jinxin & Huang, Yijun, 2026. "Matching daily wind speed patterns with grid demand: An offshore wind assessment framework integrating source-load similarity and resource abundance," Applied Energy, Elsevier, vol. 406(C).
    17. Roshani, Amir Salek & Assareh, Ehsanolah & Ershadi, Ali & Carvalho, Monica, 2024. "Optimization of a hybrid renewable energy system for off-grid residential communities using numerical simulation, response surface methodology, and life cycle assessment," Renewable Energy, Elsevier, vol. 236(C).
    18. Lin, Mingqiang & Zhong, Ming & Meng, Jinhao & Wang, Wei & Wu, Ji, 2025. "EV charging scheduling under limited charging constraints by an improve proximal policy optimization algorithm," Energy, Elsevier, vol. 333(C).
    19. Chen Guo & Changxu Jiang & Chenxi Liu, 2025. "Dynamic Reconfiguration Method of Active Distribution Networks Based on Graph Attention Network Reinforcement Learning," Energies, MDPI, vol. 18(8), pages 1-26, April.
    20. Hu, Di & Zhang, Chen & Yang, Tao & Fang, Qingyan, 2025. "A deep autoencoder with structured latent space for process monitoring and anomaly detection in coal-fired power units," Reliability Engineering and System Safety, Elsevier, vol. 261(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:renene:v:256:y:2026:i:pf:s0960148125020099. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/renewable-energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.