IDEAS home Printed from https://ideas.repec.org/a/eee/renene/v219y2023ip2s0960148123013940.html
   My bibliography  Save this article

Collective large-scale wind farm multivariate power output control based on hierarchical communication multi-agent proximal policy optimization

Author

Listed:
  • Zhang, Yubao
  • Chen, Xin
  • Gong, Sumei
  • Chen, Jiehao

Abstract

Wind power is becoming an increasingly vital source of renewable energy worldwide. However, controlling power generation in wind farms faces significant challenges due to the inherent complexity of these systems. To address this issue and maximize power output, we propose a novel communication-based multi-agent deep reinforcement learning approach for large-scale wind farm control. We introduce a multivariate power model for wind farms to analyze the impact of wake effects on power output. This model considers controllable variables such as axial induction factor, yaw angle, and tilt angle. To coordinate the continuous controls in large-scale wind farms, we propose the hierarchical communication multi-agent proximal policy optimization (HCMAPPO) algorithm. The wind farm is divided into multiple wind turbine aggregators (WTAs), and neighboring WTAs can exchange information through hierarchical communication to optimize power output. Our simulation results demonstrate that the multivariate HCMAPPO approach significantly increases wind farm power output compared to traditional PID control, coordinated model-based predictive control, and the multi-agent deep deterministic policy gradient algorithm. The HCMAPPO algorithm can be trained using a thirteen-turbine wind farm environment and effectively applied to large-scale wind farms. Importantly, as the wind farm scale increases, there is no significant increase in wind turbine blade fatigue damage from wake control. This multivariate HCMAPPO control strategy enables the collective maximization of power output in large-scale wind farms.

Suggested Citation

  • Zhang, Yubao & Chen, Xin & Gong, Sumei & Chen, Jiehao, 2023. "Collective large-scale wind farm multivariate power output control based on hierarchical communication multi-agent proximal policy optimization," Renewable Energy, Elsevier, vol. 219(P2).
  • Handle: RePEc:eee:renene:v:219:y:2023:i:p2:s0960148123013940
    DOI: 10.1016/j.renene.2023.119479
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0960148123013940
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.renene.2023.119479?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Padullaparthi, Venkata Ramakrishna & Nagarathinam, Srinarayana & Vasan, Arunchandar & Menon, Vishnu & Sudarsanam, Depak, 2022. "FALCON- FArm Level CONtrol for wind turbines using multi-agent deep reinforcement learning," Renewable Energy, Elsevier, vol. 181(C), pages 445-456.
    2. Shu, Tong & Song, Dongran & Joo, Young Hoon, 2022. "Non-centralised coordinated optimisation for maximising offshore wind farm power via a sparse communication architecture," Applied Energy, Elsevier, vol. 324(C).
    3. Sun, Haiying & Yang, Hongxing, 2023. "Wind farm layout and hub height optimization with a novel wake model," Applied Energy, Elsevier, vol. 348(C).
    4. Dong, Hongyang & Zhang, Jincheng & Zhao, Xiaowei, 2021. "Intelligent wind farm control via deep reinforcement learning and high-fidelity simulations," Applied Energy, Elsevier, vol. 292(C).
    5. Michael F. Howland & Jesús Bas Quesada & Juan José Pena Martínez & Felipe Palou Larrañaga & Neeraj Yadav & Jasvipul S. Chawla & Varun Sivaram & John O. Dabiri, 2022. "Collective wind farm operation based on a predictive model increases utility-scale energy production," Nature Energy, Nature, vol. 7(9), pages 818-827, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yu, Xiaobing & Lu, Yangchen, 2023. "Reinforcement learning-based multi-objective differential evolution for wind farm layout optimization," Energy, Elsevier, vol. 284(C).
    2. Pawar, Suraj & Sharma, Ashesh & Vijayakumar, Ganesh & Bay, Chrstopher J. & Yellapantula, Shashank & San, Omer, 2022. "Towards multi-fidelity deep learning of wind turbine wakes," Renewable Energy, Elsevier, vol. 200(C), pages 867-879.
    3. Shin, Heesoo & Rüttgers, Mario & Lee, Sangseung, 2023. "Effects of spatiotemporal correlations in wind data on neural network-based wind predictions," Energy, Elsevier, vol. 279(C).
    4. Tavakol Aghaei, Vahid & Ağababaoğlu, Arda & Bawo, Biram & Naseradinmousavi, Peiman & Yıldırım, Sinan & Yeşilyurt, Serhat & Onat, Ahmet, 2023. "Energy optimization of wind turbines via a neural control policy based on reinforcement learning Markov chain Monte Carlo algorithm," Applied Energy, Elsevier, vol. 341(C).
    5. Li, Rui & Zhang, Jincheng & Zhao, Xiaowei, 2022. "Dynamic wind farm wake modeling based on a Bilateral Convolutional Neural Network and high-fidelity LES data," Energy, Elsevier, vol. 258(C).
    6. Yildiz, Anil & Mern, John & Kochenderfer, Mykel J. & Howland, Michael F., 2023. "Towards sequential sensor placements on a wind farm to maximize lifetime energy and profit," Renewable Energy, Elsevier, vol. 216(C).
    7. Rivera-Arreba, Irene & Li, Zhaobin & Yang, Xiaolei & Bachynski-Polić, Erin E., 2024. "Comparison of the dynamic wake meandering model against large eddy simulation for horizontal and vertical steering of wind turbine wakes," Renewable Energy, Elsevier, vol. 221(C).
    8. Kadoche, Elie & Gourvénec, Sébastien & Pallud, Maxime & Levent, Tanguy, 2023. "MARLYC: Multi-Agent Reinforcement Learning Yaw Control," Renewable Energy, Elsevier, vol. 217(C).
    9. Wang, Yu & Wei, Shanbi & Yang, Wei & Chai, Yi, 2023. "Adaptive economic predictive control for offshore wind farm active yaw considering generation uncertainty," Applied Energy, Elsevier, vol. 351(C).
    10. Sara C. Pryor & Rebecca J. Barthelmie, 2024. "Power Production, Inter- and Intra-Array Wake Losses from the U.S. East Coast Offshore Wind Energy Lease Areas," Energies, MDPI, vol. 17(5), pages 1-30, February.
    11. Zhang, Jincheng & Zhao, Xiaowei, 2021. "Three-dimensional spatiotemporal wind field reconstruction based on physics-informed deep learning," Applied Energy, Elsevier, vol. 300(C).
    12. Dong, Zhen & Li, Zhongguo & Liang, Zhongchao & Xu, Yiqiao & Ding, Zhengtao, 2021. "Distributed neural network enhanced power generation strategy of large-scale wind power plant for power expansion," Applied Energy, Elsevier, vol. 303(C).
    13. Esmail Mahmoodi & Mohammad Khezri & Arash Ebrahimi & Uwe Ritschel & Leonardo P. Chamorro & Ali Khanjari, 2023. "A Simple Model for Wake-Induced Aerodynamic Interaction of Wind Turbines," Energies, MDPI, vol. 16(15), pages 1-13, July.
    14. Zhiwen Deng & Chang Xu & Zhihong Huo & Xingxing Han & Feifei Xue, 2023. "Yaw Optimisation for Wind Farm Production Maximisation Based on a Dynamic Wake Model," Energies, MDPI, vol. 16(9), pages 1-20, May.
    15. Kuichao Ma & Huanqiang Zhang & Xiaoxia Gao & Xiaodong Wang & Heng Nian & Wei Fan, 2024. "Research on Evaluation Method of Wind Farm Wake Energy Efficiency Loss Based on SCADA Data Analysis," Sustainability, MDPI, vol. 16(5), pages 1-16, February.
    16. Ganesh Mayilsamy & Kumarasamy Palanimuthu & Raghul Venkateswaran & Ruban Periyanayagam Antonysamy & Seong Ryong Lee & Dongran Song & Young Hoon Joo, 2023. "A Review of State Estimation Techniques for Grid-Connected PMSG-Based Wind Turbine Systems," Energies, MDPI, vol. 16(2), pages 1-27, January.
    17. Cheoljoon Jeong & Ziang Xu & Albert S. Berahas & Eunshin Byon & Kristen Cetin, 2023. "Multiblock Parameter Calibration in Computer Models," INFORMS Joural on Data Science, INFORMS, vol. 2(2), pages 116-137, October.
    18. Tong Shu & Young Hoon Joo, 2023. "Non-Centralised Balance Dispatch Strategy in Waked Wind Farms through a Graph Sparsification Partitioning Approach," Energies, MDPI, vol. 16(20), pages 1-21, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:renene:v:219:y:2023:i:p2:s0960148123013940. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/renewable-energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.