IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v215y2021ipas0360544220322556.html
   My bibliography  Save this article

A reinforcement learning based blade twist angle distribution searching method for optimizing wind turbine energy power

Author

Listed:
  • Jia, Liangyue
  • Hao, Jia
  • Hall, John
  • Nejadkhaki, Hamid Khakpour
  • Wang, Guoxin
  • Yan, Yan
  • Sun, Mengyuan

Abstract

The twist angle distribution (TAD) of a wind turbine blade determines its efficiency in terms of electricity production. As the blade is normally deployed in dynamic wind environments where wind speed varies widely, it is crucial to search the optimal TAD for different wind speeds in the design process. Due to the need to call a large number of complex simulators, traditional methods for optimal TAD searching are inefficient and time-consuming, which hinders the blade design process. Hence, this work presents a reinforcement learning-based method for searching optimal TAD efficiently, which is named RL-TAD. The fundamental idea of RL-TAD is to learn the TAD searching policy by an agent and reuse this agent to search optimal TAD under different wind speeds. This idea divided RL-TAD from the commonly used genetic algorithm-based methods, which only output the TAD and ignore reusing the searching policy. The RL-TAD includes the offline stage and online stage. In the offline stage, the RL-TAD learns the policy by reinforcement learning, in which the environment is constructed by a surrogate model, and a new reward policy is developed by integrating design experiences. Then in the online stage, the trained agent can be deployed to search TAD for different wind speeds. To verify the proposed RL-TAD, a case study is detailed. The empirical results show that the RL-TAD can converge to the optimal TAD at a speed of 3–5 times faster than the genetic algorithm-based method in the offline stage and also a better wind energy power coefficient is obtained. Besides, the response time is less than 0.1 s when using the trained agent to search the TAD, which proofs its potential to be used in rapid optimal TAD searching. Further, the rapid optimal TAD searching ability can support the real-time control of the wind turbine blade.

Suggested Citation

  • Jia, Liangyue & Hao, Jia & Hall, John & Nejadkhaki, Hamid Khakpour & Wang, Guoxin & Yan, Yan & Sun, Mengyuan, 2021. "A reinforcement learning based blade twist angle distribution searching method for optimizing wind turbine energy power," Energy, Elsevier, vol. 215(PA).
  • Handle: RePEc:eee:energy:v:215:y:2021:i:pa:s0360544220322556
    DOI: 10.1016/j.energy.2020.119148
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544220322556
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2020.119148?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Abhijit Gosavi, 2009. "Reinforcement Learning: A Tutorial Survey and Recent Advances," INFORMS Journal on Computing, INFORMS, vol. 21(2), pages 178-192, May.
    2. Li, Yingjue & Wei, Kexiang & Yang, Wenxian & Wang, Qiong, 2020. "Improving wind turbine blade based on multi-objective particle swarm optimization," Renewable Energy, Elsevier, vol. 161(C), pages 525-542.
    3. Liu, Xiongwei & Wang, Lin & Tang, Xinzi, 2013. "Optimized linearization of chord and twist angle profiles for fixed-pitch fixed-speed wind turbine blades," Renewable Energy, Elsevier, vol. 57(C), pages 111-119.
    4. Tahani, Mojtaba & Kavari, Ghazale & Masdari, Mehran & Mirhosseini, Mojtaba, 2017. "Aerodynamic design of horizontal axis wind turbine with innovative local linearization of chord and twist distributions," Energy, Elsevier, vol. 131(C), pages 78-91.
    5. Kusiak, Andrew & Zheng, Haiyang, 2010. "Optimization of wind turbine energy and power factor with an evolutionary computation algorithm," Energy, Elsevier, vol. 35(3), pages 1324-1332.
    6. Fischer, Gunter Reinald & Kipouros, Timoleon & Savill, Anthony Mark, 2014. "Multi-objective optimisation of horizontal axis wind turbine structure and energy production using aerofoil and blade properties as design variables," Renewable Energy, Elsevier, vol. 62(C), pages 506-515.
    7. Sang-Lae Lee & SangJoon Shin, 2020. "Wind Turbine Blade Optimal Design Considering Multi-Parameters and Response Surface Method," Energies, MDPI, vol. 13(7), pages 1-23, April.
    8. David Silver & Aja Huang & Chris J. Maddison & Arthur Guez & Laurent Sifre & George van den Driessche & Julian Schrittwieser & Ioannis Antonoglou & Veda Panneershelvam & Marc Lanctot & Sander Dieleman, 2016. "Mastering the game of Go with deep neural networks and tree search," Nature, Nature, vol. 529(7587), pages 484-489, January.
    9. Sessarego, Matias & Feng, Ju & Ramos-García, Néstor & Horcas, Sergio González, 2020. "Design optimization of a curved wind turbine blade using neural networks and an aero-elastic vortex method under turbulent inflow," Renewable Energy, Elsevier, vol. 146(C), pages 1524-1535.
    10. Maheri, Alireza, 2020. "Multiobjective optimisation and integrated design of wind turbine blades using WTBM-ANSYS for high fidelity structural analysis," Renewable Energy, Elsevier, vol. 145(C), pages 814-834.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kashif Sohail & Hooman Farzaneh, 2022. "Model for Optimal Power Coefficient Tracking and Loss Reduction of the Wind Turbine Systems," Energies, MDPI, vol. 15(11), pages 1-19, June.
    2. Shin, Heesoo & Rüttgers, Mario & Lee, Sangseung, 2023. "Effects of spatiotemporal correlations in wind data on neural network-based wind predictions," Energy, Elsevier, vol. 279(C).
    3. Zsolt Čonka & Ľubomír Beňa & Róbert Štefko & Marek Pavlík & Peter Holcsik & Judith Pálfi, 2022. "Wind Turbine Power Control According to EU Legislation," Energies, MDPI, vol. 15(22), pages 1-21, November.
    4. Fang, Jianhao & Hu, Weifei & Liu, Zhenyu & Chen, Weiyi & Tan, Jianrong & Jiang, Zhiyu & Verma, Amrit Shankar, 2022. "Wind turbine rotor speed design optimization considering rain erosion based on deep reinforcement learning," Renewable and Sustainable Energy Reviews, Elsevier, vol. 168(C).
    5. Ifaei, Pouya & Nazari-Heris, Morteza & Tayerani Charmchi, Amir Saman & Asadi, Somayeh & Yoo, ChangKyoo, 2023. "Sustainable energies and machine learning: An organized review of recent applications and challenges," Energy, Elsevier, vol. 266(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Abdelsalam, Ali M. & El-Askary, W.A. & Kotb, M.A. & Sakr, I.M., 2021. "Experimental study on small scale horizontal axis wind turbine of analytically-optimized blade with linearized chord twist angle profile," Energy, Elsevier, vol. 216(C).
    2. Tahani, Mojtaba & Kavari, Ghazale & Masdari, Mehran & Mirhosseini, Mojtaba, 2017. "Aerodynamic design of horizontal axis wind turbine with innovative local linearization of chord and twist distributions," Energy, Elsevier, vol. 131(C), pages 78-91.
    3. Del Valle Carrasco, Arturo & Valles-Rosales, Delia J. & Mendez, Luis C. & Rodriguez, Manuel I., 2016. "A site-specific design of a fixed-pitch fixed-speed wind turbine blade for energy optimization using surrogate models," Renewable Energy, Elsevier, vol. 88(C), pages 112-119.
    4. Alkhabbaz, Ali & Yang, Ho-Seong & Weerakoon, A.H Samitha & Lee, Young-Ho, 2021. "A novel linearization approach of chord and twist angle distribution for 10 kW horizontal axis wind turbine," Renewable Energy, Elsevier, vol. 178(C), pages 1398-1420.
    5. Li, Munan & Wang, Wenshu & Zhou, Keyu, 2021. "Exploring the technology emergence related to artificial intelligence: A perspective of coupling analyses," Technological Forecasting and Social Change, Elsevier, vol. 172(C).
    6. Moghadassian, Behnam & Sharma, Anupam, 2020. "Designing wind turbine rotor blades to enhance energy capture in turbine arrays," Renewable Energy, Elsevier, vol. 148(C), pages 651-664.
    7. Bertašienė, Agnė & Azzopardi, Brian, 2015. "Synergies of Wind Turbine control techniques," Renewable and Sustainable Energy Reviews, Elsevier, vol. 45(C), pages 336-342.
    8. Kyoungboo Yang, 2020. "Geometry Design Optimization of a Wind Turbine Blade Considering Effects on Aerodynamic Performance by Linearization," Energies, MDPI, vol. 13(9), pages 1-18, May.
    9. Mohammed Debbache & Messaoud Hazmoune & Semcheddine Derfouf & Dana-Alexandra Ciupageanu & Gheorghe Lazaroiu, 2021. "Wind Blade Twist Correction for Enhanced Annual Energy Production of Wind Turbines," Sustainability, MDPI, vol. 13(12), pages 1-17, June.
    10. Tian Zhu & Merry H. Ma, 2022. "Deriving the Optimal Strategy for the Two Dice Pig Game via Reinforcement Learning," Stats, MDPI, vol. 5(3), pages 1-14, August.
    11. Xiaoyue Li & John M. Mulvey, 2023. "Optimal Portfolio Execution in a Regime-switching Market with Non-linear Impact Costs: Combining Dynamic Program and Neural Network," Papers 2306.08809, arXiv.org.
    12. Wang, Lin & Liu, Xiongwei & Renevier, Nathalie & Stables, Matthew & Hall, George M., 2014. "Nonlinear aeroelastic modelling for wind turbine blades based on blade element momentum theory and geometrically exact beam theory," Energy, Elsevier, vol. 76(C), pages 487-501.
    13. Voelkel, Michael A. & Sachs, Anna-Lena & Thonemann, Ulrich W., 2020. "An aggregation-based approximate dynamic programming approach for the periodic review model with random yield," European Journal of Operational Research, Elsevier, vol. 281(2), pages 286-298.
    14. Nathan Companez & Aldeida Aleti, 2016. "Can Monte-Carlo Tree Search learn to sacrifice?," Journal of Heuristics, Springer, vol. 22(6), pages 783-813, December.
    15. Yuchen Zhang & Wei Yang, 2022. "Breakthrough invention and problem complexity: Evidence from a quasi‐experiment," Strategic Management Journal, Wiley Blackwell, vol. 43(12), pages 2510-2544, December.
    16. Yassine Chemingui & Adel Gastli & Omar Ellabban, 2020. "Reinforcement Learning-Based School Energy Management System," Energies, MDPI, vol. 13(23), pages 1-21, December.
    17. Mauro, S. & Lanzafame, R. & Messina, M. & Brusca, S., 2023. "On the importance of the root-to-hub adapter effects on HAWT performance: A CFD-BEM numerical investigation," Energy, Elsevier, vol. 275(C).
    18. Zhewei Zhang & Youngjin Yoo & Kalle Lyytinen & Aron Lindberg, 2021. "The Unknowability of Autonomous Tools and the Liminal Experience of Their Use," Information Systems Research, INFORMS, vol. 32(4), pages 1192-1213, December.
    19. Yuhong Wang & Lei Chen & Hong Zhou & Xu Zhou & Zongsheng Zheng & Qi Zeng & Li Jiang & Liang Lu, 2021. "Flexible Transmission Network Expansion Planning Based on DQN Algorithm," Energies, MDPI, vol. 14(7), pages 1-21, April.
    20. JinHyo Joseph Yun & EuiSeob Jeong & Xiaofei Zhao & Sung Deuk Hahm & KyungHun Kim, 2019. "Collective Intelligence: An Emerging World in Open Innovation," Sustainability, MDPI, vol. 11(16), pages 1-15, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:215:y:2021:i:pa:s0360544220322556. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.