IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v348y2023ics0306261923008838.html
   My bibliography  Save this article

Reward adaptive wind power tracking control based on deep deterministic policy gradient

Author

Listed:
  • Chen, Peng
  • Han, Dezhi

Abstract

Wind power efficiency is an essential factor affecting wind power development, and efficient wind power control methods are the key to improving wind power efficiency. Previous wind power control methods require high internal system expertise in internal systems and struggled to balance the accuracy of the maximum power control and the output stability under high wind speed. Therefore, this paper proposes a reward-adaptive control method for wind power tracking based on Deep Deterministic Policy Gradient (DDPG). The method can use one controller to simultaneously control the generator torque and pitch angle in various operating conditions following the system state and the designed flag of operating conditions, thus enabling efficient tracking of the maximum power generation, and stabilizing the output power under high wind speed. Moreover, this paper proposes an internal and external reward algorithm that integrates the Intrinsic Curiosity Module (ICM) and the Actor–Critic (AC) architecture, which can adaptively calculate the reward of DDPG, thereby effectively resolving the sparse reward problem, accelerating the convergence of neural network, and improving the learning effect. From the simulation, the control method proposed in this paper can effectively improve the power generation efficiency under turbulent wind speed, reduce the pitch angle variation by about 30%, and improve the power tracking accuracy by more than 70%.

Suggested Citation

  • Chen, Peng & Han, Dezhi, 2023. "Reward adaptive wind power tracking control based on deep deterministic policy gradient," Applied Energy, Elsevier, vol. 348(C).
  • Handle: RePEc:eee:appene:v:348:y:2023:i:c:s0306261923008838
    DOI: 10.1016/j.apenergy.2023.121519
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261923008838
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2023.121519?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kumar, Dipesh & Chatterjee, Kalyan, 2016. "A review of conventional and advanced MPPT algorithms for wind energy systems," Renewable and Sustainable Energy Reviews, Elsevier, vol. 55(C), pages 957-970.
    2. Sahin, Mustafa & Yavrucuk, Ilkay, 2022. "Adaptive envelope protection control of wind turbines under varying operational conditions," Energy, Elsevier, vol. 247(C).
    3. Youssef, Abdel-Raheem & Mousa, Hossam H.H. & Mohamed, Essam E.M., 2020. "Development of self-adaptive P&O MPPT algorithm for wind generation systems with concentrated search area," Renewable Energy, Elsevier, vol. 154(C), pages 875-893.
    4. Gualtieri, Giovanni, 2019. "A comprehensive review on wind resource extrapolation models applied in wind energy," Renewable and Sustainable Energy Reviews, Elsevier, vol. 102(C), pages 215-233.
    5. Yao, Qi & Hu, Yang & Zhao, Tianyang & Guan, Yuanpeng & Luo, Zhiling & Liu, Jizhen, 2022. "Fatigue load suppression during active power control process in wind farm using dynamic-local-reference DMPC," Renewable Energy, Elsevier, vol. 183(C), pages 423-434.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lafarge, Barbara & Grondel, Sébastien & Delebarre, Christophe & Curea, Octavian & Richard, Claude, 2021. "Linear electromagnetic energy harvester system embedded on a vehicle suspension: From modeling to performance analysis," Energy, Elsevier, vol. 225(C).
    2. Hamid Chojaa & Aziz Derouich & Mohammed Taoussi & Seif Eddine Chehaidia & Othmane Zamzoum & Mohamed I. Mosaad & Ayman Alhejji & Mourad Yessef, 2022. "Nonlinear Control Strategies for Enhancing the Performance of DFIG-Based WECS under a Real Wind Profile," Energies, MDPI, vol. 15(18), pages 1-23, September.
    3. Wang, Jian-jun & Deng, Yu-cong & Sun, Wen-biao & Zheng, Xiao-bin & Cui, Zheng, 2023. "Maximum power point tracking method based on impedance matching for a micro hydropower generator," Applied Energy, Elsevier, vol. 340(C).
    4. Memon, Mudasir Ahmed & Mekhilef, Saad & Mubin, Marizan & Aamir, Muhammad, 2018. "Selective harmonic elimination in inverters using bio-inspired intelligent algorithms for renewable energy conversion applications: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 82(P3), pages 2235-2253.
    5. Dali, Ali & Abdelmalek, Samir & Bakdi, Azzeddine & Bettayeb, Maamar, 2021. "A new robust control scheme: Application for MPP tracking of a PMSG-based variable-speed wind turbine," Renewable Energy, Elsevier, vol. 172(C), pages 1021-1034.
    6. Crippa, Paola & Alifa, Mariana & Bolster, Diogo & Genton, Marc G. & Castruccio, Stefano, 2021. "A temporal model for vertical extrapolation of wind speed and wind energy assessment," Applied Energy, Elsevier, vol. 301(C).
    7. Giani, Paolo & Tagle, Felipe & Genton, Marc G. & Castruccio, Stefano & Crippa, Paola, 2020. "Closing the gap between wind energy targets and implementation for emerging countries," Applied Energy, Elsevier, vol. 269(C).
    8. Tavakol Aghaei, Vahid & Ağababaoğlu, Arda & Bawo, Biram & Naseradinmousavi, Peiman & Yıldırım, Sinan & Yeşilyurt, Serhat & Onat, Ahmet, 2023. "Energy optimization of wind turbines via a neural control policy based on reinforcement learning Markov chain Monte Carlo algorithm," Applied Energy, Elsevier, vol. 341(C).
    9. Arshdeep Singh & Shimi Sudha Letha, 2019. "Emerging energy sources for electric vehicle charging station," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 21(5), pages 2043-2082, October.
    10. Tai Li & Yanbo Wang & Sunan Sun & Huimin Qian & Leqiu Wang & Lei Wang & Yanxia Shen & Zhicheng Ji, 2023. "Fuzzy Active Disturbance Rejection-Based Virtual Inertia Control Strategy for Wind Farms," Energies, MDPI, vol. 16(10), pages 1-16, May.
    11. Lin, Zhongwei & Chen, Zhenyu & Liu, Jizhen & Wu, Qiuwei, 2019. "Coordinated mechanical loads and power optimization of wind energy conversion systems with variable-weight model predictive control strategy," Applied Energy, Elsevier, vol. 236(C), pages 307-317.
    12. Zhicheng Lin & Song Zheng & Zhicheng Chen & Rong Zheng & Wang Zhang, 2019. "Application Research of the Parallel System Theory and the Data Engine Approach in Wind Energy Conversion System," Energies, MDPI, vol. 12(5), pages 1-20, March.
    13. Fathabadi, Hassan, 2016. "Novel highly accurate universal maximum power point tracker for maximum power extraction from hybrid fuel cell/photovoltaic/wind power generation systems," Energy, Elsevier, vol. 116(P1), pages 402-416.
    14. Amir Raouf & Kotb B. Tawfiq & Elsayed Tag Eldin & Hossam Youssef & Elwy E. El-Kholy, 2023. "Wind Energy Conversion Systems Based on a Synchronous Generator: Comparative Review of Control Methods and Performance," Energies, MDPI, vol. 16(5), pages 1-22, February.
    15. Christoffer Hallgren & Johan Arnqvist & Stefan Ivanell & Heiner Körnich & Ville Vakkari & Erik Sahlée, 2020. "Looking for an Offshore Low-Level Jet Champion among Recent Reanalyses: A Tight Race over the Baltic Sea," Energies, MDPI, vol. 13(14), pages 1-26, July.
    16. Li, Lei & Yin, Xiao-Li & Jia, Xin-Chun & Sobhani, Behrooz, 2020. "Day ahead powerful probabilistic wind power forecast using combined intelligent structure and fuzzy clustering algorithm," Energy, Elsevier, vol. 192(C).
    17. Pérez Albornoz, C. & Escalante Soberanis, M.A. & Ramírez Rivera, V. & Rivero, M., 2022. "Review of atmospheric stability estimations for wind power applications," Renewable and Sustainable Energy Reviews, Elsevier, vol. 163(C).
    18. Amira Elkodama & Amr Ismaiel & A. Abdellatif & S. Shaaban & Shigeo Yoshida & Mostafa A. Rushdi, 2023. "Control Methods for Horizontal Axis Wind Turbines (HAWT): State-of-the-Art Review," Energies, MDPI, vol. 16(17), pages 1-32, September.
    19. Youssef, Abdel-Raheem & Mousa, Hossam H.H. & Mohamed, Essam E.M., 2020. "Development of self-adaptive P&O MPPT algorithm for wind generation systems with concentrated search area," Renewable Energy, Elsevier, vol. 154(C), pages 875-893.
    20. Wen, Yi & Kamranzad, Bahareh & Lin, Pengzhi, 2021. "Assessment of long-term offshore wind energy potential in the south and southeast coasts of China based on a 55-year dataset," Energy, Elsevier, vol. 224(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:348:y:2023:i:c:s0306261923008838. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.