IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v264y2023ics0360544222031644.html
   My bibliography  Save this article

Variable boundary reinforcement learning for maximum power point tracking of photovoltaic grid-connected systems

Author

Listed:
  • Gao, Fang
  • Hu, Rongzhao
  • Yin, Linfei

Abstract

With clean energy development, photovoltaic power generation has become an important direction. The volt-ampere characteristic of photovoltaic modules in solar photovoltaic systems is nonlinear and changes with the environment. Therefore, tracking maximum power points in a changing environment is important for the research of photovoltaic power generation. This work proposes a variable boundary reinforcement learning (VBRL) algorithm to achieve maximum power point tracking, which is a novel reinforcement learning method that automatically divides the appropriate state range in the interaction with the environment. As a model-free control method, the VBRL algorithm can interact with the environment to learn and control without prior knowledge. The proposed algorithm realizes fast-tracking for maximum power point and has high tracking accuracy in the variable environment. Furthermore, the VBRL algorithm is a general solution to find the extremum of similar unimodal curve models. This paper compares the VBRL algorithm with some other methods in the complex variable environment. The VBRL algorithm achieves excellent comprehensive performance and has the largest average power generation when the irradiance changes rapidly.

Suggested Citation

  • Gao, Fang & Hu, Rongzhao & Yin, Linfei, 2023. "Variable boundary reinforcement learning for maximum power point tracking of photovoltaic grid-connected systems," Energy, Elsevier, vol. 264(C).
  • Handle: RePEc:eee:energy:v:264:y:2023:i:c:s0360544222031644
    DOI: 10.1016/j.energy.2022.126278
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544222031644
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2022.126278?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Mirza, Adeel Feroz & Mansoor, Majad & Zhan, Keyu & Ling, Qiang, 2021. "High-efficiency swarm intelligent maximum power point tracking control techniques for varying temperature and irradiance," Energy, Elsevier, vol. 228(C).
    2. Li, Guoliang & Han, Youhua & Li, Ming & Luo, Xi & Xu, Yongfeng & Wang, Yunfeng & Zhang, Ying, 2021. "Study on matching characteristics of photovoltaic disturbance and refrigeration compressor in solar photovoltaic direct-drive air conditioning system," Renewable Energy, Elsevier, vol. 172(C), pages 1145-1153.
    3. Osmani, Khaled & Haddad, Ahmad & Lemenand, Thierry & Castanier, Bruno & Ramadan, Mohamad, 2021. "An investigation on maximum power extraction algorithms from PV systems with corresponding DC-DC converters," Energy, Elsevier, vol. 224(C).
    4. Zhang, Xiongfeng & Lu, Renzhi & Jiang, Junhui & Hong, Seung Ho & Song, Won Seok, 2021. "Testbed implementation of reinforcement learning-based demand response energy management system," Applied Energy, Elsevier, vol. 297(C).
    5. Yadav, Vinod Kumar & Yadav, Abhishek & Yadav, Ranjana & Mittal, Aaradhya & Wazir, Nadeem Hussain & Gupta, Shubham & Pachauri, Rupendra Kumar & Ghosh, Santosh, 2022. "A novel reconfiguration technique for improvement of PV reliability," Renewable Energy, Elsevier, vol. 182(C), pages 508-520.
    6. Wang, Zhe & Hong, Tianzhen, 2020. "Reinforcement learning for building controls: The opportunities and challenges," Applied Energy, Elsevier, vol. 269(C).
    7. Jately, Vibhu & Azzopardi, Brian & Joshi, Jyoti & Venkateswaran V, Balaji & Sharma, Abhinav & Arora, Sudha, 2021. "Experimental Analysis of hill-climbing MPPT algorithms under low irradiance levels," Renewable and Sustainable Energy Reviews, Elsevier, vol. 150(C).
    8. Pan, Jeng-Shyang & Tian, Ai-Qing & Snášel, Václav & Kong, Lingping & Chu, Shu-Chuan, 2022. "Maximum power point tracking and parameter estimation for multiple-photovoltaic arrays based on enhanced pigeon-inspired optimization with Taguchi method," Energy, Elsevier, vol. 251(C).
    9. Fathabadi, Hassan, 2020. "Novel solar-powered photovoltaic/thermoelectric hybrid power source," Renewable Energy, Elsevier, vol. 146(C), pages 426-434.
    10. Pal, Rudra Sankar & Mukherjee, V., 2020. "Metaheuristic based comparative MPPT methods for photovoltaic technology under partial shading condition," Energy, Elsevier, vol. 212(C).
    11. Lappalainen, Kari & Valkealahti, Seppo, 2021. "Experimental study of the maximum power point characteristics of partially shaded photovoltaic strings," Applied Energy, Elsevier, vol. 301(C).
    12. Shang, Yuwei & Wu, Wenchuan & Guo, Jianbo & Ma, Zhao & Sheng, Wanxing & Lv, Zhe & Fu, Chenran, 2020. "Stochastic dispatch of energy storage in microgrids: An augmented reinforcement learning approach," Applied Energy, Elsevier, vol. 261(C).
    13. Li, Xingshuo & Wen, Huiqing & Hu, Yihua & Jiang, Lin, 2019. "A novel beta parameter based fuzzy-logic controller for photovoltaic MPPT application," Renewable Energy, Elsevier, vol. 130(C), pages 416-427.
    14. Kumar, Vinit & Singh, Mukesh, 2021. "Reactive power compensation using derated power generation mode of modified P&O algorithm in grid-interfaced PV system," Renewable Energy, Elsevier, vol. 178(C), pages 108-117.
    15. Celikel, Resat & Yilmaz, Musa & Gundogdu, Ahmet, 2022. "A voltage scanning-based MPPT method for PV power systems under complex partial shading conditions," Renewable Energy, Elsevier, vol. 184(C), pages 361-373.
    16. Rezk, Hegazy & Aly, Mokhtar & Fathy, Ahmed, 2021. "A novel strategy based on recent equilibrium optimizer to enhance the performance of PEM fuel cell system through optimized fuzzy logic MPPT," Energy, Elsevier, vol. 234(C).
    17. Zeb, Kamran & Islam, Saif Ul & Khan, Imran & Uddin, Waqar & Ishfaq, M. & Curi Busarello, Tiago Davi & Muyeen, S.M. & Ahmad, Iftikhar & Kim, H.J., 2022. "Faults and Fault Ride Through strategies for grid-connected photovoltaic system: A comprehensive review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 158(C).
    18. Jung, Seunghoon & Jeoung, Jaewon & Kang, Hyuna & Hong, Taehoon, 2021. "Optimal planning of a rooftop PV system using GIS-based reinforcement learning," Applied Energy, Elsevier, vol. 298(C).
    19. Zhang, Xiaoshun & Tan, Tian & Yang, Bo & Wang, Jingbo & Li, Shengnan & He, Tingyi & Yang, Lei & Yu, Tao & Sun, Liming, 2020. "Greedy search based data-driven algorithm of centralized thermoelectric generation system under non-uniform temperature distribution," Applied Energy, Elsevier, vol. 260(C).
    20. Guichi, A. & Mekhilef, S. & Berkouk, E.M. & Talha, A., 2021. "Optimal control of grid-connected microgrid PV-based source under partially shaded conditions," Energy, Elsevier, vol. 230(C).
    21. Homod, Raad Z. & Togun, Hussein & Kadhim Hussein, Ahmed & Noraldeen Al-Mousawi, Fadhel & Yaseen, Zaher Mundher & Al-Kouz, Wael & Abd, Haider J. & Alawi, Omer A. & Goodarzi, Marjan & Hussein, Omar A., 2022. "Dynamics analysis of a novel hybrid deep clustering for unsupervised learning by reinforcement of multi-agent to energy saving in intelligent buildings," Applied Energy, Elsevier, vol. 313(C).
    22. Hao, Daning & Qi, Lingfei & Tairab, Alaeldin M. & Ahmed, Ammar & Azam, Ali & Luo, Dabing & Pan, Yajia & Zhang, Zutao & Yan, Jinyue, 2022. "Solar energy harvesting technologies for PV self-powered applications: A comprehensive review," Renewable Energy, Elsevier, vol. 188(C), pages 678-697.
    23. Aatabe, Mohamed & El Guezar, Fatima & Vargas, Alessandro N. & Bouzahir, Hassane, 2021. "A novel stochastic maximum power point tracking control for off-grid standalone photovoltaic systems with unpredictable load demand," Energy, Elsevier, vol. 235(C).
    24. Eltamaly, Ali M. & Al-Saud, M.S. & Abokhalil, Ahmed G. & Farh, Hassan M.H., 2020. "Simulation and experimental validation of fast adaptive particle swarm optimization strategy for photovoltaic global peak tracker under dynamic partial shading," Renewable and Sustainable Energy Reviews, Elsevier, vol. 124(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kang, Dongju & Kang, Doeun & Hwangbo, Sumin & Niaz, Haider & Lee, Won Bo & Liu, J. Jay & Na, Jonggeol, 2023. "Optimal planning of hybrid energy storage systems using curtailed renewable energy through deep reinforcement learning," Energy, Elsevier, vol. 284(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Omar Al-Ani & Sanjoy Das, 2022. "Reinforcement Learning: Theory and Applications in HEMS," Energies, MDPI, vol. 15(17), pages 1-37, September.
    2. Khaled Osmani & Ahmad Haddad & Mohammad Alkhedher & Thierry Lemenand & Bruno Castanier & Mohamad Ramadan, 2023. "A Novel MPPT-Based Lithium-Ion Battery Solar Charger for Operation under Fluctuating Irradiance Conditions," Sustainability, MDPI, vol. 15(12), pages 1-31, June.
    3. Hou, Guolian & Ke, Yin & Huang, Congzhi, 2021. "A flexible constant power generation scheme for photovoltaic system by error-based active disturbance rejection control and perturb & observe," Energy, Elsevier, vol. 237(C).
    4. Zhu, Ziqing & Hu, Ze & Chan, Ka Wing & Bu, Siqi & Zhou, Bin & Xia, Shiwei, 2023. "Reinforcement learning in deregulated energy market: A comprehensive review," Applied Energy, Elsevier, vol. 329(C).
    5. Masmoudi, Abdelkarim & Abdelkafi, Achraf & Krichen, Lotfi & Saidi, Abdelaziz Salah, 2022. "An experimental approach for improving stability in DC bus voltage of a stand-alone photovoltaic generator," Energy, Elsevier, vol. 257(C).
    6. Xie, Jiahan & Ajagekar, Akshay & You, Fengqi, 2023. "Multi-Agent attention-based deep reinforcement learning for demand response in grid-responsive buildings," Applied Energy, Elsevier, vol. 342(C).
    7. Shaowu Li & Kunyi Chen & Qin Li & Qing Ai, 2022. "A Variable-Weather-Parameter MPPT Method Based on Equation Solution for Photovoltaic System with DC Bus," Energies, MDPI, vol. 15(18), pages 1-25, September.
    8. Lei, Yue & Zhan, Sicheng & Ono, Eikichi & Peng, Yuzhen & Zhang, Zhiang & Hasama, Takamasa & Chong, Adrian, 2022. "A practical deep reinforcement learning framework for multivariate occupant-centric control in buildings," Applied Energy, Elsevier, vol. 324(C).
    9. Tabassum Kanwal & Saif Ur Rehman & Tariq Ali & Khalid Mahmood & Santos Gracia Villar & Luis Alonso Dzul Lopez & Imran Ashraf, 2023. "An Intelligent Dual-Axis Solar Tracking System for Remote Weather Monitoring in the Agricultural Field," Agriculture, MDPI, vol. 13(8), pages 1-19, August.
    10. Fathy, Ahmed & Yousri, Dalia & Babu, Thanikanti Sudhakar & Rezk, Hegazy, 2023. "Triple X Sudoku reconfiguration for alleviating shading effect on total-cross-tied PV array," Renewable Energy, Elsevier, vol. 204(C), pages 593-604.
    11. Rezk, Hegazy & AL-Oran, Mazen & Gomaa, Mohamed R. & Tolba, Mohamed A. & Fathy, Ahmed & Abdelkareem, Mohammad Ali & Olabi, A.G. & El-Sayed, Abou Hashema M., 2019. "A novel statistical performance evaluation of most modern optimization-based global MPPT techniques for partially shaded PV system," Renewable and Sustainable Energy Reviews, Elsevier, vol. 115(C).
    12. Abdulaziz Almutairi & Ahmed G. Abo-Khalil & Khairy Sayed & Naif Albagami, 2020. "MPPT for a PV Grid-Connected System to Improve Efficiency under Partial Shading Conditions," Sustainability, MDPI, vol. 12(24), pages 1-18, December.
    13. He, Zhaoyu & Guo, Weimin & Zhang, Peng, 2022. "Performance prediction, optimal design and operational control of thermal energy storage using artificial intelligence methods," Renewable and Sustainable Energy Reviews, Elsevier, vol. 156(C).
    14. Yin, Linfei & Zhang, Bin, 2021. "Time series generative adversarial network controller for long-term smart generation control of microgrids," Applied Energy, Elsevier, vol. 281(C).
    15. Yassine Chemingui & Adel Gastli & Omar Ellabban, 2020. "Reinforcement Learning-Based School Energy Management System," Energies, MDPI, vol. 13(23), pages 1-21, December.
    16. Ahmed G. Abo-Khalil & Walied Alharbi & Abdel-Rahman Al-Qawasmi & Mohammad Alobaid & Ibrahim M. Alarifi, 2021. "Maximum Power Point Tracking of PV Systems under Partial Shading Conditions Based on Opposition-Based Learning Firefly Algorithm," Sustainability, MDPI, vol. 13(5), pages 1-18, March.
    17. Celikel, Resat & Yilmaz, Musa & Gundogdu, Ahmet, 2022. "A voltage scanning-based MPPT method for PV power systems under complex partial shading conditions," Renewable Energy, Elsevier, vol. 184(C), pages 361-373.
    18. Gokhale, Gargya & Claessens, Bert & Develder, Chris, 2022. "Physics informed neural networks for control oriented thermal modeling of buildings," Applied Energy, Elsevier, vol. 314(C).
    19. Wang, Jian-jun & Deng, Yu-cong & Sun, Wen-biao & Zheng, Xiao-bin & Cui, Zheng, 2023. "Maximum power point tracking method based on impedance matching for a micro hydropower generator," Applied Energy, Elsevier, vol. 340(C).
    20. Davide Coraci & Silvio Brandi & Marco Savino Piscitelli & Alfonso Capozzoli, 2021. "Online Implementation of a Soft Actor-Critic Agent to Enhance Indoor Temperature Control and Energy Efficiency in Buildings," Energies, MDPI, vol. 14(4), pages 1-26, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:264:y:2023:i:c:s0360544222031644. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.