IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v15y2022i18p6567-d909830.html
   My bibliography  Save this article

Modeling of Photovoltaic Array Based on Multi-Agent Deep Reinforcement Learning Using Residuals of I–V Characteristics

Author

Listed:
  • Jingwei Zhang

    (College of Mechanical and Electrical Engineering, Hohai University, Changzhou 213022, China)

  • Zenan Yang

    (College of Mechanical and Electrical Engineering, Hohai University, Changzhou 213022, China)

  • Kun Ding

    (College of Mechanical and Electrical Engineering, Hohai University, Changzhou 213022, China)

  • Li Feng

    (Solar Computing Laboratory, University of Applied Sciences Bielefeld, Artilleriestraße 9, 32427 Minden, Germany)

  • Frank Hamelmann

    (Solar Computing Laboratory, University of Applied Sciences Bielefeld, Artilleriestraße 9, 32427 Minden, Germany)

  • Xihui Chen

    (College of Mechanical and Electrical Engineering, Hohai University, Changzhou 213022, China)

  • Yongjie Liu

    (Engineering Research Center of Dredging Technology of Ministry of Education, Changzhou 213022, China)

  • Ling Chen

    (School of Physics and Electronic Electrical Engineering, Huaiyin Normal University, Huai’an 223300, China)

Abstract

Currently, the accuracy of modeling a photovoltaic (PV) array for fault diagnosis is still unsatisfactory due to the fact that the modeling accuracy is limited by the accuracy of extracted model parameters. In this paper, the modeling of a PV array based on multi-agent deep reinforcement learning (RL) using the residuals of I–V characteristics is proposed. The environment state based on the high dimensional residuals of I–V characteristics and the corresponding cooperative reward is presented for the RL agents. The actions of each agent considering the damping amplitude are designed. Then, the entire framework of modeling a PV array based on multi-agent deep RL is presented. The feasibility and accuracy of the proposed method are verified by the one-year measured data of a PV array. The experimental results show that the higher modeling accuracy of the next time step is obtained by the extracted model parameters using the proposed method, compared with that using the conventional meta-heuristic algorithms and the analytical method. The daily root mean square error (RMSE) is approximately 0.5015 A on the first day, and converges to 0.1448 A on the last day of training. The proposed multi-agent deep RL framework simplifies the design of states and rewards for extracting model parameters.

Suggested Citation

  • Jingwei Zhang & Zenan Yang & Kun Ding & Li Feng & Frank Hamelmann & Xihui Chen & Yongjie Liu & Ling Chen, 2022. "Modeling of Photovoltaic Array Based on Multi-Agent Deep Reinforcement Learning Using Residuals of I–V Characteristics," Energies, MDPI, vol. 15(18), pages 1-17, September.
    • Handle: RePEc:gam:jeners:v:15:y:2022:i:18:p:6567-:d:909830
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/15/18/6567/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/15/18/6567/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Chen, Xu & Xu, Bin & Mei, Congli & Ding, Yuhan & Li, Kangji, 2018. "Teaching–learning–based artificial bee colony for solar photovoltaic parameter estimation," Applied Energy, Elsevier, vol. 212(C), pages 1578-1588.
    2. Pang, Yiheng & Hao, Liang & Wang, Yun, 2022. "Convolutional neural network analysis of radiography images for rapid water quantification in PEM fuel cell," Applied Energy, Elsevier, vol. 321(C).
    3. Wang, Haizheng & Zhao, Jian & Sun, Qian & Zhu, Honglu, 2019. "Probability modeling for PV array output interval and its application in fault diagnosis," Energy, Elsevier, vol. 189(C).
    4. Qais, Mohammed H. & Hasanien, Hany M. & Alghuwainem, Saad, 2019. "Identification of electrical parameters for three-diode photovoltaic model using analytical and sunflower optimization algorithm," Applied Energy, Elsevier, vol. 250(C), pages 109-117.
    5. Piliougine, M. & Guejia-Burbano, R.A. & Petrone, G. & Sánchez-Pacheco, F.J. & Mora-López, L. & Sidrach-de-Cardona, M., 2021. "Parameters extraction of single diode model for degraded photovoltaic modules," Renewable Energy, Elsevier, vol. 164(C), pages 674-686.
    6. Hong, Ying-Yi & Rioflorido, Christian Lian Paulo P., 2019. "A hybrid deep learning-based neural network for 24-h ahead wind power forecasting," Applied Energy, Elsevier, vol. 250(C), pages 530-539.
    7. Sampath Kumar Vankadara & Shamik Chatterjee & Praveen Kumar Balachandran, 2022. "An accurate analytical modeling of solar photovoltaic system considering Rs and Rsh under partial shaded condition," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 13(5), pages 2472-2481, October.
    8. Li, Yuanliang & Ding, Kun & Zhang, Jingwei & Chen, Fudong & Chen, Xiang & Wu, Jiabing, 2019. "A fault diagnosis method for photovoltaic arrays based on fault parameters identification," Renewable Energy, Elsevier, vol. 143(C), pages 52-63.
    9. Jiao, Shan & Chong, Guoshuang & Huang, Changcheng & Hu, Hanqing & Wang, Mingjing & Heidari, Ali Asghar & Chen, Huiling & Zhao, Xuehua, 2020. "Orthogonally adapted Harris hawks optimization for parameter estimation of photovoltaic models," Energy, Elsevier, vol. 203(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bilal Taghezouit & Fouzi Harrou & Cherif Larbes & Ying Sun & Smail Semaoui & Amar Hadj Arab & Salim Bouchakour, 2022. "Intelligent Monitoring of Photovoltaic Systems via Simplicial Empirical Models and Performance Loss Rate Evaluation under LabVIEW: A Case Study," Energies, MDPI, vol. 15(21), pages 1-30, October.
    2. Fouzi Harrou & Ying Sun & Bilal Taghezouit & Abdelkader Dairi, 2023. "Artificial Intelligence Techniques for Solar Irradiance and PV Modeling and Forecasting," Energies, MDPI, vol. 16(18), pages 1-5, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Papul Changmai & Sunil Deka & Shashank Kumar & Thanikanti Sudhakar Babu & Belqasem Aljafari & Benedetto Nastasi, 2022. "A Critical Review on the Estimation Techniques of the Solar PV Cell’s Unknown Parameters," Energies, MDPI, vol. 15(19), pages 1-20, September.
    2. Mehmet Yesilbudak, 2021. "Parameter Extraction of Photovoltaic Cells and Modules Using Grey Wolf Optimizer with Dimension Learning-Based Hunting Search Strategy," Energies, MDPI, vol. 14(18), pages 1-27, September.
    3. Ding, Kun & Chen, Xiang & Weng, Shuai & Liu, Yongjie & Zhang, Jingwei & Li, Yuanliang & Yang, Zenan, 2023. "Health status evaluation of photovoltaic array based on deep belief network and Hausdorff distance," Energy, Elsevier, vol. 262(PB).
    4. Muhyaddin Rawa & Abdullah Abusorrah & Yusuf Al-Turki & Martin Calasan & Mihailo Micev & Ziad M. Ali & Saad Mekhilef & Hussain Bassi & Hatem Sindi & Shady H. E. Abdel Aleem, 2022. "Estimation of Parameters of Different Equivalent Circuit Models of Solar Cells and Various Photovoltaic Modules Using Hybrid Variants of Honey Badger Algorithm and Artificial Gorilla Troops Optimizer," Mathematics, MDPI, vol. 10(7), pages 1-31, March.
    5. Sairam, Seshapalli & Seshadhri, Subathra & Marafioti, Giancarlo & Srinivasan, Seshadhri & Mathisen, Geir & Bekiroglu, Korkut, 2022. "Edge-based Explainable Fault Detection Systems for photovoltaic panels on edge nodes," Renewable Energy, Elsevier, vol. 185(C), pages 1425-1440.
    6. El-Dabah, Mahmoud A. & El-Sehiemy, Ragab A. & Hasanien, Hany M. & Saad, Bahaa, 2023. "Photovoltaic model parameters identification using Northern Goshawk Optimization algorithm," Energy, Elsevier, vol. 262(PB).
    7. Long, Wen & Jiao, Jianjun & Liang, Ximing & Xu, Ming & Tang, Mingzhu & Cai, Shaohong, 2022. "Parameters estimation of photovoltaic models using a novel hybrid seagull optimization algorithm," Energy, Elsevier, vol. 249(C).
    8. Houssem Ben Aribia & Ali M. El-Rifaie & Mohamed A. Tolba & Abdullah Shaheen & Ghareeb Moustafa & Fahmi Elsayed & Mostafa Elshahed, 2023. "Growth Optimizer for Parameter Identification of Solar Photovoltaic Cells and Modules," Sustainability, MDPI, vol. 15(10), pages 1-26, May.
    9. Qais, Mohammed H. & Hasanien, Hany M. & Alghuwainem, Saad, 2020. "Parameters extraction of three-diode photovoltaic model using computation and Harris Hawks optimization," Energy, Elsevier, vol. 195(C).
    10. Samuel R. Fahim & Hany M. Hasanien & Rania A. Turky & Shady H. E. Abdel Aleem & Martin Ćalasan, 2022. "A Comprehensive Review of Photovoltaic Modules Models and Algorithms Used in Parameter Extraction," Energies, MDPI, vol. 15(23), pages 1-56, November.
    11. Yang, Mao & Wang, Da & Xu, Chuanyu & Dai, Bozhi & Ma, Miaomiao & Su, Xin, 2023. "Power transfer characteristics in fluctuation partition algorithm for wind speed and its application to wind power forecasting," Renewable Energy, Elsevier, vol. 211(C), pages 582-594.
    12. Yu, Kunjie & Liang, J.J. & Qu, B.Y. & Cheng, Zhiping & Wang, Heshan, 2018. "Multiple learning backtracking search algorithm for estimating parameters of photovoltaic models," Applied Energy, Elsevier, vol. 226(C), pages 408-422.
    13. Jianing Li & Cheng Qin & Chen Yang & Bin Ai & Yecheng Zhou, 2023. "Extraction of Single Diode Model Parameters of Solar Cells and PV Modules by Combining an Intelligent Optimization Algorithm with Simplified Explicit Equation Based on Lambert W Function," Energies, MDPI, vol. 16(14), pages 1-23, July.
    14. Wang, Yun & Zou, Runmin & Liu, Fang & Zhang, Lingjun & Liu, Qianyi, 2021. "A review of wind speed and wind power forecasting with deep neural networks," Applied Energy, Elsevier, vol. 304(C).
    15. Zhao, Yincheng & Zhang, Guozhou & Hu, Weihao & Huang, Qi & Chen, Zhe & Blaabjerg, Frede, 2023. "Meta-learning based voltage control strategy for emergency faults of active distribution networks," Applied Energy, Elsevier, vol. 349(C).
    16. Ahmed Ginidi & Sherif M. Ghoneim & Abdallah Elsayed & Ragab El-Sehiemy & Abdullah Shaheen & Attia El-Fergany, 2021. "Gorilla Troops Optimizer for Electrically Based Single and Double-Diode Models of Solar Photovoltaic Systems," Sustainability, MDPI, vol. 13(16), pages 1-28, August.
    17. Tong Kang & Jiangang Yao & Min Jin & Shengjie Yang & ThanhLong Duong, 2018. "A Novel Improved Cuckoo Search Algorithm for Parameter Estimation of Photovoltaic (PV) Models," Energies, MDPI, vol. 11(5), pages 1-31, April.
    18. Lu, Hongfang & Ma, Xin & Huang, Kun & Azimi, Mohammadamin, 2020. "Prediction of offshore wind farm power using a novel two-stage model combining kernel-based nonlinear extension of the Arps decline model with a multi-objective grey wolf optimizer," Renewable and Sustainable Energy Reviews, Elsevier, vol. 127(C).
    19. Mohamed Abdel-Basset & Reda Mohamed & Ripon K. Chakrabortty & Michael J. Ryan & Attia El-Fergany, 2021. "An Improved Artificial Jellyfish Search Optimizer for Parameter Identification of Photovoltaic Models," Energies, MDPI, vol. 14(7), pages 1-33, March.
    20. Sun, Chenhao & Zhou, Zhuoyu & Zeng, Xiangjun & Li, Zewen & Wang, Yuanyuan & Deng, Feng, 2022. "A multi-model-integration-based prediction methodology for the spatiotemporal distribution of vulnerabilities in integrated energy systems under the multi-type, imbalanced, and dependent input data sc," Applied Energy, Elsevier, vol. 320(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:15:y:2022:i:18:p:6567-:d:909830. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.