IDEAS home Printed from https://ideas.repec.org/a/gam/jftint/v17y2025i10p433-d1756276.html

Deep Learning-Based Approach to Automated Monitoring of Defects and Soiling on Solar Panels

Author

Listed:
  • Ahmed Hamdi

    (FEMTO-ST Institute, University Marie et Louis Pasteur, F-90000 Belfort, France
    These authors contributed equally to this work.)

  • Hassan N. Noura

    (FEMTO-ST Institute, University Marie et Louis Pasteur, F-90000 Belfort, France
    These authors contributed equally to this work.)

  • Joseph Azar

    (FEMTO-ST Institute, University Marie et Louis Pasteur, F-90000 Belfort, France)

Abstract

The reliable operation of photovoltaic (PV) systems is often compromised by surface soiling and structural damage, which reduce energy efficiency and complicate large-scale monitoring. To address this challenge, we propose a two-tiered image-classification framework that combines Vision Transformer (ViT) models, lightweight convolutional neural networks (CNNs), and knowledge distillation (KD). In Tier 1, a DINOv2 ViT-Base model is fine-tuned to provide robust high-level categorization of solar-panel images into three classes: Normal, Soiled, and Damaged. In Tier 2, two enhanced EfficientNetB0 models are introduced: (i) a KD-based student model distilled from a DINOv2 ViT-S/14 teacher, which improves accuracy from 96.7% to 98.67% for damage classification and from 90.7% to 92.38% for soiling classification, and (ii) an EfficientNetB0 augmented with Multi-Head Self-Attention (MHSA), which achieves 98.73% accuracy for damage and 93.33% accuracy for soiling. These results demonstrate that integrating transformer-based representations with compact CNN architectures yields a scalable and efficient solution for automated monitoring of the condition of PV systems, offering high accuracy and real-time applicability in inspections on solar farms.

Suggested Citation

  • Ahmed Hamdi & Hassan N. Noura & Joseph Azar, 2025. "Deep Learning-Based Approach to Automated Monitoring of Defects and Soiling on Solar Panels," Future Internet, MDPI, vol. 17(10), pages 1-20, September.
  • Handle: RePEc:gam:jftint:v:17:y:2025:i:10:p:433-:d:1756276
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1999-5903/17/10/433/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/1999-5903/17/10/433/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Abdulwahab A. Q. Hasan & Ammar Ahmed Alkahtani & Seyed Ahmad Shahahmadi & Mohammad Nur E. Alam & Mohammad Aminul Islam & Nowshad Amin, 2021. "Delamination-and Electromigration-Related Failures in Solar Panels—A Review," Sustainability, MDPI, vol. 13(12), pages 1-23, June.
    2. Shaheer Ansari & Afida Ayob & Molla S. Hossain Lipu & Mohamad Hanif Md Saad & Aini Hussain, 2021. "A Review of Monitoring Technologies for Solar PV Systems Using Data Processing Modules and Transmission Protocols: Progress, Challenges and Prospects," Sustainability, MDPI, vol. 13(15), pages 1-34, July.
    3. Roberto Pierdicca & Marina Paolanti & Andrea Felicetti & Fabio Piccinini & Primo Zingaretti, 2020. "Automatic Faults Detection of Photovoltaic Farms: solAIr, a Deep Learning-Based System for Thermal Images," Energies, MDPI, vol. 13(24), pages 1-17, December.
    4. Waqar Akram, M. & Li, Guiqiang & Jin, Yi & Chen, Xiao, 2022. "Failures of Photovoltaic modules and their Detection: A Review," Applied Energy, Elsevier, vol. 313(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tuhibur Rahman & Ahmed Al Mansur & Molla Shahadat Hossain Lipu & Md. Siddikur Rahman & Ratil H. Ashique & Mohamad Abou Houran & Rajvikram Madurai Elavarasan & Eklas Hossain, 2023. "Investigation of Degradation of Solar Photovoltaics: A Review of Aging Factors, Impacts, and Future Directions toward Sustainable Energy Management," Energies, MDPI, vol. 16(9), pages 1-30, April.
    2. Chen, Xin & Li, Baojie & Braid, Jennifer L. & Byford, Brandon & Colvin, Dylan J. & Glaws, Andrew & Jost, Norman & Pierce, Benjamin & Rabade, Salil & Springer, Martin & Jain, Anubhav, 2025. "Open data sets for assessing photovoltaic system reliability," Applied Energy, Elsevier, vol. 395(C).
    3. Cardoso, Andressa & Jurado-Rodríguez, David & López, Alfonso & Ramos, M. Isabel & Jurado, Juan Manuel, 2024. "Automated detection and tracking of photovoltaic modules from 3D remote sensing data," Applied Energy, Elsevier, vol. 367(C).
    4. Astitva Kumar & Mohammad Rizwan & Uma Nangia & Muhannad Alaraj, 2021. "Grey Wolf Optimizer-Based Array Reconfiguration to Enhance Power Production from Solar Photovoltaic Plants under Different Scenarios," Sustainability, MDPI, vol. 13(24), pages 1-18, December.
    5. Jacek Kusznier, 2023. "Influence of Environmental Factors on the Intelligent Management of Photovoltaic and Wind Sections in a Hybrid Power Plant," Energies, MDPI, vol. 16(4), pages 1-15, February.
    6. Shan, Chuan & Sun, Kangwen & Ji, Xinzhe & Cheng, Dongji, 2023. "A reconfiguration method for photovoltaic array of stratospheric airship based on multilevel optimization algorithm," Applied Energy, Elsevier, vol. 352(C).
    7. Cheng Yang & Fuhao Sun & Yujie Zou & Zhipeng Lv & Liang Xue & Chao Jiang & Shuangyu Liu & Bochao Zhao & Haoyang Cui, 2024. "A Survey of Photovoltaic Panel Overlay and Fault Detection Methods," Energies, MDPI, vol. 17(4), pages 1-37, February.
    8. Tomasz Popławski & Sebastian Dudzik & Piotr Szeląg & Janusz Baran, 2021. "A Case Study of a Virtual Power Plant (VPP) as a Data Acquisition Tool for PV Energy Forecasting," Energies, MDPI, vol. 14(19), pages 1-24, September.
    9. Mohamed Benghanem & Adel Mellit & Chourouk Moussaoui, 2023. "Embedded Hybrid Model (CNN–ML) for Fault Diagnosis of Photovoltaic Modules Using Thermographic Images," Sustainability, MDPI, vol. 15(10), pages 1-20, May.
    10. Gianfranco Di Lorenzo & Erika Stracqualursi & Leonardo Micheli & Salvatore Celozzi & Rodolfo Araneo, 2022. "Prognostic Methods for Photovoltaic Systems’ Underperformance and Degradation: Status, Perspectives, and Challenges," Energies, MDPI, vol. 15(17), pages 1-6, September.
    11. Juan-Pablo Villegas-Ceballos & Mateo Rico-Garcia & Carlos Andres Ramos-Paja, 2022. "Dataset for Detecting the Electrical Behavior of Photovoltaic Panels from RGB Images," Data, MDPI, vol. 7(6), pages 1-12, June.
    12. Liu, Yinyan & Duran, Earl & Bruce, Anna & Yildiz, Baran & Mendonca Severiano, Bernardo & Anwar Ibrahim, Ibrahim & Rispler, Jonathan & Martell, Chris & Rougieux, Fiacre, 2025. "A methodological review of cost-effective data-driven fault detection and diagnosis in distributed photovoltaic systems," Applied Energy, Elsevier, vol. 401(PA).
    13. Ziapour, Behrooz M. & Alirezaei, Hadi & Ghorannevis, Sepideh, 2023. "Energy recovery from the enclosures between the glassing covers in a compact photovoltaic thermal collector," Renewable Energy, Elsevier, vol. 216(C).
    14. Bilal Taghezouit & Fouzi Harrou & Cherif Larbes & Ying Sun & Smail Semaoui & Amar Hadj Arab & Salim Bouchakour, 2022. "Intelligent Monitoring of Photovoltaic Systems via Simplicial Empirical Models and Performance Loss Rate Evaluation under LabVIEW: A Case Study," Energies, MDPI, vol. 15(21), pages 1-30, October.
    15. Waqar Akram, M. & Bai, Jianbo, 2026. "Synergistic integration of text-to-image generation and deep learning for photovoltaic system inspection," Energy, Elsevier, vol. 342(C).
    16. Di Tommaso, Antonio & Betti, Alessandro & Fontanelli, Giacomo & Michelozzi, Benedetto, 2022. "A multi-stage model based on YOLOv3 for defect detection in PV panels based on IR and visible imaging by unmanned aerial vehicle," Renewable Energy, Elsevier, vol. 193(C), pages 941-962.
    17. Joshuva Arockia Dhanraj & Ali Mostafaeipour & Karthikeyan Velmurugan & Kuaanan Techato & Prem Kumar Chaurasiya & Jenoris Muthiya Solomon & Anitha Gopalan & Khamphe Phoungthong, 2021. "An Effective Evaluation on Fault Detection in Solar Panels," Energies, MDPI, vol. 14(22), pages 1-14, November.
    18. Osama, Amr & Tina, Giuseppe Marco & Gagliano, Antonio, 2025. "Thermal models for mono/bifacial modules in ground/floating photovoltaic systems: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 216(C).
    19. Xinchun Zhu & Yang Wu & Xu Zhao & Yunchen Yang & Shuangquan Liu & Luyi Shi & Yelong Wu, 2024. "Overview of Wind and Photovoltaic Data Stream Classification and Data Drift Issues," Energies, MDPI, vol. 17(17), pages 1-24, September.
    20. Liang, Qing & Fang, Chunliu & Ma, Xuechao & Zhang, Yibo & Xue, Xiaojian & Yan, Longlong, 2025. "Experimental study and artificial neural network modeling of a pulsating heat pipe PV/T module using a low-efficiency photovoltaic panel," Energy, Elsevier, vol. 334(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jftint:v:17:y:2025:i:10:p:433-:d:1756276. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager The email address of this maintainer does not seem to be valid anymore. Please ask MDPI Indexing Manager to update the entry or send us the correct address (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.