IDEAS home Printed from https://ideas.repec.org/a/eee/renene/v163y2021icp386-397.html
   My bibliography  Save this article

Image recognition of wind turbine blade damage based on a deep learning model with transfer learning and an ensemble learning classifier

Author

Listed:
  • Yang, Xiyun
  • Zhang, Yanfeng
  • Lv, Wei
  • Wang, Dong

Abstract

An image recognition model based on a deep learning network is proposed for the automatic extraction of image features and the accurate and efficient detection of wind turbine blade damage. The Otsu threshold segmentation method is used to segment the blade image to eliminate the influence of the image background on the detection task. In order to improve the recognition performance of the proposed deep learning model, transfer learning and an ensemble learning classifier are used in a convolutional neural network model. Transfer learning is used to enhance the ability of the proposed model to extract abstract features and accelerate the convergence efficiency, whereas the random forest-based ensemble learning classifier is used to improve the accuracy of detecting the blade defects. The performance of the proposed model is verified by using unmanned aerial vehicle (UAV) images of the wind turbine blades. The proposed model provided better performance than the support vector machine (SVM) method, the basic deep learning model and the deep learning model combined with the ensemble learning approach.

Suggested Citation

  • Yang, Xiyun & Zhang, Yanfeng & Lv, Wei & Wang, Dong, 2021. "Image recognition of wind turbine blade damage based on a deep learning model with transfer learning and an ensemble learning classifier," Renewable Energy, Elsevier, vol. 163(C), pages 386-397.
    • Handle: RePEc:eee:renene:v:163:y:2021:i:c:p:386-397
    DOI: 10.1016/j.renene.2020.08.125
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0960148120313707
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.renene.2020.08.125?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Huerta Herraiz, Álvaro & Pliego Marugán, Alberto & García Márquez, Fausto Pedro, 2020. "Photovoltaic plant condition monitoring using thermal images analysis by convolutional neural network-based structure," Renewable Energy, Elsevier, vol. 153(C), pages 334-348.
    2. Jiménez, Alfredo Arcos & García Márquez, Fausto Pedro & Moraleda, Victoria Borja & Gómez Muñoz, Carlos Quiterio, 2019. "Linear and nonlinear features and machine learning for wind turbine blade ice detection and diagnosis," Renewable Energy, Elsevier, vol. 132(C), pages 1034-1048.
    3. Fan, Cheng & Sun, Yongjun & Xiao, Fu & Ma, Jie & Lee, Dasheng & Wang, Jiayuan & Tseng, Yen Chieh, 2020. "Statistical investigations of transfer learning-based methodology for short-term building energy predictions," Applied Energy, Elsevier, vol. 262(C).
    4. Chujie Tian & Jian Ma & Chunhong Zhang & Panpan Zhan, 2018. "A Deep Neural Network Model for Short-Term Load Forecast Based on Long Short-Term Memory Network and Convolutional Neural Network," Energies, MDPI, vol. 11(12), pages 1-13, December.
    5. Pierre Tchakoua & René Wamkeue & Mohand Ouhrouche & Fouad Slaoui-Hasnaoui & Tommy Andy Tameghe & Gabriel Ekemb, 2014. "Wind Turbine Condition Monitoring: State-of-the-Art Review, New Trends, and Future Challenges," Energies, MDPI, vol. 7(4), pages 1-36, April.
    6. Yang, Ruizhen & He, Yunze & Zhang, Hong, 2016. "Progress and trends in nondestructive testing and evaluation for wind turbine composite blade," Renewable and Sustainable Energy Reviews, Elsevier, vol. 60(C), pages 1225-1250.
    7. Tang, Jialin & Soua, Slim & Mares, Cristinel & Gan, Tat-Hean, 2016. "An experimental study of acoustic emission methodology for in service condition monitoring of wind turbine blades," Renewable Energy, Elsevier, vol. 99(C), pages 170-179.
    8. Hu, Qinghua & Zhang, Rujia & Zhou, Yucan, 2016. "Transfer learning for short-term wind speed prediction with deep neural networks," Renewable Energy, Elsevier, vol. 85(C), pages 83-95.
    9. García Márquez, Fausto Pedro & Tobias, Andrew Mark & Pinar Pérez, Jesús María & Papaelias, Mayorkinos, 2012. "Condition monitoring of wind turbines: Techniques and methods," Renewable Energy, Elsevier, vol. 46(C), pages 169-178.
    10. Liu, W.Y. & Tang, B.P. & Han, J.G. & Lu, X.N. & Hu, N.N. & He, Z.Z., 2015. "The structure healthy condition monitoring and fault diagnosis methods in wind turbines: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 44(C), pages 466-472.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Xiaoxun, Zhu & Xinyu, Hang & Xiaoxia, Gao & Xing, Yang & Zixu, Xu & Yu, Wang & Huaxin, Liu, 2022. "Research on crack detection method of wind turbine blade based on a deep learning method," Applied Energy, Elsevier, vol. 328(C).
    2. Konstantinos Ioannou & Dimitrios Myronidis, 2021. "Automatic Detection of Photovoltaic Farms Using Satellite Imagery and Convolutional Neural Networks," Sustainability, MDPI, vol. 13(9), pages 1-15, May.
    3. Mohamed Benbouzid & Tarek Berghout & Nur Sarma & Siniša Djurović & Yueqi Wu & Xiandong Ma, 2021. "Intelligent Condition Monitoring of Wind Power Systems: State of the Art Review," Energies, MDPI, vol. 14(18), pages 1-33, September.
    4. Rami Al-Hajj & Ali Assi & Bilel Neji & Raymond Ghandour & Zaher Al Barakeh, 2023. "Transfer Learning for Renewable Energy Systems: A Survey," Sustainability, MDPI, vol. 15(11), pages 1-28, June.
    5. Zhu, Yongchao & Zhu, Caichao & Tan, Jianjun & Song, Chaosheng & Chen, Dingliang & Zheng, Jie, 2022. "Fault detection of offshore wind turbine gearboxes based on deep adaptive networks via considering Spatio-temporal fusion," Renewable Energy, Elsevier, vol. 200(C), pages 1023-1036.
    6. Attallah, Omneya & Ibrahim, Rania A. & Zakzouk, Nahla E., 2023. "CAD system for inter-turn fault diagnosis of offshore wind turbines via multi-CNNs & feature selection," Renewable Energy, Elsevier, vol. 203(C), pages 870-880.
    7. Zhu, Yongchao & Zhu, Caichao & Tan, Jianjun & Tan, Yong & Rao, Lei, 2022. "Anomaly detection and condition monitoring of wind turbine gearbox based on LSTM-FS and transfer learning," Renewable Energy, Elsevier, vol. 189(C), pages 90-103.
    8. Silvio Simani & Saverio Farsoni & Paolo Castaldi, 2023. "RETRACTED: Supervisory Control and Data Acquisition for Fault Diagnosis of Wind Turbines via Deep Transfer Learning," Energies, MDPI, vol. 16(9), pages 1-22, April.
    9. Alan Turnbull & Conor McKinnon & James Carrol & Alasdair McDonald, 2022. "On the Development of Offshore Wind Turbine Technology: An Assessment of Reliability Rates and Fault Detection Methods in a Changing Market," Energies, MDPI, vol. 15(9), pages 1-20, April.
    10. Yang, Cong & Liu, Xun & Zhou, Hua & Ke, Yan & See, John, 2023. "Towards accurate image stitching for drone-based wind turbine blade inspection," Renewable Energy, Elsevier, vol. 203(C), pages 267-279.
    11. Zengyi Zhang & Zhenru Shu, 2024. "Unmanned Aerial Vehicle (UAV)-Assisted Damage Detection of Wind Turbine Blades: A Review," Energies, MDPI, vol. 17(15), pages 1-31, July.
    12. Hang, Xinyu & Zhu, Xiaoxun & Gao, Xiaoxia & Wang, Yu & Liu, Longhu, 2024. "Study on crack monitoring method of wind turbine blade based on AI model: Integration of classification, detection, segmentation and fault level evaluation," Renewable Energy, Elsevier, vol. 224(C).
    13. Annalisa Santolamazza & Daniele Dadi & Vito Introna, 2021. "A Data-Mining Approach for Wind Turbine Fault Detection Based on SCADA Data Analysis Using Artificial Neural Networks," Energies, MDPI, vol. 14(7), pages 1-25, March.
    14. Khazaee, Meghdad & Derian, Pierre & Mouraud, Anthony, 2022. "A comprehensive study on Structural Health Monitoring (SHM) of wind turbine blades by instrumenting tower using machine learning methods," Renewable Energy, Elsevier, vol. 199(C), pages 1568-1579.
    15. Xu, Zifei & Bashir, Musa & Yang, Yang & Wang, Xinyu & Wang, Jin & Ekere, Nduka & Li, Chun, 2022. "Multisensory collaborative damage diagnosis of a 10 MW floating offshore wind turbine tendons using multi-scale convolutional neural network with attention mechanism," Renewable Energy, Elsevier, vol. 199(C), pages 21-34.
    16. Liu, Y. & Hajj, M. & Bao, Y., 2022. "Review of robot-based damage assessment for offshore wind turbines," Renewable and Sustainable Energy Reviews, Elsevier, vol. 158(C).
    17. Jian Wang & Jin Gao & Yong Zhang & Hongmei Cui, 2024. "Analysis of the Sand Erosion Effect and Wear Mechanism of Wind Turbine Blade Coating," Energies, MDPI, vol. 17(2), pages 1-18, January.
    18. Oscar Best & Asiya Khan & Sanjay Sharma & Keri Collins & Mario Gianni, 2024. "Leading Edge Erosion Classification in Offshore Wind Turbines Using Feature Extraction and Classical Machine Learning," Energies, MDPI, vol. 17(21), pages 1-19, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chen, Xuejun & Yang, Yongming & Cui, Zhixin & Shen, Jun, 2019. "Vibration fault diagnosis of wind turbines based on variational mode decomposition and energy entropy," Energy, Elsevier, vol. 174(C), pages 1100-1109.
    2. García Márquez, Fausto Pedro & Peco Chacón, Ana María, 2020. "A review of non-destructive testing on wind turbines blades," Renewable Energy, Elsevier, vol. 161(C), pages 998-1010.
    3. Artigao, Estefania & Martín-Martínez, Sergio & Honrubia-Escribano, Andrés & Gómez-Lázaro, Emilio, 2018. "Wind turbine reliability: A comprehensive review towards effective condition monitoring development," Applied Energy, Elsevier, vol. 228(C), pages 1569-1583.
    4. Xiaowen Song & Zhitai Xing & Yan Jia & Xiaojuan Song & Chang Cai & Yinan Zhang & Zekun Wang & Jicai Guo & Qingan Li, 2022. "Review on the Damage and Fault Diagnosis of Wind Turbine Blades in the Germination Stage," Energies, MDPI, vol. 15(20), pages 1-17, October.
    5. Pliego Marugán, Alberto & Peco Chacón, Ana María & García Márquez, Fausto Pedro, 2019. "Reliability analysis of detecting false alarms that employ neural networks: A real case study on wind turbines," Reliability Engineering and System Safety, Elsevier, vol. 191(C).
    6. Wenjie Wang & Yu Xue & Chengkuan He & Yongnian Zhao, 2022. "Review of the Typical Damage and Damage-Detection Methods of Large Wind Turbine Blades," Energies, MDPI, vol. 15(15), pages 1-31, August.
    7. Liu, Y. & Hajj, M. & Bao, Y., 2022. "Review of robot-based damage assessment for offshore wind turbines," Renewable and Sustainable Energy Reviews, Elsevier, vol. 158(C).
    8. Mohamed Benbouzid & Tarek Berghout & Nur Sarma & Siniša Djurović & Yueqi Wu & Xiandong Ma, 2021. "Intelligent Condition Monitoring of Wind Power Systems: State of the Art Review," Energies, MDPI, vol. 14(18), pages 1-33, September.
    9. Rybak, Aurelia & Rybak, Aleksandra & Kolev, Spas D., 2024. "Development of wind energy and access to REE. The case of Poland," Resources Policy, Elsevier, vol. 90(C).
    10. Masoud Asgarpour & John Dalsgaard Sørensen, 2018. "Bayesian Based Diagnostic Model for Condition Based Maintenance of Offshore Wind Farms," Energies, MDPI, vol. 11(2), pages 1-17, January.
    11. Guo, Jihong & Liu, Chao & Cao, Jinfeng & Jiang, Dongxiang, 2021. "Damage identification of wind turbine blades with deep convolutional neural networks," Renewable Energy, Elsevier, vol. 174(C), pages 122-133.
    12. Kaewniam, Panida & Cao, Maosen & Alkayem, Nizar Faisal & Li, Dayang & Manoach, Emil, 2022. "Recent advances in damage detection of wind turbine blades: A state-of-the-art review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 167(C).
    13. Giovanni Rinaldi & Philipp R. Thies & Lars Johanning, 2021. "Current Status and Future Trends in the Operation and Maintenance of Offshore Wind Turbines: A Review," Energies, MDPI, vol. 14(9), pages 1-28, April.
    14. Segovia Ramírez, Isaac & Pliego Marugán, Alberto & García Márquez, Fausto Pedro, 2022. "A novel approach to optimize the positioning and measurement parameters in photovoltaic aerial inspections," Renewable Energy, Elsevier, vol. 187(C), pages 371-389.
    15. Miguel A. Rodríguez-López & Luis M. López-González & Luis M. López-Ochoa & Jesús Las-Heras-Casas, 2018. "Methodology for Detecting Malfunctions and Evaluating the Maintenance Effectiveness in Wind Turbine Generator Bearings Using Generic versus Specific Models from SCADA Data," Energies, MDPI, vol. 11(4), pages 1-22, March.
    16. Lu, Yakai & Tian, Zhe & Zhou, Ruoyu & Liu, Wenjing, 2021. "A general transfer learning-based framework for thermal load prediction in regional energy system," Energy, Elsevier, vol. 217(C).
    17. Moynihan, Bridget & Moaveni, Babak & Liberatore, Sauro & Hines, Eric, 2022. "Estimation of blade forces in wind turbines using blade root strain measurements with OpenFAST verification," Renewable Energy, Elsevier, vol. 184(C), pages 662-676.
    18. Stetco, Adrian & Dinmohammadi, Fateme & Zhao, Xingyu & Robu, Valentin & Flynn, David & Barnes, Mike & Keane, John & Nenadic, Goran, 2019. "Machine learning methods for wind turbine condition monitoring: A review," Renewable Energy, Elsevier, vol. 133(C), pages 620-635.
    19. Jijian Lian & Ou Cai & Xiaofeng Dong & Qi Jiang & Yue Zhao, 2019. "Health Monitoring and Safety Evaluation of the Offshore Wind Turbine Structure: A Review and Discussion of Future Development," Sustainability, MDPI, vol. 11(2), pages 1-29, January.
    20. Xin Wu & Hong Wang & Guoqian Jiang & Ping Xie & Xiaoli Li, 2019. "Monitoring Wind Turbine Gearbox with Echo State Network Modeling and Dynamic Threshold Using SCADA Vibration Data," Energies, MDPI, vol. 12(6), pages 1-19, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:renene:v:163:y:2021:i:c:p:386-397. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/renewable-energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.