IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v15y2022i17p6373-d903451.html
   My bibliography  Save this article

Abnormal Data Cleaning Method for Wind Turbines Based on Constrained Curve Fitting

Author

Listed:
  • Xiangqing Yin

    (School of Mechanical Electronic and Information Engineering, China University of Mining and Technology-Beijing, Beijing 100083, China)

  • Yi Liu

    (School of Mechanical Electronic and Information Engineering, China University of Mining and Technology-Beijing, Beijing 100083, China)

  • Li Yang

    (School of Mechanical Electronic and Information Engineering, China University of Mining and Technology-Beijing, Beijing 100083, China)

  • Wenchao Gao

    (School of Mechanical Electronic and Information Engineering, China University of Mining and Technology-Beijing, Beijing 100083, China)

Abstract

With the increase of the scale of wind turbines, the problem of data quality of wind turbines has become increasingly prominent, which seriously affects the follow-up research. A large number of abnormal data exist in the historical data recorded by the wind turbine Supervisory Control And Data Acquisition (SCADA) system. In order to improve data quality, it is necessary to clean a large number of abnormal data in the original data. Aiming at the problem that the cleaning effect is not good in the presence of a large number of abnormal data, a method for cleaning abnormal data of wind turbines based on constrained curve fitting is proposed. According to the wind speed-power characteristics of wind turbines, the constrained wind speed-power curve is fit with the least square method, and the constrained optimization problem is transformed into an unconstrained optimization problem by using the external penalty function method. Data cleaning was performed on the fitted curve using an improved 3-σ standard deviation. Experiments show that, compared with the existing methods, this method can still perform data cleaning well when the historical wind turbine data contains many abnormal data, and the method is insensitive to parameters, simple in the calculation, and easy to automate.

Suggested Citation

  • Xiangqing Yin & Yi Liu & Li Yang & Wenchao Gao, 2022. "Abnormal Data Cleaning Method for Wind Turbines Based on Constrained Curve Fitting," Energies, MDPI, vol. 15(17), pages 1-22, August.
    • Handle: RePEc:gam:jeners:v:15:y:2022:i:17:p:6373-:d:903451
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/15/17/6373/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/15/17/6373/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Li, Tenghui & Liu, Xiaolei & Lin, Zi & Morrison, Rory, 2022. "Ensemble offshore Wind Turbine Power Curve modelling – An integration of Isolation Forest, fast Radial Basis Function Neural Network, and metaheuristic algorithm," Energy, Elsevier, vol. 239(PD).
    2. Liang Tao & Qian Siqi & Yingjuan Zhang & Huan Shi, 2019. "Abnormal Detection of Wind Turbine Based on SCADA Data Mining," Mathematical Problems in Engineering, Hindawi, vol. 2019, pages 1-10, August.
    3. Seo, Seokho & Oh, Si-Doek & Kwak, Ho-Young, 2019. "Wind turbine power curve modeling using maximum likelihood estimation method," Renewable Energy, Elsevier, vol. 136(C), pages 1164-1169.
    4. Lin, Zi & Liu, Xiaolei, 2020. "Wind power forecasting of an offshore wind turbine based on high-frequency SCADA data and deep learning neural network," Energy, Elsevier, vol. 201(C).
    5. Xu, Keyi & Yan, Jie & Zhang, Hao & Zhang, Haoran & Han, Shuang & Liu, Yongqian, 2021. "Quantile based probabilistic wind turbine power curve model," Applied Energy, Elsevier, vol. 296(C).
    6. Long, Huan & Xu, Shaohui & Gu, Wei, 2022. "An abnormal wind turbine data cleaning algorithm based on color space conversion and image feature detection," Applied Energy, Elsevier, vol. 311(C).
    7. Han, Shuang & Qiao, Yanhui & Yan, Ping & Yan, Jie & Liu, Yongqian & Li, Li, 2020. "Wind turbine power curve modeling based on interval extreme probability density for the integration of renewable energies and electric vehicles," Renewable Energy, Elsevier, vol. 157(C), pages 190-203.
    8. Neshat, Mehdi & Nezhad, Meysam Majidi & Abbasnejad, Ehsan & Mirjalili, Seyedali & Groppi, Daniele & Heydari, Azim & Tjernberg, Lina Bertling & Astiaso Garcia, Davide & Alexander, Bradley & Shi, Qinfen, 2021. "Wind turbine power output prediction using a new hybrid neuro-evolutionary method," Energy, Elsevier, vol. 229(C).
    9. Conor McKinnon & Alan Turnbull & Sofia Koukoura & James Carroll & Alasdair McDonald, 2020. "Effect of Time History on Normal Behaviour Modelling Using SCADA Data to Predict Wind Turbine Failures," Energies, MDPI, vol. 13(18), pages 1-19, September.
    10. Kevin Leahy & Colm Gallagher & Peter O’Donovan & Dominic T. J. O’Sullivan, 2019. "Issues with Data Quality for Wind Turbine Condition Monitoring and Reliability Analyses," Energies, MDPI, vol. 12(2), pages 1-22, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Peng & Li, Yanting & Zhang, Guangyao, 2023. "Probabilistic power curve estimation based on meteorological factors and density LSTM," Energy, Elsevier, vol. 269(C).
    2. Wang, Yun & Duan, Xiaocong & Zou, Runmin & Zhang, Fan & Li, Yifen & Hu, Qinghua, 2023. "A novel data-driven deep learning approach for wind turbine power curve modeling," Energy, Elsevier, vol. 270(C).
    3. Zou, Runmin & Yang, Jiaxin & Wang, Yun & Liu, Fang & Essaaidi, Mohamed & Srinivasan, Dipti, 2021. "Wind turbine power curve modeling using an asymmetric error characteristic-based loss function and a hybrid intelligent optimizer," Applied Energy, Elsevier, vol. 304(C).
    4. Francisco Bilendo & Angela Meyer & Hamed Badihi & Ningyun Lu & Philippe Cambron & Bin Jiang, 2022. "Applications and Modeling Techniques of Wind Turbine Power Curve for Wind Farms—A Review," Energies, MDPI, vol. 16(1), pages 1-38, December.
    5. Yan, Jie & Nuertayi, Akejiang & Yan, Yamin & Liu, Shan & Liu, Yongqian, 2023. "Hybrid physical and data driven modeling for dynamic operation characteristic simulation of wind turbine," Renewable Energy, Elsevier, vol. 215(C).
    6. Xu, Keyi & Yan, Jie & Zhang, Hao & Zhang, Haoran & Han, Shuang & Liu, Yongqian, 2021. "Quantile based probabilistic wind turbine power curve model," Applied Energy, Elsevier, vol. 296(C).
    7. Urmeneta, Jon & Izquierdo, Juan & Leturiondo, Urko, 2023. "A methodology for performance assessment at system level—Identification of operating regimes and anomaly detection in wind turbines," Renewable Energy, Elsevier, vol. 205(C), pages 281-292.
    8. Chatterjee, Joyjit & Dethlefs, Nina, 2021. "Scientometric review of artificial intelligence for operations & maintenance of wind turbines: The past, present and future," Renewable and Sustainable Energy Reviews, Elsevier, vol. 144(C).
    9. Li, Min & Yang, Yi & He, Zhaoshuang & Guo, Xinbo & Zhang, Ruisheng & Huang, Bingqing, 2023. "A wind speed forecasting model based on multi-objective algorithm and interpretability learning," Energy, Elsevier, vol. 269(C).
    10. Liu, Xiaolei & Lin, Zi & Feng, Ziming, 2021. "Short-term offshore wind speed forecast by seasonal ARIMA - A comparison against GRU and LSTM," Energy, Elsevier, vol. 227(C).
    11. Izquierdo, J. & Márquez, A. Crespo & Uribetxebarria, J. & Erguido, A., 2020. "On the importance of assessing the operational context impact on maintenance management for life cycle cost of wind energy projects," Renewable Energy, Elsevier, vol. 153(C), pages 1100-1110.
    12. Camila Correa-Jullian & Sergio Cofre-Martel & Gabriel San Martin & Enrique Lopez Droguett & Gustavo de Novaes Pires Leite & Alexandre Costa, 2022. "Exploring Quantum Machine Learning and Feature Reduction Techniques for Wind Turbine Pitch Fault Detection," Energies, MDPI, vol. 15(8), pages 1-29, April.
    13. Liang, Yushi & Wu, Chunbing & Ji, Xiaodong & Zhang, Mulan & Li, Yiran & He, Jianjun & Qin, Zhiheng, 2022. "Estimation of the influences of spatiotemporal variations in air density on wind energy assessment in China based on deep neural network," Energy, Elsevier, vol. 239(PC).
    14. Lin, Zi & Liu, Xiaolei & Lao, Liyun & Liu, Hengxu, 2020. "Prediction of two-phase flow patterns in upward inclined pipes via deep learning," Energy, Elsevier, vol. 210(C).
    15. Natei Ermias Benti & Mesfin Diro Chaka & Addisu Gezahegn Semie, 2023. "Forecasting Renewable Energy Generation with Machine Learning and Deep Learning: Current Advances and Future Prospects," Sustainability, MDPI, vol. 15(9), pages 1-33, April.
    16. Xingda Tian & Handong Huang & Suo Cheng & Chao Wang & Pengfei Li & Yaju Hao, 2022. "A Carbonate Reservoir Prediction Method Based on Deep Learning and Multiparameter Joint Inversion," Energies, MDPI, vol. 15(7), pages 1-20, March.
    17. Rad Haghi & Cassidy Stagg & Curran Crawford, 2024. "Wind Turbine Damage Equivalent Load Assessment Using Gaussian Process Regression Combining Measurement and Synthetic Data," Energies, MDPI, vol. 17(2), pages 1-24, January.
    18. Mingyu Li & Dongxiao Niu & Zhengsen Ji & Xiwen Cui & Lijie Sun, 2021. "Forecast Research on Multidimensional Influencing Factors of Global Offshore Wind Power Investment Based on Random Forest and Elastic Net," Sustainability, MDPI, vol. 13(21), pages 1-19, November.
    19. Bruce Stephen, 2022. "Machine Learning Applications in Power System Condition Monitoring," Energies, MDPI, vol. 15(5), pages 1-2, March.
    20. Yakoub, Ghali & Mathew, Sathyajith & Leal, Joao, 2023. "Intelligent estimation of wind farm performance with direct and indirect ‘point’ forecasting approaches integrating several NWP models," Energy, Elsevier, vol. 263(PD).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:15:y:2022:i:17:p:6373-:d:903451. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.