IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v17y2024i22p5697-d1520952.html
   My bibliography  Save this article

Cleaning of Abnormal Wind Speed Power Data Based on Quartile RANSAC Regression

Author

Listed:
  • Fengjuan Zhang

    (College of Electrical Engineering, Henan University of Technology, Zhengzhou 450001, China)

  • Xiaohui Zhang

    (College of Electrical Engineering, Henan University of Technology, Zhengzhou 450001, China)

  • Zhilei Xu

    (College of Electrical Engineering, Henan University of Technology, Zhengzhou 450001, China)

  • Keliang Dong

    (College of Electrical Engineering, Henan University of Technology, Zhengzhou 450001, China)

  • Zhiwei Li

    (College of Electrical Engineering, Henan University of Technology, Zhengzhou 450001, China)

  • Yubo Liu

    (College of Electrical Engineering, Henan University of Technology, Zhengzhou 450001, China)

Abstract

The combined complexity of wind turbine systems and harsh operating conditions pose significant challenges to the accuracy of operational data in Supervisory Control and Data Acquisition (SCADA) systems. Improving the precision of data cleaning for high proportions of stacked abnormalities remains an urgent problem. This paper deeply analyzes the distribution characteristics of abnormal data and proposes a novel method for abnormal data cleaning based on a classification processing framework. Firstly, the first type of abnormal data is cleaned based on operational criteria; secondly, the quartile method is used to eliminate sparse abnormal data to obtain a clearer boundary line; on this basis, the Random Sample Consensus (RANSAC) algorithm is employed to eliminate stacked abnormal data; finally, the effectiveness of the proposed algorithm in cleaning abnormal data with a high proportion of stacked abnormalities is verified through case studies, and evaluation indicators are introduced through comparative experiments to quantitatively assess the cleaning effect. The research results indicate that the algorithm excels in cleaning effectiveness, efficiency, accuracy, and rationality of data deletion. The cleaning accuracy improvement is particularly significant when dealing with a high proportion of stacked anomaly data, thereby bringing significant value to wind power applications such as wind power prediction, condition assessment, and fault detection.

Suggested Citation

  • Fengjuan Zhang & Xiaohui Zhang & Zhilei Xu & Keliang Dong & Zhiwei Li & Yubo Liu, 2024. "Cleaning of Abnormal Wind Speed Power Data Based on Quartile RANSAC Regression," Energies, MDPI, vol. 17(22), pages 1-14, November.
    • Handle: RePEc:gam:jeners:v:17:y:2024:i:22:p:5697-:d:1520952
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/17/22/5697/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/17/22/5697/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Conor McKinnon & James Carroll & Alasdair McDonald & Sofia Koukoura & Charlie Plumley, 2021. "Investigation of Isolation Forest for Wind Turbine Pitch System Condition Monitoring Using SCADA Data," Energies, MDPI, vol. 14(20), pages 1-20, October.
    2. Nielson, Jordan & Bhaganagar, Kiran & Meka, Rajitha & Alaeddini, Adel, 2020. "Using atmospheric inputs for Artificial Neural Networks to improve wind turbine power prediction," Energy, Elsevier, vol. 190(C).
    3. Jorge Maldonado-Correa & Sergio Martín-Martínez & Estefanía Artigao & Emilio Gómez-Lázaro, 2020. "Using SCADA Data for Wind Turbine Condition Monitoring: A Systematic Literature Review," Energies, MDPI, vol. 13(12), pages 1-21, June.
    4. Long, Huan & Xu, Shaohui & Gu, Wei, 2022. "An abnormal wind turbine data cleaning algorithm based on color space conversion and image feature detection," Applied Energy, Elsevier, vol. 311(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alessandro Murgia & Robbert Verbeke & Elena Tsiporkova & Ludovico Terzi & Davide Astolfi, 2023. "Discussion on the Suitability of SCADA-Based Condition Monitoring for Wind Turbine Fault Diagnosis through Temperature Data Analysis," Energies, MDPI, vol. 16(2), pages 1-20, January.
    2. Camila Correa-Jullian & Sergio Cofre-Martel & Gabriel San Martin & Enrique Lopez Droguett & Gustavo de Novaes Pires Leite & Alexandre Costa, 2022. "Exploring Quantum Machine Learning and Feature Reduction Techniques for Wind Turbine Pitch Fault Detection," Energies, MDPI, vol. 15(8), pages 1-29, April.
    3. Ye, Xiaoling & Liu, Chengcheng & Xiong, Xiong & Qi, Yinyi, 2025. "Recurrent attention encoder–decoder network for multi-step interval wind power prediction," Energy, Elsevier, vol. 315(C).
    4. Bashir, Hassan & Sibtain, Muhammad & Hanay, Özge & Azam, Muhammad Imran & Qurat-ul-Ain, & Saleem, Snoober, 2023. "Decomposition and Harris hawks optimized multivariate wind speed forecasting utilizing sequence2sequence-based spatiotemporal attention," Energy, Elsevier, vol. 278(PB).
    5. Tobias Mueller & Steven Gronau, 2023. "Fostering Macroeconomic Research on Hydrogen-Powered Aviation: A Systematic Literature Review on General Equilibrium Models," Energies, MDPI, vol. 16(3), pages 1-33, February.
    6. Kwak, Sanghyeok & Choi, Jaehong & Lee, Min Chul & Yoon, Youngbin, 2021. "Predicting instability frequency and amplitude using artificial neural network in a partially premixed combustor," Energy, Elsevier, vol. 230(C).
    7. Pérez Albornoz, C. & Escalante Soberanis, M.A. & Ramírez Rivera, V. & Rivero, M., 2022. "Review of atmospheric stability estimations for wind power applications," Renewable and Sustainable Energy Reviews, Elsevier, vol. 163(C).
    8. Becky Corley & Sofia Koukoura & James Carroll & Alasdair McDonald, 2021. "Combination of Thermal Modelling and Machine Learning Approaches for Fault Detection in Wind Turbine Gearboxes," Energies, MDPI, vol. 14(5), pages 1-14, March.
    9. Francisco Bilendo & Angela Meyer & Hamed Badihi & Ningyun Lu & Philippe Cambron & Bin Jiang, 2022. "Applications and Modeling Techniques of Wind Turbine Power Curve for Wind Farms—A Review," Energies, MDPI, vol. 16(1), pages 1-38, December.
    10. Adaiton Oliveira-Filho & Monelle Comeau & James Cave & Charbel Nasr & Pavel Côté & Antoine Tahan, 2024. "Wind Turbine SCADA Data Imbalance: A Review of Its Impact on Health Condition Analyses and Mitigation Strategies," Energies, MDPI, vol. 18(1), pages 1-23, December.
    11. Liu, Zhi-Feng & Liu, You-Yuan & Chen, Xiao-Rui & Zhang, Shu-Rui & Luo, Xing-Fu & Li, Ling-Ling & Yang, Yi-Zhou & You, Guo-Dong, 2024. "A novel deep learning-based evolutionary model with potential attention and memory decay-enhancement strategy for short-term wind power point-interval forecasting," Applied Energy, Elsevier, vol. 360(C).
    12. Yun, Eunjeong & Hur, Jin, 2021. "Probabilistic estimation model of power curve to enhance power output forecasting of wind generating resources," Energy, Elsevier, vol. 223(C).
    13. Navarkar, Abhishek & Hasti, Veeraraghava Raju & Deneke, Elihu & Gore, Jay P., 2020. "A data-driven model for thermodynamic properties of a steam generator under cycling operation," Energy, Elsevier, vol. 211(C).
    14. Bingchun Liu & Shijie Zhao & Xiaogang Yu & Lei Zhang & Qingshan Wang, 2020. "A Novel Deep Learning Approach for Wind Power Forecasting Based on WD-LSTM Model," Energies, MDPI, vol. 13(18), pages 1-17, September.
    15. Marek Borowski & Piotr Życzkowski & Klaudia Zwolińska & Rafał Łuczak & Zbigniew Kuczera, 2021. "The Security of Energy Supply from Internal Combustion Engines Using Coal Mine Methane—Forecasting of the Electrical Energy Generation," Energies, MDPI, vol. 14(11), pages 1-18, May.
    16. Xuan-Kien Mai & Jun-Yeop Lee & Jae-In Lee & Byeong-Soo Go & Seok-Ju Lee & Minh-Chau Dinh, 2025. "Design of an Efficient Deep Learning-Based Diagnostic Model for Wind Turbine Gearboxes Using SCADA Data," Energies, MDPI, vol. 18(11), pages 1-19, May.
    17. Davide Astolfi & Francesco Castellani & Andrea Lombardi & Ludovico Terzi, 2021. "Multivariate SCADA Data Analysis Methods for Real-World Wind Turbine Power Curve Monitoring," Energies, MDPI, vol. 14(4), pages 1-18, February.
    18. Mu, Yunfei & Xu, Yurui & Cao, Yan & Chen, Wanqing & Jia, Hongjie & Yu, Xiaodan & Jin, Xiaolong, 2022. "A two-stage scheduling method for integrated community energy system based on a hybrid mechanism and data-driven model," Applied Energy, Elsevier, vol. 323(C).
    19. Adam Krechowicz & Maria Krechowicz & Katarzyna Poczeta, 2022. "Machine Learning Approaches to Predict Electricity Production from Renewable Energy Sources," Energies, MDPI, vol. 15(23), pages 1-41, December.
    20. Erik Möllerström & Sean Gregory & Aromal Sugathan, 2021. "Improvement of AEP Predictions with Time for Swedish Wind Farms," Energies, MDPI, vol. 14(12), pages 1-12, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:17:y:2024:i:22:p:5697-:d:1520952. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.