IDEAS home Printed from https://ideas.repec.org/a/eee/renene/v204y2023icp131-140.html

A novel composed method of cleaning anomy data for improving state prediction of wind turbine

Author

Listed:
  • Yao, Qingtao
  • Zhu, Haowei
  • Xiang, Ling
  • Su, Hao
  • Hu, Aijun

Abstract

Improving the efficiency of wind turbine state prediction is an important goal of wind energy utilization. But much of abnormal data existing in supervisory control and data acquisition (SCADA) seriously affects the health state prediction of wind turbine. In this paper, a new composed method is proposed to clean SACAD data according to abnormal data type of wind turbine. In proposed composed method, a preprocessing method is first presented to get rid of outliers of power curve based on operational mechanism, and a new data cleaning method called TTLOF (Thompson tau-local outlier factor) is proposed to quantify particularly data points and eliminate outliers by setting correlation parameter thresholds. In TTLOF cleaning data, Empirical copula-based mutual information (ECMI) is used to select correlation parameters for anomaly characteristic assessments, and each parameter interval is divided for performing segmentation fine cleaning which can reduce the model complexity of identifying anomaly characteristics. Finally, a deep learning network which is long short-term memory (LSTM) is used to verify the effectiveness of the proposed data cleaning method. By analyzing the state monitoring results, it is shown the proposed composed method is more effective for cleaning anomy data than other methods.

Suggested Citation

  • Yao, Qingtao & Zhu, Haowei & Xiang, Ling & Su, Hao & Hu, Aijun, 2023. "A novel composed method of cleaning anomy data for improving state prediction of wind turbine," Renewable Energy, Elsevier, vol. 204(C), pages 131-140.
    • Handle: RePEc:eee:renene:v:204:y:2023:i:c:p:131-140
    DOI: 10.1016/j.renene.2022.12.118
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0960148122019140
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.renene.2022.12.118?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Kumar Rahul & Rohitash Kumar Banyal, 2021. "Detection and Correction of Abnormal Data with Optimized Dirty Data: A New Data Cleaning Model," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 20(02), pages 809-841, March.
    2. Dai, Juchuan & Yang, Xin & Hu, Wei & Wen, Li & Tan, Yayi, 2018. "Effect investigation of yaw on wind turbine performance based on SCADA data," Energy, Elsevier, vol. 149(C), pages 684-696.
    3. Mucchielli, P. & Bhowmik, B. & Ghosh, B. & Pakrashi, V., 2021. "Real-time accurate detection of wind turbine downtime - An Irish perspective," Renewable Energy, Elsevier, vol. 179(C), pages 1969-1989.
    4. Xiang, Ling & Yang, Xin & Hu, Aijun & Su, Hao & Wang, Penghe, 2022. "Condition monitoring and anomaly detection of wind turbine based on cascaded and bidirectional deep learning networks," Applied Energy, Elsevier, vol. 305(C).
    5. Wang, Shuai & Li, Bin & Li, Guanzheng & Yao, Bin & Wu, Jianzhong, 2021. "Short-term wind power prediction based on multidimensional data cleaning and feature reconfiguration," Applied Energy, Elsevier, vol. 292(C).
    6. Kong, Ziqian & Tang, Baoping & Deng, Lei & Liu, Wenyi & Han, Yan, 2020. "Condition monitoring of wind turbines based on spatio-temporal fusion of SCADA data by convolutional neural networks and gated recurrent units," Renewable Energy, Elsevier, vol. 146(C), pages 760-768.
    7. Long, Huan & Xu, Shaohui & Gu, Wei, 2022. "An abnormal wind turbine data cleaning algorithm based on color space conversion and image feature detection," Applied Energy, Elsevier, vol. 311(C).
    8. Aoyu Hu & Qian Sun & Hao Liu & Ning Zhou & Zhan’ao Tan & Honglu Zhu, 2019. "A Novel Photovoltaic Array Outlier Cleaning Algorithm Based on Sliding Standard Deviation Mutation," Energies, MDPI, vol. 12(22), pages 1-16, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Sun, Shilin & Li, Qi & Hu, Wenyang & Liang, Zhongchao & Wang, Tianyang & Chu, Fulei, 2023. "Wind turbine blade breakage detection based on environment-adapted contrastive learning," Renewable Energy, Elsevier, vol. 219(P2).
    2. Dai, Junfeng & Fu, Li-hui, 2024. "A wind speed forecasting model using nonlinear auto-regressive model optimized by the hybrid chaos-cloud salp swarm algorithm," Energy, Elsevier, vol. 298(C).
    3. Cui, Xiwen & Yu, Xiaoyu & Niu, Haowei & Niu, Dongxiao & Liu, Da, 2025. "A novel data-driven multi-step wind power point-interval prediction framework integrating sliding window-based two-layer adaptive decomposition and multi-objective optimization for balancing predictio," Applied Energy, Elsevier, vol. 397(C).
    4. Neshat, Mehdi & Thilakaratne, Menasha & El-Abd, Mohammed & Mirjalili, Seyedali & Gandomi, Amir H. & Boland, John, 2025. "Smart buildings energy consumption forecasting using adaptive evolutionary bagging extra tree learning models," Energy, Elsevier, vol. 333(C).
    5. Liang, Guoyuan & Su, Yahao & Wu, Xinyu & Ma, Jiajun & Long, Huan & Song, Zhe, 2023. "Abnormal data cleaning for wind turbines by image segmentation based on active shape model and class uncertainty," Renewable Energy, Elsevier, vol. 216(C).
    6. Chen, Yan & Ban, Guihua & Ding, Tingxiao, 2025. "Abnormal data recognition method for wind turbines based on alpha channel fusion," Applied Energy, Elsevier, vol. 396(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chen Zhang & Tao Yang, 2023. "Anomaly Detection for Wind Turbines Using Long Short-Term Memory-Based Variational Autoencoder Wasserstein Generation Adversarial Network under Semi-Supervised Training," Energies, MDPI, vol. 16(19), pages 1-18, October.
    2. Long, Huan & Xu, Shaohui & Gu, Wei, 2022. "An abnormal wind turbine data cleaning algorithm based on color space conversion and image feature detection," Applied Energy, Elsevier, vol. 311(C).
    3. Lv, Yunlong & Hu, Qin & Xu, Hang & Lin, Huiyao & Wu, Yufan, 2024. "An ultra-short-term wind power prediction method based on spatial-temporal attention graph convolutional model," Energy, Elsevier, vol. 293(C).
    4. Liu, Tianhao & Shan, Linke & Jiang, Meihui & Li, Fangning & Kong, Fannie & Du, Pengcheng & Zhu, Hongyu & Goh, Hui Hwang & Kurniawan, Tonni Agustiono & Huang, Chao & Zhang, Dongdong, 2025. "Multi-dimensional data processing and intelligent forecasting technologies for renewable energy generation," Applied Energy, Elsevier, vol. 398(C).
    5. Alan Turnbull & Conor McKinnon & James Carrol & Alasdair McDonald, 2022. "On the Development of Offshore Wind Turbine Technology: An Assessment of Reliability Rates and Fault Detection Methods in a Changing Market," Energies, MDPI, vol. 15(9), pages 1-20, April.
    6. Zhan, Jun & Wu, Chengkun & Yang, Canqun & Miao, Qiucheng & Wang, Shilin & Ma, Xiandong, 2022. "Condition monitoring of wind turbines based on spatial-temporal feature aggregation networks," Renewable Energy, Elsevier, vol. 200(C), pages 751-766.
    7. Arkaitz Rabanal & Alain Ulazia & Gabriel Ibarra-Berastegi & Jon Sáenz & Unai Elosegui, 2018. "MIDAS: A Benchmarking Multi-Criteria Method for the Identification of Defective Anemometers in Wind Farms," Energies, MDPI, vol. 12(1), pages 1-19, December.
    8. Zhou, Yu & Li, Zhengshuo & Wang, Guangrui, 2021. "Study on leveraging wind farms' robust reactive power range for uncertain power system reactive power optimization," Applied Energy, Elsevier, vol. 298(C).
    9. Liu, Hui & Duan, Zhu & Chen, Chao, 2020. "Wind speed big data forecasting using time-variant multi-resolution ensemble model with clustering auto-encoder," Applied Energy, Elsevier, vol. 280(C).
    10. Wang, Anqi & Pei, Yan & Qian, Zheng & Zareipour, Hamidreza & Jing, Bo & An, Jiayi, 2022. "A two-stage anomaly decomposition scheme based on multi-variable correlation extraction for wind turbine fault detection and identification," Applied Energy, Elsevier, vol. 321(C).
    11. Zhu, Yongchao & Zhu, Caichao & Tan, Jianjun & Tan, Yong & Rao, Lei, 2022. "Anomaly detection and condition monitoring of wind turbine gearbox based on LSTM-FS and transfer learning," Renewable Energy, Elsevier, vol. 189(C), pages 90-103.
    12. Zhu, Yunyi & Xie, Bin & Wang, Anqi & Qian, Zheng, 2025. "Wind turbine fault detection and identification via self-attention-based dynamic graph representation learning and variable-level normalizing flow," Reliability Engineering and System Safety, Elsevier, vol. 253(C).
    13. Wang, Yun & Zou, Runmin & Liu, Fang & Zhang, Lingjun & Liu, Qianyi, 2021. "A review of wind speed and wind power forecasting with deep neural networks," Applied Energy, Elsevier, vol. 304(C).
    14. Manisha Sawant & Rupali Patil & Tanmay Shikhare & Shreyas Nagle & Sakshi Chavan & Shivang Negi & Neeraj Dhanraj Bokde, 2022. "A Selective Review on Recent Advancements in Long, Short and Ultra-Short-Term Wind Power Prediction," Energies, MDPI, vol. 15(21), pages 1-24, October.
    15. Liqiang Wang & Shixian Dai & Zijian Kang & Shuang Han & Guozhen Zhang & Yongqian Liu, 2025. "A CNN-SA-GRU Model with Focal Loss for Fault Diagnosis of Wind Turbine Gearboxes," Energies, MDPI, vol. 18(14), pages 1-16, July.
    16. Cristian Velandia-Cardenas & Yolanda Vidal & Francesc Pozo, 2021. "Wind Turbine Fault Detection Using Highly Imbalanced Real SCADA Data," Energies, MDPI, vol. 14(6), pages 1-26, March.
    17. Feng, Chenlong & Liu, Chao & Jiang, Dongxiang, 2023. "Unsupervised anomaly detection using graph neural networks integrated with physical-statistical feature fusion and local-global learning," Renewable Energy, Elsevier, vol. 206(C), pages 309-323.
    18. Zhang, Shuangyi & Li, Xichen, 2021. "Future projections of offshore wind energy resources in China using CMIP6 simulations and a deep learning-based downscaling method," Energy, Elsevier, vol. 217(C).
    19. Guo, Junyu & Yang, Yulai & Li, He & Wang, Jiang & Tang, Aimin & Shan, Daiwei & Huang, Bangkui, 2024. "A hybrid deep learning model towards fault diagnosis of drilling pump," Applied Energy, Elsevier, vol. 372(C).
    20. Huifan Zeng & Juchuan Dai & Chengming Zuo & Huanguo Chen & Mimi Li & Fan Zhang, 2022. "Correlation Investigation of Wind Turbine Multiple Operating Parameters Based on SCADA Data," Energies, MDPI, vol. 15(14), pages 1-24, July.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:renene:v:204:y:2023:i:c:p:131-140. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/renewable-energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.