IDEAS home Printed from https://ideas.repec.org/a/eee/renene/v204y2023icp131-140.html
   My bibliography  Save this article

A novel composed method of cleaning anomy data for improving state prediction of wind turbine

Author

Listed:
  • Yao, Qingtao
  • Zhu, Haowei
  • Xiang, Ling
  • Su, Hao
  • Hu, Aijun

Abstract

Improving the efficiency of wind turbine state prediction is an important goal of wind energy utilization. But much of abnormal data existing in supervisory control and data acquisition (SCADA) seriously affects the health state prediction of wind turbine. In this paper, a new composed method is proposed to clean SACAD data according to abnormal data type of wind turbine. In proposed composed method, a preprocessing method is first presented to get rid of outliers of power curve based on operational mechanism, and a new data cleaning method called TTLOF (Thompson tau-local outlier factor) is proposed to quantify particularly data points and eliminate outliers by setting correlation parameter thresholds. In TTLOF cleaning data, Empirical copula-based mutual information (ECMI) is used to select correlation parameters for anomaly characteristic assessments, and each parameter interval is divided for performing segmentation fine cleaning which can reduce the model complexity of identifying anomaly characteristics. Finally, a deep learning network which is long short-term memory (LSTM) is used to verify the effectiveness of the proposed data cleaning method. By analyzing the state monitoring results, it is shown the proposed composed method is more effective for cleaning anomy data than other methods.

Suggested Citation

  • Yao, Qingtao & Zhu, Haowei & Xiang, Ling & Su, Hao & Hu, Aijun, 2023. "A novel composed method of cleaning anomy data for improving state prediction of wind turbine," Renewable Energy, Elsevier, vol. 204(C), pages 131-140.
    • Handle: RePEc:eee:renene:v:204:y:2023:i:c:p:131-140
    DOI: 10.1016/j.renene.2022.12.118
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0960148122019140
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.renene.2022.12.118?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Dai, Juchuan & Yang, Xin & Hu, Wei & Wen, Li & Tan, Yayi, 2018. "Effect investigation of yaw on wind turbine performance based on SCADA data," Energy, Elsevier, vol. 149(C), pages 684-696.
    2. Xiang, Ling & Yang, Xin & Hu, Aijun & Su, Hao & Wang, Penghe, 2022. "Condition monitoring and anomaly detection of wind turbine based on cascaded and bidirectional deep learning networks," Applied Energy, Elsevier, vol. 305(C).
    3. Mucchielli, P. & Bhowmik, B. & Ghosh, B. & Pakrashi, V., 2021. "Real-time accurate detection of wind turbine downtime - An Irish perspective," Renewable Energy, Elsevier, vol. 179(C), pages 1969-1989.
    4. Aoyu Hu & Qian Sun & Hao Liu & Ning Zhou & Zhan’ao Tan & Honglu Zhu, 2019. "A Novel Photovoltaic Array Outlier Cleaning Algorithm Based on Sliding Standard Deviation Mutation," Energies, MDPI, vol. 12(22), pages 1-16, November.
    5. Kumar Rahul & Rohitash Kumar Banyal, 2021. "Detection and Correction of Abnormal Data with Optimized Dirty Data: A New Data Cleaning Model," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 20(02), pages 809-841, March.
    6. Long, Huan & Xu, Shaohui & Gu, Wei, 2022. "An abnormal wind turbine data cleaning algorithm based on color space conversion and image feature detection," Applied Energy, Elsevier, vol. 311(C).
    7. Wang, Shuai & Li, Bin & Li, Guanzheng & Yao, Bin & Wu, Jianzhong, 2021. "Short-term wind power prediction based on multidimensional data cleaning and feature reconfiguration," Applied Energy, Elsevier, vol. 292(C).
    8. Kong, Ziqian & Tang, Baoping & Deng, Lei & Liu, Wenyi & Han, Yan, 2020. "Condition monitoring of wind turbines based on spatio-temporal fusion of SCADA data by convolutional neural networks and gated recurrent units," Renewable Energy, Elsevier, vol. 146(C), pages 760-768.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Liang, Guoyuan & Su, Yahao & Wu, Xinyu & Ma, Jiajun & Long, Huan & Song, Zhe, 2023. "Abnormal data cleaning for wind turbines by image segmentation based on active shape model and class uncertainty," Renewable Energy, Elsevier, vol. 216(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chen Zhang & Tao Yang, 2023. "Anomaly Detection for Wind Turbines Using Long Short-Term Memory-Based Variational Autoencoder Wasserstein Generation Adversarial Network under Semi-Supervised Training," Energies, MDPI, vol. 16(19), pages 1-18, October.
    2. Zhan, Jun & Wu, Chengkun & Yang, Canqun & Miao, Qiucheng & Wang, Shilin & Ma, Xiandong, 2022. "Condition monitoring of wind turbines based on spatial-temporal feature aggregation networks," Renewable Energy, Elsevier, vol. 200(C), pages 751-766.
    3. Long, Huan & Xu, Shaohui & Gu, Wei, 2022. "An abnormal wind turbine data cleaning algorithm based on color space conversion and image feature detection," Applied Energy, Elsevier, vol. 311(C).
    4. Alan Turnbull & Conor McKinnon & James Carrol & Alasdair McDonald, 2022. "On the Development of Offshore Wind Turbine Technology: An Assessment of Reliability Rates and Fault Detection Methods in a Changing Market," Energies, MDPI, vol. 15(9), pages 1-20, April.
    5. Zhou, Yu & Li, Zhengshuo & Wang, Guangrui, 2021. "Study on leveraging wind farms' robust reactive power range for uncertain power system reactive power optimization," Applied Energy, Elsevier, vol. 298(C).
    6. Wang, Yun & Zou, Runmin & Liu, Fang & Zhang, Lingjun & Liu, Qianyi, 2021. "A review of wind speed and wind power forecasting with deep neural networks," Applied Energy, Elsevier, vol. 304(C).
    7. Feng, Chenlong & Liu, Chao & Jiang, Dongxiang, 2023. "Unsupervised anomaly detection using graph neural networks integrated with physical-statistical feature fusion and local-global learning," Renewable Energy, Elsevier, vol. 206(C), pages 309-323.
    8. Zhang, Shuangyi & Li, Xichen, 2021. "Future projections of offshore wind energy resources in China using CMIP6 simulations and a deep learning-based downscaling method," Energy, Elsevier, vol. 217(C).
    9. Cai, Wei & Hu, Yang & Fang, Fang & Yao, Lujin & Liu, Jizhen, 2023. "Wind farm power production and fatigue load optimization based on dynamic partitioning and wake redirection of wind turbines," Applied Energy, Elsevier, vol. 339(C).
    10. Xie, Xiangmin & Peng, Fei & Zhang, Yan, 2022. "A data-driven probabilistic harmonic power flow approach in power distribution systems with PV generations," Applied Energy, Elsevier, vol. 321(C).
    11. Mu, Yunfei & Xu, Yanze & Zhang, Jiarui & Wu, Zeqing & Jia, Hongjie & Jin, Xiaolong & Qi, Yan, 2023. "A data-driven rolling optimization control approach for building energy systems that integrate virtual energy storage systems," Applied Energy, Elsevier, vol. 346(C).
    12. Zhang, Yagang & Zhao, Yunpeng & Shen, Xiaoyu & Zhang, Jinghui, 2022. "A comprehensive wind speed prediction system based on Monte Carlo and artificial intelligence algorithms," Applied Energy, Elsevier, vol. 305(C).
    13. Wu, Jie & Li, Na & Zhao, Yan & Wang, Jujie, 2022. "Usage of correlation analysis and hypothesis test in optimizing the gated recurrent unit network for wind speed forecasting," Energy, Elsevier, vol. 242(C).
    14. Ana Rita Nunes & Hugo Morais & Alberto Sardinha, 2021. "Use of Learning Mechanisms to Improve the Condition Monitoring of Wind Turbine Generators: A Review," Energies, MDPI, vol. 14(21), pages 1-22, November.
    15. Zhu, Yunlong & Dong, Zhe & Cheng, Zhonghua & Huang, Xiaojin & Dong, Yujie & Zhang, Zuoyi, 2023. "Neural network extended state-observer for energy system monitoring," Energy, Elsevier, vol. 263(PA).
    16. Zhou, Guangzhao & Guo, Zanquan & Sun, Simin & Jin, Qingsheng, 2023. "A CNN-BiGRU-AM neural network for AI applications in shale oil production prediction," Applied Energy, Elsevier, vol. 344(C).
    17. Davide Astolfi & Francesco Castellani & Matteo Becchetti & Andrea Lombardi & Ludovico Terzi, 2020. "Wind Turbine Systematic Yaw Error: Operation Data Analysis Techniques for Detecting It and Assessing Its Performance Impact," Energies, MDPI, vol. 13(9), pages 1-17, May.
    18. Mu, Yunfei & Xu, Yurui & Cao, Yan & Chen, Wanqing & Jia, Hongjie & Yu, Xiaodan & Jin, Xiaolong, 2022. "A two-stage scheduling method for integrated community energy system based on a hybrid mechanism and data-driven model," Applied Energy, Elsevier, vol. 323(C).
    19. Lijun Zhang & Kai Liu & Yufeng Wang & Zachary Bosire Omariba, 2018. "Ice Detection Model of Wind Turbine Blades Based on Random Forest Classifier," Energies, MDPI, vol. 11(10), pages 1-15, September.
    20. Junshuai Yan & Yongqian Liu & Xiaoying Ren & Li Li, 2023. "Wind Turbine Gearbox Condition Monitoring Using Hybrid Attentions and Spatio-Temporal BiConvLSTM Network," Energies, MDPI, vol. 16(19), pages 1-22, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:renene:v:204:y:2023:i:c:p:131-140. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/renewable-energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.