IDEAS home Printed from https://ideas.repec.org/a/eee/renene/v204y2023icp131-140.html
   My bibliography  Save this article

A novel composed method of cleaning anomy data for improving state prediction of wind turbine

Author

Listed:
  • Yao, Qingtao
  • Zhu, Haowei
  • Xiang, Ling
  • Su, Hao
  • Hu, Aijun

Abstract

Improving the efficiency of wind turbine state prediction is an important goal of wind energy utilization. But much of abnormal data existing in supervisory control and data acquisition (SCADA) seriously affects the health state prediction of wind turbine. In this paper, a new composed method is proposed to clean SACAD data according to abnormal data type of wind turbine. In proposed composed method, a preprocessing method is first presented to get rid of outliers of power curve based on operational mechanism, and a new data cleaning method called TTLOF (Thompson tau-local outlier factor) is proposed to quantify particularly data points and eliminate outliers by setting correlation parameter thresholds. In TTLOF cleaning data, Empirical copula-based mutual information (ECMI) is used to select correlation parameters for anomaly characteristic assessments, and each parameter interval is divided for performing segmentation fine cleaning which can reduce the model complexity of identifying anomaly characteristics. Finally, a deep learning network which is long short-term memory (LSTM) is used to verify the effectiveness of the proposed data cleaning method. By analyzing the state monitoring results, it is shown the proposed composed method is more effective for cleaning anomy data than other methods.

Suggested Citation

  • Yao, Qingtao & Zhu, Haowei & Xiang, Ling & Su, Hao & Hu, Aijun, 2023. "A novel composed method of cleaning anomy data for improving state prediction of wind turbine," Renewable Energy, Elsevier, vol. 204(C), pages 131-140.
    • Handle: RePEc:eee:renene:v:204:y:2023:i:c:p:131-140
    DOI: 10.1016/j.renene.2022.12.118
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0960148122019140
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.renene.2022.12.118?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kumar Rahul & Rohitash Kumar Banyal, 2021. "Detection and Correction of Abnormal Data with Optimized Dirty Data: A New Data Cleaning Model," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 20(02), pages 809-841, March.
    2. Dai, Juchuan & Yang, Xin & Hu, Wei & Wen, Li & Tan, Yayi, 2018. "Effect investigation of yaw on wind turbine performance based on SCADA data," Energy, Elsevier, vol. 149(C), pages 684-696.
    3. Xiang, Ling & Yang, Xin & Hu, Aijun & Su, Hao & Wang, Penghe, 2022. "Condition monitoring and anomaly detection of wind turbine based on cascaded and bidirectional deep learning networks," Applied Energy, Elsevier, vol. 305(C).
    4. Long, Huan & Xu, Shaohui & Gu, Wei, 2022. "An abnormal wind turbine data cleaning algorithm based on color space conversion and image feature detection," Applied Energy, Elsevier, vol. 311(C).
    5. Mucchielli, P. & Bhowmik, B. & Ghosh, B. & Pakrashi, V., 2021. "Real-time accurate detection of wind turbine downtime - An Irish perspective," Renewable Energy, Elsevier, vol. 179(C), pages 1969-1989.
    6. Wang, Shuai & Li, Bin & Li, Guanzheng & Yao, Bin & Wu, Jianzhong, 2021. "Short-term wind power prediction based on multidimensional data cleaning and feature reconfiguration," Applied Energy, Elsevier, vol. 292(C).
    7. Kong, Ziqian & Tang, Baoping & Deng, Lei & Liu, Wenyi & Han, Yan, 2020. "Condition monitoring of wind turbines based on spatio-temporal fusion of SCADA data by convolutional neural networks and gated recurrent units," Renewable Energy, Elsevier, vol. 146(C), pages 760-768.
    8. Aoyu Hu & Qian Sun & Hao Liu & Ning Zhou & Zhan’ao Tan & Honglu Zhu, 2019. "A Novel Photovoltaic Array Outlier Cleaning Algorithm Based on Sliding Standard Deviation Mutation," Energies, MDPI, vol. 12(22), pages 1-16, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Liang, Guoyuan & Su, Yahao & Wu, Xinyu & Ma, Jiajun & Long, Huan & Song, Zhe, 2023. "Abnormal data cleaning for wind turbines by image segmentation based on active shape model and class uncertainty," Renewable Energy, Elsevier, vol. 216(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chen Zhang & Tao Yang, 2023. "Anomaly Detection for Wind Turbines Using Long Short-Term Memory-Based Variational Autoencoder Wasserstein Generation Adversarial Network under Semi-Supervised Training," Energies, MDPI, vol. 16(19), pages 1-18, October.
    2. Long, Huan & Xu, Shaohui & Gu, Wei, 2022. "An abnormal wind turbine data cleaning algorithm based on color space conversion and image feature detection," Applied Energy, Elsevier, vol. 311(C).
    3. Alan Turnbull & Conor McKinnon & James Carrol & Alasdair McDonald, 2022. "On the Development of Offshore Wind Turbine Technology: An Assessment of Reliability Rates and Fault Detection Methods in a Changing Market," Energies, MDPI, vol. 15(9), pages 1-20, April.
    4. Zhan, Jun & Wu, Chengkun & Yang, Canqun & Miao, Qiucheng & Wang, Shilin & Ma, Xiandong, 2022. "Condition monitoring of wind turbines based on spatial-temporal feature aggregation networks," Renewable Energy, Elsevier, vol. 200(C), pages 751-766.
    5. Arkaitz Rabanal & Alain Ulazia & Gabriel Ibarra-Berastegi & Jon Sáenz & Unai Elosegui, 2018. "MIDAS: A Benchmarking Multi-Criteria Method for the Identification of Defective Anemometers in Wind Farms," Energies, MDPI, vol. 12(1), pages 1-19, December.
    6. Zhou, Yu & Li, Zhengshuo & Wang, Guangrui, 2021. "Study on leveraging wind farms' robust reactive power range for uncertain power system reactive power optimization," Applied Energy, Elsevier, vol. 298(C).
    7. Liu, Hui & Duan, Zhu & Chen, Chao, 2020. "Wind speed big data forecasting using time-variant multi-resolution ensemble model with clustering auto-encoder," Applied Energy, Elsevier, vol. 280(C).
    8. Wang, Anqi & Pei, Yan & Qian, Zheng & Zareipour, Hamidreza & Jing, Bo & An, Jiayi, 2022. "A two-stage anomaly decomposition scheme based on multi-variable correlation extraction for wind turbine fault detection and identification," Applied Energy, Elsevier, vol. 321(C).
    9. Zhu, Yongchao & Zhu, Caichao & Tan, Jianjun & Tan, Yong & Rao, Lei, 2022. "Anomaly detection and condition monitoring of wind turbine gearbox based on LSTM-FS and transfer learning," Renewable Energy, Elsevier, vol. 189(C), pages 90-103.
    10. Wang, Yun & Zou, Runmin & Liu, Fang & Zhang, Lingjun & Liu, Qianyi, 2021. "A review of wind speed and wind power forecasting with deep neural networks," Applied Energy, Elsevier, vol. 304(C).
    11. Manisha Sawant & Rupali Patil & Tanmay Shikhare & Shreyas Nagle & Sakshi Chavan & Shivang Negi & Neeraj Dhanraj Bokde, 2022. "A Selective Review on Recent Advancements in Long, Short and Ultra-Short-Term Wind Power Prediction," Energies, MDPI, vol. 15(21), pages 1-24, October.
    12. Cristian Velandia-Cardenas & Yolanda Vidal & Francesc Pozo, 2021. "Wind Turbine Fault Detection Using Highly Imbalanced Real SCADA Data," Energies, MDPI, vol. 14(6), pages 1-26, March.
    13. Feng, Chenlong & Liu, Chao & Jiang, Dongxiang, 2023. "Unsupervised anomaly detection using graph neural networks integrated with physical-statistical feature fusion and local-global learning," Renewable Energy, Elsevier, vol. 206(C), pages 309-323.
    14. Zhang, Shuangyi & Li, Xichen, 2021. "Future projections of offshore wind energy resources in China using CMIP6 simulations and a deep learning-based downscaling method," Energy, Elsevier, vol. 217(C).
    15. Huifan Zeng & Juchuan Dai & Chengming Zuo & Huanguo Chen & Mimi Li & Fan Zhang, 2022. "Correlation Investigation of Wind Turbine Multiple Operating Parameters Based on SCADA Data," Energies, MDPI, vol. 15(14), pages 1-24, July.
    16. Phong B. Dao, 2023. "On Cointegration Analysis for Condition Monitoring and Fault Detection of Wind Turbines Using SCADA Data," Energies, MDPI, vol. 16(5), pages 1-17, March.
    17. Cai, Wei & Hu, Yang & Fang, Fang & Yao, Lujin & Liu, Jizhen, 2023. "Wind farm power production and fatigue load optimization based on dynamic partitioning and wake redirection of wind turbines," Applied Energy, Elsevier, vol. 339(C).
    18. Jing, Bo & Qian, Zheng & Pei, Yan & Zhang, Lizhong & Yang, Tingyi, 2020. "Improving wind turbine efficiency through detection and calibration of yaw misalignment," Renewable Energy, Elsevier, vol. 160(C), pages 1217-1227.
    19. Zhu, Xiaoxun & Chen, Yao & Xu, Shinai & Zhang, Shaohai & Gao, Xiaoxia & Sun, Haiying & Wang, Yu & Zhao, Fei & Lv, Tiancheng, 2023. "Three-dimensional non-uniform full wake characteristics for yawed wind turbine with LiDAR-based experimental verification," Energy, Elsevier, vol. 270(C).
    20. Xie, Xiangmin & Peng, Fei & Zhang, Yan, 2022. "A data-driven probabilistic harmonic power flow approach in power distribution systems with PV generations," Applied Energy, Elsevier, vol. 321(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:renene:v:204:y:2023:i:c:p:131-140. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/renewable-energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.