IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v374y2024ics0306261924014181.html
   My bibliography  Save this article

Interpretable feature-temporal transformer for short-term wind power forecasting with multivariate time series

Author

Listed:
  • Liu, Lei
  • Wang, Xinyu
  • Dong, Xue
  • Chen, Kang
  • Chen, Qiuju
  • Li, Bin

Abstract

The inherent randomness and volatility of wind power generation present significant challenges to the reliable and secure operation of the power system. Therefore, it is crucial to have interpretable wind power forecasting (WPF) to ensure seamless grid integration and effective risk assessment. Existing forecasting models often focus on improving WPF performance and ignore the interpretability of the model, resulting in ambiguous forecasting. In this paper, the interpretable feature-temporal transformer (IFTT) for short-term wind power forecasting with multivariate time series is presented. The model uses an encoder-decoder architecture to effectively integrate historical information and future prior information from multiple variables. The designed decoupled feature-temporal self-attention (DFTA) module and variable attention network (VAN) effectively realize the interpretability of temporal information and multi-variable inputs while extracting important features. The Auxiliary Forecasting Network (AFN) plays a key role in providing pseudo-future wind speed predictions, which serve as an essential input for the model's decoder, and enhancing forecasting accuracy through multi-task learning. Experimental results on multiple datasets in different geographical locations show that the proposed algorithm is superior to various advanced methods. Besides, the interpretability of the IFTT model offers valuable insights for ensuring the safety of wind power utilization and supporting informed risk decision-making.

Suggested Citation

  • Liu, Lei & Wang, Xinyu & Dong, Xue & Chen, Kang & Chen, Qiuju & Li, Bin, 2024. "Interpretable feature-temporal transformer for short-term wind power forecasting with multivariate time series," Applied Energy, Elsevier, vol. 374(C).
  • Handle: RePEc:eee:appene:v:374:y:2024:i:c:s0306261924014181
    DOI: 10.1016/j.apenergy.2024.124035
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261924014181
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2024.124035?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Xing, Zhikai & He, Yigang, 2023. "Multi-modal multi-step wind power forecasting based on stacking deep learning model," Renewable Energy, Elsevier, vol. 215(C).
    2. Jung, Jaesung & Broadwater, Robert P., 2014. "Current status and future advances for wind speed and power forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 31(C), pages 762-777.
    3. Shi, Jing & Guo, Jinmei & Zheng, Songtao, 2012. "Evaluation of hybrid forecasting approaches for wind speed and power generation time series," Renewable and Sustainable Energy Reviews, Elsevier, vol. 16(5), pages 3471-3480.
    4. Lu, Peng & Ye, Lin & Pei, Ming & Zhao, Yongning & Dai, Binhua & Li, Zhuo, 2022. "Short-term wind power forecasting based on meteorological feature extraction and optimization strategy," Renewable Energy, Elsevier, vol. 184(C), pages 642-661.
    5. Lei, Ma & Shiyan, Luan & Chuanwen, Jiang & Hongling, Liu & Yan, Zhang, 2009. "A review on the forecasting of wind speed and generated power," Renewable and Sustainable Energy Reviews, Elsevier, vol. 13(4), pages 915-920, May.
    6. Salinas, David & Flunkert, Valentin & Gasthaus, Jan & Januschowski, Tim, 2020. "DeepAR: Probabilistic forecasting with autoregressive recurrent networks," International Journal of Forecasting, Elsevier, vol. 36(3), pages 1181-1191.
    7. Zifa Liu & Xinyi Li & Haiyan Zhao, 2023. "Short-Term Wind Power Forecasting Based on Feature Analysis and Error Correction," Energies, MDPI, vol. 16(10), pages 1-24, May.
    8. Liu, Hui & Chen, Chao, 2019. "Data processing strategies in wind energy forecasting models and applications: A comprehensive review," Applied Energy, Elsevier, vol. 249(C), pages 392-408.
    9. Ding, Yunfei & Chen, Zijun & Zhang, Hongwei & Wang, Xin & Guo, Ying, 2022. "A short-term wind power prediction model based on CEEMD and WOA-KELM," Renewable Energy, Elsevier, vol. 189(C), pages 188-198.
    10. Zhao, Jing & Guo, Zhen-Hai & Su, Zhong-Yue & Zhao, Zhi-Yuan & Xiao, Xia & Liu, Feng, 2016. "An improved multi-step forecasting model based on WRF ensembles and creative fuzzy systems for wind speed," Applied Energy, Elsevier, vol. 162(C), pages 808-826.
    11. Wang, Cong & Zhang, Hongli & Ma, Ping, 2020. "Wind power forecasting based on singular spectrum analysis and a new hybrid Laguerre neural network," Applied Energy, Elsevier, vol. 259(C).
    12. Dong, Yingchao & Zhang, Hongli & Wang, Cong & Zhou, Xiaojun, 2021. "A novel hybrid model based on Bernstein polynomial with mixture of Gaussians for wind power forecasting," Applied Energy, Elsevier, vol. 286(C).
    13. Gong, Mingju & Yan, Changcheng & Xu, Wei & Zhao, Zhixuan & Li, Wenxiang & Liu, Yan & Li, Sheng, 2023. "Short-term wind power forecasting model based on temporal convolutional network and Informer," Energy, Elsevier, vol. 283(C).
    14. Liu, Lei & Liu, Jicheng & Ye, Yu & Liu, Hui & Chen, Kun & Li, Dong & Dong, Xue & Sun, Mingzhai, 2023. "Ultra-short-term wind power forecasting based on deep Bayesian model with uncertainty," Renewable Energy, Elsevier, vol. 205(C), pages 598-607.
    15. Wang, Yun & Xu, Houhua & Zou, Runmin & Zhang, Lingjun & Zhang, Fan, 2022. "A deep asymmetric Laplace neural network for deterministic and probabilistic wind power forecasting," Renewable Energy, Elsevier, vol. 196(C), pages 497-517.
    16. Qu, Jiaqi & Qian, Zheng & Pei, Yan, 2021. "Day-ahead hourly photovoltaic power forecasting using attention-based CNN-LSTM neural network embedded with multiple relevant and target variables prediction pattern," Energy, Elsevier, vol. 232(C).
    17. Wu, Huijuan & Meng, Keqilao & Fan, Daoerji & Zhang, Zhanqiang & Liu, Qing, 2022. "Multistep short-term wind speed forecasting using transformer," Energy, Elsevier, vol. 261(PA).
    18. Wang, Gang & Jia, Ru & Liu, Jinhai & Zhang, Huaguang, 2020. "A hybrid wind power forecasting approach based on Bayesian model averaging and ensemble learning," Renewable Energy, Elsevier, vol. 145(C), pages 2426-2434.
    19. Shahid, Farah & Zameer, Aneela & Muneeb, Muhammad, 2021. "A novel genetic LSTM model for wind power forecast," Energy, Elsevier, vol. 223(C).
    20. Kisvari, Adam & Lin, Zi & Liu, Xiaolei, 2021. "Wind power forecasting – A data-driven method along with gated recurrent neural network," Renewable Energy, Elsevier, vol. 163(C), pages 1895-1909.
    21. Hu, Jianming & Heng, Jiani & Wen, Jiemei & Zhao, Weigang, 2020. "Deterministic and probabilistic wind speed forecasting with de-noising-reconstruction strategy and quantile regression based algorithm," Renewable Energy, Elsevier, vol. 162(C), pages 1208-1226.
    22. Niu, Dongxiao & Sun, Lijie & Yu, Min & Wang, Keke, 2022. "Point and interval forecasting of ultra-short-term wind power based on a data-driven method and hybrid deep learning model," Energy, Elsevier, vol. 254(PA).
    23. Lim, Bryan & Arık, Sercan Ö. & Loeff, Nicolas & Pfister, Tomas, 2021. "Temporal Fusion Transformers for interpretable multi-horizon time series forecasting," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1748-1764.
    24. Wang, Yun & Zou, Runmin & Liu, Fang & Zhang, Lingjun & Liu, Qianyi, 2021. "A review of wind speed and wind power forecasting with deep neural networks," Applied Energy, Elsevier, vol. 304(C).
    25. Putz, Dominik & Gumhalter, Michael & Auer, Hans, 2021. "A novel approach to multi-horizon wind power forecasting based on deep neural architecture," Renewable Energy, Elsevier, vol. 178(C), pages 494-505.
    26. Yimei Wang & Yongqian Liu & Li Li & David Infield & Shuang Han, 2018. "Short-Term Wind Power Forecasting Based on Clustering Pre-Calculated CFD Method," Energies, MDPI, vol. 11(4), pages 1-19, April.
    27. Abou Houran, Mohamad & Salman Bukhari, Syed M. & Zafar, Muhammad Hamza & Mansoor, Majad & Chen, Wenjie, 2023. "COA-CNN-LSTM: Coati optimization algorithm-based hybrid deep learning model for PV/wind power forecasting in smart grid applications," Applied Energy, Elsevier, vol. 349(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Yun & Zou, Runmin & Liu, Fang & Zhang, Lingjun & Liu, Qianyi, 2021. "A review of wind speed and wind power forecasting with deep neural networks," Applied Energy, Elsevier, vol. 304(C).
    2. Wang, Yun & Xu, Houhua & Zou, Runmin & Zhang, Lingjun & Zhang, Fan, 2022. "A deep asymmetric Laplace neural network for deterministic and probabilistic wind power forecasting," Renewable Energy, Elsevier, vol. 196(C), pages 497-517.
    3. Wu, Binrong & Wang, Lin & Zeng, Yu-Rong, 2022. "Interpretable wind speed prediction with multivariate time series and temporal fusion transformers," Energy, Elsevier, vol. 252(C).
    4. Lv, Sheng-Xiang & Wang, Lin, 2023. "Multivariate wind speed forecasting based on multi-objective feature selection approach and hybrid deep learning model," Energy, Elsevier, vol. 263(PE).
    5. Chen, Yuejiang & He, Yingjing & Xiao, Jiang-Wen & Wang, Yan-Wu & Li, Yuanzheng, 2024. "Hybrid model based on similar power extraction and improved temporal convolutional network for probabilistic wind power forecasting," Energy, Elsevier, vol. 304(C).
    6. Wu, Binrong & Yu, Sihao & Peng, Lu & Wang, Lin, 2024. "Interpretable wind speed forecasting with meteorological feature exploring and two-stage decomposition," Energy, Elsevier, vol. 294(C).
    7. Wang, Yun & Xu, Houhua & Zou, Runmin & Zhang, Fan & Hu, Qinghua, 2024. "Dynamic non-constraint ensemble model for probabilistic wind power and wind speed forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 204(C).
    8. Ma, Zhengjing & Mei, Gang, 2022. "A hybrid attention-based deep learning approach for wind power prediction," Applied Energy, Elsevier, vol. 323(C).
    9. Niu, Dongxiao & Sun, Lijie & Yu, Min & Wang, Keke, 2022. "Point and interval forecasting of ultra-short-term wind power based on a data-driven method and hybrid deep learning model," Energy, Elsevier, vol. 254(PA).
    10. Sun, Shaolong & Du, Zongjuan & Jin, Kun & Li, Hongtao & Wang, Shouyang, 2023. "Spatiotemporal wind power forecasting approach based on multi-factor extraction method and an indirect strategy," Applied Energy, Elsevier, vol. 350(C).
    11. Wang, Xiaodi & Hao, Yan & Yang, Wendong, 2024. "Novel wind power ensemble forecasting system based on mixed-frequency modeling and interpretable base model selection strategy," Energy, Elsevier, vol. 297(C).
    12. Zheng, Xidong & Bai, Feifei & Zeng, Ziyang & Jin, Tao, 2024. "A new methodology to improve wind power prediction accuracy considering power quality disturbance dimension reduction and elimination," Energy, Elsevier, vol. 287(C).
    13. Hu, Yue & Liu, Hanjing & Wu, Senzhen & Zhao, Yuan & Wang, Zhijin & Liu, Xiufeng, 2024. "Temporal collaborative attention for wind power forecasting," Applied Energy, Elsevier, vol. 357(C).
    14. Wang, Yun & Chen, Tuo & Zou, Runmin & Song, Dongran & Zhang, Fan & Zhang, Lingjun, 2022. "Ensemble probabilistic wind power forecasting with multi-scale features," Renewable Energy, Elsevier, vol. 201(P1), pages 734-751.
    15. Wu, Binrong & Wang, Lin, 2024. "Two-stage decomposition and temporal fusion transformers for interpretable wind speed forecasting," Energy, Elsevier, vol. 288(C).
    16. Karijadi, Irene & Chou, Shuo-Yan & Dewabharata, Anindhita, 2023. "Wind power forecasting based on hybrid CEEMDAN-EWT deep learning method," Renewable Energy, Elsevier, vol. 218(C).
    17. Wang, Yun & Xu, Houhua & Song, Mengmeng & Zhang, Fan & Li, Yifen & Zhou, Shengchao & Zhang, Lingjun, 2023. "A convolutional Transformer-based truncated Gaussian density network with data denoising for wind speed forecasting," Applied Energy, Elsevier, vol. 333(C).
    18. Bentsen, Lars Ødegaard & Warakagoda, Narada Dilp & Stenbro, Roy & Engelstad, Paal, 2023. "Spatio-temporal wind speed forecasting using graph networks and novel Transformer architectures," Applied Energy, Elsevier, vol. 333(C).
    19. Jafarzadeh Ghoushchi, Saeid & Manjili, Sobhan & Mardani, Abbas & Saraji, Mahyar Kamali, 2021. "An extended new approach for forecasting short-term wind power using modified fuzzy wavelet neural network: A case study in wind power plant," Energy, Elsevier, vol. 223(C).
    20. Zifa Liu & Xinyi Li & Haiyan Zhao, 2023. "Short-Term Wind Power Forecasting Based on Feature Analysis and Error Correction," Energies, MDPI, vol. 16(10), pages 1-24, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:374:y:2024:i:c:s0306261924014181. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.