IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v252y2022ics0360544222008933.html
   My bibliography  Save this article

Interpretable wind speed prediction with multivariate time series and temporal fusion transformers

Author

Listed:
  • Wu, Binrong
  • Wang, Lin
  • Zeng, Yu-Rong

Abstract

Wind power has been utilized well in power systems, so steady and successful wind speed forecasting is crucial to security management power grid market economy. To date, most researchers have often discounted the interpretability of prediction models, leading to obscure forecasts. This study puts forward a unique forecasting methodology that incorporates notable decomposition techniques, multifactor interpretable forecasting models, and optimization algorithms. In the proposed model, variational mode decomposition is employed to break down the raw wind speed sequence into a set of intrinsic mode functions. Adaptive differential evolution is then used for optimizing several parameters of temporal fusion transformers (TFT) to achieve satisfactory forecasting performance. TFT is a new attention-based deep learning model that puts together high-performance multi-horizon prediction and interpretable insights into temporal dynamics. Empirical studies using eight real-world 1-h wind speed data sets in Albert, Canada, and Five Points, USA demonstrate that the system using the proposed model outperforms those employing other comparable models in nearly all performance metrics. Examples of TFT's interpretable outputs are the importance ranking of the decomposed wind speed sub-sequences and meteorological data and attention analysis of different step lengths. The findings signify substantial progress for wind speed prediction and aid policymakers.

Suggested Citation

  • Wu, Binrong & Wang, Lin & Zeng, Yu-Rong, 2022. "Interpretable wind speed prediction with multivariate time series and temporal fusion transformers," Energy, Elsevier, vol. 252(C).
  • Handle: RePEc:eee:energy:v:252:y:2022:i:c:s0360544222008933
    DOI: 10.1016/j.energy.2022.123990
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544222008933
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2022.123990?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Liu, Hui & Chen, Chao, 2019. "Multi-objective data-ensemble wind speed forecasting model with stacked sparse autoencoder and adaptive decomposition-based error correction," Applied Energy, Elsevier, vol. 254(C).
    2. Zhang, Jinliang & Tan, Zhongfu & Wei, Yiming, 2020. "An adaptive hybrid model for short term electricity price forecasting," Applied Energy, Elsevier, vol. 258(C).
    3. Jung, Jaesung & Broadwater, Robert P., 2014. "Current status and future advances for wind speed and power forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 31(C), pages 762-777.
    4. Shi, Jing & Guo, Jinmei & Zheng, Songtao, 2012. "Evaluation of hybrid forecasting approaches for wind speed and power generation time series," Renewable and Sustainable Energy Reviews, Elsevier, vol. 16(5), pages 3471-3480.
    5. Moreno, Sinvaldo Rodrigues & dos Santos Coelho, Leandro, 2018. "Wind speed forecasting approach based on Singular Spectrum Analysis and Adaptive Neuro Fuzzy Inference System," Renewable Energy, Elsevier, vol. 126(C), pages 736-754.
    6. Dong, Yunxuan & Wang, Jing & Xiao, Ling & Fu, Tonglin, 2021. "Short-term wind speed time series forecasting based on a hybrid method with multiple objective optimization for non-convex target," Energy, Elsevier, vol. 215(PB).
    7. Kavasseri, Rajesh G. & Seetharaman, Krithika, 2009. "Day-ahead wind speed forecasting using f-ARIMA models," Renewable Energy, Elsevier, vol. 34(5), pages 1388-1393.
    8. Zhao, Weigang & Wei, Yi-Ming & Su, Zhongyue, 2016. "One day ahead wind speed forecasting: A resampling-based approach," Applied Energy, Elsevier, vol. 178(C), pages 886-901.
    9. Qu, Zongxi & Mao, Wenqian & Zhang, Kequan & Zhang, Wenyu & Li, Zhipeng, 2019. "Multi-step wind speed forecasting based on a hybrid decomposition technique and an improved back-propagation neural network," Renewable Energy, Elsevier, vol. 133(C), pages 919-929.
    10. Jiang, Ping & Liu, Zhenkun & Niu, Xinsong & Zhang, Lifang, 2021. "A combined forecasting system based on statistical method, artificial neural networks, and deep learning methods for short-term wind speed forecasting," Energy, Elsevier, vol. 217(C).
    11. Hu, Jianming & Heng, Jiani & Wen, Jiemei & Zhao, Weigang, 2020. "Deterministic and probabilistic wind speed forecasting with de-noising-reconstruction strategy and quantile regression based algorithm," Renewable Energy, Elsevier, vol. 162(C), pages 1208-1226.
    12. Wang, Yun & Zou, Runmin & Liu, Fang & Zhang, Lingjun & Liu, Qianyi, 2021. "A review of wind speed and wind power forecasting with deep neural networks," Applied Energy, Elsevier, vol. 304(C).
    13. Hoolohan, Victoria & Tomlin, Alison S. & Cockerill, Timothy, 2018. "Improved near surface wind speed predictions using Gaussian process regression combined with numerical weather predictions and observed meteorological data," Renewable Energy, Elsevier, vol. 126(C), pages 1043-1054.
    14. Liu, Xiaolei & Lin, Zi & Feng, Ziming, 2021. "Short-term offshore wind speed forecast by seasonal ARIMA - A comparison against GRU and LSTM," Energy, Elsevier, vol. 227(C).
    15. Cassola, Federico & Burlando, Massimiliano, 2012. "Wind speed and wind energy forecast through Kalman filtering of Numerical Weather Prediction model output," Applied Energy, Elsevier, vol. 99(C), pages 154-166.
    16. Neshat, Mehdi & Nezhad, Meysam Majidi & Abbasnejad, Ehsan & Mirjalili, Seyedali & Groppi, Daniele & Heydari, Azim & Tjernberg, Lina Bertling & Astiaso Garcia, Davide & Alexander, Bradley & Shi, Qinfen, 2021. "Wind turbine power output prediction using a new hybrid neuro-evolutionary method," Energy, Elsevier, vol. 229(C).
    17. Song, Jingjing & Wang, Jianzhou & Lu, Haiyan, 2018. "A novel combined model based on advanced optimization algorithm for short-term wind speed forecasting," Applied Energy, Elsevier, vol. 215(C), pages 643-658.
    18. Lv, Sheng-Xiang & Wang, Lin, 2022. "Deep learning combined wind speed forecasting with hybrid time series decomposition and multi-objective parameter optimization," Applied Energy, Elsevier, vol. 311(C).
    19. Lim, Bryan & Arık, Sercan Ö. & Loeff, Nicolas & Pfister, Tomas, 2021. "Temporal Fusion Transformers for interpretable multi-horizon time series forecasting," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1748-1764.
    20. Liu, Hui & Tian, Hong-qi & Pan, Di-fu & Li, Yan-fei, 2013. "Forecasting models for wind speed using wavelet, wavelet packet, time series and Artificial Neural Networks," Applied Energy, Elsevier, vol. 107(C), pages 191-208.
    21. Emeksiz, Cem & Tan, Mustafa, 2022. "Multi-step wind speed forecasting and Hurst analysis using novel hybrid secondary decomposition approach," Energy, Elsevier, vol. 238(PA).
    22. Wang, Han & Han, Shuang & Liu, Yongqian & Yan, Jie & Li, Li, 2019. "Sequence transfer correction algorithm for numerical weather prediction wind speed and its application in a wind power forecasting system," Applied Energy, Elsevier, vol. 237(C), pages 1-10.
    23. Hu, Huanling & Wang, Lin & Lv, Sheng-Xiang, 2020. "Forecasting energy consumption and wind power generation using deep echo state network," Renewable Energy, Elsevier, vol. 154(C), pages 598-613.
    24. Liu, Hui & Chen, Chao, 2019. "Data processing strategies in wind energy forecasting models and applications: A comprehensive review," Applied Energy, Elsevier, vol. 249(C), pages 392-408.
    25. Wu, Binrong & Wang, Lin & Wang, Sirui & Zeng, Yu-Rong, 2021. "Forecasting the U.S. oil markets based on social media information during the COVID-19 pandemic," Energy, Elsevier, vol. 226(C).
    26. Shang, Zhihao & He, Zhaoshuang & Chen, Yao & Chen, Yanhua & Xu, MingLiang, 2022. "Short-term wind speed forecasting system based on multivariate time series and multi-objective optimization," Energy, Elsevier, vol. 238(PC).
    27. Zhang, Jinliang & Wei, Yiming & Tan, Zhongfu, 2020. "An adaptive hybrid model for short term wind speed forecasting," Energy, Elsevier, vol. 190(C).
    28. Ait Maatallah, Othman & Achuthan, Ajit & Janoyan, Kerop & Marzocca, Pier, 2015. "Recursive wind speed forecasting based on Hammerstein Auto-Regressive model," Applied Energy, Elsevier, vol. 145(C), pages 191-197.
    29. Wang, Jianzhou & Wang, Shiqi & Yang, Wendong, 2019. "A novel non-linear combination system for short-term wind speed forecast," Renewable Energy, Elsevier, vol. 143(C), pages 1172-1192.
    30. Tascikaraoglu, Akin & Sanandaji, Borhan M. & Poolla, Kameshwar & Varaiya, Pravin, 2016. "Exploiting sparsity of interconnections in spatio-temporal wind speed forecasting using Wavelet Transform," Applied Energy, Elsevier, vol. 165(C), pages 735-747.
    31. Khaloie, Hooman & Abdollahi, Amir & Shafie-khah, Miadreza & Anvari-Moghaddam, Amjad & Nojavan, Sayyad & Siano, Pierluigi & Catalão, João P.S., 2020. "Coordinated wind-thermal-energy storage offering strategy in energy and spinning reserve markets using a multi-stage model," Applied Energy, Elsevier, vol. 259(C).
    32. Wu, Jie & Li, Na & Zhao, Yan & Wang, Jujie, 2022. "Usage of correlation analysis and hypothesis test in optimizing the gated recurrent unit network for wind speed forecasting," Energy, Elsevier, vol. 242(C).
    33. Zhang, Shuai & Chen, Yong & Xiao, Jiuhong & Zhang, Wenyu & Feng, Ruijun, 2021. "Hybrid wind speed forecasting model based on multivariate data secondary decomposition approach and deep learning algorithm with attention mechanism," Renewable Energy, Elsevier, vol. 174(C), pages 688-704.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bentsen, Lars Ødegaard & Warakagoda, Narada Dilp & Stenbro, Roy & Engelstad, Paal, 2023. "Spatio-temporal wind speed forecasting using graph networks and novel Transformer architectures," Applied Energy, Elsevier, vol. 333(C).
    2. Nascimento, Erick Giovani Sperandio & de Melo, Talison A.C. & Moreira, Davidson M., 2023. "A transformer-based deep neural network with wavelet transform for forecasting wind speed and wind energy," Energy, Elsevier, vol. 278(C).
    3. Katarzyna Rudnik & Anna Hnydiuk-Stefan & Aneta Kucińska-Landwójtowicz & Łukasz Mach, 2022. "Forecasting Day-Ahead Carbon Price by Modelling Its Determinants Using the PCA-Based Approach," Energies, MDPI, vol. 15(21), pages 1-23, October.
    4. Liu, Chenyu & Zhang, Xuemin & Mei, Shengwei & Zhou, Qingyu & Fan, Hang, 2023. "Series-wise attention network for wind power forecasting considering temporal lag of numerical weather prediction," Applied Energy, Elsevier, vol. 336(C).
    5. Shengxiang Lv & Lin Wang & Sirui Wang, 2023. "A Hybrid Neural Network Model for Short-Term Wind Speed Forecasting," Energies, MDPI, vol. 16(4), pages 1-18, February.
    6. Lv, Sheng-Xiang & Wang, Lin, 2023. "Multivariate wind speed forecasting based on multi-objective feature selection approach and hybrid deep learning model," Energy, Elsevier, vol. 263(PE).
    7. Konstantinos Blazakis & Yiannis Katsigiannis & Georgios Stavrakakis, 2022. "One-Day-Ahead Solar Irradiation and Windspeed Forecasting with Advanced Deep Learning Techniques," Energies, MDPI, vol. 15(12), pages 1-25, June.
    8. Ahmad Zia Ul-Saufie & Nurul Haziqah Hamzan & Zulaika Zahari & Wan Nur Shaziayani & Norazian Mohamad Noor & Mohd Remy Rozainy Mohd Arif Zainol & Andrei Victor Sandu & Gyorgy Deak & Petrica Vizureanu, 2022. "Improving Air Pollution Prediction Modelling Using Wrapper Feature Selection," Sustainability, MDPI, vol. 14(18), pages 1-16, September.
    9. Athanasios Ioannis Arvanitidis & Dimitrios Bargiotas & Dimitrios Kontogiannis & Athanasios Fevgas & Miltiadis Alamaniotis, 2022. "Optimized Data-Driven Models for Short-Term Electricity Price Forecasting Based on Signal Decomposition and Clustering Techniques," Energies, MDPI, vol. 15(21), pages 1-24, October.
    10. Li, Yang & Shen, Xiaojun & Zhou, Chongcheng, 2023. "Dynamic multi-turbines spatiotemporal correlation model enabled digital twin technology for real-time wind speed prediction," Renewable Energy, Elsevier, vol. 203(C), pages 841-853.
    11. Miguel López Santos & Xela García-Santiago & Fernando Echevarría Camarero & Gonzalo Blázquez Gil & Pablo Carrasco Ortega, 2022. "Application of Temporal Fusion Transformer for Day-Ahead PV Power Forecasting," Energies, MDPI, vol. 15(14), pages 1-22, July.
    12. Wuyue An & Lin Wang & Dongfeng Zhang, 2023. "Comprehensive commodity price forecasting framework using text mining methods," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(7), pages 1865-1888, November.
    13. Fatma Mazen Ali Mazen & Yomna Shaker & Rania Ahmed Abul Seoud, 2023. "Forecasting of Solar Power Using GRU–Temporal Fusion Transformer Model and DILATE Loss Function," Energies, MDPI, vol. 16(24), pages 1-24, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Yun & Zou, Runmin & Liu, Fang & Zhang, Lingjun & Liu, Qianyi, 2021. "A review of wind speed and wind power forecasting with deep neural networks," Applied Energy, Elsevier, vol. 304(C).
    2. Lv, Sheng-Xiang & Wang, Lin, 2022. "Deep learning combined wind speed forecasting with hybrid time series decomposition and multi-objective parameter optimization," Applied Energy, Elsevier, vol. 311(C).
    3. Wang, Yun & Xu, Houhua & Song, Mengmeng & Zhang, Fan & Li, Yifen & Zhou, Shengchao & Zhang, Lingjun, 2023. "A convolutional Transformer-based truncated Gaussian density network with data denoising for wind speed forecasting," Applied Energy, Elsevier, vol. 333(C).
    4. Wang, Yun & Xu, Houhua & Zou, Runmin & Zhang, Lingjun & Zhang, Fan, 2022. "A deep asymmetric Laplace neural network for deterministic and probabilistic wind power forecasting," Renewable Energy, Elsevier, vol. 196(C), pages 497-517.
    5. Zhang, Shuai & Chen, Yong & Xiao, Jiuhong & Zhang, Wenyu & Feng, Ruijun, 2021. "Hybrid wind speed forecasting model based on multivariate data secondary decomposition approach and deep learning algorithm with attention mechanism," Renewable Energy, Elsevier, vol. 174(C), pages 688-704.
    6. Li, Dan & Jiang, Fuxin & Chen, Min & Qian, Tao, 2022. "Multi-step-ahead wind speed forecasting based on a hybrid decomposition method and temporal convolutional networks," Energy, Elsevier, vol. 238(PC).
    7. Hu, Huanling & Wang, Lin & Tao, Rui, 2021. "Wind speed forecasting based on variational mode decomposition and improved echo state network," Renewable Energy, Elsevier, vol. 164(C), pages 729-751.
    8. Song, Jingjing & Wang, Jianzhou & Lu, Haiyan, 2018. "A novel combined model based on advanced optimization algorithm for short-term wind speed forecasting," Applied Energy, Elsevier, vol. 215(C), pages 643-658.
    9. Liu, Xingdou & Zhang, Li & Wang, Jiangong & Zhou, Yue & Gan, Wei, 2023. "A unified multi-step wind speed forecasting framework based on numerical weather prediction grids and wind farm monitoring data," Renewable Energy, Elsevier, vol. 211(C), pages 948-963.
    10. Costa, Marcelo Azevedo & Ruiz-Cárdenas, Ramiro & Mineti, Leandro Brioschi & Prates, Marcos Oliveira, 2021. "Dynamic time scan forecasting for multi-step wind speed prediction," Renewable Energy, Elsevier, vol. 177(C), pages 584-595.
    11. Lv, Sheng-Xiang & Wang, Lin, 2023. "Multivariate wind speed forecasting based on multi-objective feature selection approach and hybrid deep learning model," Energy, Elsevier, vol. 263(PE).
    12. Zhao, Xinyu & Bai, Mingliang & Yang, Xusheng & Liu, Jinfu & Yu, Daren & Chang, Juntao, 2021. "Short-term probabilistic predictions of wind multi-parameter based on one-dimensional convolutional neural network with attention mechanism and multivariate copula distribution estimation," Energy, Elsevier, vol. 234(C).
    13. Wang, Yun & Chen, Tuo & Zou, Runmin & Song, Dongran & Zhang, Fan & Zhang, Lingjun, 2022. "Ensemble probabilistic wind power forecasting with multi-scale features," Renewable Energy, Elsevier, vol. 201(P1), pages 734-751.
    14. Lu, Peng & Ye, Lin & Zhao, Yongning & Dai, Binhua & Pei, Ming & Tang, Yong, 2021. "Review of meta-heuristic algorithms for wind power prediction: Methodologies, applications and challenges," Applied Energy, Elsevier, vol. 301(C).
    15. Liang, Tao & Chai, Chunjie & Sun, Hexu & Tan, Jianxin, 2022. "Wind speed prediction based on multi-variable Capsnet-BILSTM-MOHHO for WPCCC," Energy, Elsevier, vol. 250(C).
    16. Shang, Zhihao & He, Zhaoshuang & Chen, Yao & Chen, Yanhua & Xu, MingLiang, 2022. "Short-term wind speed forecasting system based on multivariate time series and multi-objective optimization," Energy, Elsevier, vol. 238(PC).
    17. Zhao, Weigang & Wei, Yi-Ming & Su, Zhongyue, 2016. "One day ahead wind speed forecasting: A resampling-based approach," Applied Energy, Elsevier, vol. 178(C), pages 886-901.
    18. Ma, Zhengjing & Mei, Gang, 2022. "A hybrid attention-based deep learning approach for wind power prediction," Applied Energy, Elsevier, vol. 323(C).
    19. Yang, Rui & Liu, Hui & Nikitas, Nikolaos & Duan, Zhu & Li, Yanfei & Li, Ye, 2022. "Short-term wind speed forecasting using deep reinforcement learning with improved multiple error correction approach," Energy, Elsevier, vol. 239(PB).
    20. Hu, Huanling & Wang, Lin & Zhang, Dabin & Ling, Liwen, 2023. "Rolling decomposition method in fusion with echo state network for wind speed forecasting," Renewable Energy, Elsevier, vol. 216(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:252:y:2022:i:c:s0360544222008933. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.