IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v278y2023ipas0360544223012598.html
   My bibliography  Save this article

Multi-head attention-based probabilistic CNN-BiLSTM for day-ahead wind speed forecasting

Author

Listed:
  • Zhang, Yi-Ming
  • Wang, Hao

Abstract

Wind energy is one of the most widely used and fastest-growing renewable energy. Wind speed prediction is an efficient way to rationally dispatch wind power generation and ensure the stability of the power system. Typical deep learning algorithms, such as the convolution neural network (CNN), long short-term memory (LSTM), and their hybrid model (CNN-LSTM), have been extensively used for time-series prediction in various fields. The CNN-LSTM model exhibits superior forecasting performance by integrating the advantages of CNN and LSTM, but it fails to quantify the forecasting uncertainty that is critical for optimal management. This study proposes a probabilistic model to forecast day-ahead wind speed based on the CNN-bidirectional LSTM (BiLSTM) and deep ensemble strategy. Unlike purely statistical methods, the hybrid physical-statistical model that combines the numerical weather prediction (NWP) model and onsite measurements is employed to improve long-term forecasting accuracy. Specifically, the probabilistic CNN-BiLSTM model is developed by adjusting the network structure, and the uncertainty is optimized through a proper scoring rule. A combination of ensembles is then used to improve the robustness of probabilistic prediction. The spatial and temporal correlations of NWP data are both considered. The new probabilistic model is applied to forecast wind speed in measurements collected from the outdoor competition venues in the 2022 Winter Olympics. Nine probabilistic benchmark methods are used to compare the performance of the proposed deep ensemble model. The results indicate that the proposed model exhibits the highest forecasting accuracy and the best ability in uncertainty estimation.

Suggested Citation

  • Zhang, Yi-Ming & Wang, Hao, 2023. "Multi-head attention-based probabilistic CNN-BiLSTM for day-ahead wind speed forecasting," Energy, Elsevier, vol. 278(PA).
  • Handle: RePEc:eee:energy:v:278:y:2023:i:pa:s0360544223012598
    DOI: 10.1016/j.energy.2023.127865
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544223012598
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2023.127865?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Hu, Jianming & Wang, Jianzhou, 2015. "Short-term wind speed prediction using empirical wavelet transform and Gaussian process regression," Energy, Elsevier, vol. 93(P2), pages 1456-1466.
    2. Al-Yahyai, Sultan & Charabi, Yassine & Gastli, Adel, 2010. "Review of the use of Numerical Weather Prediction (NWP) Models for wind energy assessment," Renewable and Sustainable Energy Reviews, Elsevier, vol. 14(9), pages 3192-3198, December.
    3. Kim, Tae-Young & Cho, Sung-Bae, 2019. "Predicting residential energy consumption using CNN-LSTM neural networks," Energy, Elsevier, vol. 182(C), pages 72-81.
    4. Lopes, Francis M. & Conceição, Ricardo & Silva, Hugo G. & Salgado, Rui & Collares-Pereira, Manuel, 2021. "Improved ECMWF forecasts of direct normal irradiance: A tool for better operational strategies in concentrating solar power plants," Renewable Energy, Elsevier, vol. 163(C), pages 755-771.
    5. Hoolohan, Victoria & Tomlin, Alison S. & Cockerill, Timothy, 2018. "Improved near surface wind speed predictions using Gaussian process regression combined with numerical weather predictions and observed meteorological data," Renewable Energy, Elsevier, vol. 126(C), pages 1043-1054.
    6. Liu, Xiaolei & Lin, Zi & Feng, Ziming, 2021. "Short-term offshore wind speed forecast by seasonal ARIMA - A comparison against GRU and LSTM," Energy, Elsevier, vol. 227(C).
    7. Cassola, Federico & Burlando, Massimiliano, 2012. "Wind speed and wind energy forecast through Kalman filtering of Numerical Weather Prediction model output," Applied Energy, Elsevier, vol. 99(C), pages 154-166.
    8. Dokur, Emrah & Erdogan, Nuh & Salari, Mahdi Ebrahimi & Karakuzu, Cihan & Murphy, Jimmy, 2022. "Offshore wind speed short-term forecasting based on a hybrid method: Swarm decomposition and meta-extreme learning machine," Energy, Elsevier, vol. 248(C).
    9. Yu, Enbo & Xu, Guoji & Han, Yan & Li, Yongle, 2022. "An efficient short-term wind speed prediction model based on cross-channel data integration and attention mechanisms," Energy, Elsevier, vol. 256(C).
    10. Liu, Guanjun & Qin, Hui & Shen, Qin & Lyv, Hao & Qu, Yuhua & Fu, Jialong & Liu, Yongqi & Zhou, Jianzhong, 2021. "Probabilistic spatiotemporal solar irradiation forecasting using deep ensembles convolutional shared weight long short-term memory network," Applied Energy, Elsevier, vol. 300(C).
    11. Ahmad, Tanveer & Zhang, Dongdong, 2022. "A data-driven deep sequence-to-sequence long-short memory method along with a gated recurrent neural network for wind power forecasting," Energy, Elsevier, vol. 239(PB).
    12. Liu, Yongqi & Qin, Hui & Zhang, Zhendong & Pei, Shaoqian & Jiang, Zhiqiang & Feng, Zhongkai & Zhou, Jianzhong, 2020. "Probabilistic spatiotemporal wind speed forecasting based on a variational Bayesian deep learning model," Applied Energy, Elsevier, vol. 260(C).
    13. Kim, Gyeongmin & Hur, Jin, 2021. "Probabilistic modeling of wind energy potential for power grid expansion planning," Energy, Elsevier, vol. 230(C).
    14. Zhang, Yu & Li, Yanting & Zhang, Guangyao, 2020. "Short-term wind power forecasting approach based on Seq2Seq model using NWP data," Energy, Elsevier, vol. 213(C).
    15. Liu, Hui & Yu, Chengqing & Wu, Haiping & Duan, Zhu & Yan, Guangxi, 2020. "A new hybrid ensemble deep reinforcement learning model for wind speed short term forecasting," Energy, Elsevier, vol. 202(C).
    16. Feng, Cong & Cui, Mingjian & Hodge, Bri-Mathias & Zhang, Jie, 2017. "A data-driven multi-model methodology with deep feature selection for short-term wind forecasting," Applied Energy, Elsevier, vol. 190(C), pages 1245-1257.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Yun & Zou, Runmin & Liu, Fang & Zhang, Lingjun & Liu, Qianyi, 2021. "A review of wind speed and wind power forecasting with deep neural networks," Applied Energy, Elsevier, vol. 304(C).
    2. Lv, Sheng-Xiang & Wang, Lin, 2022. "Deep learning combined wind speed forecasting with hybrid time series decomposition and multi-objective parameter optimization," Applied Energy, Elsevier, vol. 311(C).
    3. Cai, Haoshu & Jia, Xiaodong & Feng, Jianshe & Yang, Qibo & Li, Wenzhe & Li, Fei & Lee, Jay, 2021. "A unified Bayesian filtering framework for multi-horizon wind speed prediction with improved accuracy," Renewable Energy, Elsevier, vol. 178(C), pages 709-719.
    4. Bashir, Hassan & Sibtain, Muhammad & Hanay, Özge & Azam, Muhammad Imran & Qurat-ul-Ain, & Saleem, Snoober, 2023. "Decomposition and Harris hawks optimized multivariate wind speed forecasting utilizing sequence2sequence-based spatiotemporal attention," Energy, Elsevier, vol. 278(PB).
    5. Zhao, Jing & Guo, Zhenhai & Guo, Yanling & Lin, Wantao & Zhu, Wenjin, 2021. "A self-organizing forecast of day-ahead wind speed: Selective ensemble strategy based on numerical weather predictions," Energy, Elsevier, vol. 218(C).
    6. Yang, Yang & Lang, Jin & Wu, Jian & Zhang, Yanyan & Su, Lijie & Song, Xiangman, 2022. "Wind speed forecasting with correlation network pruning and augmentation: A two-phase deep learning method," Renewable Energy, Elsevier, vol. 198(C), pages 267-282.
    7. Liu, Guanjun & Wang, Yun & Qin, Hui & Shen, Keyan & Liu, Shuai & Shen, Qin & Qu, Yuhua & Zhou, Jianzhong, 2023. "Probabilistic spatiotemporal forecasting of wind speed based on multi-network deep ensembles method," Renewable Energy, Elsevier, vol. 209(C), pages 231-247.
    8. Dai, Xiaoran & Liu, Guo-Ping & Hu, Wenshan, 2023. "An online-learning-enabled self-attention-based model for ultra-short-term wind power forecasting," Energy, Elsevier, vol. 272(C).
    9. Li, Yang & Wang, Ruinong & Li, Yuanzheng & Zhang, Meng & Long, Chao, 2023. "Wind power forecasting considering data privacy protection: A federated deep reinforcement learning approach," Applied Energy, Elsevier, vol. 329(C).
    10. Wu, Binrong & Wang, Lin & Zeng, Yu-Rong, 2022. "Interpretable wind speed prediction with multivariate time series and temporal fusion transformers," Energy, Elsevier, vol. 252(C).
    11. Han, Yan & Mi, Lihua & Shen, Lian & Cai, C.S. & Liu, Yuchen & Li, Kai & Xu, Guoji, 2022. "A short-term wind speed prediction method utilizing novel hybrid deep learning algorithms to correct numerical weather forecasting," Applied Energy, Elsevier, vol. 312(C).
    12. Ma, Zhengjing & Mei, Gang, 2022. "A hybrid attention-based deep learning approach for wind power prediction," Applied Energy, Elsevier, vol. 323(C).
    13. Fang, Ping & Fu, Wenlong & Wang, Kai & Xiong, Dongzhen & Zhang, Kai, 2022. "A compositive architecture coupling outlier correction, EWT, nonlinear Volterra multi-model fusion with multi-objective optimization for short-term wind speed forecasting," Applied Energy, Elsevier, vol. 307(C).
    14. Liang, Tao & Zhao, Qing & Lv, Qingzhao & Sun, Hexu, 2021. "A novel wind speed prediction strategy based on Bi-LSTM, MOOFADA and transfer learning for centralized control centers," Energy, Elsevier, vol. 230(C).
    15. Liu, Xingdou & Zhang, Li & Wang, Jiangong & Zhou, Yue & Gan, Wei, 2023. "A unified multi-step wind speed forecasting framework based on numerical weather prediction grids and wind farm monitoring data," Renewable Energy, Elsevier, vol. 211(C), pages 948-963.
    16. Acikgoz, Hakan & Budak, Umit & Korkmaz, Deniz & Yildiz, Ceyhun, 2021. "WSFNet: An efficient wind speed forecasting model using channel attention-based densely connected convolutional neural network," Energy, Elsevier, vol. 233(C).
    17. Shengxiang Lv & Lin Wang & Sirui Wang, 2023. "A Hybrid Neural Network Model for Short-Term Wind Speed Forecasting," Energies, MDPI, vol. 16(4), pages 1-18, February.
    18. Zhang, Lifang & Wang, Jianzhou & Niu, Xinsong & Liu, Zhenkun, 2021. "Ensemble wind speed forecasting with multi-objective Archimedes optimization algorithm and sub-model selection," Applied Energy, Elsevier, vol. 301(C).
    19. Sareen, Karan & Panigrahi, Bijaya Ketan & Shikhola, Tushar & Sharma, Rajneesh, 2023. "An imputation and decomposition algorithms based integrated approach with bidirectional LSTM neural network for wind speed prediction," Energy, Elsevier, vol. 278(C).
    20. Zhang, Yagang & Zhang, Jinghui & Yu, Leyi & Pan, Zhiya & Feng, Changyou & Sun, Yiqian & Wang, Fei, 2022. "A short-term wind energy hybrid optimal prediction system with denoising and novel error correction technique," Energy, Elsevier, vol. 254(PC).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:278:y:2023:i:pa:s0360544223012598. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.