IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v288y2024ics036054422303147x.html
   My bibliography  Save this article

High and low frequency wind power prediction based on Transformer and BiGRU-Attention

Author

Listed:
  • Wang, Shuangxin
  • Shi, Jiarong
  • Yang, Wei
  • Yin, Qingyan

Abstract

An accurate and reliable wind power prediction model has important significance for the operation of power systems and large-scale grid connection. This paper proposes a hybrid deep learning model, CEEMDAN-SE-TR-BiGRU-Attention, for high and low frequency wind power prediction by combining complete ensemble empirical mode decomposition with adaptive noise (CEEMDAN), sample entropy (SE), Transformer (TR) and bidirectional gated recurrent unit with attention mechanism (BiGRU-Attention). Firstly, the CEEMDAN decomposes the original wind power sequence into multiple sub-modes and a residual, and the sample entropy of each sub-sequence is calculated by restructuring the sequence, which can effectively alleviate the impact of the original non-stationary series on the accuracy and computational complexity. Next, the reconstructed sequences are further divided into high and low frequency sequences according to the sample entropy value of the original sequence. The Transformer and BiGRU-Attention models are respectively applied to the prediction of high frequency and low frequency sequences according to the characteristics of each sequence. Finally, the predicted values of all components are superimposed to obtain the final prediction results. Experiments are carried out on four datasets with different seasons, and different models are compared to illustrate the effectiveness and superiority of the proposed model. The experimental results show that the proposed model achieves better prediction accuracy.

Suggested Citation

  • Wang, Shuangxin & Shi, Jiarong & Yang, Wei & Yin, Qingyan, 2024. "High and low frequency wind power prediction based on Transformer and BiGRU-Attention," Energy, Elsevier, vol. 288(C).
    • Handle: RePEc:eee:energy:v:288:y:2024:i:c:s036054422303147x
    DOI: 10.1016/j.energy.2023.129753
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S036054422303147X
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.energy.2023.129753?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Zhang, Yi-Ming & Wang, Hao, 2023. "Multi-head attention-based probabilistic CNN-BiLSTM for day-ahead wind speed forecasting," Energy, Elsevier, vol. 278(PA).
    2. Zhang, Chu & Hua, Lei & Ji, Chunlei & Shahzad Nazir, Muhammad & Peng, Tian, 2022. "An evolutionary robust solar radiation prediction model based on WT-CEEMDAN and IASO-optimized outlier robust extreme learning machine," Applied Energy, Elsevier, vol. 322(C).
    3. Ding, Yunfei & Chen, Zijun & Zhang, Hongwei & Wang, Xin & Guo, Ying, 2022. "A short-term wind power prediction model based on CEEMD and WOA-KELM," Renewable Energy, Elsevier, vol. 189(C), pages 188-198.
    4. Xiong, Jinlin & Peng, Tian & Tao, Zihan & Zhang, Chu & Song, Shihao & Nazir, Muhammad Shahzad, 2023. "A dual-scale deep learning model based on ELM-BiLSTM and improved reptile search algorithm for wind power prediction," Energy, Elsevier, vol. 266(C).
    5. Bentsen, Lars Ødegaard & Warakagoda, Narada Dilp & Stenbro, Roy & Engelstad, Paal, 2023. "Spatio-temporal wind speed forecasting using graph networks and novel Transformer architectures," Applied Energy, Elsevier, vol. 333(C).
    6. Wang, Yun & Zou, Runmin & Liu, Fang & Zhang, Lingjun & Liu, Qianyi, 2021. "A review of wind speed and wind power forecasting with deep neural networks," Applied Energy, Elsevier, vol. 304(C).
    7. Gao, Bixuan & Huang, Xiaoqiao & Shi, Junsheng & Tai, Yonghang & Zhang, Jun, 2020. "Hourly forecasting of solar irradiance based on CEEMDAN and multi-strategy CNN-LSTM neural networks," Renewable Energy, Elsevier, vol. 162(C), pages 1665-1683.
    8. Zhang, Ziyuan & Wang, Jianzhou & Wei, Danxiang & Luo, Tianrui & Xia, Yurui, 2023. "A novel ensemble system for short-term wind speed forecasting based on Two-stage Attention-Based Recurrent Neural Network," Renewable Energy, Elsevier, vol. 204(C), pages 11-23.
    9. Lu, Peng & Ye, Lin & Zhao, Yongning & Dai, Binhua & Pei, Ming & Tang, Yong, 2021. "Review of meta-heuristic algorithms for wind power prediction: Methodologies, applications and challenges," Applied Energy, Elsevier, vol. 301(C).
    10. Jiang, Zheyong & Che, Jinxing & He, Mingjun & Yuan, Fang, 2023. "A CGRU multi-step wind speed forecasting model based on multi-label specific XGBoost feature selection and secondary decomposition," Renewable Energy, Elsevier, vol. 203(C), pages 802-827.
    11. Li, Jingrui & Wang, Jiyang & Li, Zhiwu, 2023. "A novel combined forecasting system based on advanced optimization algorithm - A study on optimal interval prediction of wind speed," Energy, Elsevier, vol. 264(C).
    12. Wang, Yun & Xu, Houhua & Song, Mengmeng & Zhang, Fan & Li, Yifen & Zhou, Shengchao & Zhang, Lingjun, 2023. "A convolutional Transformer-based truncated Gaussian density network with data denoising for wind speed forecasting," Applied Energy, Elsevier, vol. 333(C).
    13. Costa, Alexandre & Crespo, Antonio & Navarro, Jorge & Lizcano, Gil & Madsen, Henrik & Feitosa, Everaldo, 2008. "A review on the young history of the wind power short-term prediction," Renewable and Sustainable Energy Reviews, Elsevier, vol. 12(6), pages 1725-1744, August.
    14. Wu, Huijuan & Meng, Keqilao & Fan, Daoerji & Zhang, Zhanqiang & Liu, Qing, 2022. "Multistep short-term wind speed forecasting using transformer," Energy, Elsevier, vol. 261(PA).
    15. Zhang, Chu & Ma, Huixin & Hua, Lei & Sun, Wei & Nazir, Muhammad Shahzad & Peng, Tian, 2022. "An evolutionary deep learning model based on TVFEMD, improved sine cosine algorithm, CNN and BiLSTM for wind speed prediction," Energy, Elsevier, vol. 254(PA).
    16. Dai, Xiaoran & Liu, Guo-Ping & Hu, Wenshan, 2023. "An online-learning-enabled self-attention-based model for ultra-short-term wind power forecasting," Energy, Elsevier, vol. 272(C).
    17. Joseph, Lionel P. & Deo, Ravinesh C. & Prasad, Ramendra & Salcedo-Sanz, Sancho & Raj, Nawin & Soar, Jeffrey, 2023. "Near real-time wind speed forecast model with bidirectional LSTM networks," Renewable Energy, Elsevier, vol. 204(C), pages 39-58.
    18. Yu, Min & Niu, Dongxiao & Gao, Tian & Wang, Keke & Sun, Lijie & Li, Mingyu & Xu, Xiaomin, 2023. "A novel framework for ultra-short-term interval wind power prediction based on RF-WOA-VMD and BiGRU optimized by the attention mechanism," Energy, Elsevier, vol. 269(C).
    19. Yakoub, Ghali & Mathew, Sathyajith & Leal, Joao, 2023. "Intelligent estimation of wind farm performance with direct and indirect ‘point’ forecasting approaches integrating several NWP models," Energy, Elsevier, vol. 263(PD).
    20. Shi, Jinhao & Wang, Bo & Luo, Kaiyi & Wu, Yifei & Zhou, Min & Watada, Junzo, 2023. "Ultra-short-term wind power interval prediction based on multi-task learning and generative critic networks," Energy, Elsevier, vol. 272(C).
    21. Xiao, Yulong & Zou, Chongzhe & Chi, Hetian & Fang, Rengcun, 2023. "Boosted GRU model for short-term forecasting of wind power with feature-weighted principal component analysis," Energy, Elsevier, vol. 267(C).
    22. Liu, Lei & Liu, Jicheng & Ye, Yu & Liu, Hui & Chen, Kun & Li, Dong & Dong, Xue & Sun, Mingzhai, 2023. "Ultra-short-term wind power forecasting based on deep Bayesian model with uncertainty," Renewable Energy, Elsevier, vol. 205(C), pages 598-607.
    23. Hu, Yahui & Guo, Yingshi & Fu, Rui, 2023. "A novel wind speed forecasting combined model using variational mode decomposition, sparse auto-encoder and optimized fuzzy cognitive mapping network," Energy, Elsevier, vol. 278(PA).
    24. Krishna Rayi, Vijaya & Mishra, S.P. & Naik, Jyotirmayee & Dash, P.K., 2022. "Adaptive VMD based optimized deep learning mixed kernel ELM autoencoder for single and multistep wind power forecasting," Energy, Elsevier, vol. 244(PA).
    25. Bommidi, Bala Saibabu & Teeparthi, Kiran & Kosana, Vishalteja, 2023. "Hybrid wind speed forecasting using ICEEMDAN and transformer model with novel loss function," Energy, Elsevier, vol. 265(C).
    26. Huang, Congzhi & Yang, Mengyuan, 2023. "Memory long and short term time series network for ultra-short-term photovoltaic power forecasting," Energy, Elsevier, vol. 279(C).
    27. Duan, Jikai & Chang, Mingheng & Chen, Xiangyue & Wang, Wenpeng & Zuo, Hongchao & Bai, Yulong & Chen, Bolong, 2022. "A combined short-term wind speed forecasting model based on CNN–RNN and linear regression optimization considering error," Renewable Energy, Elsevier, vol. 200(C), pages 788-808.
    28. AL-Alimi, Dalal & AlRassas, Ayman Mutahar & Al-qaness, Mohammed A.A. & Cai, Zhihua & Aseeri, Ahmad O. & Abd Elaziz, Mohamed & Ewees, Ahmed A., 2023. "TLIA: Time-series forecasting model using long short-term memory integrated with artificial neural networks for volatile energy markets," Applied Energy, Elsevier, vol. 343(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sun, Shaolong & Du, Zongjuan & Jin, Kun & Li, Hongtao & Wang, Shouyang, 2023. "Spatiotemporal wind power forecasting approach based on multi-factor extraction method and an indirect strategy," Applied Energy, Elsevier, vol. 350(C).
    2. Jiang, Wenjun & Liu, Bo & Liang, Yang & Gao, Huanxiang & Lin, Pengfei & Zhang, Dongqin & Hu, Gang, 2024. "Applicability analysis of transformer to wind speed forecasting by a novel deep learning framework with multiple atmospheric variables," Applied Energy, Elsevier, vol. 353(PB).
    3. Hou, Guolian & Wang, Junjie & Fan, Yuzhen, 2024. "Multistep short-term wind power forecasting model based on secondary decomposition, the kernel principal component analysis, an enhanced arithmetic optimization algorithm, and error correction," Energy, Elsevier, vol. 286(C).
    4. Zheng, Xidong & Bai, Feifei & Zeng, Ziyang & Jin, Tao, 2024. "A new methodology to improve wind power prediction accuracy considering power quality disturbance dimension reduction and elimination," Energy, Elsevier, vol. 287(C).
    5. Wu, Binrong & Wang, Lin, 2024. "Two-stage decomposition and temporal fusion transformers for interpretable wind speed forecasting," Energy, Elsevier, vol. 288(C).
    6. Zhang, Dongdong & Chen, Baian & Zhu, Hongyu & Goh, Hui Hwang & Dong, Yunxuan & Wu, Thomas, 2023. "Short-term wind power prediction based on two-layer decomposition and BiTCN-BiLSTM-attention model," Energy, Elsevier, vol. 285(C).
    7. Zhang, Guowei & Zhang, Yi & Wang, Hui & Liu, Da & Cheng, Runkun & Yang, Di, 2024. "Short-term wind speed forecasting based on adaptive secondary decomposition and robust temporal convolutional network," Energy, Elsevier, vol. 288(C).
    8. Meng, Anbo & Zhang, Haitao & Yin, Hao & Xian, Zikang & Chen, Shu & Zhu, Zibin & Zhang, Zheng & Rong, Jiayu & Li, Chen & Wang, Chenen & Wu, Zhenbo & Deng, Weisi & Luo, Jianqiang & Wang, Xiaolin, 2023. "A novel multi-gradient evolutionary deep learning approach for few-shot wind power prediction using time-series GAN," Energy, Elsevier, vol. 283(C).
    9. Lv, Sheng-Xiang & Wang, Lin, 2023. "Multivariate wind speed forecasting based on multi-objective feature selection approach and hybrid deep learning model," Energy, Elsevier, vol. 263(PE).
    10. Suo, Leiming & Peng, Tian & Song, Shihao & Zhang, Chu & Wang, Yuhan & Fu, Yongyan & Nazir, Muhammad Shahzad, 2023. "Wind speed prediction by a swarm intelligence based deep learning model via signal decomposition and parameter optimization using improved chimp optimization algorithm," Energy, Elsevier, vol. 276(C).
    11. Xiong, Jinlin & Peng, Tian & Tao, Zihan & Zhang, Chu & Song, Shihao & Nazir, Muhammad Shahzad, 2023. "A dual-scale deep learning model based on ELM-BiLSTM and improved reptile search algorithm for wind power prediction," Energy, Elsevier, vol. 266(C).
    12. Joseph, Lionel P. & Deo, Ravinesh C. & Casillas-Pérez, David & Prasad, Ramendra & Raj, Nawin & Salcedo-Sanz, Sancho, 2024. "Short-term wind speed forecasting using an optimized three-phase convolutional neural network fused with bidirectional long short-term memory network model," Applied Energy, Elsevier, vol. 359(C).
    13. Dongran Song & Xiao Tan & Qian Huang & Li Wang & Mi Dong & Jian Yang & Solomin Evgeny, 2024. "Review of AI-Based Wind Prediction within Recent Three Years: 2021–2023," Energies, MDPI, vol. 17(6), pages 1-22, March.
    14. Wang, Yun & Song, Mengmeng & Yang, Dazhi, 2024. "Local-global feature-based spatio-temporal wind speed forecasting with a sparse and dynamic graph," Energy, Elsevier, vol. 289(C).
    15. Liu, Hong & Yang, Luoxiao & Zhang, Bingying & Zhang, Zijun, 2023. "A two-channel deep network based model for improving ultra-short-term prediction of wind power via utilizing multi-source data," Energy, Elsevier, vol. 283(C).
    16. Li, Yanhui & Sun, Kaixuan & Yao, Qi & Wang, Lin, 2024. "A dual-optimization wind speed forecasting model based on deep learning and improved dung beetle optimization algorithm," Energy, Elsevier, vol. 286(C).
    17. Wang, Cong & He, Yan & Zhang, Hong-li & Ma, Ping, 2024. "Wind power forecasting based on manifold learning and a double-layer SWLSTM model," Energy, Elsevier, vol. 290(C).
    18. Zhang, Yagang & Pan, Zhiya & Wang, Hui & Wang, Jingchao & Zhao, Zheng & Wang, Fei, 2023. "Achieving wind power and photovoltaic power prediction: An intelligent prediction system based on a deep learning approach," Energy, Elsevier, vol. 283(C).
    19. Dong, Juan & Xing, Liwen & Cui, Ningbo & Zhao, Lu & Guo, Li & Wang, Zhihui & Du, Taisheng & Tan, Mingdong & Gong, Daozhi, 2024. "Estimating reference crop evapotranspiration using improved convolutional bidirectional long short-term memory network by multi-head attention mechanism in the four climatic zones of China," Agricultural Water Management, Elsevier, vol. 292(C).
    20. Wang, Jianguo & Han, Lincheng & Zhang, Xiuyu & Wang, Yingzhou & Zhang, Shude, 2023. "Electrical load forecasting based on variable T-distribution and dual attention mechanism," Energy, Elsevier, vol. 283(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:288:y:2024:i:c:s036054422303147x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.