IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v278y2023ics0360544223010721.html
   My bibliography  Save this article

A transformer-based deep neural network with wavelet transform for forecasting wind speed and wind energy

Author

Listed:
  • Nascimento, Erick Giovani Sperandio
  • de Melo, Talison A.C.
  • Moreira, Davidson M.

Abstract

This work presents a novel transformer-based deep neural network architecture integrated with wavelet transform for forecasting wind speed and wind energy (power) generation for the next 6 h ahead, using multiple meteorological variables as input for multivariate time series forecasting. To evaluate the performance of the proposed model, different case studies were investigated, using data collected from anemometers installed in three different regions in Bahia, Brazil. The performance of the proposed transformer-based model with wavelet transform was compared with an LSTM (Long Short Term Memory) model as a baseline, since it has been successfully used for time series processing in deep learning, as well as with previous state-of-the-art (SOTA) similar works. Results of the forecasting performance were evaluated using statistical metrics, along with the time for training and performing inferences, both using quantitative and qualitative analysis. They showed that the proposed method is effective for forecasting wind speed and power generation, with superior performance than the baseline model and comparable performance to previous similar SOTA works, presenting potential suitability for being extended for the general purpose of multivariate time series forecasting. Furthermore, results demonstrated that the integration of the transformer model with wavelet decomposition improved the forecast accuracy.

Suggested Citation

  • Nascimento, Erick Giovani Sperandio & de Melo, Talison A.C. & Moreira, Davidson M., 2023. "A transformer-based deep neural network with wavelet transform for forecasting wind speed and wind energy," Energy, Elsevier, vol. 278(C).
    • Handle: RePEc:eee:energy:v:278:y:2023:i:c:s0360544223010721
    DOI: 10.1016/j.energy.2023.127678
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544223010721
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.energy.2023.127678?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Niu, Zhewen & Yu, Zeyuan & Tang, Wenhu & Wu, Qinghua & Reformat, Marek, 2020. "Wind power forecasting using attention-based gated recurrent unit network," Energy, Elsevier, vol. 196(C).
    2. Zucatelli, P.J. & Nascimento, E.G.S. & Santos, A.Á.B. & Arce, A.M.G. & Moreira, D.M., 2021. "An investigation on deep learning and wavelet transform to nowcast wind power and wind power ramp: A case study in Brazil and Uruguay," Energy, Elsevier, vol. 230(C).
    3. Lim, Bryan & Arık, Sercan Ö. & Loeff, Nicolas & Pfister, Tomas, 2021. "Temporal Fusion Transformers for interpretable multi-horizon time series forecasting," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1748-1764.
    4. Wu, Binrong & Wang, Lin & Zeng, Yu-Rong, 2022. "Interpretable wind speed prediction with multivariate time series and temporal fusion transformers," Energy, Elsevier, vol. 252(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Wen-Chang Tsai & Chih-Ming Hong & Chia-Sheng Tu & Whei-Min Lin & Chiung-Hsing Chen, 2023. "A Review of Modern Wind Power Generation Forecasting Technologies," Sustainability, MDPI, vol. 15(14), pages 1-40, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bentsen, Lars Ødegaard & Warakagoda, Narada Dilp & Stenbro, Roy & Engelstad, Paal, 2023. "Spatio-temporal wind speed forecasting using graph networks and novel Transformer architectures," Applied Energy, Elsevier, vol. 333(C).
    2. Shengxiang Lv & Lin Wang & Sirui Wang, 2023. "A Hybrid Neural Network Model for Short-Term Wind Speed Forecasting," Energies, MDPI, vol. 16(4), pages 1-18, February.
    3. Lv, Sheng-Xiang & Wang, Lin, 2023. "Multivariate wind speed forecasting based on multi-objective feature selection approach and hybrid deep learning model," Energy, Elsevier, vol. 263(PE).
    4. Liu, Chenyu & Zhang, Xuemin & Mei, Shengwei & Zhou, Qingyu & Fan, Hang, 2023. "Series-wise attention network for wind power forecasting considering temporal lag of numerical weather prediction," Applied Energy, Elsevier, vol. 336(C).
    5. Miguel López Santos & Xela García-Santiago & Fernando Echevarría Camarero & Gonzalo Blázquez Gil & Pablo Carrasco Ortega, 2022. "Application of Temporal Fusion Transformer for Day-Ahead PV Power Forecasting," Energies, MDPI, vol. 15(14), pages 1-22, July.
    6. Frank, Johannes, 2023. "Forecasting realized volatility in turbulent times using temporal fusion transformers," FAU Discussion Papers in Economics 03/2023, Friedrich-Alexander University Erlangen-Nuremberg, Institute for Economics.
    7. Zhang, Ziyuan & Wang, Jianzhou & Wei, Danxiang & Luo, Tianrui & Xia, Yurui, 2023. "A novel ensemble system for short-term wind speed forecasting based on Two-stage Attention-Based Recurrent Neural Network," Renewable Energy, Elsevier, vol. 204(C), pages 11-23.
    8. Katarzyna Rudnik & Anna Hnydiuk-Stefan & Aneta Kucińska-Landwójtowicz & Łukasz Mach, 2022. "Forecasting Day-Ahead Carbon Price by Modelling Its Determinants Using the PCA-Based Approach," Energies, MDPI, vol. 15(21), pages 1-23, October.
    9. Shijun Wang & Chun Liu & Kui Liang & Ziyun Cheng & Xue Kong & Shuang Gao, 2022. "Wind Speed Prediction Model Based on Improved VMD and Sudden Change of Wind Speed," Sustainability, MDPI, vol. 14(14), pages 1-15, July.
    10. Wang, Yun & Zou, Runmin & Liu, Fang & Zhang, Lingjun & Liu, Qianyi, 2021. "A review of wind speed and wind power forecasting with deep neural networks," Applied Energy, Elsevier, vol. 304(C).
    11. Guglielmo D’Amico & Filippo Petroni & Salvatore Vergine, 2022. "Ramp Rate Limitation of Wind Power: An Overview," Energies, MDPI, vol. 15(16), pages 1-15, August.
    12. Dong, Hanjiang & Zhu, Jizhong & Li, Shenglin & Wu, Wanli & Zhu, Haohao & Fan, Junwei, 2023. "Short-term residential household reactive power forecasting considering active power demand via deep Transformer sequence-to-sequence networks," Applied Energy, Elsevier, vol. 329(C).
    13. Wuyue An & Lin Wang & Dongfeng Zhang, 2023. "Comprehensive commodity price forecasting framework using text mining methods," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(7), pages 1865-1888, November.
    14. Kate Murray & Andrea Rossi & Diego Carraro & Andrea Visentin, 2023. "On Forecasting Cryptocurrency Prices: A Comparison of Machine Learning, Deep Learning, and Ensembles," Forecasting, MDPI, vol. 5(1), pages 1-14, January.
    15. Zhang, Yagang & Zhang, Jinghui & Yu, Leyi & Pan, Zhiya & Feng, Changyou & Sun, Yiqian & Wang, Fei, 2022. "A short-term wind energy hybrid optimal prediction system with denoising and novel error correction technique," Energy, Elsevier, vol. 254(PC).
    16. Pegah Eslamieh & Mehdi Shajari & Ahmad Nickabadi, 2023. "User2Vec: A Novel Representation for the Information of the Social Networks for Stock Market Prediction Using Convolutional and Recurrent Neural Networks," Mathematics, MDPI, vol. 11(13), pages 1-26, July.
    17. Dokur, Emrah & Erdogan, Nuh & Salari, Mahdi Ebrahimi & Karakuzu, Cihan & Murphy, Jimmy, 2022. "Offshore wind speed short-term forecasting based on a hybrid method: Swarm decomposition and meta-extreme learning machine," Energy, Elsevier, vol. 248(C).
    18. Tom Liu & Stefan Zohren, 2023. "Multi-Factor Inception: What to Do with All of These Features?," Papers 2307.13832, arXiv.org.
    19. Pinheiro, Marco G. & Madeira, Sara C. & Francisco, Alexandre P., 2023. "Short-term electricity load forecasting—A systematic approach from system level to secondary substations," Applied Energy, Elsevier, vol. 332(C).
    20. Fachrizal Aksan & Yang Li & Vishnu Suresh & Przemysław Janik, 2023. "Multistep Forecasting of Power Flow Based on LSTM Autoencoder: A Study Case in Regional Grid Cluster Proposal," Energies, MDPI, vol. 16(13), pages 1-20, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:278:y:2023:i:c:s0360544223010721. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.