IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v13y2020i7p1772-d342383.html
   My bibliography  Save this article

Multi-Step Short-Term Wind Speed Prediction Using a Residual Dilated Causal Convolutional Network with Nonlinear Attention

Author

Listed:
  • Kumar Shivam

    (Department of Mechanical Engineering, Kun Shan University, No.195, Kunda Rd., Yongkang District, Tainan City 710, Taiwan)

  • Jong-Chyuan Tzou

    (Department of Mechanical Engineering, Kun Shan University, No.195, Kunda Rd., Yongkang District, Tainan City 710, Taiwan)

  • Shang-Chen Wu

    (Department of Mechanical Engineering, Kun Shan University, No.195, Kunda Rd., Yongkang District, Tainan City 710, Taiwan)

Abstract

Wind energy is the most used renewable energy worldwide second only to hydropower. However, the stochastic nature of wind speed makes it harder for wind farms to manage the future power production and maintenance schedules efficiently. Many wind speed prediction models exist that focus on advance neural networks and/or preprocessing techniques to improve the accuracy. Since most of these models require a large amount of historic wind data and are validated using the data split method, the application to real-world scenarios cannot be determined. In this paper, we present a multi-step univariate prediction model for wind speed data inspired by the residual U-net architecture of the convolutional neural network (CNN). We propose a residual dilated causal convolutional neural network (Res-DCCNN) with nonlinear attention for multi-step-ahead wind speed forecasting. Our model can outperform long-term short-term memory networks (LSTM), gated recurrent units (GRU), and Res-DCCNN using sliding window validation techniques for 50-step-ahead wind speed prediction. We tested the performance of the proposed model on six real-world wind speed datasets with different probability distributions to confirm its effectiveness, and using several error metrics, we demonstrated that our proposed model was robust, precise, and applicable to real-world cases.

Suggested Citation

  • Kumar Shivam & Jong-Chyuan Tzou & Shang-Chen Wu, 2020. "Multi-Step Short-Term Wind Speed Prediction Using a Residual Dilated Causal Convolutional Network with Nonlinear Attention," Energies, MDPI, vol. 13(7), pages 1-29, April.
  • Handle: RePEc:gam:jeners:v:13:y:2020:i:7:p:1772-:d:342383
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/13/7/1772/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/1996-1073/13/7/1772/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Chao Chen & Jamie Twycross & Jonathan M Garibaldi, 2017. "A new accuracy measure based on bounded relative error for time series forecasting," PLOS ONE, Public Library of Science, vol. 12(3), pages 1-23, March.
    2. Pedro G. Lind & Luis Vera-Tudela & Matthias Wächter & Martin Kühn & Joachim Peinke, 2017. "Normal Behaviour Models for Wind Turbine Vibrations: Comparison of Neural Networks and a Stochastic Approach," Energies, MDPI, vol. 10(12), pages 1-14, November.
    3. Chiou-Jye Huang & Ping-Huan Kuo, 2018. "A Short-Term Wind Speed Forecasting Model by Using Artificial Neural Networks with Stochastic Optimization for Renewable Energy Systems," Energies, MDPI, vol. 11(10), pages 1-20, October.
    4. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
    5. Lei, Ma & Shiyan, Luan & Chuanwen, Jiang & Hongling, Liu & Yan, Zhang, 2009. "A review on the forecasting of wind speed and generated power," Renewable and Sustainable Energy Reviews, Elsevier, vol. 13(4), pages 915-920, May.
    6. Jhih-Huang Wang & Gwo-Fong Lin & Ming-Jui Chang & I-Hang Huang & Yu-Ren Chen, 2019. "Real-Time Water-Level Forecasting Using Dilated Causal Convolutional Neural Networks," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 33(11), pages 3759-3780, September.
    7. Wang, Jianzhou & Heng, Jiani & Xiao, Liye & Wang, Chen, 2017. "Research and application of a combined model based on multi-objective optimization for multi-step ahead wind speed forecasting," Energy, Elsevier, vol. 125(C), pages 591-613.
    8. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    9. Makridakis, Spyros & Hibon, Michele, 2000. "The M3-Competition: results, conclusions and implications," International Journal of Forecasting, Elsevier, vol. 16(4), pages 451-476.
    10. Ping-Huan Kuo & Chiou-Jye Huang, 2018. "A High Precision Artificial Neural Networks Model for Short-Term Energy Load Forecasting," Energies, MDPI, vol. 11(1), pages 1-13, January.
    11. Ning Li & Fuxing He & Wentao Ma, 2019. "Wind Power Prediction Based on Extreme Learning Machine with Kernel Mean p -Power Error Loss," Energies, MDPI, vol. 12(4), pages 1-19, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bentsen, Lars Ødegaard & Warakagoda, Narada Dilp & Stenbro, Roy & Engelstad, Paal, 2023. "Spatio-temporal wind speed forecasting using graph networks and novel Transformer architectures," Applied Energy, Elsevier, vol. 333(C).
    2. Lars Ødegaard Bentsen & Narada Dilp Warakagoda & Roy Stenbro & Paal Engelstad, 2023. "A Unified Graph Formulation for Spatio-Temporal Wind Forecasting," Energies, MDPI, vol. 16(20), pages 1-23, October.
    3. Wu, Huijuan & Meng, Keqilao & Fan, Daoerji & Zhang, Zhanqiang & Liu, Qing, 2022. "Multistep short-term wind speed forecasting using transformer," Energy, Elsevier, vol. 261(PA).
    4. Bommidi, Bala Saibabu & Teeparthi, Kiran & Kosana, Vishalteja, 2023. "Hybrid wind speed forecasting using ICEEMDAN and transformer model with novel loss function," Energy, Elsevier, vol. 265(C).
    5. Chatterjee, Joyjit & Dethlefs, Nina, 2021. "Scientometric review of artificial intelligence for operations & maintenance of wind turbines: The past, present and future," Renewable and Sustainable Energy Reviews, Elsevier, vol. 144(C).
    6. Kui Yang & Bofu Wang & Xiang Qiu & Jiahua Li & Yuze Wang & Yulu Liu, 2022. "Multi-Step Short-Term Wind Speed Prediction Models Based on Adaptive Robust Decomposition Coupled with Deep Gated Recurrent Unit," Energies, MDPI, vol. 15(12), pages 1-24, June.
    7. Qin Chen & Yan Chen & Xingzhi Bai, 2020. "Deterministic and Interval Wind Speed Prediction Method in Offshore Wind Farm Considering the Randomness of Wind," Energies, MDPI, vol. 13(21), pages 1-23, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kailai Ni & Jianzhou Wang & Guangyu Tang & Danxiang Wei, 2019. "Research and Application of a Novel Hybrid Model Based on a Deep Neural Network for Electricity Load Forecasting: A Case Study in Australia," Energies, MDPI, vol. 12(13), pages 1-30, June.
    2. Hendry, David F. & Hubrich, Kirstin, 2006. "Forecasting economic aggregates by disaggregates," Working Paper Series 589, European Central Bank.
    3. Tian, Chengshi & Hao, Yan & Hu, Jianming, 2018. "A novel wind speed forecasting system based on hybrid data preprocessing and multi-objective optimization," Applied Energy, Elsevier, vol. 231(C), pages 301-319.
    4. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    5. Olivares, Kin G. & Challu, Cristian & Marcjasz, Grzegorz & Weron, Rafał & Dubrawski, Artur, 2023. "Neural basis expansion analysis with exogenous variables: Forecasting electricity prices with NBEATSx," International Journal of Forecasting, Elsevier, vol. 39(2), pages 884-900.
    6. Anders Bredahl Kock & Timo Teräsvirta, 2016. "Forecasting Macroeconomic Variables Using Neural Network Models and Three Automated Model Selection Techniques," Econometric Reviews, Taylor & Francis Journals, vol. 35(8-10), pages 1753-1779, December.
    7. Gao, Yuyang & Wang, Jianzhou & Yang, Hufang, 2022. "A multi-component hybrid system based on predictability recognition and modified multi-objective optimization for ultra-short-term onshore wind speed forecasting," Renewable Energy, Elsevier, vol. 188(C), pages 384-401.
    8. Ju-Yeol Ryu & Bora Lee & Sungho Park & Seonghyeon Hwang & Hyemin Park & Changhyeong Lee & Dohyeon Kwon, 2022. "Evaluation of Weather Information for Short-Term Wind Power Forecasting with Various Types of Models," Energies, MDPI, vol. 15(24), pages 1-14, December.
    9. Song, Jingjing & Wang, Jianzhou & Lu, Haiyan, 2018. "A novel combined model based on advanced optimization algorithm for short-term wind speed forecasting," Applied Energy, Elsevier, vol. 215(C), pages 643-658.
    10. João C. Claudio & Katja Heinisch & Oliver Holtemöller, 2020. "Nowcasting East German GDP growth: a MIDAS approach," Empirical Economics, Springer, vol. 58(1), pages 29-54, January.
    11. Cavit Pakel & Neil Shephard & Kevin Sheppard, 2009. "Nuisance parameters, composite likelihoods and a panel of GARCH models," Economics Papers 2009-W12, Economics Group, Nuffield College, University of Oxford.
    12. Xilong Chen & Eric Ghysels, 2011. "News--Good or Bad--and Its Impact on Volatility Predictions over Multiple Horizons," The Review of Financial Studies, Society for Financial Studies, vol. 24(1), pages 46-81, October.
    13. Cavit Pakel & Neil Shephard & Kevin Sheppard & Robert F. Engle, 2021. "Fitting Vast Dimensional Time-Varying Covariance Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(3), pages 652-668, July.
    14. Daniel Buncic, 2012. "Understanding forecast failure of ESTAR models of real exchange rates," Empirical Economics, Springer, vol. 43(1), pages 399-426, August.
    15. Scott Brave & R. Andrew Butters & Alejandro Justiniano, 2016. "Forecasting Economic Activity with Mixed Frequency Bayesian VARs," Working Paper Series WP-2016-5, Federal Reserve Bank of Chicago.
    16. Hewamalage, Hansika & Bergmeir, Christoph & Bandara, Kasun, 2021. "Recurrent Neural Networks for Time Series Forecasting: Current status and future directions," International Journal of Forecasting, Elsevier, vol. 37(1), pages 388-427.
    17. Dimitrakopoulos, Stefanos & Tsionas, Mike, 2019. "Ordinal-response GARCH models for transaction data: A forecasting exercise," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1273-1287.
    18. Norman R. Swanson & Weiqi Xiong, 2018. "Big data analytics in economics: What have we learned so far, and where should we go from here?," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 51(3), pages 695-746, August.
    19. Marie Bessec & Julien Fouquau & Sophie Meritet, 2016. "Forecasting electricity spot prices using time-series models with a double temporal segmentation," Applied Economics, Taylor & Francis Journals, vol. 48(5), pages 361-378, January.
    20. Mittnik, Stefan & Robinzonov, Nikolay & Spindler, Martin, 2015. "Stock market volatility: Identifying major drivers and the nature of their impact," Journal of Banking & Finance, Elsevier, vol. 58(C), pages 1-14.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:13:y:2020:i:7:p:1772-:d:342383. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.