IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v202y2020ics0360544220309014.html
   My bibliography  Save this article

A new hybrid ensemble deep reinforcement learning model for wind speed short term forecasting

Author

Listed:
  • Liu, Hui
  • Yu, Chengqing
  • Wu, Haiping
  • Duan, Zhu
  • Yan, Guangxi

Abstract

Wind speed forecasting is a promising solution to improve the efficiency of energy utilization. In this study, a novel hybrid wind speed forecasting model is proposed. The whole modeling process of the proposed model consists of three steps. In stage I, the empirical wavelet transform method reduces the non-stationarity of the original wind speed data by decomposing the original data into several sub-series. In stage II, three kinds of deep networks are utilized to build the forecasting model and calculate prediction results of all sub-series, respectively. In stage III, the reinforcement learning method is used to combine three kinds of deep networks. The forecasting results of each sub-series are combined to obtain the final forecasting results. By comparing all the results of the predictions over three different types of wind speed series, it can be concluded that: (a) the proposed reinforcement learning based ensemble method is effective in integrating three kinds of deep network and works better than traditional optimization based ensemble method; (b) the proposed ensemble deep reinforcement learning based wind speed prediction model can get accurate results in all cases and provide the best accuracy compared with sixteen alternative models and three state-of-the-art models.

Suggested Citation

  • Liu, Hui & Yu, Chengqing & Wu, Haiping & Duan, Zhu & Yan, Guangxi, 2020. "A new hybrid ensemble deep reinforcement learning model for wind speed short term forecasting," Energy, Elsevier, vol. 202(C).
    • Handle: RePEc:eee:energy:v:202:y:2020:i:c:s0360544220309014
    DOI: 10.1016/j.energy.2020.117794
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544220309014
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.energy.2020.117794?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Liu, Hui & Chen, Chao, 2019. "Multi-objective data-ensemble wind speed forecasting model with stacked sparse autoencoder and adaptive decomposition-based error correction," Applied Energy, Elsevier, vol. 254(C).
    2. Hu, Jianming & Wang, Jianzhou, 2015. "Short-term wind speed prediction using empirical wavelet transform and Gaussian process regression," Energy, Elsevier, vol. 93(P2), pages 1456-1466.
    3. Wang, Kejun & Qi, Xiaoxia & Liu, Hongda & Song, Jiakang, 2018. "Deep belief network based k-means cluster approach for short-term wind power forecasting," Energy, Elsevier, vol. 165(PA), pages 840-852.
    4. Fu, Guoyin, 2018. "Deep belief network based ensemble approach for cooling load forecasting of air-conditioning system," Energy, Elsevier, vol. 148(C), pages 269-282.
    5. Kong, Yun & Wang, Tianyang & Chu, Fulei, 2019. "Meshing frequency modulation assisted empirical wavelet transform for fault diagnosis of wind turbine planetary ring gear," Renewable Energy, Elsevier, vol. 132(C), pages 1373-1388.
    6. Maleki, Akbar & Khajeh, Morteza Gholipour & Rosen, Marc A., 2016. "Weather forecasting for optimization of a hybrid solar-wind–powered reverse osmosis water desalination system using a novel optimizer approach," Energy, Elsevier, vol. 114(C), pages 1120-1134.
    7. Li, Yanfei & Shi, Huipeng & Han, Fengze & Duan, Zhu & Liu, Hui, 2019. "Smart wind speed forecasting approach using various boosting algorithms, big multi-step forecasting strategy," Renewable Energy, Elsevier, vol. 135(C), pages 540-553.
    8. Song, Jingjing & Wang, Jianzhou & Lu, Haiyan, 2018. "A novel combined model based on advanced optimization algorithm for short-term wind speed forecasting," Applied Energy, Elsevier, vol. 215(C), pages 643-658.
    9. I. Momennejad & E. M. Russek & J. H. Cheong & M. M. Botvinick & N. D. Daw & S. J. Gershman, 2017. "The successor representation in human reinforcement learning," Nature Human Behaviour, Nature, vol. 1(9), pages 680-692, September.
    10. Wang, H.Z. & Wang, G.B. & Li, G.Q. & Peng, J.C. & Liu, Y.T., 2016. "Deep belief network based deterministic and probabilistic wind speed forecasting approach," Applied Energy, Elsevier, vol. 182(C), pages 80-93.
    11. Chen, Jinglong & Pan, Jun & Li, Zipeng & Zi, Yanyang & Chen, Xuefeng, 2016. "Generator bearing fault diagnosis for wind turbine via empirical wavelet transform using measured vibration signals," Renewable Energy, Elsevier, vol. 89(C), pages 80-92.
    12. Liu, Hui & Chen, Chao, 2019. "Data processing strategies in wind energy forecasting models and applications: A comprehensive review," Applied Energy, Elsevier, vol. 249(C), pages 392-408.
    13. Wang, Jianzhou & Heng, Jiani & Xiao, Liye & Wang, Chen, 2017. "Research and application of a combined model based on multi-objective optimization for multi-step ahead wind speed forecasting," Energy, Elsevier, vol. 125(C), pages 591-613.
    14. Xiong, Rui & Cao, Jiayi & Yu, Quanqing, 2018. "Reinforcement learning-based real-time power management for hybrid energy storage system in the plug-in hybrid electric vehicle," Applied Energy, Elsevier, vol. 211(C), pages 538-548.
    15. Šemrov, D. & Marsetič, R. & Žura, M. & Todorovski, L. & Srdic, A., 2016. "Reinforcement learning approach for train rescheduling on a single-track railway," Transportation Research Part B: Methodological, Elsevier, vol. 86(C), pages 250-267.
    16. Liu, Da & Wang, Jilong & Wang, Hui, 2015. "Short-term wind speed forecasting based on spectral clustering and optimised echo state networks," Renewable Energy, Elsevier, vol. 78(C), pages 599-608.
    17. Volodymyr Mnih & Koray Kavukcuoglu & David Silver & Andrei A. Rusu & Joel Veness & Marc G. Bellemare & Alex Graves & Martin Riedmiller & Andreas K. Fidjeland & Georg Ostrovski & Stig Petersen & Charle, 2015. "Human-level control through deep reinforcement learning," Nature, Nature, vol. 518(7540), pages 529-533, February.
    18. Qing, Xiangyun & Niu, Yugang, 2018. "Hourly day-ahead solar irradiance prediction using weather forecasts by LSTM," Energy, Elsevier, vol. 148(C), pages 461-468.
    19. Zhang, Jinliang & Wei, Yiming & Tan, Zhongfu, 2020. "An adaptive hybrid model for short term wind speed forecasting," Energy, Elsevier, vol. 190(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Yun & Zou, Runmin & Liu, Fang & Zhang, Lingjun & Liu, Qianyi, 2021. "A review of wind speed and wind power forecasting with deep neural networks," Applied Energy, Elsevier, vol. 304(C).
    2. Lu, Peng & Ye, Lin & Zhao, Yongning & Dai, Binhua & Pei, Ming & Tang, Yong, 2021. "Review of meta-heuristic algorithms for wind power prediction: Methodologies, applications and challenges," Applied Energy, Elsevier, vol. 301(C).
    3. Qian, Zheng & Pei, Yan & Zareipour, Hamidreza & Chen, Niya, 2019. "A review and discussion of decomposition-based hybrid models for wind energy forecasting applications," Applied Energy, Elsevier, vol. 235(C), pages 939-953.
    4. Niu, Xinsong & Wang, Jiyang, 2019. "A combined model based on data preprocessing strategy and multi-objective optimization algorithm for short-term wind speed forecasting," Applied Energy, Elsevier, vol. 241(C), pages 519-539.
    5. Liu, Hui & Chen, Chao, 2019. "Data processing strategies in wind energy forecasting models and applications: A comprehensive review," Applied Energy, Elsevier, vol. 249(C), pages 392-408.
    6. Chengqing, Yu & Guangxi, Yan & Chengming, Yu & Yu, Zhang & Xiwei, Mi, 2023. "A multi-factor driven spatiotemporal wind power prediction model based on ensemble deep graph attention reinforcement learning networks," Energy, Elsevier, vol. 263(PE).
    7. Jin, Huaiping & Shi, Lixian & Chen, Xiangguang & Qian, Bin & Yang, Biao & Jin, Huaikang, 2021. "Probabilistic wind power forecasting using selective ensemble of finite mixture Gaussian process regression models," Renewable Energy, Elsevier, vol. 174(C), pages 1-18.
    8. Wu, Binrong & Wang, Lin & Zeng, Yu-Rong, 2022. "Interpretable wind speed prediction with multivariate time series and temporal fusion transformers," Energy, Elsevier, vol. 252(C).
    9. Ghimire, Sujan & Deo, Ravinesh C. & Raj, Nawin & Mi, Jianchun, 2019. "Deep solar radiation forecasting with convolutional neural network and long short-term memory network algorithms," Applied Energy, Elsevier, vol. 253(C), pages 1-1.
    10. Liu, Hui & Duan, Zhu, 2020. "A vanishing moment ensemble model for wind speed multi-step prediction with multi-objective base model selection," Applied Energy, Elsevier, vol. 261(C).
    11. Liu, Hui & Yang, Rui & Wang, Tiantian & Zhang, Lei, 2021. "A hybrid neural network model for short-term wind speed forecasting based on decomposition, multi-learner ensemble, and adaptive multiple error corrections," Renewable Energy, Elsevier, vol. 165(P1), pages 573-594.
    12. Zhang, Jinliang & Wei, Yiming & Tan, Zhongfu, 2020. "An adaptive hybrid model for short term wind speed forecasting," Energy, Elsevier, vol. 190(C).
    13. Wang, Yun & Xu, Houhua & Song, Mengmeng & Zhang, Fan & Li, Yifen & Zhou, Shengchao & Zhang, Lingjun, 2023. "A convolutional Transformer-based truncated Gaussian density network with data denoising for wind speed forecasting," Applied Energy, Elsevier, vol. 333(C).
    14. Sharifzadeh, Mahdi & Sikinioti-Lock, Alexandra & Shah, Nilay, 2019. "Machine-learning methods for integrated renewable power generation: A comparative study of artificial neural networks, support vector regression, and Gaussian Process Regression," Renewable and Sustainable Energy Reviews, Elsevier, vol. 108(C), pages 513-538.
    15. Wang, Shuai & Wang, Jianzhou & Lu, Haiyan & Zhao, Weigang, 2021. "A novel combined model for wind speed prediction – Combination of linear model, shallow neural networks, and deep learning approaches," Energy, Elsevier, vol. 234(C).
    16. Liu, Hui & Chen, Chao, 2019. "Multi-objective data-ensemble wind speed forecasting model with stacked sparse autoencoder and adaptive decomposition-based error correction," Applied Energy, Elsevier, vol. 254(C).
    17. Duan, Jikai & Chang, Mingheng & Chen, Xiangyue & Wang, Wenpeng & Zuo, Hongchao & Bai, Yulong & Chen, Bolong, 2022. "A combined short-term wind speed forecasting model based on CNN–RNN and linear regression optimization considering error," Renewable Energy, Elsevier, vol. 200(C), pages 788-808.
    18. Zhang, Jinhua & Yan, Jie & Infield, David & Liu, Yongqian & Lien, Fue-sang, 2019. "Short-term forecasting and uncertainty analysis of wind turbine power based on long short-term memory network and Gaussian mixture model," Applied Energy, Elsevier, vol. 241(C), pages 229-244.
    19. Chinmoy, Lakshmi & Iniyan, S. & Goic, Ranko, 2019. "Modeling wind power investments, policies and social benefits for deregulated electricity market – A review," Applied Energy, Elsevier, vol. 242(C), pages 364-377.
    20. Li, Chen & Zhu, Zhijie & Yang, Hufang & Li, Ranran, 2019. "An innovative hybrid system for wind speed forecasting based on fuzzy preprocessing scheme and multi-objective optimization," Energy, Elsevier, vol. 174(C), pages 1219-1237.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:202:y:2020:i:c:s0360544220309014. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.