IDEAS home Printed from https://ideas.repec.org/a/eee/renene/v244y2025ics0960148125003544.html

A reinforcement learning-based ensemble forecasting framework for renewable energy forecasting

Author

Listed:
  • Wu, Zhiyuan
  • Fang, Guohua
  • Ye, Jian
  • Zhu, David Z.
  • Huang, Xianfeng

Abstract

The randomness and intermittency of wind and photovoltaic power generation can negatively affect the stability of power systems. Therefore, accurate forecasting of these energy outputs is crucial for effective power system management. Among various forecasting methods, ensemble forecasting has gained attention for its superior performance and reliability. However, traditional ensemble methods, such as weighted averaging and stacking, use fixed model combinations that fail to adapt to varying wind and radiation conditions, thereby limiting their accuracy. To overcome this limitation, this study proposes a novel ensemble forecasting framework based on reinforcement learning. The framework uses a deep Q-network to dynamically select the appropriate base model for different wind and radiation conditions. The learning process is supported by a model control module, a basic forecasting module, and a performance evaluation module. Independent experiments conducted across 14 regions in China validate the framework's effectiveness, showing a significant improvement in forecasting accuracy. The framework achieved an average improvement of 12.18 % in mean absolute scaled error over base models and 4.84 % over other ensemble methods. Additionally, this study analyzes the impact of different reinforcement learning models and sample sizes on the framework's performance.

Suggested Citation

  • Wu, Zhiyuan & Fang, Guohua & Ye, Jian & Zhu, David Z. & Huang, Xianfeng, 2025. "A reinforcement learning-based ensemble forecasting framework for renewable energy forecasting," Renewable Energy, Elsevier, vol. 244(C).
  • Handle: RePEc:eee:renene:v:244:y:2025:i:c:s0960148125003544
    DOI: 10.1016/j.renene.2025.122692
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0960148125003544
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.renene.2025.122692?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Bommidi, Bala Saibabu & Teeparthi, Kiran & Kosana, Vishalteja, 2023. "Hybrid wind speed forecasting using ICEEMDAN and transformer model with novel loss function," Energy, Elsevier, vol. 265(C).
    2. Qi, Yunying & Xu, Xiao & Liu, Youbo & Pan, Li & Liu, Junyong & Hu, Weihao, 2024. "Intelligent energy management for an on-grid hydrogen refueling station based on dueling double deep Q network algorithm with NoisyNet," Renewable Energy, Elsevier, vol. 222(C).
    3. Liu, Hui & Yu, Chengqing & Wu, Haiping & Duan, Zhu & Yan, Guangxi, 2020. "A new hybrid ensemble deep reinforcement learning model for wind speed short term forecasting," Energy, Elsevier, vol. 202(C).
    4. Zhao, Jing & Guo, Yiyi & Lin, Yihua & Zhao, Zhiyuan & Guo, Zhenhai, 2024. "A novel dynamic ensemble of numerical weather prediction for multi-step wind speed forecasting with deep reinforcement learning and error sequence modeling," Energy, Elsevier, vol. 302(C).
    5. Wang, Huai-zhi & Li, Gang-qiang & Wang, Gui-bin & Peng, Jian-chun & Jiang, Hui & Liu, Yi-tao, 2017. "Deep learning based ensemble approach for probabilistic wind power forecasting," Applied Energy, Elsevier, vol. 188(C), pages 56-70.
    6. Mellit, A. & Pavan, A. Massi & Lughi, V., 2021. "Deep learning neural networks for short-term photovoltaic power forecasting," Renewable Energy, Elsevier, vol. 172(C), pages 276-288.
    7. Liu, Hui & Yang, Rui & Wang, Tiantian & Zhang, Lei, 2021. "A hybrid neural network model for short-term wind speed forecasting based on decomposition, multi-learner ensemble, and adaptive multiple error corrections," Renewable Energy, Elsevier, vol. 165(P1), pages 573-594.
    8. Hyndman, Rob J. & Koehler, Anne B., 2006. "Another look at measures of forecast accuracy," International Journal of Forecasting, Elsevier, vol. 22(4), pages 679-688.
    9. Li, Yang & Wang, Ruinong & Li, Yuanzheng & Zhang, Meng & Long, Chao, 2023. "Wind power forecasting considering data privacy protection: A federated deep reinforcement learning approach," Applied Energy, Elsevier, vol. 329(C).
    10. Zhu, Jiebei & Li, Mingrui & Luo, Lin & Zhang, Bidan & Cui, Mingjian & Yu, Lujie, 2023. "Short-term PV power forecast methodology based on multi-scale fluctuation characteristics extraction," Renewable Energy, Elsevier, vol. 208(C), pages 141-151.
    11. da Silva, Ramon Gomes & Ribeiro, Matheus Henrique Dal Molin & Moreno, Sinvaldo Rodrigues & Mariani, Viviana Cocco & Coelho, Leandro dos Santos, 2021. "A novel decomposition-ensemble learning framework for multi-step ahead wind energy forecasting," Energy, Elsevier, vol. 216(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mahmud, Sakib & Sayed, Aya Nabil & Himeur, Yassine & Nhlabatsi, Armstrong & Bensaali, Faycal, 2026. "A comprehensive review of deep reinforcement learning applications from centralized power generation to modern energy internet frameworks," Renewable and Sustainable Energy Reviews, Elsevier, vol. 226(PE).
    2. Chen, Xi & Yu, Ruyi & Ullah, Sajid & Wu, Dianming & Li, Zhiqiang & Li, Qingli & Qi, Honggang & Liu, Jihui & Liu, Min & Zhang, Yundong, 2022. "A novel loss function of deep learning in wind speed forecasting," Energy, Elsevier, vol. 238(PB).
    3. Verdone, Alessio & Panella, Massimo & De Santis, Enrico & Rizzi, Antonello, 2025. "A review of solar and wind energy forecasting: From single-site to multi-site paradigm," Applied Energy, Elsevier, vol. 392(C).
    4. Huang, Xiaojia & Wang, Chen & Zhang, Shenghui, 2024. "Research and application of a Model selection forecasting system for wind speed and theoretical power generation in wind farms based on classification and wind conversion," Energy, Elsevier, vol. 293(C).
    5. Wang, Yun & Zou, Runmin & Liu, Fang & Zhang, Lingjun & Liu, Qianyi, 2021. "A review of wind speed and wind power forecasting with deep neural networks," Applied Energy, Elsevier, vol. 304(C).
    6. Zhang, Lifang & Wang, Jianzhou & Niu, Xinsong & Liu, Zhenkun, 2021. "Ensemble wind speed forecasting with multi-objective Archimedes optimization algorithm and sub-model selection," Applied Energy, Elsevier, vol. 301(C).
    7. Chen, Bingyang & Zeng, Xingjie & Zhang, Weishan & Fan, Lulu & Cao, Shaohua & Zhou, Jiehan, 2023. "Knowledge sharing-based multi-block federated learning for few-shot oil layer identification," Energy, Elsevier, vol. 283(C).
    8. Hu, Yusha & Man, Yi, 2023. "Energy consumption and carbon emissions forecasting for industrial processes: Status, challenges and perspectives," Renewable and Sustainable Energy Reviews, Elsevier, vol. 182(C).
    9. Liu, Tianhao & Shan, Linke & Jiang, Meihui & Li, Fangning & Kong, Fannie & Du, Pengcheng & Zhu, Hongyu & Goh, Hui Hwang & Kurniawan, Tonni Agustiono & Huang, Chao & Zhang, Dongdong, 2025. "Multi-dimensional data processing and intelligent forecasting technologies for renewable energy generation," Applied Energy, Elsevier, vol. 398(C).
    10. Leng, Zhiyuan & Chen, Lu & Yi, Bin & Liu, Fanqian & Xie, Tao & Mei, Ziyi, 2025. "Short-term wind speed forecasting based on a novel KANInformer model and improved dual decomposition," Energy, Elsevier, vol. 322(C).
    11. Nam, KiJeon & Hwangbo, Soonho & Yoo, ChangKyoo, 2020. "A deep learning-based forecasting model for renewable energy scenarios to guide sustainable energy policy: A case study of Korea," Renewable and Sustainable Energy Reviews, Elsevier, vol. 122(C).
    12. Liu, Yanli & Wang, Junyi & Liu, Liqi, 2024. "Physics-informed reinforcement learning for probabilistic wind power forecasting under extreme events," Applied Energy, Elsevier, vol. 376(PA).
    13. González-Sopeña, J.M. & Pakrashi, V. & Ghosh, B., 2021. "An overview of performance evaluation metrics for short-term statistical wind power forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 138(C).
    14. Zeng, Huanze & Wu, Binrong & Fang, Haoyu & Lin, Jiacheng, 2025. "Interpretable wind speed forecasting through two-stage decomposition with comprehensive relative importance analysis," Applied Energy, Elsevier, vol. 392(C).
    15. Shengcai Zhang & Changsheng Zhu & Xiuting Guo, 2024. "Wind-Speed Multi-Step Forecasting Based on Variational Mode Decomposition, Temporal Convolutional Network, and Transformer Model," Energies, MDPI, vol. 17(9), pages 1-22, April.
    16. Lv, Sheng-Xiang & Wang, Lin, 2022. "Deep learning combined wind speed forecasting with hybrid time series decomposition and multi-objective parameter optimization," Applied Energy, Elsevier, vol. 311(C).
    17. Jin, Ji & Peng, Tao & Wang, Dongwei, 2025. "A novel wind speed prediction method based on fractal wavelet decomposition explainable gated recurrent unit," Chaos, Solitons & Fractals, Elsevier, vol. 200(P1).
    18. Hong, Ying-Yi & Satriani, Thursy Rienda Aulia, 2020. "Day-ahead spatiotemporal wind speed forecasting using robust design-based deep learning neural network," Energy, Elsevier, vol. 209(C).
    19. Al-qaness, Mohammed A.A. & Ewees, Ahmed A. & Fan, Hong & Abualigah, Laith & Elaziz, Mohamed Abd, 2022. "Boosted ANFIS model using augmented marine predator algorithm with mutation operators for wind power forecasting," Applied Energy, Elsevier, vol. 314(C).
    20. Yang, Mao & Jiang, Yue & Zhang, Wei & Li, Yi & Su, Xin, 2024. "Short-term interval prediction strategy of photovoltaic power based on meteorological reconstruction with spatiotemporal correlation and multi-factor interval constraints," Renewable Energy, Elsevier, vol. 237(PC).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:renene:v:244:y:2025:i:c:s0960148125003544. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/renewable-energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.