IDEAS home Printed from https://ideas.repec.org/a/eee/renene/v244y2025ics0960148125003544.html
   My bibliography  Save this article

A reinforcement learning-based ensemble forecasting framework for renewable energy forecasting

Author

Listed:
  • Wu, Zhiyuan
  • Fang, Guohua
  • Ye, Jian
  • Zhu, David Z.
  • Huang, Xianfeng

Abstract

The randomness and intermittency of wind and photovoltaic power generation can negatively affect the stability of power systems. Therefore, accurate forecasting of these energy outputs is crucial for effective power system management. Among various forecasting methods, ensemble forecasting has gained attention for its superior performance and reliability. However, traditional ensemble methods, such as weighted averaging and stacking, use fixed model combinations that fail to adapt to varying wind and radiation conditions, thereby limiting their accuracy. To overcome this limitation, this study proposes a novel ensemble forecasting framework based on reinforcement learning. The framework uses a deep Q-network to dynamically select the appropriate base model for different wind and radiation conditions. The learning process is supported by a model control module, a basic forecasting module, and a performance evaluation module. Independent experiments conducted across 14 regions in China validate the framework's effectiveness, showing a significant improvement in forecasting accuracy. The framework achieved an average improvement of 12.18 % in mean absolute scaled error over base models and 4.84 % over other ensemble methods. Additionally, this study analyzes the impact of different reinforcement learning models and sample sizes on the framework's performance.

Suggested Citation

  • Wu, Zhiyuan & Fang, Guohua & Ye, Jian & Zhu, David Z. & Huang, Xianfeng, 2025. "A reinforcement learning-based ensemble forecasting framework for renewable energy forecasting," Renewable Energy, Elsevier, vol. 244(C).
  • Handle: RePEc:eee:renene:v:244:y:2025:i:c:s0960148125003544
    DOI: 10.1016/j.renene.2025.122692
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0960148125003544
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.renene.2025.122692?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Li, Yang & Wang, Ruinong & Li, Yuanzheng & Zhang, Meng & Long, Chao, 2023. "Wind power forecasting considering data privacy protection: A federated deep reinforcement learning approach," Applied Energy, Elsevier, vol. 329(C).
    2. Zhu, Jiebei & Li, Mingrui & Luo, Lin & Zhang, Bidan & Cui, Mingjian & Yu, Lujie, 2023. "Short-term PV power forecast methodology based on multi-scale fluctuation characteristics extraction," Renewable Energy, Elsevier, vol. 208(C), pages 141-151.
    3. Qi, Yunying & Xu, Xiao & Liu, Youbo & Pan, Li & Liu, Junyong & Hu, Weihao, 2024. "Intelligent energy management for an on-grid hydrogen refueling station based on dueling double deep Q network algorithm with NoisyNet," Renewable Energy, Elsevier, vol. 222(C).
    4. Wang, Huai-zhi & Li, Gang-qiang & Wang, Gui-bin & Peng, Jian-chun & Jiang, Hui & Liu, Yi-tao, 2017. "Deep learning based ensemble approach for probabilistic wind power forecasting," Applied Energy, Elsevier, vol. 188(C), pages 56-70.
    5. Hyndman, Rob J. & Koehler, Anne B., 2006. "Another look at measures of forecast accuracy," International Journal of Forecasting, Elsevier, vol. 22(4), pages 679-688.
    6. Bommidi, Bala Saibabu & Teeparthi, Kiran & Kosana, Vishalteja, 2023. "Hybrid wind speed forecasting using ICEEMDAN and transformer model with novel loss function," Energy, Elsevier, vol. 265(C).
    7. Liu, Hui & Yu, Chengqing & Wu, Haiping & Duan, Zhu & Yan, Guangxi, 2020. "A new hybrid ensemble deep reinforcement learning model for wind speed short term forecasting," Energy, Elsevier, vol. 202(C).
    8. Zhao, Jing & Guo, Yiyi & Lin, Yihua & Zhao, Zhiyuan & Guo, Zhenhai, 2024. "A novel dynamic ensemble of numerical weather prediction for multi-step wind speed forecasting with deep reinforcement learning and error sequence modeling," Energy, Elsevier, vol. 302(C).
    9. Mellit, A. & Pavan, A. Massi & Lughi, V., 2021. "Deep learning neural networks for short-term photovoltaic power forecasting," Renewable Energy, Elsevier, vol. 172(C), pages 276-288.
    10. Liu, Hui & Yang, Rui & Wang, Tiantian & Zhang, Lei, 2021. "A hybrid neural network model for short-term wind speed forecasting based on decomposition, multi-learner ensemble, and adaptive multiple error corrections," Renewable Energy, Elsevier, vol. 165(P1), pages 573-594.
    11. da Silva, Ramon Gomes & Ribeiro, Matheus Henrique Dal Molin & Moreno, Sinvaldo Rodrigues & Mariani, Viviana Cocco & Coelho, Leandro dos Santos, 2021. "A novel decomposition-ensemble learning framework for multi-step ahead wind energy forecasting," Energy, Elsevier, vol. 216(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chen, Xi & Yu, Ruyi & Ullah, Sajid & Wu, Dianming & Li, Zhiqiang & Li, Qingli & Qi, Honggang & Liu, Jihui & Liu, Min & Zhang, Yundong, 2022. "A novel loss function of deep learning in wind speed forecasting," Energy, Elsevier, vol. 238(PB).
    2. Huang, Xiaojia & Wang, Chen & Zhang, Shenghui, 2024. "Research and application of a Model selection forecasting system for wind speed and theoretical power generation in wind farms based on classification and wind conversion," Energy, Elsevier, vol. 293(C).
    3. Wang, Yun & Zou, Runmin & Liu, Fang & Zhang, Lingjun & Liu, Qianyi, 2021. "A review of wind speed and wind power forecasting with deep neural networks," Applied Energy, Elsevier, vol. 304(C).
    4. Zhang, Lifang & Wang, Jianzhou & Niu, Xinsong & Liu, Zhenkun, 2021. "Ensemble wind speed forecasting with multi-objective Archimedes optimization algorithm and sub-model selection," Applied Energy, Elsevier, vol. 301(C).
    5. Chen, Bingyang & Zeng, Xingjie & Zhang, Weishan & Fan, Lulu & Cao, Shaohua & Zhou, Jiehan, 2023. "Knowledge sharing-based multi-block federated learning for few-shot oil layer identification," Energy, Elsevier, vol. 283(C).
    6. Hu, Yusha & Man, Yi, 2023. "Energy consumption and carbon emissions forecasting for industrial processes: Status, challenges and perspectives," Renewable and Sustainable Energy Reviews, Elsevier, vol. 182(C).
    7. Leng, Zhiyuan & Chen, Lu & Yi, Bin & Liu, Fanqian & Xie, Tao & Mei, Ziyi, 2025. "Short-term wind speed forecasting based on a novel KANInformer model and improved dual decomposition," Energy, Elsevier, vol. 322(C).
    8. Nam, KiJeon & Hwangbo, Soonho & Yoo, ChangKyoo, 2020. "A deep learning-based forecasting model for renewable energy scenarios to guide sustainable energy policy: A case study of Korea," Renewable and Sustainable Energy Reviews, Elsevier, vol. 122(C).
    9. Liu, Yanli & Wang, Junyi & Liu, Liqi, 2024. "Physics-informed reinforcement learning for probabilistic wind power forecasting under extreme events," Applied Energy, Elsevier, vol. 376(PA).
    10. González-Sopeña, J.M. & Pakrashi, V. & Ghosh, B., 2021. "An overview of performance evaluation metrics for short-term statistical wind power forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 138(C).
    11. Lv, Sheng-Xiang & Wang, Lin, 2022. "Deep learning combined wind speed forecasting with hybrid time series decomposition and multi-objective parameter optimization," Applied Energy, Elsevier, vol. 311(C).
    12. Hong, Ying-Yi & Satriani, Thursy Rienda Aulia, 2020. "Day-ahead spatiotemporal wind speed forecasting using robust design-based deep learning neural network," Energy, Elsevier, vol. 209(C).
    13. Al-qaness, Mohammed A.A. & Ewees, Ahmed A. & Fan, Hong & Abualigah, Laith & Elaziz, Mohamed Abd, 2022. "Boosted ANFIS model using augmented marine predator algorithm with mutation operators for wind power forecasting," Applied Energy, Elsevier, vol. 314(C).
    14. Yang, Mao & Jiang, Yue & Zhang, Wei & Li, Yi & Su, Xin, 2024. "Short-term interval prediction strategy of photovoltaic power based on meteorological reconstruction with spatiotemporal correlation and multi-factor interval constraints," Renewable Energy, Elsevier, vol. 237(PC).
    15. de Azevedo Takara, Lucas & Teixeira, Ana Clara & Yazdanpanah, Hamed & Mariani, Viviana Cocco & dos Santos Coelho, Leandro, 2024. "Optimizing multi-step wind power forecasting: Integrating advanced deep neural networks with stacking-based probabilistic learning," Applied Energy, Elsevier, vol. 369(C).
    16. Yang, Mao & Guo, Yunfeng & Fan, Fulin & Huang, Tao, 2024. "Two-stage correction prediction of wind power based on numerical weather prediction wind speed superposition correction and improved clustering," Energy, Elsevier, vol. 302(C).
    17. Chen, Rujian & Liu, Gang & Cao, Yisheng & Xiao, Gang & Tang, Jianchao, 2024. "CGAformer: Multi-scale feature Transformer with MLP architecture for short-term photovoltaic power forecasting," Energy, Elsevier, vol. 312(C).
    18. Wang, Yun & Xu, Houhua & Zou, Runmin & Zhang, Lingjun & Zhang, Fan, 2022. "A deep asymmetric Laplace neural network for deterministic and probabilistic wind power forecasting," Renewable Energy, Elsevier, vol. 196(C), pages 497-517.
    19. Fabrizio De Caro & Jacopo De Stefani & Gianluca Bontempi & Alfredo A. Vaccaro & Domenico D. Villacci, 2020. "Robust Assessment of Short-Term Wind Power Forecasting Models on Multiple Time Horizons," ULB Institutional Repository 2013/314435, ULB -- Universite Libre de Bruxelles.
    20. Gensler, André & Sick, Bernhard & Vogt, Stephan, 2018. "A review of uncertainty representations and metaverification of uncertainty assessment techniques for renewable energies," Renewable and Sustainable Energy Reviews, Elsevier, vol. 96(C), pages 352-379.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:renene:v:244:y:2025:i:c:s0960148125003544. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/renewable-energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.