IDEAS home Printed from https://ideas.repec.org/a/eee/renene/v225y2024ics0960148124003185.html

Probabilistic net load forecasting based on transformer network and Gaussian process-enabled residual modeling learning method

Author

Listed:
  • Hu, Jiaxiang
  • Hu, Weihao
  • Cao, Di
  • Sun, Xinwu
  • Chen, Jianjun
  • Huang, Yuehui
  • Chen, Zhe
  • Blaabjerg, Frede

Abstract

Accurate net load forecasting plays an increasingly pivotal role in ensuring the reliable operation and scheduling of power systems. This paper introduces a novel probabilistic net load forecasting approach that combines the strengths of a Transformer network with Gaussian process regression. The state-of-the-art Transformer network is first employed to capture the net load pattern utilizing relatively abundant historical training samples. The remarkable temporal feature extraction ability allows it to discover the complex structure in net loads. Subsequently, the Gaussian Process is applied to capture the behavior of the Transformer network by modeling its forecasting residual utilizing a specific composite kernel. The modeling of the forecasting residual not only provides valuable uncertainty quantification of net load but also improves the forecasting performance based on the Transformer network. Comparative tests utilizing real-world data verify the superiority of the proposed method over other state-of-the-art net load forecasting algorithms.

Suggested Citation

  • Hu, Jiaxiang & Hu, Weihao & Cao, Di & Sun, Xinwu & Chen, Jianjun & Huang, Yuehui & Chen, Zhe & Blaabjerg, Frede, 2024. "Probabilistic net load forecasting based on transformer network and Gaussian process-enabled residual modeling learning method," Renewable Energy, Elsevier, vol. 225(C).
  • Handle: RePEc:eee:renene:v:225:y:2024:i:c:s0960148124003185
    DOI: 10.1016/j.renene.2024.120253
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0960148124003185
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.renene.2024.120253?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Wang, H.Z. & Wang, G.B. & Li, G.Q. & Peng, J.C. & Liu, Y.T., 2016. "Deep belief network based deterministic and probabilistic wind speed forecasting approach," Applied Energy, Elsevier, vol. 182(C), pages 80-93.
    2. Wang, Guang Chao & Ratnam, Elizabeth & Haghi, Hamed Valizadeh & Kleissl, Jan, 2019. "Corrective receding horizon EV charge scheduling using short-term solar forecasting," Renewable Energy, Elsevier, vol. 130(C), pages 1146-1158.
    3. Men, Zhongxian & Yee, Eugene & Lien, Fue-Sang & Wen, Deyong & Chen, Yongsheng, 2016. "Short-term wind speed and power forecasting using an ensemble of mixture density neural networks," Renewable Energy, Elsevier, vol. 87(P1), pages 203-211.
    4. Liu, Xin & Zhang, Zijun & Song, Zhe, 2020. "A comparative study of the data-driven day-ahead hourly provincial load forecasting methods: From classical data mining to deep learning," Renewable and Sustainable Energy Reviews, Elsevier, vol. 119(C).
    5. Sobolewski, Robert Adam & Tchakorom, Médane & Couturier, Raphaël, 2023. "Gradient boosting-based approach for short- and medium-term wind turbine output power prediction," Renewable Energy, Elsevier, vol. 203(C), pages 142-160.
    6. Negri, Simone & Giani, Federico & Blasuttigh, Nicola & Massi Pavan, Alessandro & Mellit, Adel & Tironi, Enrico, 2022. "Combined model predictive control and ANN-based forecasters for jointly acting renewable self-consumers: An environmental and economical evaluation," Renewable Energy, Elsevier, vol. 198(C), pages 440-454.
    7. Hu, Jiaxiang & Hu, Weihao & Cao, Di & Huang, Yuehui & Chen, Jianjun & Li, Yahe & Chen, Zhe & Blaabjerg, Frede, 2024. "Bayesian averaging-enabled transfer learning method for probabilistic wind power forecasting of newly built wind farms," Applied Energy, Elsevier, vol. 355(C).
    8. Zhang, Chu & Ji, Chunlei & Hua, Lei & Ma, Huixin & Nazir, Muhammad Shahzad & Peng, Tian, 2022. "Evolutionary quantile regression gated recurrent unit network based on variational mode decomposition, improved whale optimization algorithm for probabilistic short-term wind speed prediction," Renewable Energy, Elsevier, vol. 197(C), pages 668-682.
    9. Lee, Yoonjae & Ha, Byeongmin & Hwangbo, Soonho, 2022. "Generative model-based hybrid forecasting model for renewable electricity supply using long short-term memory networks: A case study of South Korea's energy transition policy," Renewable Energy, Elsevier, vol. 200(C), pages 69-87.
    10. Zhang, Jinhua & Meng, Hang & Gu, Bo & Li, Pin, 2020. "Research on short-term wind power combined forecasting and its Gaussian cloud uncertainty to support the integration of renewables and EVs," Renewable Energy, Elsevier, vol. 153(C), pages 884-899.
    11. Lusis, Peter & Khalilpour, Kaveh Rajab & Andrew, Lachlan & Liebman, Ariel, 2017. "Short-term residential load forecasting: Impact of calendar effects and forecast granularity," Applied Energy, Elsevier, vol. 205(C), pages 654-669.
    12. Chen, Yahong & Deng, Changhong & Yao, Weiwei & Liang, Ning & Xia, Pei & Cao, Peng & Dong, Yiwang & Zhang, Yuan-ao & Liu, Zhichao & Li, Dinglin & Chen, Man & Peng, Peng, 2019. "Impacts of stochastic forecast errors of renewable energy generation and load demands on microgrid operation," Renewable Energy, Elsevier, vol. 133(C), pages 442-461.
    13. Pierro, Marco & De Felice, Matteo & Maggioni, Enrico & Moser, David & Perotto, Alessandro & Spada, Francesco & Cornaro, Cristina, 2020. "Residual load probabilistic forecast for reserve assessment: A real case study," Renewable Energy, Elsevier, vol. 149(C), pages 508-522.
    14. Toro-Cárdenas, Mateo & Moreira, Inês & Morais, Hugo & Carvalho, Pedro M.S. & Ferreira, Luis A.F.M., 2023. "Net load disaggregation at secondary substation level," Renewable Energy, Elsevier, vol. 207(C), pages 765-771.
    15. Kaur, Amanpreet & Nonnenmacher, Lukas & Coimbra, Carlos F.M., 2016. "Net load forecasting for high renewable energy penetration grids," Energy, Elsevier, vol. 114(C), pages 1073-1084.
    16. Liu, Xin & Yang, Luoxiao & Zhang, Zijun, 2022. "The attention-assisted ordinary differential equation networks for short-term probabilistic wind power predictions," Applied Energy, Elsevier, vol. 324(C).
    17. Sreekumar, S. & Khan, N.U. & Rana, A.S. & Sajjadi, M. & Kothari, D.P., 2022. "Aggregated Net-load Forecasting using Markov-Chain Monte-Carlo Regression and C-vine copula," Applied Energy, Elsevier, vol. 328(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chen, Haoyu & Huang, Hai & Zheng, Yong & Yang, Bing, 2024. "A load forecasting approach for integrated energy systems based on aggregation hybrid modal decomposition and combined model," Applied Energy, Elsevier, vol. 375(C).
    2. Tian, Zhirui & Liu, Weican & Zhang, Jiahao & Sun, Wenpu & Wu, Chenye, 2025. "EDformer family: End-to-end multi-task load forecasting frameworks for day-ahead economic dispatch," Applied Energy, Elsevier, vol. 383(C).
    3. Meisenbacher, Stefan & Phipps, Kaleb & Taubert, Oskar & Weiel, Marie & Götz, Markus & Mikut, Ralf & Hagenmeyer, Veit, 2025. "AutoPQ: Automating quantile estimation from point forecasts in the context of sustainability," Applied Energy, Elsevier, vol. 392(C).
    4. Qu, Hongjiao & Wang, Weiyin & Feng, Chen-Chieh & Guo, Luo, 2026. "The new perspective of future multi-scenario analysis: Decoding impact pathways of land use dynamics on sustainable development goals," Land Use Policy, Elsevier, vol. 162(C).
    5. Zhang, Ying & Qiao, Dalei & Wu, Shun & Liu, Chao & Zhao, Bu & Gu, Yongli & Du, Tao, 2026. "Short-term wind power forecasting in complex terrain based on spatiotemporal enhanced deep correction network," Renewable Energy, Elsevier, vol. 256(PF).
    6. Wu, Bizhi & Xiao, Jiangwen & Wang, Shanlin & Zhang, Ziyuan & Wen, Renqiang, 2025. "Enhancing short-term net load forecasting with additive neural decomposition and Weibull Attention," Energy, Elsevier, vol. 322(C).
    7. Tingzhe Pan & Zean Zhu & Hongxuan Luo & Chao Li & Xin Jin & Zijie Meng & Xinlei Cai, 2025. "Probabilistic HVAC Load Forecasting Method Based on Transformer Network Considering Multiscale and Multivariable Correlation," Energies, MDPI, vol. 18(19), pages 1-21, September.
    8. Mingxiang Li & Tianyi Zhang & Haizhu Yang & Kun Liu, 2024. "Multiple Load Forecasting of Integrated Renewable Energy System Based on TCN-FECAM-Informer," Energies, MDPI, vol. 17(20), pages 1-16, October.
    9. Tang, Yan & Jiang, Yizhuo & Hu, Yang & Cheng, Yunpei, 2026. "Carbon emission reduction potential analysis of biodiesel production from microalgae and waste cooking oil under different SSPs scenarios in China-based on GRA-CNN-BiLSTM modeling," Renewable Energy, Elsevier, vol. 258(C).
    10. Liang, Min & Hu, Yongli & Weng, Haoen & Xi, Jiayang & Yin, Baocai, 2025. "EnergyGPT: Fine-tuning large language model for multi-energy load forecasting," Renewable Energy, Elsevier, vol. 251(C).
    11. Cai, Jun & Cai, Yuxin & Yan, Ying & Chen, Liang & Zhang, Xin, 2026. "Synergistic cyclic optimization strategy for the data screening and forecasting of solar power, Wind power, and electricity load," Renewable Energy, Elsevier, vol. 256(PH).
    12. Wang, Jun & Zhang, Xuanyu & Wang, Yonggang & Liu, Jiashun & Wang, Han & Lin, Jiali & Xu, Chen & Hua, Shuo, 2025. "A zero-shot load forecasting method for extreme weather integrating causal learning and meta-learning," Energy, Elsevier, vol. 334(C).
    13. Liu, Tianhao & Li, Fangning & Zhang, Dongdong & Shan, Linke & Zhu, Hongyu & Du, Pengcheng & Jiang, Meihui & Goh, Hui Hwang & Kurniawan, Tonni Agustiono & Huang, Chao & Kong, Fannie, 2026. "Intelligent load forecasting technologies for diverse scenarios in the new power systems," Renewable and Sustainable Energy Reviews, Elsevier, vol. 226(PD).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Yun & Zhang, Fan & Kou, Hongbo & Zou, Runmin & Hu, Qinghua & Wang, Jianzhou & Srinivasan, Dipti, 2025. "A review of predictive uncertainty modeling techniques and evaluation metrics in probabilistic wind speed and wind power forecasting," Applied Energy, Elsevier, vol. 396(C).
    2. He, Yan & Zhang, Hongli & Dong, Yingchao & Wang, Cong & Ma, Ping, 2024. "Residential net load interval prediction based on stacking ensemble learning," Energy, Elsevier, vol. 296(C).
    3. Wang, Jianzhou & Dong, Yunxuan & Zhang, Kequan & Guo, Zhenhai, 2017. "A numerical model based on prior distribution fuzzy inference and neural networks," Renewable Energy, Elsevier, vol. 112(C), pages 486-497.
    4. Meng, Anbo & Li, Hanhong & Yin, Hao & Li, Xuecong, 2025. "A novel net load prediction approach using multi-scale deep learning network based on Trend-Multi-Period encoder and segment imbalance regression," Energy, Elsevier, vol. 332(C).
    5. Lu, Peng & Ye, Lin & Pei, Ming & Zhao, Yongning & Dai, Binhua & Li, Zhuo, 2022. "Short-term wind power forecasting based on meteorological feature extraction and optimization strategy," Renewable Energy, Elsevier, vol. 184(C), pages 642-661.
    6. Luca Massidda & Marino Marrocu, 2017. "Decoupling Weather Influence from User Habits for an Optimal Electric Load Forecast System," Energies, MDPI, vol. 10(12), pages 1-16, December.
    7. Zang, Haixiang & Xu, Ruiqi & Cheng, Lilin & Ding, Tao & Liu, Ling & Wei, Zhinong & Sun, Guoqiang, 2021. "Residential load forecasting based on LSTM fusing self-attention mechanism with pooling," Energy, Elsevier, vol. 229(C).
    8. Liu, Xin & Yang, Luoxiao & Zhang, Zijun, 2022. "The attention-assisted ordinary differential equation networks for short-term probabilistic wind power predictions," Applied Energy, Elsevier, vol. 324(C).
    9. Zhao, Ning & Su, Yi & Dai, Xianxing & Jia, Shaomin & Wang, Xuewei, 2024. "A new decomposition-ensemble strategy fusion with correntropy optimization learning algorithms for short-term wind speed prediction," Applied Energy, Elsevier, vol. 369(C).
    10. Zhang, Jinhua & Yan, Jie & Infield, David & Liu, Yongqian & Lien, Fue-sang, 2019. "Short-term forecasting and uncertainty analysis of wind turbine power based on long short-term memory network and Gaussian mixture model," Applied Energy, Elsevier, vol. 241(C), pages 229-244.
    11. Liu, Tianhao & Li, Fangning & Zhang, Dongdong & Shan, Linke & Zhu, Hongyu & Du, Pengcheng & Jiang, Meihui & Goh, Hui Hwang & Kurniawan, Tonni Agustiono & Huang, Chao & Kong, Fannie, 2026. "Intelligent load forecasting technologies for diverse scenarios in the new power systems," Renewable and Sustainable Energy Reviews, Elsevier, vol. 226(PD).
    12. Agga, Ali & Abbou, Ahmed & Labbadi, Moussa & El Houm, Yassine, 2021. "Short-term self consumption PV plant power production forecasts based on hybrid CNN-LSTM, ConvLSTM models," Renewable Energy, Elsevier, vol. 177(C), pages 101-112.
    13. Mojtaba Qolipour & Ali Mostafaeipour & Mohammad Saidi-Mehrabad & Hamid R Arabnia, 2019. "Prediction of wind speed using a new Grey-extreme learning machine hybrid algorithm: A case study," Energy & Environment, , vol. 30(1), pages 44-62, February.
    14. Jihoon Moon & Junhong Kim & Pilsung Kang & Eenjun Hwang, 2020. "Solving the Cold-Start Problem in Short-Term Load Forecasting Using Tree-Based Methods," Energies, MDPI, vol. 13(4), pages 1-37, February.
    15. Rana Muhammad Adnan & Zhongmin Liang & Xiaohui Yuan & Ozgur Kisi & Muhammad Akhlaq & Binquan Li, 2019. "Comparison of LSSVR, M5RT, NF-GP, and NF-SC Models for Predictions of Hourly Wind Speed and Wind Power Based on Cross-Validation," Energies, MDPI, vol. 12(2), pages 1-22, January.
    16. Zhang, Ning & Li, Zhiying & Zou, Xun & Quiring, Steven M., 2019. "Comparison of three short-term load forecast models in Southern California," Energy, Elsevier, vol. 189(C).
    17. Bhattacharjee, Vikram & Khan, Irfan, 2018. "A non-linear convex cost model for economic dispatch in microgrids," Applied Energy, Elsevier, vol. 222(C), pages 637-648.
    18. Kong, Xiangyu & Li, Chuang & Wang, Chengshan & Zhang, Yusen & Zhang, Jian, 2020. "Short-term electrical load forecasting based on error correction using dynamic mode decomposition," Applied Energy, Elsevier, vol. 261(C).
    19. Erik Heilmann & Janosch Henze & Heike Wetzel, 2021. "Machine learning in energy forecasts with an application to high frequency electricity consumption data," MAGKS Papers on Economics 202135, Philipps-Universität Marburg, Faculty of Business Administration and Economics, Department of Economics (Volkswirtschaftliche Abteilung).
    20. Ke Yan & Xudong Wang & Yang Du & Ning Jin & Haichao Huang & Hangxia Zhou, 2018. "Multi-Step Short-Term Power Consumption Forecasting with a Hybrid Deep Learning Strategy," Energies, MDPI, vol. 11(11), pages 1-15, November.

    More about this item

    Keywords

    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:renene:v:225:y:2024:i:c:s0960148124003185. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/renewable-energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.