IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v320y2025ics0360544225006176.html

A multi-energy loads forecasting model based on dual attention mechanism and multi-scale hierarchical residual network with gated recurrent unit

Author

Listed:
  • Chen, Wenhao
  • Rong, Fei
  • Lin, Chuan

Abstract

Multi-energy loads forecasting (MELF) is crucial for the effective management of integrated energy systems (IES) and the balance between energy supply and demand. Nevertheless, a complex coupling relationship exists between multi-energy loads, and they are also influenced by external factors such as meteorological conditions, calendar information, and random user behaviors. Moreover, existing methods are usually difficult to capture the characteristics of multi-energy loads with obvious regularities, which limits the prediction accuracy. To address these challenges, we design a MELF method based on a dual attention mechanism, multi-scale hierarchical residual network, and gated recurrent unit (GRU), referred to as the DAM-MSHRN-GRU method. First, we design a dual attention mechanism that allocates suitable weights to various time points and input features, mitigating the impact of time and external factors on prediction accuracy. Next, we develop a multi-scale hierarchical residual network to extract both short-term load fluctuations and long-term periodic load characteristics, enhancing the forecasting capability during periods of significant load volatility. MSHRN uses depthwise convolution residual blocks with different kernel sizes to convolve the exogenous features of multi-energy loads one by one to capture the regularities of multi-energy loads. Finally, we utilize GRU to capture the temporal patterns of the load. Simulation results demonstrate that the DAM-MSHRN-GRU obtains higher forecasting accuracy compared to existing models.

Suggested Citation

  • Chen, Wenhao & Rong, Fei & Lin, Chuan, 2025. "A multi-energy loads forecasting model based on dual attention mechanism and multi-scale hierarchical residual network with gated recurrent unit," Energy, Elsevier, vol. 320(C).
  • Handle: RePEc:eee:energy:v:320:y:2025:i:c:s0360544225006176
    DOI: 10.1016/j.energy.2025.134975
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544225006176
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2025.134975?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Gao, Peng & Yang, Yang & Li, Fei & Ge, Jiaxin & Yin, Qianqian & Wang, Ruikun, 2024. "Research on integrated decision making of multiple load combination forecasting for integrated energy system," Energy, Elsevier, vol. 311(C).
    2. Wan, Anping & Chang, Qing & AL-Bukhaiti, Khalil & He, Jiabo, 2023. "Short-term power load forecasting for combined heat and power using CNN-LSTM enhanced by attention mechanism," Energy, Elsevier, vol. 282(C).
    3. Song, Cairong & Yang, Haidong & Cai, Jianyang & Yang, Pan & Bao, Hao & Xu, Kangkang & Meng, Xian-Bing, 2024. "Multi-energy load forecasting via hierarchical multi-task learning and spatiotemporal attention," Applied Energy, Elsevier, vol. 373(C).
    4. Mokarram, Mohammad Jafar & Rashiditabar, Reza & Gitizadeh, Mohsen & Aghaei, Jamshid, 2023. "Net-load forecasting of renewable energy systems using multi-input LSTM fuzzy and discrete wavelet transform," Energy, Elsevier, vol. 275(C).
    5. Li, Ke & Mu, Yuchen & Yang, Fan & Wang, Haiyang & Yan, Yi & Zhang, Chenghui, 2023. "A novel short-term multi-energy load forecasting method for integrated energy system based on feature separation-fusion technology and improved CNN," Applied Energy, Elsevier, vol. 351(C).
    6. Wang, Han & Yan, Jie & Zhang, Jiawei & Liu, Shihua & Liu, Yongqian & Han, Shuang & Qu, Tonghui, 2024. "Short-term integrated forecasting method for wind power, solar power, and system load based on variable attention mechanism and multi-task learning," Energy, Elsevier, vol. 304(C).
    7. Gong, Mingju & Zhao, Yin & Sun, Jiawang & Han, Cuitian & Sun, Guannan & Yan, Bo, 2022. "Load forecasting of district heating system based on Informer," Energy, Elsevier, vol. 253(C).
    8. Shi, Jian & Teh, Jiashen & Alharbi, Bader & Lai, Ching-Ming, 2024. "Load forecasting for regional integrated energy system based on two-phase decomposition and mixture prediction model," Energy, Elsevier, vol. 297(C).
    9. Liao, Chengchen & Tan, Mao & Li, Kang & Chen, Jie & Wang, Rui & Su, Yongxin, 2024. "Sequence signal prediction and reconstruction for multi-energy load forecasting in integrated energy systems: A bi-level multi-task learning method," Energy, Elsevier, vol. 313(C).
    10. Ma, Xin & Peng, Bo & Ma, Xiangxue & Tian, Changbin & Yan, Yi, 2023. "Multi-timescale optimization scheduling of regional integrated energy system based on source-load joint forecasting," Energy, Elsevier, vol. 283(C).
    11. Chung, Won Hee & Gu, Yeong Hyeon & Yoo, Seong Joon, 2022. "District heater load forecasting based on machine learning and parallel CNN-LSTM attention," Energy, Elsevier, vol. 246(C).
    12. Xie, Xiangmin & Ding, Yuhao & Sun, Yuanyuan & Zhang, Zhisheng & Fan, Jianhua, 2024. "A novel time-series probabilistic forecasting method for multi-energy loads," Energy, Elsevier, vol. 306(C).
    13. Li, Ke & Mu, Yuchen & Yang, Fan & Wang, Haiyang & Yan, Yi & Zhang, Chenghui, 2024. "Joint forecasting of source-load-price for integrated energy system based on multi-task learning and hybrid attention mechanism," Applied Energy, Elsevier, vol. 360(C).
    14. Imani, Maryam, 2021. "Electrical load-temperature CNN for residential load forecasting," Energy, Elsevier, vol. 227(C).
    15. Li, Chuang & Li, Guojie & Wang, Keyou & Han, Bei, 2022. "A multi-energy load forecasting method based on parallel architecture CNN-GRU and transfer learning for data deficient integrated energy systems," Energy, Elsevier, vol. 259(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chen, Wenhao & Rong, Fei & Lin, Chuan, 2025. "A deep reinforcement learning method based on Mamba model with adaptive cross-attention for multi-energy microgrid energy management," Energy, Elsevier, vol. 340(C).
    2. Zhao, Xiaoyu & Duan, Pengfei & Cao, Xiaodong & Xue, Qingwen & Zhao, Bingxu & Hu, Jinxue & Zhang, Chenyang & Yuan, Xiaoyang, 2025. "A probabilistic load forecasting method for multi-energy loads based on inflection point optimization and integrated feature screening," Energy, Elsevier, vol. 327(C).
    3. Wu, Xiaobang & Wang, Deguang & Yang, Ming & Liang, Chengbin, 2025. "CEEMDAN-SE-HDBSCAN-VMD-TCN-BiGRU: A two-stage decomposition-based parallel model for multi-altitude ultra-short-term wind speed forecasting," Energy, Elsevier, vol. 330(C).
    4. Wang, Danhao & Peng, Daogang & Huang, Dongmei & Zhao, Huirong & Qu, Bogang, 2025. "MMEMformer: A multi-scale memory-enhanced transformer framework for short-term load forecasting in integrated energy systems," Energy, Elsevier, vol. 322(C).
    5. Xia, Baozhou & Ye, Min & Wei, Meng & Wang, Qiao & Lian, Gaoqi & Li, Yan, 2025. "SOH estimation of lithium-ion batteries with local health indicators in multi-stage fast charging protocols," Energy, Elsevier, vol. 334(C).
    6. Luo, Haowen & Tong, Cunzhi & Gu, Wei & Li, Zhiyi, 2025. "Time-series imaging for improving the accuracy of short-term load forecasting," Energy, Elsevier, vol. 333(C).
    7. Heng Zhou & Qing Ai & Ruiting Li, 2025. "Short-Term Multi-Energy Load Forecasting Method Based on Transformer Spatio-Temporal Graph Neural Network," Energies, MDPI, vol. 18(17), pages 1-19, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhao, Xiaoyu & Duan, Pengfei & Cao, Xiaodong & Xue, Qingwen & Zhao, Bingxu & Hu, Jinxue & Zhang, Chenyang & Yuan, Xiaoyang, 2025. "A probabilistic load forecasting method for multi-energy loads based on inflection point optimization and integrated feature screening," Energy, Elsevier, vol. 327(C).
    2. Wang, Danhao & Peng, Daogang & Huang, Dongmei & Zhao, Huirong & Qu, Bogang, 2025. "MMEMformer: A multi-scale memory-enhanced transformer framework for short-term load forecasting in integrated energy systems," Energy, Elsevier, vol. 322(C).
    3. Hu, Rong & Zhou, Kaile & Lu, Xinhui, 2025. "Integrated loads forecasting with absence of crucial factors," Energy, Elsevier, vol. 322(C).
    4. Liao, Chengchen & Tan, Mao & Li, Kang & Chen, Jie & Wang, Rui & Su, Yongxin, 2024. "Sequence signal prediction and reconstruction for multi-energy load forecasting in integrated energy systems: A bi-level multi-task learning method," Energy, Elsevier, vol. 313(C).
    5. Liu, Tianhao & Li, Fangning & Zhang, Dongdong & Shan, Linke & Zhu, Hongyu & Du, Pengcheng & Jiang, Meihui & Goh, Hui Hwang & Kurniawan, Tonni Agustiono & Huang, Chao & Kong, Fannie, 2026. "Intelligent load forecasting technologies for diverse scenarios in the new power systems," Renewable and Sustainable Energy Reviews, Elsevier, vol. 226(PD).
    6. Tan, Quanwei & Zhu, Jiebei & Xue, Guijun & Xie, Wenju, 2025. "A hybrid heat load forecasting model based on multistage decomposition and dynamic adaptive loss function," Energy, Elsevier, vol. 335(C).
    7. Li, Ke & Qin, Zheng & Mu, Yuchen & Wang, Haiyang & Bie, Qingfeng & Yin, Xianxin & Yan, Yi, 2025. "Transfer learning-based multi-energy load forecasting method for integrated energy system with zero-shot," Applied Energy, Elsevier, vol. 401(PC).
    8. Li, Feng & Liu, Shiheng & Wang, Tianhu & Liu, Ranran, 2024. "Optimal planning for integrated electricity and heat systems using CNN-BiLSTM-Attention network forecasts," Energy, Elsevier, vol. 309(C).
    9. Chen, Haoyu & Huang, Hai & Zheng, Yong & Yang, Bing, 2024. "A load forecasting approach for integrated energy systems based on aggregation hybrid modal decomposition and combined model," Applied Energy, Elsevier, vol. 375(C).
    10. Wu, Bizhi & Xiao, Jiangwen & Wang, Shanlin & Zhang, Ziyuan & Wen, Renqiang, 2025. "Enhancing short-term net load forecasting with additive neural decomposition and Weibull Attention," Energy, Elsevier, vol. 322(C).
    11. Hu, Jinxue & Duan, Pengfei & Cao, Xiaodong & Xue, Qingwen & Zhao, Bingxu & Zhao, Xiaoyu & Yuan, Xiaoyang & Zhang, Chenyang, 2025. "A multi-energy load forecasting method based on the Mixture-of-Experts model and dynamic multilevel attention mechanism," Energy, Elsevier, vol. 324(C).
    12. Hu, Likun & Cao, Yi & Yin, Linfei, 2024. "Long-term price guidance mechanism for integrated energy systems based on gated recurrent unit - vision transformer prediction and fractional-order stochastic dynamic calculus control," Energy, Elsevier, vol. 312(C).
    13. Ren, Xiaoxiao & Tian, Xin & Wang, Kai & Yang, Sifan & Chen, Weixiong & Wang, Jinshi, 2025. "Enhanced load forecasting for distributed multi-energy system: A stacking ensemble learning method with deep reinforcement learning and model fusion," Energy, Elsevier, vol. 319(C).
    14. Fan, Pengdan & Wang, Dan & Wang, Wei & Zhang, Xiuyu & Sun, Yuying, 2024. "A novel multi-energy load forecasting method based on building flexibility feature recognition technology and multi-task learning model integrating LSTM," Energy, Elsevier, vol. 308(C).
    15. Peng, Daogang & Liu, Yu & Wang, Danhao & Zhao, Huirong & Qu, Bogang, 2024. "Multi-energy load forecasting for integrated energy system based on sequence decomposition fusion and factors correlation analysis," Energy, Elsevier, vol. 308(C).
    16. Liu, Yanli & Jia, Ziwen & Liu, Liqi, 2025. "Spatio-temporal feature amplified forecasting framework for uncertain power tracking of multitype renewable energy and loads," Applied Energy, Elsevier, vol. 400(C).
    17. Xu, Huifeng & Hu, Feihu & Liang, Xinhao & Zhao, Guoqing & Abugunmi, Mohammad, 2024. "A framework for electricity load forecasting based on attention mechanism time series depthwise separable convolutional neural network," Energy, Elsevier, vol. 299(C).
    18. Runge, Jason & Saloux, Etienne, 2023. "A comparison of prediction and forecasting artificial intelligence models to estimate the future energy demand in a district heating system," Energy, Elsevier, vol. 269(C).
    19. Song, Jiancai & Wang, Kangning & Bian, Tianxiang & Li, Wen & Dong, Qianxing & Chen, Lei & Xue, Guixiang & Wu, Xiangdong, 2025. "A novel heat load prediction algorithm based on fuzzy C-mean clustering and mixed positional encoding informer," Applied Energy, Elsevier, vol. 388(C).
    20. Moreno, Sinvaldo Rodrigues & Seman, Laio Oriel & Stefenon, Stefano Frizzo & Coelho, Leandro dos Santos & Mariani, Viviana Cocco, 2024. "Enhancing wind speed forecasting through synergy of machine learning, singular spectral analysis, and variational mode decomposition," Energy, Elsevier, vol. 292(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:320:y:2025:i:c:s0360544225006176. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.