IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v320y2025ics0360544225006176.html
   My bibliography  Save this article

A multi-energy loads forecasting model based on dual attention mechanism and multi-scale hierarchical residual network with gated recurrent unit

Author

Listed:
  • Chen, Wenhao
  • Rong, Fei
  • Lin, Chuan

Abstract

Multi-energy loads forecasting (MELF) is crucial for the effective management of integrated energy systems (IES) and the balance between energy supply and demand. Nevertheless, a complex coupling relationship exists between multi-energy loads, and they are also influenced by external factors such as meteorological conditions, calendar information, and random user behaviors. Moreover, existing methods are usually difficult to capture the characteristics of multi-energy loads with obvious regularities, which limits the prediction accuracy. To address these challenges, we design a MELF method based on a dual attention mechanism, multi-scale hierarchical residual network, and gated recurrent unit (GRU), referred to as the DAM-MSHRN-GRU method. First, we design a dual attention mechanism that allocates suitable weights to various time points and input features, mitigating the impact of time and external factors on prediction accuracy. Next, we develop a multi-scale hierarchical residual network to extract both short-term load fluctuations and long-term periodic load characteristics, enhancing the forecasting capability during periods of significant load volatility. MSHRN uses depthwise convolution residual blocks with different kernel sizes to convolve the exogenous features of multi-energy loads one by one to capture the regularities of multi-energy loads. Finally, we utilize GRU to capture the temporal patterns of the load. Simulation results demonstrate that the DAM-MSHRN-GRU obtains higher forecasting accuracy compared to existing models.

Suggested Citation

  • Chen, Wenhao & Rong, Fei & Lin, Chuan, 2025. "A multi-energy loads forecasting model based on dual attention mechanism and multi-scale hierarchical residual network with gated recurrent unit," Energy, Elsevier, vol. 320(C).
  • Handle: RePEc:eee:energy:v:320:y:2025:i:c:s0360544225006176
    DOI: 10.1016/j.energy.2025.134975
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544225006176
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2025.134975?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Gong, Mingju & Zhao, Yin & Sun, Jiawang & Han, Cuitian & Sun, Guannan & Yan, Bo, 2022. "Load forecasting of district heating system based on Informer," Energy, Elsevier, vol. 253(C).
    2. Liao, Chengchen & Tan, Mao & Li, Kang & Chen, Jie & Wang, Rui & Su, Yongxin, 2024. "Sequence signal prediction and reconstruction for multi-energy load forecasting in integrated energy systems: A bi-level multi-task learning method," Energy, Elsevier, vol. 313(C).
    3. Ma, Xin & Peng, Bo & Ma, Xiangxue & Tian, Changbin & Yan, Yi, 2023. "Multi-timescale optimization scheduling of regional integrated energy system based on source-load joint forecasting," Energy, Elsevier, vol. 283(C).
    4. Li, Chuang & Li, Guojie & Wang, Keyou & Han, Bei, 2022. "A multi-energy load forecasting method based on parallel architecture CNN-GRU and transfer learning for data deficient integrated energy systems," Energy, Elsevier, vol. 259(C).
    5. Song, Cairong & Yang, Haidong & Cai, Jianyang & Yang, Pan & Bao, Hao & Xu, Kangkang & Meng, Xian-Bing, 2024. "Multi-energy load forecasting via hierarchical multi-task learning and spatiotemporal attention," Applied Energy, Elsevier, vol. 373(C).
    6. Mokarram, Mohammad Jafar & Rashiditabar, Reza & Gitizadeh, Mohsen & Aghaei, Jamshid, 2023. "Net-load forecasting of renewable energy systems using multi-input LSTM fuzzy and discrete wavelet transform," Energy, Elsevier, vol. 275(C).
    7. Wang, Han & Yan, Jie & Zhang, Jiawei & Liu, Shihua & Liu, Yongqian & Han, Shuang & Qu, Tonghui, 2024. "Short-term integrated forecasting method for wind power, solar power, and system load based on variable attention mechanism and multi-task learning," Energy, Elsevier, vol. 304(C).
    8. Chung, Won Hee & Gu, Yeong Hyeon & Yoo, Seong Joon, 2022. "District heater load forecasting based on machine learning and parallel CNN-LSTM attention," Energy, Elsevier, vol. 246(C).
    9. Li, Ke & Mu, Yuchen & Yang, Fan & Wang, Haiyang & Yan, Yi & Zhang, Chenghui, 2024. "Joint forecasting of source-load-price for integrated energy system based on multi-task learning and hybrid attention mechanism," Applied Energy, Elsevier, vol. 360(C).
    10. Imani, Maryam, 2021. "Electrical load-temperature CNN for residential load forecasting," Energy, Elsevier, vol. 227(C).
    11. Li, Ke & Mu, Yuchen & Yang, Fan & Wang, Haiyang & Yan, Yi & Zhang, Chenghui, 2023. "A novel short-term multi-energy load forecasting method for integrated energy system based on feature separation-fusion technology and improved CNN," Applied Energy, Elsevier, vol. 351(C).
    12. Shi, Jian & Teh, Jiashen & Alharbi, Bader & Lai, Ching-Ming, 2024. "Load forecasting for regional integrated energy system based on two-phase decomposition and mixture prediction model," Energy, Elsevier, vol. 297(C).
    13. Xie, Xiangmin & Ding, Yuhao & Sun, Yuanyuan & Zhang, Zhisheng & Fan, Jianhua, 2024. "A novel time-series probabilistic forecasting method for multi-energy loads," Energy, Elsevier, vol. 306(C).
    14. Gao, Peng & Yang, Yang & Li, Fei & Ge, Jiaxin & Yin, Qianqian & Wang, Ruikun, 2024. "Research on integrated decision making of multiple load combination forecasting for integrated energy system," Energy, Elsevier, vol. 311(C).
    15. Wan, Anping & Chang, Qing & AL-Bukhaiti, Khalil & He, Jiabo, 2023. "Short-term power load forecasting for combined heat and power using CNN-LSTM enhanced by attention mechanism," Energy, Elsevier, vol. 282(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhao, Xiaoyu & Duan, Pengfei & Cao, Xiaodong & Xue, Qingwen & Zhao, Bingxu & Hu, Jinxue & Zhang, Chenyang & Yuan, Xiaoyang, 2025. "A probabilistic load forecasting method for multi-energy loads based on inflection point optimization and integrated feature screening," Energy, Elsevier, vol. 327(C).
    2. Wang, Danhao & Peng, Daogang & Huang, Dongmei & Zhao, Huirong & Qu, Bogang, 2025. "MMEMformer: A multi-scale memory-enhanced transformer framework for short-term load forecasting in integrated energy systems," Energy, Elsevier, vol. 322(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhao, Xiaoyu & Duan, Pengfei & Cao, Xiaodong & Xue, Qingwen & Zhao, Bingxu & Hu, Jinxue & Zhang, Chenyang & Yuan, Xiaoyang, 2025. "A probabilistic load forecasting method for multi-energy loads based on inflection point optimization and integrated feature screening," Energy, Elsevier, vol. 327(C).
    2. Wang, Danhao & Peng, Daogang & Huang, Dongmei & Zhao, Huirong & Qu, Bogang, 2025. "MMEMformer: A multi-scale memory-enhanced transformer framework for short-term load forecasting in integrated energy systems," Energy, Elsevier, vol. 322(C).
    3. Hu, Rong & Zhou, Kaile & Lu, Xinhui, 2025. "Integrated loads forecasting with absence of crucial factors," Energy, Elsevier, vol. 322(C).
    4. Liao, Chengchen & Tan, Mao & Li, Kang & Chen, Jie & Wang, Rui & Su, Yongxin, 2024. "Sequence signal prediction and reconstruction for multi-energy load forecasting in integrated energy systems: A bi-level multi-task learning method," Energy, Elsevier, vol. 313(C).
    5. Chen, Haoyu & Huang, Hai & Zheng, Yong & Yang, Bing, 2024. "A load forecasting approach for integrated energy systems based on aggregation hybrid modal decomposition and combined model," Applied Energy, Elsevier, vol. 375(C).
    6. Hu, Likun & Cao, Yi & Yin, Linfei, 2024. "Long-term price guidance mechanism for integrated energy systems based on gated recurrent unit - vision transformer prediction and fractional-order stochastic dynamic calculus control," Energy, Elsevier, vol. 312(C).
    7. Fan, Pengdan & Wang, Dan & Wang, Wei & Zhang, Xiuyu & Sun, Yuying, 2024. "A novel multi-energy load forecasting method based on building flexibility feature recognition technology and multi-task learning model integrating LSTM," Energy, Elsevier, vol. 308(C).
    8. Peng, Daogang & Liu, Yu & Wang, Danhao & Zhao, Huirong & Qu, Bogang, 2024. "Multi-energy load forecasting for integrated energy system based on sequence decomposition fusion and factors correlation analysis," Energy, Elsevier, vol. 308(C).
    9. Li, Feng & Liu, Shiheng & Wang, Tianhu & Liu, Ranran, 2024. "Optimal planning for integrated electricity and heat systems using CNN-BiLSTM-Attention network forecasts," Energy, Elsevier, vol. 309(C).
    10. Wu, Bizhi & Xiao, Jiangwen & Wang, Shanlin & Zhang, Ziyuan & Wen, Renqiang, 2025. "Enhancing short-term net load forecasting with additive neural decomposition and Weibull Attention," Energy, Elsevier, vol. 322(C).
    11. Hu, Jinxue & Duan, Pengfei & Cao, Xiaodong & Xue, Qingwen & Zhao, Bingxu & Zhao, Xiaoyu & Yuan, Xiaoyang & Zhang, Chenyang, 2025. "A multi-energy load forecasting method based on the Mixture-of-Experts model and dynamic multilevel attention mechanism," Energy, Elsevier, vol. 324(C).
    12. Ren, Xiaoxiao & Tian, Xin & Wang, Kai & Yang, Sifan & Chen, Weixiong & Wang, Jinshi, 2025. "Enhanced load forecasting for distributed multi-energy system: A stacking ensemble learning method with deep reinforcement learning and model fusion," Energy, Elsevier, vol. 319(C).
    13. Runge, Jason & Saloux, Etienne, 2023. "A comparison of prediction and forecasting artificial intelligence models to estimate the future energy demand in a district heating system," Energy, Elsevier, vol. 269(C).
    14. Song, Jiancai & Wang, Kangning & Bian, Tianxiang & Li, Wen & Dong, Qianxing & Chen, Lei & Xue, Guixiang & Wu, Xiangdong, 2025. "A novel heat load prediction algorithm based on fuzzy C-mean clustering and mixed positional encoding informer," Applied Energy, Elsevier, vol. 388(C).
    15. Moreno, Sinvaldo Rodrigues & Seman, Laio Oriel & Stefenon, Stefano Frizzo & Coelho, Leandro dos Santos & Mariani, Viviana Cocco, 2024. "Enhancing wind speed forecasting through synergy of machine learning, singular spectral analysis, and variational mode decomposition," Energy, Elsevier, vol. 292(C).
    16. Ehsani, Behdad & Pineau, Pierre-Olivier & Charlin, Laurent, 2024. "Price forecasting in the Ontario electricity market via TriConvGRU hybrid model: Univariate vs. multivariate frameworks," Applied Energy, Elsevier, vol. 359(C).
    17. Yin, Linfei & Ju, Linyi, 2025. "ShuffleTransformerMulti-headAttentionNet network for user load forecasting," Energy, Elsevier, vol. 322(C).
    18. Sekhar, Charan & Dahiya, Ratna, 2023. "Robust framework based on hybrid deep learning approach for short term load forecasting of building electricity demand," Energy, Elsevier, vol. 268(C).
    19. Hu, Likun & Cao, Yi & Yin, Linfei, 2024. "Fractional-order long-term price guidance mechanism based on bidirectional prediction with attention mechanism for electric vehicle charging," Energy, Elsevier, vol. 293(C).
    20. Saini, Priyesh & Parida, S.K., 2024. "A novel probabilistic gradient boosting model with multi-approach feature selection and iterative seasonal trend decomposition for short-term load forecasting," Energy, Elsevier, vol. 294(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:320:y:2025:i:c:s0360544225006176. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.