IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v322y2025ics0360544225014045.html
   My bibliography  Save this article

MMEMformer: A multi-scale memory-enhanced transformer framework for short-term load forecasting in integrated energy systems

Author

Listed:
  • Wang, Danhao
  • Peng, Daogang
  • Huang, Dongmei
  • Zhao, Huirong
  • Qu, Bogang

Abstract

As integrated energy systems (IES) increase in scale and complexity, achieving high-precision load forecasting has become essential for ensuring energy supply-demand balance, optimizing dispatch strategies, and enhancing energy utilization efficiency. Traditional deep learning methods often struggle with the multi-seasonal patterns, nonlinear couplings, and external disturbances inherent in IES load data, resulting in reduced accuracy and generalization. To address these challenges, this paper presents a multi-scale, memory-enhanced deep learning prediction framework. Drawing inspiration from the TimesNet approach, the proposed framework decomposes the input time series into multiple temporal scales, enabling the extraction and fusion of complex multi-seasonal dynamics. In parallel, a historical pattern retrieval memory module leverages a feature repository to incorporate long-term memory, thereby improving the model's ability to track persistent trends and irregular fluctuations. Additionally, cross-attention mechanisms are employed to integrate external features, increasing the model's sensitivity to environmental and behavioral factors. Finally, a multi-gating fusion strategy adaptively combines seasonal, trend, historical, and external information sources to produce more stable and flexible forecasts. Experimental results on a multi-energy load dataset demonstrate that the proposed model significantly outperforms other deep learning and state-of-the-art predictive approaches in terms of accuracy, stability, and generalization performance.

Suggested Citation

  • Wang, Danhao & Peng, Daogang & Huang, Dongmei & Zhao, Huirong & Qu, Bogang, 2025. "MMEMformer: A multi-scale memory-enhanced transformer framework for short-term load forecasting in integrated energy systems," Energy, Elsevier, vol. 322(C).
  • Handle: RePEc:eee:energy:v:322:y:2025:i:c:s0360544225014045
    DOI: 10.1016/j.energy.2025.135762
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544225014045
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2025.135762?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Wang, Ying & Li, Hongmin & Jahanger, Atif & Li, Qiwei & Wang, Biao & Balsalobre-Lorente, Daniel, 2024. "A novel ensemble electricity load forecasting system based on a decomposition-selection-optimization strategy," Energy, Elsevier, vol. 312(C).
    2. Tian, Zhirui & Liu, Weican & Jiang, Wenqian & Wu, Chenye, 2024. "CNNs-Transformer based day-ahead probabilistic load forecasting for weekends with limited data availability," Energy, Elsevier, vol. 293(C).
    3. Li, Chuang & Li, Guojie & Wang, Keyou & Han, Bei, 2022. "A multi-energy load forecasting method based on parallel architecture CNN-GRU and transfer learning for data deficient integrated energy systems," Energy, Elsevier, vol. 259(C).
    4. Gong, Jianqiang & Qu, Zhiguo & Zhu, Zhenle & Xu, Hongtao & Yang, Qiguo, 2025. "Ensemble models of TCN-LSTM-LightGBM based on ensemble learning methods for short-term electrical load forecasting," Energy, Elsevier, vol. 318(C).
    5. Peng, Daogang & Liu, Yu & Wang, Danhao & Zhao, Huirong & Qu, Bogang, 2024. "Multi-energy load forecasting for integrated energy system based on sequence decomposition fusion and factors correlation analysis," Energy, Elsevier, vol. 308(C).
    6. Cheng, Fang & Liu, Hui, 2024. "Multi-step electric vehicles charging loads forecasting: An autoformer variant with feature extraction, frequency enhancement, and error correction blocks," Applied Energy, Elsevier, vol. 376(PB).
    7. Wang, Han & Yan, Jie & Zhang, Jiawei & Liu, Shihua & Liu, Yongqian & Han, Shuang & Qu, Tonghui, 2024. "Short-term integrated forecasting method for wind power, solar power, and system load based on variable attention mechanism and multi-task learning," Energy, Elsevier, vol. 304(C).
    8. Chung, Won Hee & Gu, Yeong Hyeon & Yoo, Seong Joon, 2022. "District heater load forecasting based on machine learning and parallel CNN-LSTM attention," Energy, Elsevier, vol. 246(C).
    9. Wen, Yan & Pan, Su & Li, Xinxin & Li, Zibo & Wen, Wuzhenghong, 2024. "Improving multi-site photovoltaic forecasting with relevance amplification: DeepFEDformer-based approach," Energy, Elsevier, vol. 299(C).
    10. Li, Hao & Ma, Gang & Wang, Bo & Wang, Shu & Li, Wenhao & Meng, Yuxiang, 2025. "Multi-modal feature fusion model based on TimesNet and T2T-ViT for ultra-short-term solar irradiance forecasting," Renewable Energy, Elsevier, vol. 240(C).
    11. Chen, Wenhao & Rong, Fei & Lin, Chuan, 2025. "A multi-energy loads forecasting model based on dual attention mechanism and multi-scale hierarchical residual network with gated recurrent unit," Energy, Elsevier, vol. 320(C).
    12. Chen, Haoyu & Huang, Hai & Zheng, Yong & Yang, Bing, 2024. "A load forecasting approach for integrated energy systems based on aggregation hybrid modal decomposition and combined model," Applied Energy, Elsevier, vol. 375(C).
    13. Shi, Jian & Teh, Jiashen & Alharbi, Bader & Lai, Ching-Ming, 2024. "Load forecasting for regional integrated energy system based on two-phase decomposition and mixture prediction model," Energy, Elsevier, vol. 297(C).
    14. Zhang, Ji & Hu, Yuxin & Yuan, Yonggong & Yuan, Han & Mei, Ning, 2024. "Accuracy improvement of the load forecasting in the district heating system by the informer-based framework with the optimal step size selection," Energy, Elsevier, vol. 291(C).
    15. Jiang, Yuqi & Gao, Tianlu & Dai, Yuxin & Si, Ruiqi & Hao, Jun & Zhang, Jun & Gao, David Wenzhong, 2022. "Very short-term residential load forecasting based on deep-autoformer," Applied Energy, Elsevier, vol. 328(C).
    16. Zheng, Zhuang & Shafique, Muhammad & Luo, Xiaowei & Wang, Shengwei, 2024. "A systematic review towards integrative energy management of smart grids and urban energy systems," Renewable and Sustainable Energy Reviews, Elsevier, vol. 189(PB).
    17. Zhu, Jizhong & Dong, Hanjiang & Zheng, Weiye & Li, Shenglin & Huang, Yanting & Xi, Lei, 2022. "Review and prospect of data-driven techniques for load forecasting in integrated energy systems," Applied Energy, Elsevier, vol. 321(C).
    18. Saini, Priyesh & Parida, S.K., 2024. "A novel probabilistic gradient boosting model with multi-approach feature selection and iterative seasonal trend decomposition for short-term load forecasting," Energy, Elsevier, vol. 294(C).
    19. Wan, Anping & Chang, Qing & AL-Bukhaiti, Khalil & He, Jiabo, 2023. "Short-term power load forecasting for combined heat and power using CNN-LSTM enhanced by attention mechanism," Energy, Elsevier, vol. 282(C).
    20. Shi, Jian & Teh, Jiashen, 2024. "Load forecasting for regional integrated energy system based on complementary ensemble empirical mode decomposition and multi-model fusion," Applied Energy, Elsevier, vol. 353(PB).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hu, Rong & Zhou, Kaile & Lu, Xinhui, 2025. "Integrated loads forecasting with absence of crucial factors," Energy, Elsevier, vol. 322(C).
    2. Zhao, Xiaoyu & Duan, Pengfei & Cao, Xiaodong & Xue, Qingwen & Zhao, Bingxu & Hu, Jinxue & Zhang, Chenyang & Yuan, Xiaoyang, 2025. "A probabilistic load forecasting method for multi-energy loads based on inflection point optimization and integrated feature screening," Energy, Elsevier, vol. 327(C).
    3. Ren, Xiaoxiao & Tian, Xin & Wang, Kai & Yang, Sifan & Chen, Weixiong & Wang, Jinshi, 2025. "Enhanced load forecasting for distributed multi-energy system: A stacking ensemble learning method with deep reinforcement learning and model fusion," Energy, Elsevier, vol. 319(C).
    4. Chen, Wenhao & Rong, Fei & Lin, Chuan, 2025. "A multi-energy loads forecasting model based on dual attention mechanism and multi-scale hierarchical residual network with gated recurrent unit," Energy, Elsevier, vol. 320(C).
    5. Chen, Haoyu & Huang, Hai & Zheng, Yong & Yang, Bing, 2024. "A load forecasting approach for integrated energy systems based on aggregation hybrid modal decomposition and combined model," Applied Energy, Elsevier, vol. 375(C).
    6. Yin, Linfei & Ju, Linyi, 2025. "ShuffleTransformerMulti-headAttentionNet network for user load forecasting," Energy, Elsevier, vol. 322(C).
    7. Hu, Likun & Cao, Yi & Yin, Linfei, 2024. "Long-term price guidance mechanism for integrated energy systems based on gated recurrent unit - vision transformer prediction and fractional-order stochastic dynamic calculus control," Energy, Elsevier, vol. 312(C).
    8. Xie, Xiangmin & Ding, Yuhao & Sun, Yuanyuan & Zhang, Zhisheng & Fan, Jianhua, 2024. "A novel time-series probabilistic forecasting method for multi-energy loads," Energy, Elsevier, vol. 306(C).
    9. Karamolegkos, Spyridon & Koulouriotis, Dimitrios E., 2025. "Advancing short-term load forecasting with decomposed Fourier ARIMA: A case study on the Greek energy market," Energy, Elsevier, vol. 325(C).
    10. Mingxiang Li & Tianyi Zhang & Haizhu Yang & Kun Liu, 2024. "Multiple Load Forecasting of Integrated Renewable Energy System Based on TCN-FECAM-Informer," Energies, MDPI, vol. 17(20), pages 1-16, October.
    11. Liao, Chengchen & Tan, Mao & Li, Kang & Chen, Jie & Wang, Rui & Su, Yongxin, 2024. "Sequence signal prediction and reconstruction for multi-energy load forecasting in integrated energy systems: A bi-level multi-task learning method," Energy, Elsevier, vol. 313(C).
    12. Fan, Pengdan & Wang, Dan & Wang, Wei & Zhang, Xiuyu & Sun, Yuying, 2024. "A novel multi-energy load forecasting method based on building flexibility feature recognition technology and multi-task learning model integrating LSTM," Energy, Elsevier, vol. 308(C).
    13. Peng, Daogang & Liu, Yu & Wang, Danhao & Zhao, Huirong & Qu, Bogang, 2024. "Multi-energy load forecasting for integrated energy system based on sequence decomposition fusion and factors correlation analysis," Energy, Elsevier, vol. 308(C).
    14. Xu, Huifeng & Hu, Feihu & Liang, Xinhao & Zhao, Guoqing & Abugunmi, Mohammad, 2024. "A framework for electricity load forecasting based on attention mechanism time series depthwise separable convolutional neural network," Energy, Elsevier, vol. 299(C).
    15. Fan, Jingmin & Zhong, Mingwei & Guan, Yuanpeng & Yi, Siqi & Xu, Cancheng & Zhai, Yanpeng & Zhou, Yongwang, 2024. "An online long-term load forecasting method: Hierarchical highway network based on crisscross feature collaboration," Energy, Elsevier, vol. 299(C).
    16. Cui, Xuyang & Zhu, Junda & Jia, Lifu & Wang, Jiahui & Wu, Yusen, 2024. "A novel heat load prediction model of district heating system based on hybrid whale optimization algorithm (WOA) and CNN-LSTM with attention mechanism," Energy, Elsevier, vol. 312(C).
    17. Gao, Peng & Yang, Yang & Li, Fei & Ge, Jiaxin & Yin, Qianqian & Wang, Ruikun, 2024. "Research on integrated decision making of multiple load combination forecasting for integrated energy system," Energy, Elsevier, vol. 311(C).
    18. Cheng, Fang & Liu, Hui, 2024. "Multi-step electric vehicles charging loads forecasting: An autoformer variant with feature extraction, frequency enhancement, and error correction blocks," Applied Energy, Elsevier, vol. 376(PB).
    19. Song, Jiancai & Wang, Kangning & Bian, Tianxiang & Li, Wen & Dong, Qianxing & Chen, Lei & Xue, Guixiang & Wu, Xiangdong, 2025. "A novel heat load prediction algorithm based on fuzzy C-mean clustering and mixed positional encoding informer," Applied Energy, Elsevier, vol. 388(C).
    20. Semmelmann, Leo & Hertel, Matthias & Kircher, Kevin J. & Mikut, Ralf & Hagenmeyer, Veit & Weinhardt, Christof, 2024. "The impact of heat pumps on day-ahead energy community load forecasting," Applied Energy, Elsevier, vol. 368(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:322:y:2025:i:c:s0360544225014045. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.