IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v396y2025ics0306261925009857.html

Global-local attention-enabled multiple decoder Transformer for multi-energy load forecasting in user-level integrated energy system

Author

Listed:
  • Kim, Hyung Joon
  • Kim, Dongwoo
  • Tak, Hyunwoo
  • Lee, Jae Yong

Abstract

Accurate multi-energy load forecasting (MELF) is crucial for reliable and cost-effective operation of integrated energy system (IES). Despite advancements, existing MELF models naively aggregate all input features without explicit global modeling mechanisms, leading to suboptimal MELF results. Additionally, they are primarily designed for regional-level IES, limiting their ability to capture local contexts and subtle fluctuations in complex user-level IES (UIES). To overcome these limitations, this study proposes a novel global-local attention-enabled multiple decoder Transformer for MELF in UIES. First, a new feature-temporal attention mechanism is proposed to jointly capture coupling relationships and temporal dependencies in a global context. Second, as a local modeling method, a residual bi-directional temporal convolution-based attention mechanism is incorporated into each decoder to efficiently extract subtle variations. Furthermore, a day-type tendency network is integrated into each decoder to address critical external factors. Case studies demonstrate that the proposed model outperforms state-of-the-art MELF models, achieving the highest average R2 of 0.9676 across multiple loads while requiring only 5.39 % more training time than the shortest training model. These results highlight the model's practical engineering value for robust UIES operation and optimal dispatch, with future extensions into anomaly detection for enhanced fault diagnosis, system resilience, and proactive energy management.

Suggested Citation

  • Kim, Hyung Joon & Kim, Dongwoo & Tak, Hyunwoo & Lee, Jae Yong, 2025. "Global-local attention-enabled multiple decoder Transformer for multi-energy load forecasting in user-level integrated energy system," Applied Energy, Elsevier, vol. 396(C).
  • Handle: RePEc:eee:appene:v:396:y:2025:i:c:s0306261925009857
    DOI: 10.1016/j.apenergy.2025.126255
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261925009857
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2025.126255?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. He, Feifei & Zhou, Jianzhong & Mo, Li & Feng, Kuaile & Liu, Guangbiao & He, Zhongzheng, 2020. "Day-ahead short-term load probability density forecasting method with a decomposition-based quantile regression forest," Applied Energy, Elsevier, vol. 262(C).
    2. Ruijin Zhu & Weilin Guo & Xuejiao Gong, 2019. "Short-Term Load Forecasting for CCHP Systems Considering the Correlation between Heating, Gas and Electrical Loads Based on Deep Learning," Energies, MDPI, vol. 12(17), pages 1-18, August.
    3. Wang, Yongli & Wang, Yudong & Huang, Yujing & Li, Fang & Zeng, Ming & Li, Jiapu & Wang, Xiaohai & Zhang, Fuwei, 2019. "Planning and operation method of the regional integrated energy system considering economy and environment," Energy, Elsevier, vol. 171(C), pages 731-750.
    4. Li, Ke & Mu, Yuchen & Yang, Fan & Wang, Haiyang & Yan, Yi & Zhang, Chenghui, 2023. "A novel short-term multi-energy load forecasting method for integrated energy system based on feature separation-fusion technology and improved CNN," Applied Energy, Elsevier, vol. 351(C).
    5. Songyao Wang & Zhisheng Zhang, 2021. "Short-Term Multiple Load Forecasting Model of Regional Integrated Energy System Based on QWGRU-MTL," Energies, MDPI, vol. 14(20), pages 1-13, October.
    6. Yang, Youlong & Che, Jinxing & Deng, Chengzhi & Li, Li, 2019. "Sequential grid approach based support vector regression for short-term electric load forecasting," Applied Energy, Elsevier, vol. 238(C), pages 1010-1021.
    7. Tan, Mao & Liao, Chengchen & Chen, Jie & Cao, Yijia & Wang, Rui & Su, Yongxin, 2023. "A multi-task learning method for multi-energy load forecasting based on synthesis correlation analysis and load participation factor," Applied Energy, Elsevier, vol. 343(C).
    8. Shi, Jian & Teh, Jiashen, 2024. "Load forecasting for regional integrated energy system based on complementary ensemble empirical mode decomposition and multi-model fusion," Applied Energy, Elsevier, vol. 353(PB).
    9. Li, Chuang & Li, Guojie & Wang, Keyou & Han, Bei, 2022. "A multi-energy load forecasting method based on parallel architecture CNN-GRU and transfer learning for data deficient integrated energy systems," Energy, Elsevier, vol. 259(C).
    10. Kim, H.J. & Kim, M.K., 2023. "A novel deep learning-based forecasting model optimized by heuristic algorithm for energy management of microgrid," Applied Energy, Elsevier, vol. 332(C).
    11. Jieyun Zheng & Linyao Zhang & Jinpeng Chen & Guilian Wu & Shiyuan Ni & Zhijian Hu & Changhong Weng & Zhi Chen, 2021. "Multiple-Load Forecasting for Integrated Energy System Based on Copula-DBiLSTM," Energies, MDPI, vol. 14(8), pages 1-14, April.
    12. Niu, Dongxiao & Yu, Min & Sun, Lijie & Gao, Tian & Wang, Keke, 2022. "Short-term multi-energy load forecasting for integrated energy systems based on CNN-BiGRU optimized by attention mechanism," Applied Energy, Elsevier, vol. 313(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Heng Zhou & Qing Ai & Ruiting Li, 2025. "Short-Term Multi-Energy Load Forecasting Method Based on Transformer Spatio-Temporal Graph Neural Network," Energies, MDPI, vol. 18(17), pages 1-19, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tan, Mao & Liao, Chengchen & Chen, Jie & Cao, Yijia & Wang, Rui & Su, Yongxin, 2023. "A multi-task learning method for multi-energy load forecasting based on synthesis correlation analysis and load participation factor," Applied Energy, Elsevier, vol. 343(C).
    2. Liao, Chengchen & Tan, Mao & Li, Kang & Chen, Jie & Wang, Rui & Su, Yongxin, 2024. "Sequence signal prediction and reconstruction for multi-energy load forecasting in integrated energy systems: A bi-level multi-task learning method," Energy, Elsevier, vol. 313(C).
    3. Fan, Pengdan & Wang, Dan & Wang, Wei & Zhang, Xiuyu & Sun, Yuying, 2024. "A novel multi-energy load forecasting method based on building flexibility feature recognition technology and multi-task learning model integrating LSTM," Energy, Elsevier, vol. 308(C).
    4. Peng, Daogang & Liu, Yu & Wang, Danhao & Zhao, Huirong & Qu, Bogang, 2024. "Multi-energy load forecasting for integrated energy system based on sequence decomposition fusion and factors correlation analysis," Energy, Elsevier, vol. 308(C).
    5. Yifei Chen & Zhihan Fu, 2023. "Multi-Step Ahead Forecasting of the Energy Consumed by the Residential and Commercial Sectors in the United States Based on a Hybrid CNN-BiLSTM Model," Sustainability, MDPI, vol. 15(3), pages 1-21, January.
    6. Zhu, Jizhong & Dong, Hanjiang & Zheng, Weiye & Li, Shenglin & Huang, Yanting & Xi, Lei, 2022. "Review and prospect of data-driven techniques for load forecasting in integrated energy systems," Applied Energy, Elsevier, vol. 321(C).
    7. Hu, Rong & Zhou, Kaile & Lu, Xinhui, 2025. "Integrated loads forecasting with absence of crucial factors," Energy, Elsevier, vol. 322(C).
    8. Yan, Qin & Lu, Zhiying & Liu, Hong & He, Xingtang & Zhang, Xihai & Guo, Jianlin, 2024. "Short-term prediction of integrated energy load aggregation using a bi-directional simple recurrent unit network with feature-temporal attention mechanism ensemble learning model," Applied Energy, Elsevier, vol. 355(C).
    9. Chen, Haoyu & Huang, Hai & Zheng, Yong & Yang, Bing, 2024. "A load forecasting approach for integrated energy systems based on aggregation hybrid modal decomposition and combined model," Applied Energy, Elsevier, vol. 375(C).
    10. Yin, Linfei & Ju, Linyi, 2025. "ShuffleTransformerMulti-headAttentionNet network for user load forecasting," Energy, Elsevier, vol. 322(C).
    11. Song, Cairong & Yang, Haidong & Cai, Jianyang & Yang, Pan & Bao, Hao & Xu, Kangkang & Meng, Xian-Bing, 2024. "Multi-energy load forecasting via hierarchical multi-task learning and spatiotemporal attention," Applied Energy, Elsevier, vol. 373(C).
    12. Gao, Peng & Yang, Yang & Li, Fei & Ge, Jiaxin & Yin, Qianqian & Wang, Ruikun, 2024. "Research on integrated decision making of multiple load combination forecasting for integrated energy system," Energy, Elsevier, vol. 311(C).
    13. Hu, Likun & Cao, Yi & Yin, Linfei, 2024. "Long-term price guidance mechanism for integrated energy systems based on gated recurrent unit - vision transformer prediction and fractional-order stochastic dynamic calculus control," Energy, Elsevier, vol. 312(C).
    14. Ren, Xiaoxiao & Tian, Xin & Wang, Kai & Yang, Sifan & Chen, Weixiong & Wang, Jinshi, 2025. "Enhanced load forecasting for distributed multi-energy system: A stacking ensemble learning method with deep reinforcement learning and model fusion," Energy, Elsevier, vol. 319(C).
    15. Lin, Zhengyang & Lin, Tao & Li, Jun & Li, Chen, 2025. "A novel short-term multi-energy load forecasting method for integrated energy system based on two-layer joint modal decomposition and dynamic optimal ensemble learning," Applied Energy, Elsevier, vol. 378(PA).
    16. Peng Song & Zhisheng Zhang, 2023. "Research on Multiple Load Short-Term Forecasting Model of Integrated Energy Distribution System Based on Mogrifier-Quantum Weighted MELSTM," Energies, MDPI, vol. 16(9), pages 1-13, April.
    17. Akash Kumar & Bing Yan & Ace Bilton, 2022. "Machine Learning-Based Load Forecasting for Nanogrid Peak Load Cost Reduction," Energies, MDPI, vol. 15(18), pages 1-23, September.
    18. Qizhuan Shao & Rungang Bao & Shuangquan Liu & Kaixiang Fu & Li Mo & Wenjing Xiao, 2025. "Short-Term Electric Load Probability Forecasting Based on the BiGRU-GAM-GPR Model," Sustainability, MDPI, vol. 17(12), pages 1-23, June.
    19. Zhao, Xiaoyu & Duan, Pengfei & Cao, Xiaodong & Xue, Qingwen & Zhao, Bingxu & Hu, Jinxue & Zhang, Chenyang & Yuan, Xiaoyang, 2025. "A probabilistic load forecasting method for multi-energy loads based on inflection point optimization and integrated feature screening," Energy, Elsevier, vol. 327(C).
    20. Wang, Danhao & Peng, Daogang & Huang, Dongmei & Zhao, Huirong & Qu, Bogang, 2025. "MMEMformer: A multi-scale memory-enhanced transformer framework for short-term load forecasting in integrated energy systems," Energy, Elsevier, vol. 322(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:396:y:2025:i:c:s0306261925009857. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.