IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v401y2025ipcs0306261925014990.html

Transfer learning-based multi-energy load forecasting method for integrated energy system with zero-shot

Author

Listed:
  • Li, Ke
  • Qin, Zheng
  • Mu, Yuchen
  • Wang, Haiyang
  • Bie, Qingfeng
  • Yin, Xianxin
  • Yan, Yi

Abstract

In the planning and capacity design of integrated energy system (IES), the critical reliance on multi-energy load data faces a paradoxical dilemma: a scarcity or complete absence of historical operating data. This “fundamental demand vs. data scarcity” contradiction challenges optimal design. This paper systematically proposes a transfer learning (TL)-based forecasting framework designed for zero-shot scenarios, which addresses this challenge through a three-stage innovative approach: First, a novel algorithm, Tnet, is designed based on probabilistic generalization assessment. By decomposing temporal features and incorporating weighted mutual information entropy, a source domain selection paradigm guided by probabilistic judgment is constructed. This paradigm identifies source domain groups from multiple candidates with the highest generalization value for a given target domain. Second, an improved meta-learning strategy, Metas, is developed to optimize cross-domain parameter transfer by adapting task weights dynamically, significantly enhancing the modeling accuracy of temporal features. Third, an encoder-decoder model integrated with a multi-head attention mechanism is constructed to enable the coordinated forecasting of electricity, heating, gas, and cooling loads. Experimental results show that under zero-shot conditions, the proposed method reduces mean absolute percentage error by more than 42 % compared to benchmark models while improving the coefficient of determination by over 50 %. Further validation through few-shot fine-tuning (FSFT) demonstrates that when the target domain gradually acquires a small amount of real data, the model can achieve rapid correction within a few iterations and maintain high forecasting robustness. Its performance in the “cold-start” phase, where data is scarce, far exceeds that of direct training. This highlights the core role of the FSFT strategy in bridging the performance gap during the critical transition from zero-shot scenarios to those with sufficient data. It provides a complete, feasible, and efficient forecasting paradigm for IES that have not yet been commissioned or lack comprehensive historical data. This paradigm covers the entire process from a zero-shot start-up to few-shot optimization, offering valuable insights for energy planning and operational scheduling in real-world applications.

Suggested Citation

  • Li, Ke & Qin, Zheng & Mu, Yuchen & Wang, Haiyang & Bie, Qingfeng & Yin, Xianxin & Yan, Yi, 2025. "Transfer learning-based multi-energy load forecasting method for integrated energy system with zero-shot," Applied Energy, Elsevier, vol. 401(PC).
  • Handle: RePEc:eee:appene:v:401:y:2025:i:pc:s0306261925014990
    DOI: 10.1016/j.apenergy.2025.126769
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261925014990
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2025.126769?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Luo, Xing & Zhang, Dongxiao & Zhu, Xu, 2022. "Combining transfer learning and constrained long short-term memory for power generation forecasting of newly-constructed photovoltaic plants," Renewable Energy, Elsevier, vol. 185(C), pages 1062-1077.
    2. Wang, Sen & Zhang, Wenjie & Sun, Yonghui & Trivedi, Anupam & Chung, C.Y. & Srinivasan, Dipti, 2024. "Wind Power Forecasting in the presence of data scarcity: A very short-term conditional probabilistic modeling framework," Energy, Elsevier, vol. 291(C).
    3. Han, Zepeng & Han, Wei & Ye, Yiyin & Sui, Jun, 2024. "Multi-objective sustainability optimization of a solar-based integrated energy system," Renewable and Sustainable Energy Reviews, Elsevier, vol. 202(C).
    4. Wang, Yonggang & Zhao, Kaixing & Hao, Yue & Yao, Yilin, 2024. "Short-term wind power prediction using a novel model based on butterfly optimization algorithm-variational mode decomposition-long short-term memory," Applied Energy, Elsevier, vol. 366(C).
    5. Chen, Haoyu & Huang, Hai & Zheng, Yong & Yang, Bing, 2024. "A load forecasting approach for integrated energy systems based on aggregation hybrid modal decomposition and combined model," Applied Energy, Elsevier, vol. 375(C).
    6. Li, Ke & Mu, Yuchen & Yang, Fan & Wang, Haiyang & Yan, Yi & Zhang, Chenghui, 2023. "A novel short-term multi-energy load forecasting method for integrated energy system based on feature separation-fusion technology and improved CNN," Applied Energy, Elsevier, vol. 351(C).
    7. Chen, Yuejiang & Xiao, Jiang-Wen & Wang, Yan-Wu & Luo, Yunfeng, 2025. "Non-crossing quantile probabilistic forecasting of cluster wind power considering spatio-temporal correlation," Applied Energy, Elsevier, vol. 377(PA).
    8. Shi, Jian & Teh, Jiashen & Alharbi, Bader & Lai, Ching-Ming, 2024. "Load forecasting for regional integrated energy system based on two-phase decomposition and mixture prediction model," Energy, Elsevier, vol. 297(C).
    9. Tian, Chenlu & Liu, Yechun & Zhang, Guiqing & Yang, Yalong & Yan, Yi & Li, Chengdong, 2024. "Transfer learning based hybrid model for power demand prediction of large-scale electric vehicles," Energy, Elsevier, vol. 300(C).
    10. Xing, Zhuoqun & Pan, Yiqun & Yang, Yiting & Yuan, Xiaolei & Liang, Yumin & Huang, Zhizhong, 2024. "Transfer learning integrating similarity analysis for short-term and long-term building energy consumption prediction," Applied Energy, Elsevier, vol. 365(C).
    11. Shi, Jian & Teh, Jiashen, 2024. "Load forecasting for regional integrated energy system based on complementary ensemble empirical mode decomposition and multi-model fusion," Applied Energy, Elsevier, vol. 353(PB).
    12. Li, Ke & Mu, Yuchen & Yang, Fan & Wang, Haiyang & Yan, Yi & Zhang, Chenghui, 2024. "Joint forecasting of source-load-price for integrated energy system based on multi-task learning and hybrid attention mechanism," Applied Energy, Elsevier, vol. 360(C).
    13. Shi, Jian & Teh, Jiashen & Lai, Ching-Ming, 2025. "Wind power prediction based on improved self-attention mechanism combined with Bi-directional Temporal Convolutional Network," Energy, Elsevier, vol. 322(C).
    14. Goodell, John W. & Ben Jabeur, Sami & Saâdaoui, Foued & Nasir, Muhammad Ali, 2023. "Explainable artificial intelligence modeling to forecast bitcoin prices," International Review of Financial Analysis, Elsevier, vol. 88(C).
    15. Zhu, Jizhong & Dong, Hanjiang & Zheng, Weiye & Li, Shenglin & Huang, Yanting & Xi, Lei, 2022. "Review and prospect of data-driven techniques for load forecasting in integrated energy systems," Applied Energy, Elsevier, vol. 321(C).
    16. Li, Chuang & Li, Guojie & Wang, Keyou & Han, Bei, 2022. "A multi-energy load forecasting method based on parallel architecture CNN-GRU and transfer learning for data deficient integrated energy systems," Energy, Elsevier, vol. 259(C).
    17. Lu, Yakai & Tian, Zhe & Zhou, Ruoyu & Liu, Wenjing, 2021. "A general transfer learning-based framework for thermal load prediction in regional energy system," Energy, Elsevier, vol. 217(C).
    18. Hu, Zehuan & Gao, Yuan & Sun, Luning & Mae, Masayuki, 2025. "A novel attention-enhanced LLM approach for accurate power demand and generation forecasting," Renewable Energy, Elsevier, vol. 252(C).
    19. Wei, Nan & Yin, Chuang & Yin, Lihua & Tan, Jingyi & Liu, Jinyuan & Wang, Shouxi & Qiao, Weibiao & Zeng, Fanhua, 2024. "Short-term load forecasting based on WM algorithm and transfer learning model," Applied Energy, Elsevier, vol. 353(PA).
    20. Tang, Yugui & Yang, Kuo & Zheng, Yichu & Ma, Li & Zhang, Shujing & Zhang, Zhen, 2024. "Wind power forecasting: A transfer learning approach incorporating temporal convolution and adversarial training," Renewable Energy, Elsevier, vol. 224(C).
    21. Ma, Zhengjing & Mei, Gang, 2022. "A hybrid attention-based deep learning approach for wind power prediction," Applied Energy, Elsevier, vol. 323(C).
    22. Niu, Dongxiao & Yu, Min & Sun, Lijie & Gao, Tian & Wang, Keke, 2022. "Short-term multi-energy load forecasting for integrated energy systems based on CNN-BiGRU optimized by attention mechanism," Applied Energy, Elsevier, vol. 313(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hu, Rong & Zhou, Kaile & Lu, Xinhui, 2025. "Integrated loads forecasting with absence of crucial factors," Energy, Elsevier, vol. 322(C).
    2. Chen, Haoyu & Huang, Hai & Zheng, Yong & Yang, Bing, 2024. "A load forecasting approach for integrated energy systems based on aggregation hybrid modal decomposition and combined model," Applied Energy, Elsevier, vol. 375(C).
    3. Ren, Xiaoxiao & Tian, Xin & Wang, Kai & Yang, Sifan & Chen, Weixiong & Wang, Jinshi, 2025. "Enhanced load forecasting for distributed multi-energy system: A stacking ensemble learning method with deep reinforcement learning and model fusion," Energy, Elsevier, vol. 319(C).
    4. Wang, Danhao & Peng, Daogang & Huang, Dongmei & Zhao, Huirong & Qu, Bogang, 2025. "MMEMformer: A multi-scale memory-enhanced transformer framework for short-term load forecasting in integrated energy systems," Energy, Elsevier, vol. 322(C).
    5. Peng, Daogang & Liu, Yu & Wang, Danhao & Zhao, Huirong & Qu, Bogang, 2024. "Multi-energy load forecasting for integrated energy system based on sequence decomposition fusion and factors correlation analysis," Energy, Elsevier, vol. 308(C).
    6. Liu, Tianhao & Li, Fangning & Zhang, Dongdong & Shan, Linke & Zhu, Hongyu & Du, Pengcheng & Jiang, Meihui & Goh, Hui Hwang & Kurniawan, Tonni Agustiono & Huang, Chao & Kong, Fannie, 2026. "Intelligent load forecasting technologies for diverse scenarios in the new power systems," Renewable and Sustainable Energy Reviews, Elsevier, vol. 226(PD).
    7. Chen, Wenhao & Rong, Fei & Lin, Chuan, 2025. "A multi-energy loads forecasting model based on dual attention mechanism and multi-scale hierarchical residual network with gated recurrent unit," Energy, Elsevier, vol. 320(C).
    8. Yin, Linfei & Ju, Linyi, 2025. "ShuffleTransformerMulti-headAttentionNet network for user load forecasting," Energy, Elsevier, vol. 322(C).
    9. Guo, Xifeng & Liu, Rongqian & Wang, Yonggang & Ning, Yi & Qu, Qiuxia & Wang, Zedi & Cong, Wenzhuo, 2025. "Short-term power load forecasting for estate-level buildings considering multilevel feature extraction and adaptive fusion," Energy, Elsevier, vol. 337(C).
    10. Xie, Xiangmin & Ding, Yuhao & Sun, Yuanyuan & Zhang, Zhisheng & Fan, Jianhua, 2024. "A novel time-series probabilistic forecasting method for multi-energy loads," Energy, Elsevier, vol. 306(C).
    11. Fan, Pengdan & Wang, Dan & Wang, Wei & Zhang, Xiuyu & Sun, Yuying, 2024. "A novel multi-energy load forecasting method based on building flexibility feature recognition technology and multi-task learning model integrating LSTM," Energy, Elsevier, vol. 308(C).
    12. Kim, Hyung Joon & Kim, Dongwoo & Tak, Hyunwoo & Lee, Jae Yong, 2025. "Global-local attention-enabled multiple decoder Transformer for multi-energy load forecasting in user-level integrated energy system," Applied Energy, Elsevier, vol. 396(C).
    13. Tan, Quanwei & Zhu, Jiebei & Xue, Guijun & Xie, Wenju, 2025. "A hybrid heat load forecasting model based on multistage decomposition and dynamic adaptive loss function," Energy, Elsevier, vol. 335(C).
    14. Cao, Yuzhe & Huang, Xuefei & Liu, Jing & Cai, Defu & Ding, Yuemin & Lu, Renzhi, 2025. "DDRGS2S: A novel spatiotemporal correlation-based deep learning model for wind power prediction," Energy, Elsevier, vol. 338(C).
    15. Liu, Shuhan & Sun, Wenqiang, 2025. "Knowledge- and data-driven prediction of blast furnace gas generation and consumption in iron and steel sites," Applied Energy, Elsevier, vol. 390(C).
    16. Yan, Qin & Lu, Zhiying & Liu, Hong & He, Xingtang & Zhang, Xihai & Guo, Jianlin, 2024. "Short-term prediction of integrated energy load aggregation using a bi-directional simple recurrent unit network with feature-temporal attention mechanism ensemble learning model," Applied Energy, Elsevier, vol. 355(C).
    17. Ma, Xin & Peng, Bo & Ma, Xiangxue & Tian, Changbin & Yan, Yi, 2023. "Multi-timescale optimization scheduling of regional integrated energy system based on source-load joint forecasting," Energy, Elsevier, vol. 283(C).
    18. Liao, Chengchen & Tan, Mao & Li, Kang & Chen, Jie & Wang, Rui & Su, Yongxin, 2024. "Sequence signal prediction and reconstruction for multi-energy load forecasting in integrated energy systems: A bi-level multi-task learning method," Energy, Elsevier, vol. 313(C).
    19. Di Bai & Shuo Ma & Hongting Ma, 2025. "Performance Evaluation of Similarity Metrics in Transfer Learning for Building Heating Load Forecasting," Energies, MDPI, vol. 18(17), pages 1-14, September.
    20. Hu, Likun & Cao, Yi & Yin, Linfei, 2024. "Long-term price guidance mechanism for integrated energy systems based on gated recurrent unit - vision transformer prediction and fractional-order stochastic dynamic calculus control," Energy, Elsevier, vol. 312(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:401:y:2025:i:pc:s0306261925014990. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.