IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v18y2025i15p3984-d1710222.html
   My bibliography  Save this article

An Ensemble Model of Attention-Enhanced N-BEATS and XGBoost for District Heating Load Forecasting

Author

Listed:
  • Shaohua Yu

    (School of Intelligent Manufacturing, Nanjing University of Science and Technology, Nanjing 210094, China)

  • Xiaole Yang

    (School of Cyber Science and Engineering, Nanjing University of Science and Technology, Nanjing 210094, China)

  • Hengrui Ye

    (School of Cyber Science and Engineering, Nanjing University of Science and Technology, Nanjing 210094, China)

  • Daogui Tang

    (School of Transportation and Logistics Engineering, Wuhan University of Technology, Wuhan 430063, China)

  • Hamidreza Arasteh

    (Center for Research on Microgrids (CROM), Huanjiang Laboratory, Shaoxing 311800, China)

  • Josep M. Guerrero

    (Center for Research on Microgrids (CROM), Huanjiang Laboratory, Shaoxing 311800, China)

Abstract

Accurate heat load forecasting is essential for the efficiency of District Heating Systems (DHS). Still, it is challenged by the need to model long-term temporal dependencies and nonlinear relationships with weather and other factors. This study proposes a hybrid deep learning framework combining an attention-enhanced Neural Basis Expansion Analysis for Time Series (N-BEATS) model and eXtreme Gradient Boosting (XGBoost). The N-BEATS component, with a multi-head self-attention mechanism, captures temporal dynamics, while XGBoost models non-linear impacts of external variables. Predictions are integrated using an optimized weighted averaging strategy. Evaluated on a dataset from 103 heating units, the model outperformed 13 baselines, achieving an MSE of 0.4131, MAE of 0.3732, RMSE of 0.6427, and R 2 of 0.9664. This corresponds to a reduction of 32.6% in MSE, 32.0% in MAE, and 17.9% in RMSE, and an improvement of 5.1% in R 2 over the best baseline. Ablation studies and statistical tests confirmed the effectiveness of the attention mechanism and ensemble strategy. This model provides an efficient solution for DHS load forecasting, facilitating optimized energy dispatch and enhancing system performance.

Suggested Citation

  • Shaohua Yu & Xiaole Yang & Hengrui Ye & Daogui Tang & Hamidreza Arasteh & Josep M. Guerrero, 2025. "An Ensemble Model of Attention-Enhanced N-BEATS and XGBoost for District Heating Load Forecasting," Energies, MDPI, vol. 18(15), pages 1-22, July.
  • Handle: RePEc:gam:jeners:v:18:y:2025:i:15:p:3984-:d:1710222
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/18/15/3984/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/1996-1073/18/15/3984/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Oreshkin, Boris N. & Dudek, Grzegorz & Pełka, Paweł & Turkina, Ekaterina, 2021. "N-BEATS neural network for mid-term electricity load forecasting," Applied Energy, Elsevier, vol. 293(C).
    2. Ge, Pingxu & Tang, Daogui & Yuan, Yuji & Guerrero, Josep M. & Zio, Enrico, 2025. "A hierarchical multi-objective co-optimization framework for sizing and energy management of coupled hydrogen-electricity energy storage systems at ports," Applied Energy, Elsevier, vol. 384(C).
    3. Kamil Szostek & Damian Mazur & Grzegorz Drałus & Jacek Kusznier, 2024. "Analysis of the Effectiveness of ARIMA, SARIMA, and SVR Models in Time Series Forecasting: A Case Study of Wind Farm Energy Production," Energies, MDPI, vol. 17(19), pages 1-18, September.
    4. Jiao, Dingyu & Su, Huai & He, Yuxuan & Zhang, Li & Yang, Zhaoming & Peng, Shiliang & Zuo, Lili & Zhang, Jinjun, 2024. "A systematic method of long-sequence prediction of natural gas supply in IES based on spatio-temporal causal network of multi-energy," Applied Energy, Elsevier, vol. 376(PA).
    5. Lumbreras, Mikel & Garay-Martinez, Roberto & Arregi, Beñat & Martin-Escudero, Koldobika & Diarce, Gonzalo & Raud, Margus & Hagu, Indrek, 2022. "Data driven model for heat load prediction in buildings connected to District Heating by using smart heat meters," Energy, Elsevier, vol. 239(PD).
    6. Luan, Wenpeng & Wei, Zun & Liu, Bo & Yu, Yixin, 2024. "A training-free non-intrusive air conditioning load monitoring method based on fuzzy comprehensive evaluation," Applied Energy, Elsevier, vol. 376(PA).
    7. Ciulla, G. & D'Amico, A., 2019. "Building energy performance forecasting: A multiple linear regression approach," Applied Energy, Elsevier, vol. 253(C), pages 1-1.
    8. Xu, Weiyan & Tu, Jielei & Xu, Ning & Liu, Zuming, 2024. "Predicting daily heating energy consumption in residential buildings through integration of random forest model and meta-heuristic algorithms," Energy, Elsevier, vol. 301(C).
    9. Changzhi Li & Dandan Liu & Mao Wang & Hanlin Wang & Shuai Xu, 2023. "Detection of Outliers in Time Series Power Data Based on Prediction Errors," Energies, MDPI, vol. 16(2), pages 1-19, January.
    10. Amasyali, Kadir & El-Gohary, Nora M., 2018. "A review of data-driven building energy consumption prediction studies," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1192-1205.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhang, Xiang & Saelens, Dirk & Roels, Staf, 2025. "Quantifying dynamic solar gains in buildings: Measurement, simulation and data-driven modelling," Renewable and Sustainable Energy Reviews, Elsevier, vol. 212(C).
    2. Wenninger, Simon & Kaymakci, Can & Wiethe, Christian, 2022. "Explainable long-term building energy consumption prediction using QLattice," Applied Energy, Elsevier, vol. 308(C).
    3. Zhang, Xiang & Rasmussen, Christoffer & Saelens, Dirk & Roels, Staf, 2022. "Time-dependent solar aperture estimation of a building: Comparing grey-box and white-box approaches," Renewable and Sustainable Energy Reviews, Elsevier, vol. 161(C).
    4. Venkatraj, V. & Dixit, M.K., 2022. "Challenges in implementing data-driven approaches for building life cycle energy assessment: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 160(C).
    5. Lara Ramadan & Isam Shahrour & Hussein Mroueh & Fadi Hage Chehade, 2021. "Use of Machine Learning Methods for Indoor Temperature Forecasting," Future Internet, MDPI, vol. 13(10), pages 1-18, September.
    6. Razak Olu-Ajayi & Hafiz Alaka & Hakeem Owolabi & Lukman Akanbi & Sikiru Ganiyu, 2023. "Data-Driven Tools for Building Energy Consumption Prediction: A Review," Energies, MDPI, vol. 16(6), pages 1-20, March.
    7. Mohammad Mahdi Forootan & Iman Larki & Rahim Zahedi & Abolfazl Ahmadi, 2022. "Machine Learning and Deep Learning in Energy Systems: A Review," Sustainability, MDPI, vol. 14(8), pages 1-49, April.
    8. Sahraei, Mohammad Ali & Duman, Hakan & Çodur, Muhammed Yasin & Eyduran, Ecevit, 2021. "Prediction of transportation energy demand: Multivariate Adaptive Regression Splines," Energy, Elsevier, vol. 224(C).
    9. Hany Habbak & Mohamed Mahmoud & Khaled Metwally & Mostafa M. Fouda & Mohamed I. Ibrahem, 2023. "Load Forecasting Techniques and Their Applications in Smart Grids," Energies, MDPI, vol. 16(3), pages 1-33, February.
    10. Joanna Henzel & Łukasz Wróbel & Marcin Fice & Marek Sikora, 2022. "Energy Consumption Forecasting for the Digital-Twin Model of the Building," Energies, MDPI, vol. 15(12), pages 1-21, June.
    11. Hua, Pengmin & Wang, Haichao & Xie, Zichan & Lahdelma, Risto, 2024. "District heating load patterns and short-term forecasting for buildings and city level," Energy, Elsevier, vol. 289(C).
    12. Pedone, Livio & Molaioni, Filippo & Vallati, Andrea & Pampanin, Stefano, 2023. "Energy refurbishment planning of Italian school buildings using data-driven predictive models," Applied Energy, Elsevier, vol. 350(C).
    13. Simon Wenninger & Christian Wiethe, 2021. "Benchmarking Energy Quantification Methods to Predict Heating Energy Performance of Residential Buildings in Germany," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 63(3), pages 223-242, June.
    14. Nazir, Kashif & Memon, Shazim Ali, 2025. "Evaluating the impact of data preprocessing to develop a robust MEP-based forecasting model for building integrated with PCM," Energy, Elsevier, vol. 324(C).
    15. Somu, Nivethitha & Raman M R, Gauthama & Ramamritham, Krithi, 2021. "A deep learning framework for building energy consumption forecast," Renewable and Sustainable Energy Reviews, Elsevier, vol. 137(C).
    16. Arkar, C. & Žižak, T. & Domjan, S. & Medved, S., 2020. "Dynamic parametric models for the holistic evaluation of semi-transparent photovoltaic/thermal façade with latent storage inserts," Applied Energy, Elsevier, vol. 280(C).
    17. Kazimierz Kawa & Rafał Mularczyk & Waldemar Bauer & Katarzyna Grobler-Dębska & Edyta Kucharska, 2024. "Prediction of Energy Consumption on Example of Heterogenic Commercial Buildings," Energies, MDPI, vol. 17(13), pages 1-16, June.
    18. Fredrik Skaug Fadnes & Reyhaneh Banihabib & Mohsen Assadi, 2023. "Using Artificial Neural Networks to Gather Intelligence on a Fully Operational Heat Pump System in an Existing Building Cluster," Energies, MDPI, vol. 16(9), pages 1-33, May.
    19. Alejandra Martínez-Martínez & Rafael Llorca-Vivero, 2025. "The Taxonomy of Climate Change: How Rising Temperatures Unequally Impact Nations’ Discomfort," Working Papers 2507, Department of Applied Economics II, Universidad de Valencia.
    20. Zhang, Yuyang & Ma, Wenke & Du, Pengcheng & Li, Shaoting & Gao, Ke & Wang, Yuxuan & Liu, Yifei & Zhang, Bo & Yu, Dingyi & Zhang, Jingyi & Li, Yan, 2024. "Powering the future: Unraveling residential building characteristics for accurate prediction of total electricity consumption during summer heat," Applied Energy, Elsevier, vol. 376(PA).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:18:y:2025:i:15:p:3984-:d:1710222. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.