IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v349y2023ics0306261923009716.html
   My bibliography  Save this article

Interpretable building energy consumption forecasting using spectral clustering algorithm and temporal fusion transformers architecture

Author

Listed:
  • Zheng, Peijun
  • Zhou, Heng
  • Liu, Jiang
  • Nakanishi, Yosuke

Abstract

Accurate building energy consumption forecasting is crucial for developing efficient building energy management systems, improving energy efficiency, and local building energy supervision and management. However, short-term building energy consumption forecasting is challenging due to highly non-smooth and volatile trends. In this paper, we present a novel methodology that combines interpretable decomposition methods with an interpretable forecasting model. We first illustrate a daily energy consumption pattern recognition (DECPR) method, which decomposes daily energy consumption patterns into interpretable energy consumption subsequences. To achieve satisfactory forecasting performance, we design the vector representation of each subsequence as a static input to the temporal fusion transformers (TFT) model. This vector representation integrates the DECPR method into the TFT model. The TFT model produces interpretable outputs, such as the attention analysis of different step lengths and the visualization of the importance ranking of exogenous variables, including meteorological data, calendar information, and the vector representation. Empirical studies demonstrate that our proposed DECPR-TFT system outperforms comparable models with a mean absolute percentage error (MAPE) of 6.11%, which is significantly lower than other models. These interpretable outputs provide valuable insights for researchers seeking to develop energy-saving operation strategies in buildings. Overall, our methodology offers a promising solution for short-term building energy consumption forecasting that can contribute to more efficient building energy management and energy-saving operation strategies.

Suggested Citation

  • Zheng, Peijun & Zhou, Heng & Liu, Jiang & Nakanishi, Yosuke, 2023. "Interpretable building energy consumption forecasting using spectral clustering algorithm and temporal fusion transformers architecture," Applied Energy, Elsevier, vol. 349(C).
    • Handle: RePEc:eee:appene:v:349:y:2023:i:c:s0306261923009716
    DOI: 10.1016/j.apenergy.2023.121607
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261923009716
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.apenergy.2023.121607?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kim, Tae-Young & Cho, Sung-Bae, 2019. "Predicting residential energy consumption using CNN-LSTM neural networks," Energy, Elsevier, vol. 182(C), pages 72-81.
    2. Tian, Chengshi & Hao, Yan & Hu, Jianming, 2018. "A novel wind speed forecasting system based on hybrid data preprocessing and multi-objective optimization," Applied Energy, Elsevier, vol. 231(C), pages 301-319.
    3. Salinas, David & Flunkert, Valentin & Gasthaus, Jan & Januschowski, Tim, 2020. "DeepAR: Probabilistic forecasting with autoregressive recurrent networks," International Journal of Forecasting, Elsevier, vol. 36(3), pages 1181-1191.
    4. Huiting Zheng & Jiabin Yuan & Long Chen, 2017. "Short-Term Load Forecasting Using EMD-LSTM Neural Networks with a Xgboost Algorithm for Feature Importance Evaluation," Energies, MDPI, vol. 10(8), pages 1-20, August.
    5. Lusis, Peter & Khalilpour, Kaveh Rajab & Andrew, Lachlan & Liebman, Ariel, 2017. "Short-term residential load forecasting: Impact of calendar effects and forecast granularity," Applied Energy, Elsevier, vol. 205(C), pages 654-669.
    6. Chitalia, Gopal & Pipattanasomporn, Manisa & Garg, Vishal & Rahman, Saifur, 2020. "Robust short-term electrical load forecasting framework for commercial buildings using deep recurrent neural networks," Applied Energy, Elsevier, vol. 278(C).
    7. Lim, Bryan & Arık, Sercan Ö. & Loeff, Nicolas & Pfister, Tomas, 2021. "Temporal Fusion Transformers for interpretable multi-horizon time series forecasting," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1748-1764.
    8. Rahman, Aowabin & Smith, Amanda D., 2018. "Predicting heating demand and sizing a stratified thermal storage tank using deep learning algorithms," Applied Energy, Elsevier, vol. 228(C), pages 108-121.
    9. Somu, Nivethitha & M R, Gauthama Raman & Ramamritham, Krithi, 2020. "A hybrid model for building energy consumption forecasting using long short term memory networks," Applied Energy, Elsevier, vol. 261(C).
    10. Xu, Lei & Wang, Shengwei & Tang, Rui, 2019. "Probabilistic load forecasting for buildings considering weather forecasting uncertainty and uncertain peak load," Applied Energy, Elsevier, vol. 237(C), pages 180-195.
    11. Xiaolei Sun & Jun Hao & Jianping Li, 2022. "Multi-objective optimization of crude oil-supply portfolio based on interval prediction data," Annals of Operations Research, Springer, vol. 309(2), pages 611-639, February.
    12. Fan, Cheng & Xiao, Fu & Yan, Chengchu & Liu, Chengliang & Li, Zhengdao & Wang, Jiayuan, 2019. "A novel methodology to explain and evaluate data-driven building energy performance models based on interpretable machine learning," Applied Energy, Elsevier, vol. 235(C), pages 1551-1560.
    13. He, Feifei & Zhou, Jianzhong & Feng, Zhong-kai & Liu, Guangbiao & Yang, Yuqi, 2019. "A hybrid short-term load forecasting model based on variational mode decomposition and long short-term memory networks considering relevant factors with Bayesian optimization algorithm," Applied Energy, Elsevier, vol. 237(C), pages 103-116.
    14. Jin-Young Kim & Sung-Bae Cho, 2019. "Electric Energy Consumption Prediction by Deep Learning with State Explainable Autoencoder," Energies, MDPI, vol. 12(4), pages 1-14, February.
    15. Li, Ao & Xiao, Fu & Zhang, Chong & Fan, Cheng, 2021. "Attention-based interpretable neural network for building cooling load prediction," Applied Energy, Elsevier, vol. 299(C).
    16. Ahajjam, Mohamed Aymane & Bonilla Licea, Daniel & Ghogho, Mounir & Kobbane, Abdellatif, 2022. "Experimental investigation of variational mode decomposition and deep learning for short-term multi-horizon residential electric load forecasting," Applied Energy, Elsevier, vol. 326(C).
    17. Wenhui Zeng & Jiarui Li & Changchun Sun & Lin Cao & Xiaoping Tang & Shaolong Shu & Junsheng Zheng, 2023. "Ultra Short-Term Power Load Forecasting Based on Similar Day Clustering and Ensemble Empirical Mode Decomposition," Energies, MDPI, vol. 16(4), pages 1-15, February.
    18. Rob J. Hyndman, 2006. "Another Look at Forecast Accuracy Metrics for Intermittent Demand," Foresight: The International Journal of Applied Forecasting, International Institute of Forecasters, issue 4, pages 43-46, June.
    19. Fan, Cheng & Wang, Jiayuan & Gang, Wenjie & Li, Shenghan, 2019. "Assessment of deep recurrent neural network-based strategies for short-term building energy predictions," Applied Energy, Elsevier, vol. 236(C), pages 700-710.
    20. Armstrong, J. Scott & Collopy, Fred, 1992. "Error measures for generalizing about forecasting methods: Empirical comparisons," International Journal of Forecasting, Elsevier, vol. 8(1), pages 69-80, June.
    21. Ling Tang & Shuai Wang & Kaijian He & Shouyang Wang, 2015. "A novel mode-characteristic-based decomposition ensemble model for nuclear energy consumption forecasting," Annals of Operations Research, Springer, vol. 234(1), pages 111-132, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ijaz Ul Haq & Amin Ullah & Samee Ullah Khan & Noman Khan & Mi Young Lee & Seungmin Rho & Sung Wook Baik, 2021. "Sequential Learning-Based Energy Consumption Prediction Model for Residential and Commercial Sectors," Mathematics, MDPI, vol. 9(6), pages 1-17, March.
    2. Chongchong Xu & Zhicheng Liao & Chaojie Li & Xiaojun Zhou & Renyou Xie, 2022. "Review on Interpretable Machine Learning in Smart Grid," Energies, MDPI, vol. 15(12), pages 1-31, June.
    3. Yang, Dongchuan & Guo, Ju-e & Li, Yanzhao & Sun, Shaolong & Wang, Shouyang, 2023. "Short-term load forecasting with an improved dynamic decomposition-reconstruction-ensemble approach," Energy, Elsevier, vol. 263(PA).
    4. Jason Runge & Radu Zmeureanu, 2021. "A Review of Deep Learning Techniques for Forecasting Energy Use in Buildings," Energies, MDPI, vol. 14(3), pages 1-26, January.
    5. Mobarak Abumohsen & Amani Yousef Owda & Majdi Owda, 2023. "Electrical Load Forecasting Using LSTM, GRU, and RNN Algorithms," Energies, MDPI, vol. 16(5), pages 1-31, February.
    6. Luo, X.J. & Oyedele, Lukumon O. & Ajayi, Anuoluwapo O. & Akinade, Olugbenga O. & Owolabi, Hakeem A. & Ahmed, Ashraf, 2020. "Feature extraction and genetic algorithm enhanced adaptive deep neural network for energy consumption prediction in buildings," Renewable and Sustainable Energy Reviews, Elsevier, vol. 131(C).
    7. Yin, Linfei & Xie, Jiaxing, 2021. "Multi-temporal-spatial-scale temporal convolution network for short-term load forecasting of power systems," Applied Energy, Elsevier, vol. 283(C).
    8. Tang, Lingfeng & Xie, Haipeng & Wang, Xiaoyang & Bie, Zhaohong, 2023. "Privacy-preserving knowledge sharing for few-shot building energy prediction: A federated learning approach," Applied Energy, Elsevier, vol. 337(C).
    9. Lee, Juyong & Cho, Youngsang, 2022. "National-scale electricity peak load forecasting: Traditional, machine learning, or hybrid model?," Energy, Elsevier, vol. 239(PD).
    10. Sharma, Abhishek & Jain, Sachin Kumar, 2022. "A novel seasonal segmentation approach for day-ahead load forecasting," Energy, Elsevier, vol. 257(C).
    11. Khan, Zulfiqar Ahmad & Hussain, Tanveer & Baik, Sung Wook, 2023. "Dual stream network with attention mechanism for photovoltaic power forecasting," Applied Energy, Elsevier, vol. 338(C).
    12. Haizhou Fang & Hongwei Tan & Ningfang Dai & Zhaohui Liu & Risto Kosonen, 2023. "Hourly Building Energy Consumption Prediction Using a Training Sample Selection Method Based on Key Feature Search," Sustainability, MDPI, vol. 15(9), pages 1-23, May.
    13. Somu, Nivethitha & M R, Gauthama Raman & Ramamritham, Krithi, 2020. "A hybrid model for building energy consumption forecasting using long short term memory networks," Applied Energy, Elsevier, vol. 261(C).
    14. Gao, Lei & Liu, Tianyuan & Cao, Tao & Hwang, Yunho & Radermacher, Reinhard, 2021. "Comparing deep learning models for multi energy vectors prediction on multiple types of building," Applied Energy, Elsevier, vol. 301(C).
    15. Li, Guannan & Li, Fan & Ahmad, Tanveer & Liu, Jiangyan & Li, Tao & Fang, Xi & Wu, Yubei, 2022. "Performance evaluation of sequence-to-sequence-Attention model for short-term multi-step ahead building energy predictions," Energy, Elsevier, vol. 259(C).
    16. Zang, Haixiang & Xu, Ruiqi & Cheng, Lilin & Ding, Tao & Liu, Ling & Wei, Zhinong & Sun, Guoqiang, 2021. "Residential load forecasting based on LSTM fusing self-attention mechanism with pooling," Energy, Elsevier, vol. 229(C).
    17. Fernández, Joaquín Delgado & Menci, Sergio Potenciano & Lee, Chul Min & Rieger, Alexander & Fridgen, Gilbert, 2022. "Privacy-preserving federated learning for residential short-term load forecasting," Applied Energy, Elsevier, vol. 326(C).
    18. Zheng, Zhuang & Chen, Hainan & Luo, Xiaowei, 2019. "A Kalman filter-based bottom-up approach for household short-term load forecast," Applied Energy, Elsevier, vol. 250(C), pages 882-894.
    19. Ding, Zhikun & Chen, Weilin & Hu, Ting & Xu, Xiaoxiao, 2021. "Evolutionary double attention-based long short-term memory model for building energy prediction: Case study of a green building," Applied Energy, Elsevier, vol. 288(C).
    20. Fath U Min Ullah & Noman Khan & Tanveer Hussain & Mi Young Lee & Sung Wook Baik, 2021. "Diving Deep into Short-Term Electricity Load Forecasting: Comparative Analysis and a Novel Framework," Mathematics, MDPI, vol. 9(6), pages 1-22, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:349:y:2023:i:c:s0306261923009716. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.