IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v259y2022ics0360544222018163.html
   My bibliography  Save this article

Performance evaluation of sequence-to-sequence-Attention model for short-term multi-step ahead building energy predictions

Author

Listed:
  • Li, Guannan
  • Li, Fan
  • Ahmad, Tanveer
  • Liu, Jiangyan
  • Li, Tao
  • Fang, Xi
  • Wu, Yubei

Abstract

Traditional building energy prediction(BEP) methods usually solve time-series prediction problems using either recursive strategy or direct strategy, which may ignore time-dependence between continuous building energy data in building energy systems. To overcome this issue, a sequence-to-sequence(Seq2seq) model combined with attention mechanism(Seq2seq-Att) is developed to realize multi-step ahead BEP. Compared with the original Seq2seq, both parameter-tuning and attention mechanism in the Seq2seq-Att model have great impacts on BEP performance improvement. To obtain quantitative analyses of performance improvement of these two aspects, this study conducted a comprehensive performance evaluation of four Seq2seq models (i.e., before and after parameter-tuning, adding attention and without attention). In this study, the length of sliding window is 24-h and prediction time steps ranges from 1-h to 12-h ahead. From the open-source Building Data Genome Project 2, 36 buildings are selected. Results indicate that adding attention to Seq2seq together with parameter-tuning, the multi-step ahead prediction performance can be increased by 8%(parameter-tuning around 6% while adding attention about 2%) on average. For prediction time step less than 3-h, parameter-tuning is a convenient way to improve the Seq2seq-based multi-step ahead BEP model. But for cases of prediction time step over 3-h, combining attention to the Seq2seq after parameter-tuning is recommended.

Suggested Citation

  • Li, Guannan & Li, Fan & Ahmad, Tanveer & Liu, Jiangyan & Li, Tao & Fang, Xi & Wu, Yubei, 2022. "Performance evaluation of sequence-to-sequence-Attention model for short-term multi-step ahead building energy predictions," Energy, Elsevier, vol. 259(C).
    • Handle: RePEc:eee:energy:v:259:y:2022:i:c:s0360544222018163
    DOI: 10.1016/j.energy.2022.124915
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544222018163
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.energy.2022.124915?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Wang, Zhe & Hong, Tianzhen & Piette, Mary Ann, 2020. "Building thermal load prediction through shallow machine learning and deep learning," Applied Energy, Elsevier, vol. 263(C).
    2. Wang, Jian Qi & Du, Yu & Wang, Jing, 2020. "LSTM based long-term energy consumption prediction with periodicity," Energy, Elsevier, vol. 197(C).
    3. Ahmad, Tanveer & Zhang, Hongcai, 2020. "Novel deep supervised ML models with feature selection approach for large-scale utilities and buildings short and medium-term load requirement forecasts," Energy, Elsevier, vol. 209(C).
    4. Ding, Zhikun & Chen, Weilin & Hu, Ting & Xu, Xiaoxiao, 2021. "Evolutionary double attention-based long short-term memory model for building energy prediction: Case study of a green building," Applied Energy, Elsevier, vol. 288(C).
    5. Wang, Fu-Kwun & Amogne, Zemenu Endalamaw & Chou, Jia-Hong & Tseng, Cheng, 2022. "Online remaining useful life prediction of lithium-ion batteries using bidirectional long short-term memory with attention mechanism," Energy, Elsevier, vol. 254(PB).
    6. Chung, Won Hee & Gu, Yeong Hyeon & Yoo, Seong Joon, 2022. "District heater load forecasting based on machine learning and parallel CNN-LSTM attention," Energy, Elsevier, vol. 246(C).
    7. Zhang, Liang & Wen, Jin & Li, Yanfei & Chen, Jianli & Ye, Yunyang & Fu, Yangyang & Livingood, William, 2021. "A review of machine learning in building load prediction," Applied Energy, Elsevier, vol. 285(C).
    8. Li, Qing & Zhang, Xinyan & Ma, Tianjiao & Jiao, Chunlei & Wang, Heng & Hu, Wei, 2021. "A multi-step ahead photovoltaic power prediction model based on similar day, enhanced colliding bodies optimization, variational mode decomposition, and deep extreme learning machine," Energy, Elsevier, vol. 224(C).
    9. Fan, Cheng & Sun, Yongjun & Zhao, Yang & Song, Mengjie & Wang, Jiayuan, 2019. "Deep learning-based feature engineering methods for improved building energy prediction," Applied Energy, Elsevier, vol. 240(C), pages 35-45.
    10. Somu, Nivethitha & M R, Gauthama Raman & Ramamritham, Krithi, 2020. "A hybrid model for building energy consumption forecasting using long short term memory networks," Applied Energy, Elsevier, vol. 261(C).
    11. Wang, Yi & Gan, Dahua & Sun, Mingyang & Zhang, Ning & Lu, Zongxiang & Kang, Chongqing, 2019. "Probabilistic individual load forecasting using pinball loss guided LSTM," Applied Energy, Elsevier, vol. 235(C), pages 10-20.
    12. Chen, Junxiong & Feng, Xiong & Jiang, Lin & Zhu, Qiao, 2021. "State of charge estimation of lithium-ion battery using denoising autoencoder and gated recurrent unit recurrent neural network," Energy, Elsevier, vol. 227(C).
    13. Xue, Guixiang & Qi, Chengying & Li, Han & Kong, Xiangfei & Song, Jiancai, 2020. "Heating load prediction based on attention long short term memory: A case study of Xingtai," Energy, Elsevier, vol. 203(C).
    14. Bingchun Liu & Shijie Zhao & Xiaogang Yu & Lei Zhang & Qingshan Wang, 2020. "A Novel Deep Learning Approach for Wind Power Forecasting Based on WD-LSTM Model," Energies, MDPI, vol. 13(18), pages 1-17, September.
    15. Rahman, Aowabin & Srikumar, Vivek & Smith, Amanda D., 2018. "Predicting electricity consumption for commercial and residential buildings using deep recurrent neural networks," Applied Energy, Elsevier, vol. 212(C), pages 372-385.
    16. Wang, Gang & Jia, Ru & Liu, Jinhai & Zhang, Huaguang, 2020. "A hybrid wind power forecasting approach based on Bayesian model averaging and ensemble learning," Renewable Energy, Elsevier, vol. 145(C), pages 2426-2434.
    17. Lu, Hongfang & Cheng, Feifei & Ma, Xin & Hu, Gang, 2020. "Short-term prediction of building energy consumption employing an improved extreme gradient boosting model: A case study of an intake tower," Energy, Elsevier, vol. 203(C).
    18. Fang, Xi & Gong, Guangcai & Li, Guannan & Chun, Liang & Li, Wenqiang & Peng, Pei, 2021. "A hybrid deep transfer learning strategy for short term cross-building energy prediction," Energy, Elsevier, vol. 215(PB).
    19. Gao, Lei & Liu, Tianyuan & Cao, Tao & Hwang, Yunho & Radermacher, Reinhard, 2021. "Comparing deep learning models for multi energy vectors prediction on multiple types of building," Applied Energy, Elsevier, vol. 301(C).
    20. Zhang, Yu & Li, Yanting & Zhang, Guangyao, 2020. "Short-term wind power forecasting approach based on Seq2Seq model using NWP data," Energy, Elsevier, vol. 213(C).
    21. Ma, Weiwu & Fang, Song & Liu, Gang & Zhou, Ruoyu, 2017. "Modeling of district load forecasting for distributed energy system," Applied Energy, Elsevier, vol. 204(C), pages 181-205.
    22. Li, Ao & Xiao, Fu & Zhang, Chong & Fan, Cheng, 2021. "Attention-based interpretable neural network for building cooling load prediction," Applied Energy, Elsevier, vol. 299(C).
    23. Sun, Ying & Haghighat, Fariborz & Fung, Benjamin C.M., 2022. "Trade-off between accuracy and fairness of data-driven building and indoor environment models: A comparative study of pre-processing methods," Energy, Elsevier, vol. 239(PD).
    24. Fan, Cheng & Lei, Yutian & Sun, Yongjun & Piscitelli, Marco Savino & Chiosa, Roberto & Capozzoli, Alfonso, 2022. "Data-centric or algorithm-centric: Exploiting the performance of transfer learning for improving building energy predictions in data-scarce context," Energy, Elsevier, vol. 240(C).
    25. Xiao, Tong & Xu, Peng & He, Ruikai & Sha, Huajing, 2022. "Status quo and opportunities for building energy prediction in limited data Context—Overview from a competition," Applied Energy, Elsevier, vol. 305(C).
    26. Fan, Cheng & Wang, Jiayuan & Gang, Wenjie & Li, Shenghan, 2019. "Assessment of deep recurrent neural network-based strategies for short-term building energy predictions," Applied Energy, Elsevier, vol. 236(C), pages 700-710.
    27. Liu, Jiangyan & Zhang, Qing & Dong, Zhenxiang & Li, Xin & Li, Guannan & Xie, Yi & Li, Kuining, 2021. "Quantitative evaluation of the building energy performance based on short-term energy predictions," Energy, Elsevier, vol. 223(C).
    28. Gao, Dian-ce & Sun, Yongjun & Lu, Yuehong, 2015. "A robust demand response control of commercial buildings for smart grid under load prediction uncertainty," Energy, Elsevier, vol. 93(P1), pages 275-283.
    29. Jiang, Feifeng & Ma, Jun & Li, Zheng & Ding, Yuexiong, 2022. "Prediction of energy use intensity of urban buildings using the semi-supervised deep learning model," Energy, Elsevier, vol. 249(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Stefenon, Stefano Frizzo & Seman, Laio Oriel & Aquino, Luiza Scapinello & Coelho, Leandro dos Santos, 2023. "Wavelet-Seq2Seq-LSTM with attention for time series forecasting of level of dams in hydroelectric power plants," Energy, Elsevier, vol. 274(C).
    2. Liang, Xinbin & Chen, Siliang & Zhu, Xu & Jin, Xinqiao & Du, Zhimin, 2023. "Domain knowledge decomposition of building energy consumption and a hybrid data-driven model for 24-h ahead predictions," Applied Energy, Elsevier, vol. 344(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jason Runge & Radu Zmeureanu, 2021. "A Review of Deep Learning Techniques for Forecasting Energy Use in Buildings," Energies, MDPI, vol. 14(3), pages 1-26, January.
    2. Haizhou Fang & Hongwei Tan & Ningfang Dai & Zhaohui Liu & Risto Kosonen, 2023. "Hourly Building Energy Consumption Prediction Using a Training Sample Selection Method Based on Key Feature Search," Sustainability, MDPI, vol. 15(9), pages 1-23, May.
    3. Tang, Lingfeng & Xie, Haipeng & Wang, Xiaoyang & Bie, Zhaohong, 2023. "Privacy-preserving knowledge sharing for few-shot building energy prediction: A federated learning approach," Applied Energy, Elsevier, vol. 337(C).
    4. Fan, Cheng & Lei, Yutian & Sun, Yongjun & Piscitelli, Marco Savino & Chiosa, Roberto & Capozzoli, Alfonso, 2022. "Data-centric or algorithm-centric: Exploiting the performance of transfer learning for improving building energy predictions in data-scarce context," Energy, Elsevier, vol. 240(C).
    5. Yong Zhou & Lingyu Wang & Junhao Qian, 2022. "Application of Combined Models Based on Empirical Mode Decomposition, Deep Learning, and Autoregressive Integrated Moving Average Model for Short-Term Heating Load Predictions," Sustainability, MDPI, vol. 14(12), pages 1-20, June.
    6. Saima Akhtar & Sulman Shahzad & Asad Zaheer & Hafiz Sami Ullah & Heybet Kilic & Radomir Gono & Michał Jasiński & Zbigniew Leonowicz, 2023. "Short-Term Load Forecasting Models: A Review of Challenges, Progress, and the Road Ahead," Energies, MDPI, vol. 16(10), pages 1-29, May.
    7. Yue, Naihua & Caini, Mauro & Li, Lingling & Zhao, Yang & Li, Yu, 2023. "A comparison of six metamodeling techniques applied to multi building performance vectors prediction on gymnasiums under multiple climate conditions," Applied Energy, Elsevier, vol. 332(C).
    8. Zang, Haixiang & Xu, Ruiqi & Cheng, Lilin & Ding, Tao & Liu, Ling & Wei, Zhinong & Sun, Guoqiang, 2021. "Residential load forecasting based on LSTM fusing self-attention mechanism with pooling," Energy, Elsevier, vol. 229(C).
    9. Ye, Lin & Li, Yilin & Pei, Ming & Zhao, Yongning & Li, Zhuo & Lu, Peng, 2022. "A novel integrated method for short-term wind power forecasting based on fluctuation clustering and history matching," Applied Energy, Elsevier, vol. 327(C).
    10. Ding, Zhikun & Chen, Weilin & Hu, Ting & Xu, Xiaoxiao, 2021. "Evolutionary double attention-based long short-term memory model for building energy prediction: Case study of a green building," Applied Energy, Elsevier, vol. 288(C).
    11. Seok-Jun Bu & Sung-Bae Cho, 2020. "Time Series Forecasting with Multi-Headed Attention-Based Deep Learning for Residential Energy Consumption," Energies, MDPI, vol. 13(18), pages 1-16, September.
    12. Lu, Yakai & Tian, Zhe & Zhou, Ruoyu & Liu, Wenjing, 2021. "A general transfer learning-based framework for thermal load prediction in regional energy system," Energy, Elsevier, vol. 217(C).
    13. Ling, Jihong & Zhang, Bingyang & Dai, Na & Xing, Jincheng, 2023. "Coupling input feature construction methods and machine learning algorithms for hourly secondary supply temperature prediction," Energy, Elsevier, vol. 278(C).
    14. Stefenon, Stefano Frizzo & Seman, Laio Oriel & Aquino, Luiza Scapinello & Coelho, Leandro dos Santos, 2023. "Wavelet-Seq2Seq-LSTM with attention for time series forecasting of level of dams in hydroelectric power plants," Energy, Elsevier, vol. 274(C).
    15. Wen, Songkang & Li, Yanting & Su, Yan, 2022. "A new hybrid model for power forecasting of a wind farm using spatial–temporal correlations," Renewable Energy, Elsevier, vol. 198(C), pages 155-168.
    16. Zhou, Xinlei & Lin, Wenye & Kumar, Ritunesh & Cui, Ping & Ma, Zhenjun, 2022. "A data-driven strategy using long short term memory models and reinforcement learning to predict building electricity consumption," Applied Energy, Elsevier, vol. 306(PB).
    17. Liu, Che & Li, Fan & Zhang, Chenghui & Sun, Bo & Zhang, Guanguan, 2023. "A day-ahead prediction method for high-resolution electricity consumption in residential units," Energy, Elsevier, vol. 265(C).
    18. Liang, Xinbin & Chen, Siliang & Zhu, Xu & Jin, Xinqiao & Du, Zhimin, 2023. "Domain knowledge decomposition of building energy consumption and a hybrid data-driven model for 24-h ahead predictions," Applied Energy, Elsevier, vol. 344(C).
    19. Venkatraj, V. & Dixit, M.K., 2022. "Challenges in implementing data-driven approaches for building life cycle energy assessment: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 160(C).
    20. Razak Olu-Ajayi & Hafiz Alaka & Hakeem Owolabi & Lukman Akanbi & Sikiru Ganiyu, 2023. "Data-Driven Tools for Building Energy Consumption Prediction: A Review," Energies, MDPI, vol. 16(6), pages 1-20, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:259:y:2022:i:c:s0360544222018163. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.