IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v306y2022ipbs0306261921013647.html

A data-driven strategy using long short term memory models and reinforcement learning to predict building electricity consumption

Author

Listed:
  • Zhou, Xinlei
  • Lin, Wenye
  • Kumar, Ritunesh
  • Cui, Ping
  • Ma, Zhenjun

Abstract

Data-driven modeling emerges as a promising approach to predicting building electricity consumption and facilitating building energy management. However, the majority of the existing models suffer from performance degradation during the prediction process. This paper presents a new strategy that integrates Long Short Term Memory (LSTM) models and Reinforcement Learning (RL) agents to forecast building next-day electricity consumption and peak electricity demand. In this strategy, LSTM models were first developed and trained using the historical data as the base models for prediction. RL agents were further constructed and introduced to learn a policy that can dynamically tune the parameters of the LSTM models according to the prediction error. This strategy was tested using the electricity consumption data collected from a group of university buildings and student accommodations. The results showed that for the student accommodations which showed relatively large monthly variations in daily electricity consumption, the proposed strategy can increase the prediction accuracy by up to 23.5% as compared with the strategy using the LSTM models only. However, when it was applied to the buildings with insignificant monthly variations in the daily electricity consumption, the prediction accuracy did not show an obvious improvement when compared with the use of the LSTM models alone. This study demonstrated how to use LSTM models and reinforcement learning with self-optimization capability to likely provide more reliable prediction in daily electricity consumption and thus to facilitate building optimal operation and demand side management.

Suggested Citation

  • Zhou, Xinlei & Lin, Wenye & Kumar, Ritunesh & Cui, Ping & Ma, Zhenjun, 2022. "A data-driven strategy using long short term memory models and reinforcement learning to predict building electricity consumption," Applied Energy, Elsevier, vol. 306(PB).
  • Handle: RePEc:eee:appene:v:306:y:2022:i:pb:s0306261921013647
    DOI: 10.1016/j.apenergy.2021.118078
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261921013647
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2021.118078?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Costa, Andrea & Keane, Marcus M. & Torrens, J. Ignacio & Corry, Edward, 2013. "Building operation and energy performance: Monitoring, analysis and optimisation toolkit," Applied Energy, Elsevier, vol. 101(C), pages 310-316.
    2. Wen, Lulu & Zhou, Kaile & Yang, Shanlin & Lu, Xinhui, 2019. "Optimal load dispatch of community microgrid with deep learning based solar power and load forecasting," Energy, Elsevier, vol. 171(C), pages 1053-1065.
    3. Du, Yan & Zandi, Helia & Kotevska, Olivera & Kurte, Kuldeep & Munk, Jeffery & Amasyali, Kadir & Mckee, Evan & Li, Fangxing, 2021. "Intelligent multi-zone residential HVAC control strategy based on deep reinforcement learning," Applied Energy, Elsevier, vol. 281(C).
    4. Rahman, Aowabin & Srikumar, Vivek & Smith, Amanda D., 2018. "Predicting electricity consumption for commercial and residential buildings using deep recurrent neural networks," Applied Energy, Elsevier, vol. 212(C), pages 372-385.
    5. Amasyali, Kadir & El-Gohary, Nora M., 2018. "A review of data-driven building energy consumption prediction studies," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1192-1205.
    6. Wang, Zhe & Hong, Tianzhen & Piette, Mary Ann, 2020. "Building thermal load prediction through shallow machine learning and deep learning," Applied Energy, Elsevier, vol. 263(C).
    7. Rae-Jun Park & Kyung-Bin Song & Bo-Sung Kwon, 2020. "Short-Term Load Forecasting Algorithm Using a Similar Day Selection Method Based on Reinforcement Learning," Energies, MDPI, vol. 13(10), pages 1-19, May.
    8. Zhang, Liang & Wen, Jin & Li, Yanfei & Chen, Jianli & Ye, Yunyang & Fu, Yangyang & Livingood, William, 2021. "A review of machine learning in building load prediction," Applied Energy, Elsevier, vol. 285(C).
    9. Wang, Zeyu & Srinivasan, Ravi S., 2017. "A review of artificial intelligence based building energy use prediction: Contrasting the capabilities of single and ensemble prediction models," Renewable and Sustainable Energy Reviews, Elsevier, vol. 75(C), pages 796-808.
    10. Hong, Jichao & Wang, Zhenpo & Chen, Wen & Yao, Yongtao, 2019. "Synchronous multi-parameter prediction of battery systems on electric vehicles using long short-term memory networks," Applied Energy, Elsevier, vol. 254(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhou, Xinlei & Du, Han & Xue, Shan & Ma, Zhenjun, 2024. "Recent advances in data mining and machine learning for enhanced building energy management," Energy, Elsevier, vol. 307(C).
    2. Jason Runge & Radu Zmeureanu, 2021. "A Review of Deep Learning Techniques for Forecasting Energy Use in Buildings," Energies, MDPI, vol. 14(3), pages 1-26, January.
    3. Liang, Xinbin & Chen, Siliang & Zhu, Xu & Jin, Xinqiao & Du, Zhimin, 2023. "Domain knowledge decomposition of building energy consumption and a hybrid data-driven model for 24-h ahead predictions," Applied Energy, Elsevier, vol. 344(C).
    4. Gao, Lei & Liu, Tianyuan & Cao, Tao & Hwang, Yunho & Radermacher, Reinhard, 2021. "Comparing deep learning models for multi energy vectors prediction on multiple types of building," Applied Energy, Elsevier, vol. 301(C).
    5. Wang, Zeyu & Liu, Jian & Zhang, Yuanxin & Yuan, Hongping & Zhang, Ruixue & Srinivasan, Ravi S., 2021. "Practical issues in implementing machine-learning models for building energy efficiency: Moving beyond obstacles," Renewable and Sustainable Energy Reviews, Elsevier, vol. 143(C).
    6. Lu, Yakai & Tian, Zhe & Zhou, Ruoyu & Liu, Wenjing, 2021. "A general transfer learning-based framework for thermal load prediction in regional energy system," Energy, Elsevier, vol. 217(C).
    7. Venkatraj, V. & Dixit, M.K., 2022. "Challenges in implementing data-driven approaches for building life cycle energy assessment: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 160(C).
    8. Li, Guannan & Li, Fan & Ahmad, Tanveer & Liu, Jiangyan & Li, Tao & Fang, Xi & Wu, Yubei, 2022. "Performance evaluation of sequence-to-sequence-Attention model for short-term multi-step ahead building energy predictions," Energy, Elsevier, vol. 259(C).
    9. Zhang, Xu & Sun, Yongjun & Gao, Dian-ce & Zou, Wenke & Fu, Jianping & Ma, Xiaowen, 2022. "Similarity-based grouping method for evaluation and optimization of dataset structure in machine-learning based short-term building cooling load prediction without measurable occupancy information," Applied Energy, Elsevier, vol. 327(C).
    10. Ding, Zhikun & Chen, Weilin & Hu, Ting & Xu, Xiaoxiao, 2021. "Evolutionary double attention-based long short-term memory model for building energy prediction: Case study of a green building," Applied Energy, Elsevier, vol. 288(C).
    11. Lu, Chujie & Li, Sihui & Reddy Penaka, Santhan & Olofsson, Thomas, 2023. "Automated machine learning-based framework of heating and cooling load prediction for quick residential building design," Energy, Elsevier, vol. 274(C).
    12. Tran, Duc-Hoc & Luong, Duc-Long & Chou, Jui-Sheng, 2020. "Nature-inspired metaheuristic ensemble model for forecasting energy consumption in residential buildings," Energy, Elsevier, vol. 191(C).
    13. Peplinski, McKenna & Dilkina, Bistra & Chen, Mo & Silva, Sam J. & Ban-Weiss, George A. & Sanders, Kelly T., 2024. "A machine learning framework to estimate residential electricity demand based on smart meter electricity, climate, building characteristics, and socioeconomic datasets," Applied Energy, Elsevier, vol. 357(C).
    14. Xu, X. & Hu, Y. & Atamturktur, S. & Chen, L. & Wang, J., 2025. "Systematic review on uncertainty quantification in machine learning-based building energy modeling," Renewable and Sustainable Energy Reviews, Elsevier, vol. 218(C).
    15. Li, Guannan & Wu, Yubei & Yoon, Sungmin & Fang, Xi, 2024. "Comprehensive transferability assessment of short-term cross-building-energy prediction using deep adversarial network transfer learning," Energy, Elsevier, vol. 299(C).
    16. Yue, Naihua & Caini, Mauro & Li, Lingling & Zhao, Yang & Li, Yu, 2023. "A comparison of six metamodeling techniques applied to multi building performance vectors prediction on gymnasiums under multiple climate conditions," Applied Energy, Elsevier, vol. 332(C).
    17. Fan, Cheng & Xiao, Fu & Song, Mengjie & Wang, Jiayuan, 2019. "A graph mining-based methodology for discovering and visualizing high-level knowledge for building energy management," Applied Energy, Elsevier, vol. 251(C), pages 1-1.
    18. Gao, Dian-ce & Zhang, Xu & Zhang, Yaxi & Gao, Yafeng & Zou, Wenke & Shan, Kui, 2026. "Dataset preprocessing and optimization for machine learning-based building load prediction: A review," Energy, Elsevier, vol. 344(C).
    19. Li, Guannan & Zhan, Lei & Fang, Xi & Gao, Jiajia & Xu, Chengliang & He, Xin & Deng, Jiahui & Xiong, Chenglong, 2024. "Performance comparison on improved data-driven building energy prediction under data shortage scenarios in four perspectives: Data generation, incremental learning, transfer learning, and physics-informed," Energy, Elsevier, vol. 312(C).
    20. Lei, Lei & Shao, Suola & Liang, Lixia, 2024. "An evolutionary deep learning model based on EWKM, random forest algorithm, SSA and BiLSTM for building energy consumption prediction," Energy, Elsevier, vol. 288(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:306:y:2022:i:pb:s0306261921013647. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.