IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v306y2022ipbs0306261921013647.html
   My bibliography  Save this article

A data-driven strategy using long short term memory models and reinforcement learning to predict building electricity consumption

Author

Listed:
  • Zhou, Xinlei
  • Lin, Wenye
  • Kumar, Ritunesh
  • Cui, Ping
  • Ma, Zhenjun

Abstract

Data-driven modeling emerges as a promising approach to predicting building electricity consumption and facilitating building energy management. However, the majority of the existing models suffer from performance degradation during the prediction process. This paper presents a new strategy that integrates Long Short Term Memory (LSTM) models and Reinforcement Learning (RL) agents to forecast building next-day electricity consumption and peak electricity demand. In this strategy, LSTM models were first developed and trained using the historical data as the base models for prediction. RL agents were further constructed and introduced to learn a policy that can dynamically tune the parameters of the LSTM models according to the prediction error. This strategy was tested using the electricity consumption data collected from a group of university buildings and student accommodations. The results showed that for the student accommodations which showed relatively large monthly variations in daily electricity consumption, the proposed strategy can increase the prediction accuracy by up to 23.5% as compared with the strategy using the LSTM models only. However, when it was applied to the buildings with insignificant monthly variations in the daily electricity consumption, the prediction accuracy did not show an obvious improvement when compared with the use of the LSTM models alone. This study demonstrated how to use LSTM models and reinforcement learning with self-optimization capability to likely provide more reliable prediction in daily electricity consumption and thus to facilitate building optimal operation and demand side management.

Suggested Citation

  • Zhou, Xinlei & Lin, Wenye & Kumar, Ritunesh & Cui, Ping & Ma, Zhenjun, 2022. "A data-driven strategy using long short term memory models and reinforcement learning to predict building electricity consumption," Applied Energy, Elsevier, vol. 306(PB).
  • Handle: RePEc:eee:appene:v:306:y:2022:i:pb:s0306261921013647
    DOI: 10.1016/j.apenergy.2021.118078
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261921013647
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2021.118078?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Wang, Zhe & Hong, Tianzhen & Piette, Mary Ann, 2020. "Building thermal load prediction through shallow machine learning and deep learning," Applied Energy, Elsevier, vol. 263(C).
    2. Wen, Lulu & Zhou, Kaile & Yang, Shanlin & Lu, Xinhui, 2019. "Optimal load dispatch of community microgrid with deep learning based solar power and load forecasting," Energy, Elsevier, vol. 171(C), pages 1053-1065.
    3. Zhang, Liang & Wen, Jin & Li, Yanfei & Chen, Jianli & Ye, Yunyang & Fu, Yangyang & Livingood, William, 2021. "A review of machine learning in building load prediction," Applied Energy, Elsevier, vol. 285(C).
    4. Costa, Andrea & Keane, Marcus M. & Torrens, J. Ignacio & Corry, Edward, 2013. "Building operation and energy performance: Monitoring, analysis and optimisation toolkit," Applied Energy, Elsevier, vol. 101(C), pages 310-316.
    5. Rahman, Aowabin & Srikumar, Vivek & Smith, Amanda D., 2018. "Predicting electricity consumption for commercial and residential buildings using deep recurrent neural networks," Applied Energy, Elsevier, vol. 212(C), pages 372-385.
    6. Rae-Jun Park & Kyung-Bin Song & Bo-Sung Kwon, 2020. "Short-Term Load Forecasting Algorithm Using a Similar Day Selection Method Based on Reinforcement Learning," Energies, MDPI, vol. 13(10), pages 1-19, May.
    7. Hong, Jichao & Wang, Zhenpo & Chen, Wen & Yao, Yongtao, 2019. "Synchronous multi-parameter prediction of battery systems on electric vehicles using long short-term memory networks," Applied Energy, Elsevier, vol. 254(C).
    8. Du, Yan & Zandi, Helia & Kotevska, Olivera & Kurte, Kuldeep & Munk, Jeffery & Amasyali, Kadir & Mckee, Evan & Li, Fangxing, 2021. "Intelligent multi-zone residential HVAC control strategy based on deep reinforcement learning," Applied Energy, Elsevier, vol. 281(C).
    9. Amasyali, Kadir & El-Gohary, Nora M., 2018. "A review of data-driven building energy consumption prediction studies," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1192-1205.
    10. Wang, Zeyu & Srinivasan, Ravi S., 2017. "A review of artificial intelligence based building energy use prediction: Contrasting the capabilities of single and ensemble prediction models," Renewable and Sustainable Energy Reviews, Elsevier, vol. 75(C), pages 796-808.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yin, Linfei & Qiu, Yao, 2022. "Neural network dynamic differential control for long-term price guidance mechanism of flexible energy service providers," Energy, Elsevier, vol. 255(C).
    2. Ghafoori, Mahdi & Abdallah, Moatassem & Kim, Serena, 2023. "Electricity peak shaving for commercial buildings using machine learning and vehicle to building (V2B) system," Applied Energy, Elsevier, vol. 340(C).
    3. Li, Jianbin & Chen, Zhiqiang & Cheng, Long & Liu, Xiufeng, 2022. "Energy data generation with Wasserstein Deep Convolutional Generative Adversarial Networks," Energy, Elsevier, vol. 257(C).
    4. Meihang Zhang & Hua Zhang & Wei Yan & Zhigang Jiang & Shuo Zhu, 2023. "An Integrated Deep-Learning-Based Approach for Energy Consumption Prediction of Machining Systems," Sustainability, MDPI, vol. 15(7), pages 1-17, March.
    5. dos Santos Ferreira, Greicili & Martins dos Santos, Deilson & Luciano Avila, Sérgio & Viana Luiz Albani, Vinicius & Cardoso Orsi, Gustavo & Cesar Cordeiro Vieira, Pedro & Nilson Rodrigues, Rafael, 2023. "Short- and long-term forecasting for building energy consumption considering IPMVP recommendations, WEO and COP27 scenarios," Applied Energy, Elsevier, vol. 339(C).
    6. Haizhou Fang & Hongwei Tan & Ningfang Dai & Zhaohui Liu & Risto Kosonen, 2023. "Hourly Building Energy Consumption Prediction Using a Training Sample Selection Method Based on Key Feature Search," Sustainability, MDPI, vol. 15(9), pages 1-23, May.
    7. Omar Al-Ani & Sanjoy Das, 2022. "Reinforcement Learning: Theory and Applications in HEMS," Energies, MDPI, vol. 15(17), pages 1-37, September.
    8. Wu, Han & Liang, Yan & Heng, Jiani, 2023. "Pulse-diagnosis-inspired multi-feature extraction deep network for short-term electricity load forecasting," Applied Energy, Elsevier, vol. 339(C).
    9. Lu, Jie & Zhang, Chaobo & Li, Junyang & Zhao, Yang & Qiu, Weikang & Li, Tingting & Zhou, Kai & He, Jianing, 2022. "Graph convolutional networks-based method for estimating design loads of complex buildings in the preliminary design stage," Applied Energy, Elsevier, vol. 322(C).
    10. Ayas Shaqour & Aya Hagishima, 2022. "Systematic Review on Deep Reinforcement Learning-Based Energy Management for Different Building Types," Energies, MDPI, vol. 15(22), pages 1-27, November.
    11. Ali, Aliyuda & Aliyuda, Kachalla & Elmitwally, Nouh & Muhammad Bello, Abdulwahab, 2022. "Towards more accurate and explainable supervised learning-based prediction of deliverability for underground natural gas storage," Applied Energy, Elsevier, vol. 327(C).
    12. Liang, Xuedong & Luo, Peng & Li, Xiaoyan & Wang, Xia & Shu, Lingli, 2023. "Crude oil price prediction using deep reinforcement learning," Resources Policy, Elsevier, vol. 81(C).
    13. Shang, Jingyi & Gao, Jinfeng & Jiang, Xin & Liu, Mingguang & Liu, Dunnan, 2023. "Optimal configuration of hybrid energy systems considering power to hydrogen and electricity-price prediction: A two-stage multi-objective bi-level framework," Energy, Elsevier, vol. 263(PF).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Liang, Xinbin & Chen, Siliang & Zhu, Xu & Jin, Xinqiao & Du, Zhimin, 2023. "Domain knowledge decomposition of building energy consumption and a hybrid data-driven model for 24-h ahead predictions," Applied Energy, Elsevier, vol. 344(C).
    2. Gao, Lei & Liu, Tianyuan & Cao, Tao & Hwang, Yunho & Radermacher, Reinhard, 2021. "Comparing deep learning models for multi energy vectors prediction on multiple types of building," Applied Energy, Elsevier, vol. 301(C).
    3. Jason Runge & Radu Zmeureanu, 2021. "A Review of Deep Learning Techniques for Forecasting Energy Use in Buildings," Energies, MDPI, vol. 14(3), pages 1-26, January.
    4. Wang, Zeyu & Liu, Jian & Zhang, Yuanxin & Yuan, Hongping & Zhang, Ruixue & Srinivasan, Ravi S., 2021. "Practical issues in implementing machine-learning models for building energy efficiency: Moving beyond obstacles," Renewable and Sustainable Energy Reviews, Elsevier, vol. 143(C).
    5. Lu, Yakai & Tian, Zhe & Zhou, Ruoyu & Liu, Wenjing, 2021. "A general transfer learning-based framework for thermal load prediction in regional energy system," Energy, Elsevier, vol. 217(C).
    6. Yue, Naihua & Caini, Mauro & Li, Lingling & Zhao, Yang & Li, Yu, 2023. "A comparison of six metamodeling techniques applied to multi building performance vectors prediction on gymnasiums under multiple climate conditions," Applied Energy, Elsevier, vol. 332(C).
    7. Venkatraj, V. & Dixit, M.K., 2022. "Challenges in implementing data-driven approaches for building life cycle energy assessment: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 160(C).
    8. Li, Guannan & Li, Fan & Ahmad, Tanveer & Liu, Jiangyan & Li, Tao & Fang, Xi & Wu, Yubei, 2022. "Performance evaluation of sequence-to-sequence-Attention model for short-term multi-step ahead building energy predictions," Energy, Elsevier, vol. 259(C).
    9. Zhang, Xu & Sun, Yongjun & Gao, Dian-ce & Zou, Wenke & Fu, Jianping & Ma, Xiaowen, 2022. "Similarity-based grouping method for evaluation and optimization of dataset structure in machine-learning based short-term building cooling load prediction without measurable occupancy information," Applied Energy, Elsevier, vol. 327(C).
    10. Ding, Zhikun & Chen, Weilin & Hu, Ting & Xu, Xiaoxiao, 2021. "Evolutionary double attention-based long short-term memory model for building energy prediction: Case study of a green building," Applied Energy, Elsevier, vol. 288(C).
    11. Fan, Cheng & Xiao, Fu & Song, Mengjie & Wang, Jiayuan, 2019. "A graph mining-based methodology for discovering and visualizing high-level knowledge for building energy management," Applied Energy, Elsevier, vol. 251(C), pages 1-1.
    12. Lu, Chujie & Li, Sihui & Reddy Penaka, Santhan & Olofsson, Thomas, 2023. "Automated machine learning-based framework of heating and cooling load prediction for quick residential building design," Energy, Elsevier, vol. 274(C).
    13. Pan, Yue & Zhang, Limao, 2020. "Data-driven estimation of building energy consumption with multi-source heterogeneous data," Applied Energy, Elsevier, vol. 268(C).
    14. Tran, Duc-Hoc & Luong, Duc-Long & Chou, Jui-Sheng, 2020. "Nature-inspired metaheuristic ensemble model for forecasting energy consumption in residential buildings," Energy, Elsevier, vol. 191(C).
    15. Chen, Zhelun & O’Neill, Zheng & Wen, Jin & Pradhan, Ojas & Yang, Tao & Lu, Xing & Lin, Guanjing & Miyata, Shohei & Lee, Seungjae & Shen, Chou & Chiosa, Roberto & Piscitelli, Marco Savino & Capozzoli, , 2023. "A review of data-driven fault detection and diagnostics for building HVAC systems," Applied Energy, Elsevier, vol. 339(C).
    16. Fu, Chun & Miller, Clayton, 2022. "Using Google Trends as a proxy for occupant behavior to predict building energy consumption," Applied Energy, Elsevier, vol. 310(C).
    17. Saima Akhtar & Sulman Shahzad & Asad Zaheer & Hafiz Sami Ullah & Heybet Kilic & Radomir Gono & Michał Jasiński & Zbigniew Leonowicz, 2023. "Short-Term Load Forecasting Models: A Review of Challenges, Progress, and the Road Ahead," Energies, MDPI, vol. 16(10), pages 1-29, May.
    18. Ijaz Ul Haq & Amin Ullah & Samee Ullah Khan & Noman Khan & Mi Young Lee & Seungmin Rho & Sung Wook Baik, 2021. "Sequential Learning-Based Energy Consumption Prediction Model for Residential and Commercial Sectors," Mathematics, MDPI, vol. 9(6), pages 1-17, March.
    19. Salah Bouktif & Ali Fiaz & Ali Ouni & Mohamed Adel Serhani, 2018. "Optimal Deep Learning LSTM Model for Electric Load Forecasting using Feature Selection and Genetic Algorithm: Comparison with Machine Learning Approaches †," Energies, MDPI, vol. 11(7), pages 1-20, June.
    20. Fan, Cheng & Sun, Yongjun & Xiao, Fu & Ma, Jie & Lee, Dasheng & Wang, Jiayuan & Tseng, Yen Chieh, 2020. "Statistical investigations of transfer learning-based methodology for short-term building energy predictions," Applied Energy, Elsevier, vol. 262(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:306:y:2022:i:pb:s0306261921013647. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.