IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v15y2023i3p2340-d1048498.html
   My bibliography  Save this article

Implementation of a Long Short-Term Memory Transfer Learning (LSTM-TL)-Based Data-Driven Model for Building Energy Demand Forecasting

Author

Listed:
  • Dongsu Kim

    (Department of Architecture Engineering, Hanbat National University, Daejeon 34158, Republic of Korea)

  • Yongjun Lee

    (Building Environmental Logic (BEL) Technology, Seoul 05548, Republic of Korea)

  • Kyungil Chin

    (Department of Architecture Engineering, Hanbat National University, Daejeon 34158, Republic of Korea)

  • Pedro J. Mago

    (Department of Mechanical and Aerospace Engineering, West Virginia University, Morgantown, WV 26506, USA)

  • Heejin Cho

    (Department of Mechanical Engineering, Mississippi State University, Mississippi State, MS 39762, USA)

  • Jian Zhang

    (Department of Mechanical Engineering, University of Wisconsin-Green Bay, Wisconsin, WI 54311, USA)

Abstract

Building energy consumption accounts for about 40% of global primary energy use and 30% of worldwide greenhouse gas (GHG) emissions. Among the energy-related factors present in buildings, heating, cooling, and air-conditioning (HVAC) systems are considered major contributors to whole-building energy use. To improve the energy efficiency of HVAC systems and mitigate whole-building energy consumption, accurately predicting the building energy consumption can play a significant role. Although many prediction approaches are available for building energy use, a machine learning-based modeling approach (i.e., black box models) has recently been considered to be one of the most promising building energy modeling techniques due to its simplicity and flexibility compared to physics-based modeling techniques (i.e., white box models). This study presents a building energy load forecasting method based on long-term short-term memory (LSTM) and transfer learning (TL) strategies. To implement this approach, this study first conducted raw data pre-processing analysis to generate input datasets. A hospital building type was considered for a case study in the first stage. The hospital prototype building model, developed by the U.S. department of energy (DOE), was used to generate an initial input training and testing dataset for source domain tasks before the transfer learning process. For the transfer learning process in a target domain, a simulation-based analysis was also conducted to obtain target datasets by assuming limited data lengths in different weather conditions. The training and testing procedures were performed using separate cooling and heating periods with and without the transfer learning process for source and target domain tasks, respectively. Lastly, a comparative analysis was carried out to investigate how the accuracy of LSTM prediction can be enhanced with the help of transfer learning strategies. The results from this study show that the developed LSTM-TL model can achieve better performance than the prediction model, which only uses LSTM under different weather conditions. In addition, accurate performance can vary according to different transfer learning methods with frozen and fine-tuning layers and locations.

Suggested Citation

  • Dongsu Kim & Yongjun Lee & Kyungil Chin & Pedro J. Mago & Heejin Cho & Jian Zhang, 2023. "Implementation of a Long Short-Term Memory Transfer Learning (LSTM-TL)-Based Data-Driven Model for Building Energy Demand Forecasting," Sustainability, MDPI, vol. 15(3), pages 1-23, January.
  • Handle: RePEc:gam:jsusta:v:15:y:2023:i:3:p:2340-:d:1048498
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/15/3/2340/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2071-1050/15/3/2340/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Cao, Jian & Li, Zhi & Li, Jian, 2019. "Financial time series forecasting model based on CEEMDAN and LSTM," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 519(C), pages 127-139.
    2. Deepak Gupta & Mahardhika Pratama & Zhenyuan Ma & Jun Li & Mukesh Prasad, 2019. "Financial time series forecasting using twin support vector regression," PLOS ONE, Public Library of Science, vol. 14(3), pages 1-27, March.
    3. Wang, Zhe & Hong, Tianzhen, 2020. "Reinforcement learning for building controls: The opportunities and challenges," Applied Energy, Elsevier, vol. 269(C).
    4. Dongsu Kim & Yeobeom Yoon & Jongman Lee & Pedro J. Mago & Kwangho Lee & Heejin Cho, 2022. "Design and Implementation of Smart Buildings: A Review of Current Research Trend," Energies, MDPI, vol. 15(12), pages 1-17, June.
    5. Yong Zhou & Lingyu Wang & Junhao Qian, 2022. "Application of Combined Models Based on Empirical Mode Decomposition, Deep Learning, and Autoregressive Integrated Moving Average Model for Short-Term Heating Load Predictions," Sustainability, MDPI, vol. 14(12), pages 1-20, June.
    6. Zhao, Hai-xiang & Magoulès, Frédéric, 2012. "A review on the prediction of building energy consumption," Renewable and Sustainable Energy Reviews, Elsevier, vol. 16(6), pages 3586-3592.
    7. Fang, Xi & Gong, Guangcai & Li, Guannan & Chun, Liang & Li, Wenqiang & Peng, Pei, 2021. "A hybrid deep transfer learning strategy for short term cross-building energy prediction," Energy, Elsevier, vol. 215(PB).
    8. Cox, Sam J. & Kim, Dongsu & Cho, Heejin & Mago, Pedro, 2019. "Real time optimal control of district cooling system with thermal energy storage using neural networks," Applied Energy, Elsevier, vol. 238(C), pages 466-480.
    9. Shengwen Zhou & Shunsheng Guo & Baigang Du & Shuo Huang & Jun Guo, 2022. "A Hybrid Framework for Multivariate Time Series Forecasting of Daily Urban Water Demand Using Attention-Based Convolutional Neural Network and Long Short-Term Memory Network," Sustainability, MDPI, vol. 14(17), pages 1-22, September.
    10. Deb, C. & Schlueter, A., 2021. "Review of data-driven energy modelling techniques for building retrofit," Renewable and Sustainable Energy Reviews, Elsevier, vol. 144(C).
    11. Afroz, Zakia & Shafiullah, GM & Urmee, Tania & Higgins, Gary, 2018. "Modeling techniques used in building HVAC control systems: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 83(C), pages 64-84.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fang, Xi & Gong, Guangcai & Li, Guannan & Chun, Liang & Peng, Pei & Li, Wenqiang & Shi, Xing, 2023. "Cross temporal-spatial transferability investigation of deep reinforcement learning control strategy in the building HVAC system level," Energy, Elsevier, vol. 263(PB).
    2. Sumit Saroha & Marta Zurek-Mortka & Jerzy Ryszard Szymanski & Vineet Shekher & Pardeep Singla, 2021. "Forecasting of Market Clearing Volume Using Wavelet Packet-Based Neural Networks with Tracking Signals," Energies, MDPI, vol. 14(19), pages 1-21, September.
    3. Xuliang Tang & Heng Wan & Weiwen Wang & Mengxu Gu & Linfeng Wang & Linfeng Gan, 2023. "Lithium-Ion Battery Remaining Useful Life Prediction Based on Hybrid Model," Sustainability, MDPI, vol. 15(7), pages 1-18, April.
    4. Lu, Hongfang & Ma, Xin & Huang, Kun & Azimi, Mohammadamin, 2020. "Prediction of offshore wind farm power using a novel two-stage model combining kernel-based nonlinear extension of the Arps decline model with a multi-objective grey wolf optimizer," Renewable and Sustainable Energy Reviews, Elsevier, vol. 127(C).
    5. Li, Yanxue & Wang, Zixuan & Xu, Wenya & Gao, Weijun & Xu, Yang & Xiao, Fu, 2023. "Modeling and energy dynamic control for a ZEH via hybrid model-based deep reinforcement learning," Energy, Elsevier, vol. 277(C).
    6. Sanghyuk Yoo & Sangyong Jeon & Seunghwan Jeong & Heesoo Lee & Hosun Ryou & Taehyun Park & Yeonji Choi & Kyongjoo Oh, 2021. "Prediction of the Change Points in Stock Markets Using DAE-LSTM," Sustainability, MDPI, vol. 13(21), pages 1-15, October.
    7. Yoon, Y. & Jung, S. & Im, P. & Salonvaara, M. & Bhandari, M. & Kunwar, N., 2023. "Empirical validation of building energy simulation model input parameter for multizone commercial building during the cooling season," Renewable and Sustainable Energy Reviews, Elsevier, vol. 188(C).
    8. Xiangzhou Chen & Zhi Long, 2023. "E-Commerce Enterprises Financial Risk Prediction Based on FA-PSO-LSTM Neural Network Deep Learning Model," Sustainability, MDPI, vol. 15(7), pages 1-17, March.
    9. Dongsu Kim & Jongman Lee & Sunglok Do & Pedro J. Mago & Kwang Ho Lee & Heejin Cho, 2022. "Energy Modeling and Model Predictive Control for HVAC in Buildings: A Review of Current Research Trends," Energies, MDPI, vol. 15(19), pages 1-30, October.
    10. Lin, Yu & Lu, Qin & Tan, Bin & Yu, Yuanyuan, 2022. "Forecasting energy prices using a novel hybrid model with variational mode decomposition," Energy, Elsevier, vol. 246(C).
    11. Huakun Huang & Dingrong Dai & Longtao Guo & Sihui Xue & Huijun Wu, 2023. "AI and Big Data-Empowered Low-Carbon Buildings: Challenges and Prospects," Sustainability, MDPI, vol. 15(16), pages 1-21, August.
    12. Clara Ceccolini & Roozbeh Sangi, 2022. "Benchmarking Approaches for Assessing the Performance of Building Control Strategies: A Review," Energies, MDPI, vol. 15(4), pages 1-30, February.
    13. Seyed Mehrzad Asaad Sajadi & Pouya Khodaee & Ehsan Hajizadeh & Sabri Farhadi & Sohaib Dastgoshade & Bo Du, 2022. "Deep Learning-Based Methods for Forecasting Brent Crude Oil Return Considering COVID-19 Pandemic Effect," Energies, MDPI, vol. 15(21), pages 1-23, October.
    14. Xie, Yiwei & Hu, Pingfang & Zhu, Na & Lei, Fei & Xing, Lu & Xu, Linghong & Sun, Qiming, 2020. "A hybrid short-term load forecasting model and its application in ground source heat pump with cooling storage system," Renewable Energy, Elsevier, vol. 161(C), pages 1244-1259.
    15. Zhang, Qingang & Zeng, Wei & Lin, Qinjie & Chng, Chin-Boon & Chui, Chee-Kong & Lee, Poh-Seng, 2023. "Deep reinforcement learning towards real-world dynamic thermal management of data centers," Applied Energy, Elsevier, vol. 333(C).
    16. Venkatraj, V. & Dixit, M.K., 2022. "Challenges in implementing data-driven approaches for building life cycle energy assessment: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 160(C).
    17. Di Natale, L. & Svetozarevic, B. & Heer, P. & Jones, C.N., 2022. "Physically Consistent Neural Networks for building thermal modeling: Theory and analysis," Applied Energy, Elsevier, vol. 325(C).
    18. Zhou, Feite & Huang, Zhehao & Zhang, Changhong, 2022. "Carbon price forecasting based on CEEMDAN and LSTM," Applied Energy, Elsevier, vol. 311(C).
    19. Li, Jingmiao & Wang, Jun, 2020. "Forcasting of energy futures market and synchronization based on stochastic gated recurrent unit model," Energy, Elsevier, vol. 213(C).
    20. Yang, Xiu'e & Liu, Shuli & Zou, Yuliang & Ji, Wenjie & Zhang, Qunli & Ahmed, Abdullahi & Han, Xiaojing & Shen, Yongliang & Zhang, Shaoliang, 2022. "Energy-saving potential prediction models for large-scale building: A state-of-the-art review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 156(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:15:y:2023:i:3:p:2340-:d:1048498. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.