IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v235y2019icp1551-1560.html
   My bibliography  Save this article

A novel methodology to explain and evaluate data-driven building energy performance models based on interpretable machine learning

Author

Listed:
  • Fan, Cheng
  • Xiao, Fu
  • Yan, Chengchu
  • Liu, Chengliang
  • Li, Zhengdao
  • Wang, Jiayuan

Abstract

The development of advanced data-driven approaches for building energy management is becoming increasingly essential in the era of big data. Machine learning techniques have gained great popularity in predictive modeling due to their excellence in capturing nonlinear and complicated relationships. However, it is a big challenge for building professionals to fully understand the inference mechanism learnt and put trust into the prediction made, as the models developed are typically of high complexity and low interpretability. To enhance the practical value of advanced machine learning techniques in the building field, this study proposes a comprehensive methodology to explain and evaluate data-driven building energy performance models. The methodology is developed based on the framework of interpretable machine learning. It can help building professionals to understand the inference mechanism learnt, e.g., why a certain prediction is made and what are the supporting and conflicting evidences towards the prediction. A novel metric, i.e., trust, is proposed as an alternative approach other than conventional accuracy metrics to evaluate model performance. The methodology has been validated based on actual building operational data. The results obtained are valuable for the development of intelligent and user-friendly building management systems.

Suggested Citation

  • Fan, Cheng & Xiao, Fu & Yan, Chengchu & Liu, Chengliang & Li, Zhengdao & Wang, Jiayuan, 2019. "A novel methodology to explain and evaluate data-driven building energy performance models based on interpretable machine learning," Applied Energy, Elsevier, vol. 235(C), pages 1551-1560.
    • Handle: RePEc:eee:appene:v:235:y:2019:i:c:p:1551-1560
    DOI: 10.1016/j.apenergy.2018.11.081
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261918317975
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.apenergy.2018.11.081?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kim, Yang-Seon & Heidarinejad, Mohammad & Dahlhausen, Matthew & Srebric, Jelena, 2017. "Building energy model calibration with schedules derived from electricity use data," Applied Energy, Elsevier, vol. 190(C), pages 997-1007.
    2. Rahman, Aowabin & Srikumar, Vivek & Smith, Amanda D., 2018. "Predicting electricity consumption for commercial and residential buildings using deep recurrent neural networks," Applied Energy, Elsevier, vol. 212(C), pages 372-385.
    3. Fan, Cheng & Xiao, Fu & Zhao, Yang, 2017. "A short-term building cooling load prediction method using deep learning algorithms," Applied Energy, Elsevier, vol. 195(C), pages 222-233.
    4. Fan, Cheng & Xiao, Fu & Wang, Shengwei, 2014. "Development of prediction models for next-day building energy consumption and peak power demand using data mining techniques," Applied Energy, Elsevier, vol. 127(C), pages 1-10.
    5. Amasyali, Kadir & El-Gohary, Nora M., 2018. "A review of data-driven building energy consumption prediction studies," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1192-1205.
    6. Chen, Yibo & Tan, Hongwei, 2017. "Short-term prediction of electric demand in building sector via hybrid support vector regression," Applied Energy, Elsevier, vol. 204(C), pages 1363-1374.
    7. Molina-Solana, Miguel & Ros, María & Ruiz, M. Dolores & Gómez-Romero, Juan & Martin-Bautista, M.J., 2017. "Data science for building energy management: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 70(C), pages 598-609.
    8. Miller, Clayton & Nagy, Zoltán & Schlueter, Arno, 2018. "A review of unsupervised statistical learning and visual analytics techniques applied to performance analysis of non-residential buildings," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1365-1377.
    9. J. Gower & P. Legendre, 1986. "Metric and Euclidean properties of dissimilarity coefficients," Journal of Classification, Springer;The Classification Society, vol. 3(1), pages 5-48, March.
    10. Guo, Yabin & Wang, Jiangyu & Chen, Huanxin & Li, Guannan & Liu, Jiangyan & Xu, Chengliang & Huang, Ronggeng & Huang, Yao, 2018. "Machine learning-based thermal response time ahead energy demand prediction for building heating systems," Applied Energy, Elsevier, vol. 221(C), pages 16-27.
    11. Biswas, M.A. Rafe & Robinson, Melvin D. & Fumo, Nelson, 2016. "Prediction of residential building energy consumption: A neural network approach," Energy, Elsevier, vol. 117(P1), pages 84-92.
    12. Vaghefi, A. & Jafari, M.A. & Bisse, Emmanuel & Lu, Y. & Brouwer, J., 2014. "Modeling and forecasting of cooling and electricity load demand," Applied Energy, Elsevier, vol. 136(C), pages 186-196.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Li, Hao & Zhong, Shengyuan & Wang, Yongzhen & Zhao, Jun & Li, Minxia & Wang, Fu & Zhu, Jiebei, 2020. "New understanding on information’s role in the matching of supply and demand of distributed energy system," Energy, Elsevier, vol. 206(C).
    2. Chongchong Xu & Zhicheng Liao & Chaojie Li & Xiaojun Zhou & Renyou Xie, 2022. "Review on Interpretable Machine Learning in Smart Grid," Energies, MDPI, vol. 15(12), pages 1-31, June.
    3. Chen, Zhelun & O’Neill, Zheng & Wen, Jin & Pradhan, Ojas & Yang, Tao & Lu, Xing & Lin, Guanjing & Miyata, Shohei & Lee, Seungjae & Shen, Chou & Chiosa, Roberto & Piscitelli, Marco Savino & Capozzoli, , 2023. "A review of data-driven fault detection and diagnostics for building HVAC systems," Applied Energy, Elsevier, vol. 339(C).
    4. Liang, Xinbin & Liu, Zhuoxuan & Wang, Jie & Jin, Xinqiao & Du, Zhimin, 2023. "Uncertainty quantification-based robust deep learning for building energy systems considering distribution shift problem," Applied Energy, Elsevier, vol. 337(C).
    5. Dey, Maitreyee & Rana, Soumya Prakash & Dudley, Sandra, 2021. "Automated terminal unit performance analysis employing x-RBF neural network and associated energy optimisation – A case study based approach," Applied Energy, Elsevier, vol. 298(C).
    6. Liang, Xinbin & Zhu, Xu & Chen, Siliang & Jin, Xinqiao & Xiao, Fu & Du, Zhimin, 2023. "Physics-constrained cooperative learning-based reference models for smart management of chillers considering extrapolation scenarios," Applied Energy, Elsevier, vol. 349(C).
    7. Venkatraj, V. & Dixit, M.K., 2022. "Challenges in implementing data-driven approaches for building life cycle energy assessment: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 160(C).
    8. Weinand, Jann Michael & Scheller, Fabian & McKenna, Russell, 2020. "Reviewing energy system modelling of decentralized energy autonomy," Energy, Elsevier, vol. 203(C).
    9. Fan, Cheng & Xiao, Fu & Song, Mengjie & Wang, Jiayuan, 2019. "A graph mining-based methodology for discovering and visualizing high-level knowledge for building energy management," Applied Energy, Elsevier, vol. 251(C), pages 1-1.
    10. Deb, C. & Schlueter, A., 2021. "Review of data-driven energy modelling techniques for building retrofit," Renewable and Sustainable Energy Reviews, Elsevier, vol. 144(C).
    11. Stef, Nicolae & Başağaoğlu, Hakan & Chakraborty, Debaditya & Ben Jabeur, Sami, 2023. "Does institutional quality affect CO2 emissions? Evidence from explainable artificial intelligence models," Energy Economics, Elsevier, vol. 124(C).
    12. Zheng, Peijun & Zhou, Heng & Liu, Jiang & Nakanishi, Yosuke, 2023. "Interpretable building energy consumption forecasting using spectral clustering algorithm and temporal fusion transformers architecture," Applied Energy, Elsevier, vol. 349(C).
    13. Abbasabadi, Narjes & Ashayeri, Mehdi & Azari, Rahman & Stephens, Brent & Heidarinejad, Mohammad, 2019. "An integrated data-driven framework for urban energy use modeling (UEUM)," Applied Energy, Elsevier, vol. 253(C), pages 1-1.
    14. Sooyoun Cho & Jeehang Lee & Jumi Baek & Gi-Seok Kim & Seung-Bok Leigh, 2019. "Investigating Primary Factors Affecting Electricity Consumption in Non-Residential Buildings Using a Data-Driven Approach," Energies, MDPI, vol. 12(21), pages 1-23, October.
    15. Gao, Lei & Liu, Tianyuan & Cao, Tao & Hwang, Yunho & Radermacher, Reinhard, 2021. "Comparing deep learning models for multi energy vectors prediction on multiple types of building," Applied Energy, Elsevier, vol. 301(C).
    16. Gao, Yuan & Miyata, Shohei & Akashi, Yasunori, 2023. "How to improve the application potential of deep learning model in HVAC fault diagnosis: Based on pruning and interpretable deep learning method," Applied Energy, Elsevier, vol. 348(C).
    17. Jonas Hülsmann & Julia Barbosa & Florian Steinke, 2023. "Local Interpretable Explanations of Energy System Designs," Energies, MDPI, vol. 16(5), pages 1-17, February.
    18. Jia, Kunqi & Guo, Ge & Xiao, Jucheng & Zhou, Huan & Wang, Zhihua & He, Guangyu, 2019. "Data compression approach for the home energy management system," Applied Energy, Elsevier, vol. 247(C), pages 643-656.
    19. Zhang, Chaobo & Li, Junyang & Zhao, Yang & Li, Tingting & Chen, Qi & Zhang, Xuejun & Qiu, Weikang, 2021. "Problem of data imbalance in building energy load prediction: Concept, influence, and solution," Applied Energy, Elsevier, vol. 297(C).
    20. Cai, Qingsen & Luo, XingQi & Wang, Peng & Gao, Chunyang & Zhao, Peiyu, 2022. "Hybrid model-driven and data-driven control method based on machine learning algorithm in energy hub and application," Applied Energy, Elsevier, vol. 305(C).
    21. Fan, Cheng & Sun, Yongjun & Xiao, Fu & Ma, Jie & Lee, Dasheng & Wang, Jiayuan & Tseng, Yen Chieh, 2020. "Statistical investigations of transfer learning-based methodology for short-term building energy predictions," Applied Energy, Elsevier, vol. 262(C).
    22. Sukjoon Oh & Chul Kim & Joonghyeok Heo & Sung Lok Do & Kee Han Kim, 2020. "Heating Performance Analysis for Short-Term Energy Monitoring and Prediction Using Multi-Family Residential Energy Consumption Data," Energies, MDPI, vol. 13(12), pages 1-24, June.
    23. Jeeyoung Lim & Joseph J. Kim & Sunkuk Kim, 2021. "A Holistic Review of Building Energy Efficiency and Reduction Based on Big Data," Sustainability, MDPI, vol. 13(4), pages 1-18, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fan, Cheng & Xiao, Fu & Song, Mengjie & Wang, Jiayuan, 2019. "A graph mining-based methodology for discovering and visualizing high-level knowledge for building energy management," Applied Energy, Elsevier, vol. 251(C), pages 1-1.
    2. Fan, Cheng & Sun, Yongjun & Xiao, Fu & Ma, Jie & Lee, Dasheng & Wang, Jiayuan & Tseng, Yen Chieh, 2020. "Statistical investigations of transfer learning-based methodology for short-term building energy predictions," Applied Energy, Elsevier, vol. 262(C).
    3. Zhang, Liang & Wen, Jin & Li, Yanfei & Chen, Jianli & Ye, Yunyang & Fu, Yangyang & Livingood, William, 2021. "A review of machine learning in building load prediction," Applied Energy, Elsevier, vol. 285(C).
    4. Wang, Ran & Lu, Shilei & Feng, Wei, 2020. "A novel improved model for building energy consumption prediction based on model integration," Applied Energy, Elsevier, vol. 262(C).
    5. Chitalia, Gopal & Pipattanasomporn, Manisa & Garg, Vishal & Rahman, Saifur, 2020. "Robust short-term electrical load forecasting framework for commercial buildings using deep recurrent neural networks," Applied Energy, Elsevier, vol. 278(C).
    6. Vangelis Marinakis, 2020. "Big Data for Energy Management and Energy-Efficient Buildings," Energies, MDPI, vol. 13(7), pages 1-18, March.
    7. Li, Xinyue & Chen, Shuqin & Li, Hongliang & Lou, Yunxiao & Li, Jiahe, 2023. "A behavior-orientated prediction method for short-term energy consumption of air-conditioning systems in buildings blocks," Energy, Elsevier, vol. 263(PD).
    8. Fathi, Soheil & Srinivasan, Ravi & Fenner, Andriel & Fathi, Sahand, 2020. "Machine learning applications in urban building energy performance forecasting: A systematic review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 133(C).
    9. Guo, Yabin & Wang, Jiangyu & Chen, Huanxin & Li, Guannan & Liu, Jiangyan & Xu, Chengliang & Huang, Ronggeng & Huang, Yao, 2018. "Machine learning-based thermal response time ahead energy demand prediction for building heating systems," Applied Energy, Elsevier, vol. 221(C), pages 16-27.
    10. Venkatraj, V. & Dixit, M.K., 2022. "Challenges in implementing data-driven approaches for building life cycle energy assessment: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 160(C).
    11. Razak Olu-Ajayi & Hafiz Alaka & Hakeem Owolabi & Lukman Akanbi & Sikiru Ganiyu, 2023. "Data-Driven Tools for Building Energy Consumption Prediction: A Review," Energies, MDPI, vol. 16(6), pages 1-20, March.
    12. Wang, Zeyu & Liu, Jian & Zhang, Yuanxin & Yuan, Hongping & Zhang, Ruixue & Srinivasan, Ravi S., 2021. "Practical issues in implementing machine-learning models for building energy efficiency: Moving beyond obstacles," Renewable and Sustainable Energy Reviews, Elsevier, vol. 143(C).
    13. Deb, Chirag & Dai, Zhonghao & Schlueter, Arno, 2021. "A machine learning-based framework for cost-optimal building retrofit," Applied Energy, Elsevier, vol. 294(C).
    14. Pan, Yue & Zhang, Limao, 2020. "Data-driven estimation of building energy consumption with multi-source heterogeneous data," Applied Energy, Elsevier, vol. 268(C).
    15. Wang, Zhe & Hong, Tianzhen & Piette, Mary Ann, 2020. "Building thermal load prediction through shallow machine learning and deep learning," Applied Energy, Elsevier, vol. 263(C).
    16. Chen, Yibo & Zhang, Fengyi & Berardi, Umberto, 2020. "Day-ahead prediction of hourly subentry energy consumption in the building sector using pattern recognition algorithms," Energy, Elsevier, vol. 211(C).
    17. Jason Runge & Radu Zmeureanu, 2019. "Forecasting Energy Use in Buildings Using Artificial Neural Networks: A Review," Energies, MDPI, vol. 12(17), pages 1-27, August.
    18. Fan, Cheng & Sun, Yongjun & Zhao, Yang & Song, Mengjie & Wang, Jiayuan, 2019. "Deep learning-based feature engineering methods for improved building energy prediction," Applied Energy, Elsevier, vol. 240(C), pages 35-45.
    19. Capozzoli, Alfonso & Piscitelli, Marco Savino & Brandi, Silvio & Grassi, Daniele & Chicco, Gianfranco, 2018. "Automated load pattern learning and anomaly detection for enhancing energy management in smart buildings," Energy, Elsevier, vol. 157(C), pages 336-352.
    20. Chou, Jui-Sheng & Tran, Duc-Son, 2018. "Forecasting energy consumption time series using machine learning techniques based on usage patterns of residential householders," Energy, Elsevier, vol. 165(PB), pages 709-726.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:235:y:2019:i:c:p:1551-1560. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.