IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v182y2016icp115-134.html
   My bibliography  Save this article

Evaluation of “Autotune” calibration against manual calibration of building energy models

Author

Listed:
  • Chaudhary, Gaurav
  • New, Joshua
  • Sanyal, Jibonananda
  • Im, Piljae
  • O’Neill, Zheng
  • Garg, Vishal

Abstract

This paper demonstrates the application of Autotune, a methodology aimed at automatically producing calibrated building energy models using measured data, in two case studies. In the first case, a building model is de-tuned by deliberately injecting faults into more than 60 parameters. This model was then calibrated using Autotune and its accuracy with respect to the original model was evaluated in terms of the industry-standard normalized mean bias error and coefficient of variation of root mean squared error metrics set forth in ASHRAE Guideline 14. In addition to whole-building energy consumption, outputs including lighting, plug load profiles, HVAC energy consumption, zone temperatures, and other variables were analyzed. In the second case, Autotune calibration is compared directly to experts’ manual calibration of an emulated-occupancy, full-size residential building with comparable calibration results in much less time. The paper concludes with a discussion of the key strengths and weaknesses of auto-calibration approaches.

Suggested Citation

  • Chaudhary, Gaurav & New, Joshua & Sanyal, Jibonananda & Im, Piljae & O’Neill, Zheng & Garg, Vishal, 2016. "Evaluation of “Autotune” calibration against manual calibration of building energy models," Applied Energy, Elsevier, vol. 182(C), pages 115-134.
  • Handle: RePEc:eee:appene:v:182:y:2016:i:c:p:115-134
    DOI: 10.1016/j.apenergy.2016.08.073
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S030626191631159X
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2016.08.073?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Široký, Jan & Oldewurtel, Frauke & Cigler, Jiří & Prívara, Samuel, 2011. "Experimental analysis of model predictive control for an energy efficient building heating system," Applied Energy, Elsevier, vol. 88(9), pages 3079-3087.
    2. Akbari, H., 1995. "Validation of an algorithm to disaggregate whole-building hourly electrical load into end uses," Energy, Elsevier, vol. 20(12), pages 1291-1301.
    3. Garrett, Aaron & New, Joshua, 2015. "Scalable tuning of building models to hourly data," Energy, Elsevier, vol. 84(C), pages 493-502.
    4. Ji, Ying & Xu, Peng, 2015. "A bottom-up and procedural calibration method for building energy simulation models based on hourly electricity submetering data," Energy, Elsevier, vol. 93(P2), pages 2337-2350.
    5. Hong, Tianzhen & Chang, Wen-Kuei & Lin, Hung-Wen, 2013. "A fresh look at weather impact on peak electricity demand and energy use of buildings using 30-year actual weather data," Applied Energy, Elsevier, vol. 111(C), pages 333-350.
    6. Hong, Tianzhen & Yang, Le & Hill, David & Feng, Wei, 2014. "Data and analytics to inform energy retrofit of high performance buildings," Applied Energy, Elsevier, vol. 126(C), pages 90-106.
    7. Ramos Ruiz, Germán & Fernández Bandera, Carlos & Gómez-Acebo Temes, Tomás & Sánchez-Ostiz Gutierrez, Ana, 2016. "Genetic algorithm for building envelope calibration," Applied Energy, Elsevier, vol. 168(C), pages 691-705.
    8. Pisello, Anna Laura & Goretti, Michele & Cotana, Franco, 2012. "A method for assessing buildings’ energy efficiency by dynamic simulation and experimental activity," Applied Energy, Elsevier, vol. 97(C), pages 419-429.
    9. Li, Qiong & Meng, Qinglin & Cai, Jiejin & Yoshino, Hiroshi & Mochida, Akashi, 2009. "Applying support vector machine to predict hourly cooling load in the building," Applied Energy, Elsevier, vol. 86(10), pages 2249-2256, October.
    10. Fumo, Nelson, 2014. "A review on the basics of building energy estimation," Renewable and Sustainable Energy Reviews, Elsevier, vol. 31(C), pages 53-60.
    11. Chong, Howard, 2012. "Building vintage and electricity use: Old homes use less electricity in hot weather," European Economic Review, Elsevier, vol. 56(5), pages 906-930.
    12. Menezes, Anna Carolina & Cripps, Andrew & Bouchlaghem, Dino & Buswell, Richard, 2012. "Predicted vs. actual energy performance of non-domestic buildings: Using post-occupancy evaluation data to reduce the performance gap," Applied Energy, Elsevier, vol. 97(C), pages 355-364.
    13. Robertson, Joseph J. & Polly, Ben J. & Collis, Jon M., 2015. "Reduced-order modeling and simulated annealing optimization for efficient residential building utility bill calibration," Applied Energy, Elsevier, vol. 148(C), pages 169-177.
    14. Oldewurtel, Frauke & Sturzenegger, David & Morari, Manfred, 2013. "Importance of occupancy information for building climate control," Applied Energy, Elsevier, vol. 101(C), pages 521-532.
    15. Manfren, Massimiliano & Aste, Niccolò & Moshksar, Reza, 2013. "Calibration and uncertainty analysis for computer models – A meta-model based approach for integrated building energy simulation," Applied Energy, Elsevier, vol. 103(C), pages 627-641.
    16. Huang, Yu & Niu, Jian-lei & Chung, Tse-ming, 2013. "Study on performance of energy-efficient retrofitting measures on commercial building external walls in cooling-dominant cities," Applied Energy, Elsevier, vol. 103(C), pages 97-108.
    17. Yang, Zheng & Becerik-Gerber, Burcin, 2015. "A model calibration framework for simultaneous multi-level building energy simulation," Applied Energy, Elsevier, vol. 149(C), pages 415-431.
    18. Mustafaraj, Giorgio & Marini, Dashamir & Costa, Andrea & Keane, Marcus, 2014. "Model calibration for building energy efficiency simulation," Applied Energy, Elsevier, vol. 130(C), pages 72-85.
    19. Marc C. Kennedy & Anthony O'Hagan, 2001. "Bayesian calibration of computer models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 63(3), pages 425-464.
    20. Deeble, V.C. & Probert, S.D., 1986. "Straight-line correlations for annual energy-consumption predictions?," Applied Energy, Elsevier, vol. 25(1), pages 23-39.
    21. Li, Cheng & Hong, Tianzhen & Yan, Da, 2014. "An insight into actual energy use and its drivers in high-performance buildings," Applied Energy, Elsevier, vol. 131(C), pages 394-410.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jeong, Kwangbok & Hong, Taehoon & Kim, Jimin & Cho, Kyuman, 2019. "Development of a multi-objective optimization model for determining the optimal CO2 emissions reduction strategies for a multi-family housing complex," Renewable and Sustainable Energy Reviews, Elsevier, vol. 110(C), pages 118-131.
    2. Santos, Luis Guilherme Resende & Afshari, Afshin & Norford, Leslie K. & Mao, Jiachen, 2018. "Evaluating approaches for district-wide energy model calibration considering the Urban Heat Island effect," Applied Energy, Elsevier, vol. 215(C), pages 31-40.
    3. Chen, Yixing & Hong, Tianzhen, 2018. "Impacts of building geometry modeling methods on the simulation results of urban building energy models," Applied Energy, Elsevier, vol. 215(C), pages 717-735.
    4. Pedro Paulo Fernandes da Silva & Alberto Hernandez Neto & Ildo Luis Sauer, 2021. "Evaluation of Model Calibration Method for Simulation Performance of a Public Hospital in Brazil," Energies, MDPI, vol. 14(13), pages 1-20, June.
    5. Calama-González, Carmen María & Symonds, Phil & Petrou, Giorgos & Suárez, Rafael & León-Rodríguez, Ángel Luis, 2021. "Bayesian calibration of building energy models for uncertainty analysis through test cells monitoring," Applied Energy, Elsevier, vol. 282(PA).
    6. Enríquez, R. & Jiménez, M.J. & Heras, M.R., 2017. "Towards non-intrusive thermal load Monitoring of buildings: BES calibration," Applied Energy, Elsevier, vol. 191(C), pages 44-54.
    7. Burillo, Daniel & Chester, Mikhail V. & Pincetl, Stephanie & Fournier, Eric D. & Reyna, Janet, 2019. "Forecasting peak electricity demand for Los Angeles considering higher air temperatures due to climate change," Applied Energy, Elsevier, vol. 236(C), pages 1-9.
    8. Vicente Gutiérrez González & Lissette Álvarez Colmenares & Jesús Fernando López Fidalgo & Germán Ramos Ruiz & Carlos Fernández Bandera, 2019. "Uncertainy’s Indices Assessment for Calibrated Energy Models," Energies, MDPI, vol. 12(11), pages 1-18, May.
    9. Chen, Jianli & Gao, Xinghua & Hu, Yuqing & Zeng, Zhaoyun & Liu, Yanan, 2019. "A meta-model-based optimization approach for fast and reliable calibration of building energy models," Energy, Elsevier, vol. 188(C).
    10. Carlos Fernández Bandera & Germán Ramos Ruiz, 2017. "Towards a New Generation of Building Envelope Calibration," Energies, MDPI, vol. 10(12), pages 1-19, December.
    11. Garwood, Tom Lloyd & Hughes, Ben Richard & O'Connor, Dominic & Calautit, John K. & Oates, Michael R. & Hodgson, Thomas, 2018. "A framework for producing gbXML building geometry from Point Clouds for accurate and efficient Building Energy Modelling," Applied Energy, Elsevier, vol. 224(C), pages 527-537.
    12. Lim, Hyunwoo & Zhai, Zhiqiang (John), 2018. "Influences of energy data on Bayesian calibration of building energy model," Applied Energy, Elsevier, vol. 231(C), pages 686-698.
    13. Germán Ramos Ruiz & Carlos Fernández Bandera, 2017. "Validation of Calibrated Energy Models: Common Errors," Energies, MDPI, vol. 10(10), pages 1-19, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yang, Zheng & Becerik-Gerber, Burcin, 2015. "A model calibration framework for simultaneous multi-level building energy simulation," Applied Energy, Elsevier, vol. 149(C), pages 415-431.
    2. Yang, Tao & Pan, Yiqun & Mao, Jiachen & Wang, Yonglong & Huang, Zhizhong, 2016. "An automated optimization method for calibrating building energy simulation models with measured data: Orientation and a case study," Applied Energy, Elsevier, vol. 179(C), pages 1220-1231.
    3. Sun, Kaiyu & Hong, Tianzhen & Taylor-Lange, Sarah C. & Piette, Mary Ann, 2016. "A pattern-based automated approach to building energy model calibration," Applied Energy, Elsevier, vol. 165(C), pages 214-224.
    4. Li, Nan & Yang, Zheng & Becerik-Gerber, Burcin & Tang, Chao & Chen, Nanlin, 2015. "Why is the reliability of building simulation limited as a tool for evaluating energy conservation measures?," Applied Energy, Elsevier, vol. 159(C), pages 196-205.
    5. Ramos Ruiz, Germán & Fernández Bandera, Carlos, 2017. "Analysis of uncertainty indices used for building envelope calibration," Applied Energy, Elsevier, vol. 185(P1), pages 82-94.
    6. Yuan, Jun & Nian, Victor & Su, Bin & Meng, Qun, 2017. "A simultaneous calibration and parameter ranking method for building energy models," Applied Energy, Elsevier, vol. 206(C), pages 657-666.
    7. Ramos Ruiz, Germán & Fernández Bandera, Carlos & Gómez-Acebo Temes, Tomás & Sánchez-Ostiz Gutierrez, Ana, 2016. "Genetic algorithm for building envelope calibration," Applied Energy, Elsevier, vol. 168(C), pages 691-705.
    8. Yang, Liu & Yan, Haiyan & Lam, Joseph C., 2014. "Thermal comfort and building energy consumption implications – A review," Applied Energy, Elsevier, vol. 115(C), pages 164-173.
    9. Si Chen & Daniel Friedrich & Zhibin Yu & James Yu, 2019. "District Heating Network Demand Prediction Using a Physics-Based Energy Model with a Bayesian Approach for Parameter Calibration," Energies, MDPI, vol. 12(18), pages 1-19, September.
    10. Massimiliano Manfren & Maurizio Sibilla & Lamberto Tronchin, 2021. "Energy Modelling and Analytics in the Built Environment—A Review of Their Role for Energy Transitions in the Construction Sector," Energies, MDPI, vol. 14(3), pages 1-29, January.
    11. Ji, Ying & Xu, Peng & Duan, Pengfei & Lu, Xing, 2016. "Estimating hourly cooling load in commercial buildings using a thermal network model and electricity submetering data," Applied Energy, Elsevier, vol. 169(C), pages 309-323.
    12. Vicente Gutiérrez González & Lissette Álvarez Colmenares & Jesús Fernando López Fidalgo & Germán Ramos Ruiz & Carlos Fernández Bandera, 2019. "Uncertainy’s Indices Assessment for Calibrated Energy Models," Energies, MDPI, vol. 12(11), pages 1-18, May.
    13. Carlos Fernández Bandera & Germán Ramos Ruiz, 2017. "Towards a New Generation of Building Envelope Calibration," Energies, MDPI, vol. 10(12), pages 1-19, December.
    14. Germán Ramos Ruiz & Carlos Fernández Bandera, 2017. "Validation of Calibrated Energy Models: Common Errors," Energies, MDPI, vol. 10(10), pages 1-19, October.
    15. Tian, Wei & Heo, Yeonsook & de Wilde, Pieter & Li, Zhanyong & Yan, Da & Park, Cheol Soo & Feng, Xiaohang & Augenbroe, Godfried, 2018. "A review of uncertainty analysis in building energy assessment," Renewable and Sustainable Energy Reviews, Elsevier, vol. 93(C), pages 285-301.
    16. Behl, Madhur & Smarra, Francesco & Mangharam, Rahul, 2016. "DR-Advisor: A data-driven demand response recommender system," Applied Energy, Elsevier, vol. 170(C), pages 30-46.
    17. Tronchin, Lamberto & Manfren, Massimiliano & James, Patrick AB., 2018. "Linking design and operation performance analysis through model calibration: Parametric assessment on a Passive House building," Energy, Elsevier, vol. 165(PA), pages 26-40.
    18. Calama-González, Carmen María & Symonds, Phil & Petrou, Giorgos & Suárez, Rafael & León-Rodríguez, Ángel Luis, 2021. "Bayesian calibration of building energy models for uncertainty analysis through test cells monitoring," Applied Energy, Elsevier, vol. 282(PA).
    19. Niemierko, Rochus & Töppel, Jannick & Tränkler, Timm, 2019. "A D-vine copula quantile regression approach for the prediction of residential heating energy consumption based on historical data," Applied Energy, Elsevier, vol. 233, pages 691-708.
    20. Ji, Ying & Xu, Peng, 2015. "A bottom-up and procedural calibration method for building energy simulation models based on hourly electricity submetering data," Energy, Elsevier, vol. 93(P2), pages 2337-2350.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:182:y:2016:i:c:p:115-134. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.