IDEAS home Printed from https://ideas.repec.org/a/eee/rensus/v158y2022ics1364032121012405.html
   My bibliography  Save this article

On the accuracy of Urban Building Energy Modelling

Author

Listed:
  • Oraiopoulos, A.
  • Howard, B.

Abstract

The growing demand for energy in urban areas has led to the development of a variety of methodologies for modelling energy in buildings at large scale. However, their accuracy has yet to be thoroughly reviewed. This paper presents a systematic analysis of urban building energy models, that have been validated against measured data, using a singular taxonomy based on key attributes that could influence a model’s accuracy: application, scale, input data, computational method, calibration and validation methods. The analysis showed that the accuracy of urban building energy models is multi-dimensional, considered at a variety of temporal resolutions, spatial resolutions and measures of error, with the results demonstrating that there is no single key attribute that governs it. At the aggregate spatial and annual temporal resolutions, the accuracy, often reported in a single percent error value, can be as low as 1%, while for individual buildings at the annual resolution, the tails of the distribution of errors can reach 1000%. Models using non-calibrated physics-based computational methods were more likely to report overly large errors, while those employing Bayesian calibration consistently reported lower errors at the hourly temporal resolution, demonstrating the positive impact of calibration and in particular the Bayesian approach, on the models’ accuracy. Overall, the review has highlighted that more transparent and consistent reporting of accuracy is necessary and further research is essential for improving the evaluation of accuracy in modelling methodologies, if modern challenges are to be met through emerging applications such as energy systems integration and climate resilience.

Suggested Citation

  • Oraiopoulos, A. & Howard, B., 2022. "On the accuracy of Urban Building Energy Modelling," Renewable and Sustainable Energy Reviews, Elsevier, vol. 158(C).
    • Handle: RePEc:eee:rensus:v:158:y:2022:i:c:s1364032121012405
    DOI: 10.1016/j.rser.2021.111976
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1364032121012405
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.rser.2021.111976?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Katal, Ali & Mortezazadeh, Mohammad & Wang, Liangzhu (Leon), 2019. "Modeling building resilience against extreme weather by integrated CityFFD and CityBEM simulations," Applied Energy, Elsevier, vol. 250(C), pages 1402-1417.
    2. Cerezo Davila, Carlos & Reinhart, Christoph F. & Bemis, Jamie L., 2016. "Modeling Boston: A workflow for the efficient generation and maintenance of urban building energy models from existing geospatial datasets," Energy, Elsevier, vol. 117(P1), pages 237-250.
    3. Li, Wenliang & Zhou, Yuyu & Cetin, Kristen & Eom, Jiyong & Wang, Yu & Chen, Gang & Zhang, Xuesong, 2017. "Modeling urban building energy use: A review of modeling approaches and procedures," Energy, Elsevier, vol. 141(C), pages 2445-2457.
    4. Hedegaard, Rasmus Elbæk & Kristensen, Martin Heine & Pedersen, Theis Heidmann & Brun, Adam & Petersen, Steffen, 2019. "Bottom-up modelling methodology for urban-scale analysis of residential space heating demand response," Applied Energy, Elsevier, vol. 242(C), pages 181-204.
    5. Olivo, Y. & Hamidi, A. & Ramamurthy, P., 2017. "Spatiotemporal variability in building energy use in New York City," Energy, Elsevier, vol. 141(C), pages 1393-1401.
    6. Filogamo, Luana & Peri, Giorgia & Rizzo, Gianfranco & Giaccone, Antonino, 2014. "On the classification of large residential buildings stocks by sample typologies for energy planning purposes," Applied Energy, Elsevier, vol. 135(C), pages 825-835.
    7. Ang, Yu Qian & Berzolla, Zachary Michael & Reinhart, Christoph F., 2020. "From concept to application: A review of use cases in urban building energy modeling," Applied Energy, Elsevier, vol. 279(C).
    8. Shimoda, Yoshiyuki & Asahi, Takahiro & Taniguchi, Ayako & Mizuno, Minoru, 2007. "Evaluation of city-scale impact of residential energy conservation measures using the detailed end-use simulation model," Energy, Elsevier, vol. 32(9), pages 1617-1633.
    9. Kontokosta, Constantine E. & Tull, Christopher, 2017. "A data-driven predictive model of city-scale energy use in buildings," Applied Energy, Elsevier, vol. 197(C), pages 303-317.
    10. Lorimer, Stephen, 2012. "A housing stock model of non-heating end-use energy in England verified by aggregate energy use data," Energy Policy, Elsevier, vol. 50(C), pages 419-427.
    11. Ferrari, Simone & Zagarella, Federica & Caputo, Paola & Bonomolo, Marina, 2019. "Assessment of tools for urban energy planning," Energy, Elsevier, vol. 176(C), pages 544-551.
    12. Ma, Jun & Cheng, Jack C.P., 2016. "Estimation of the building energy use intensity in the urban scale by integrating GIS and big data technology," Applied Energy, Elsevier, vol. 183(C), pages 182-192.
    13. Koschwitz, D. & Frisch, J. & van Treeck, C., 2018. "Data-driven heating and cooling load predictions for non-residential buildings based on support vector machine regression and NARX Recurrent Neural Network: A comparative study on district scale," Energy, Elsevier, vol. 165(PA), pages 134-142.
    14. Streltsov, Artem & Malof, Jordan M. & Huang, Bohao & Bradbury, Kyle, 2020. "Estimating residential building energy consumption using overhead imagery," Applied Energy, Elsevier, vol. 280(C).
    15. Ren, Zhengen & Paevere, Phillip & McNamara, Cheryl, 2012. "A local-community-level, physically-based model of end-use energy consumption by Australian housing stock," Energy Policy, Elsevier, vol. 49(C), pages 586-596.
    16. Nutkiewicz, Alex & Yang, Zheng & Jain, Rishee K., 2018. "Data-driven Urban Energy Simulation (DUE-S): A framework for integrating engineering simulation and machine learning methods in a multi-scale urban energy modeling workflow," Applied Energy, Elsevier, vol. 225(C), pages 1176-1189.
    17. Allegrini, Jonas & Orehounig, Kristina & Mavromatidis, Georgios & Ruesch, Florian & Dorer, Viktor & Evins, Ralph, 2015. "A review of modelling approaches and tools for the simulation of district-scale energy systems," Renewable and Sustainable Energy Reviews, Elsevier, vol. 52(C), pages 1391-1404.
    18. Keirstead, James & Jennings, Mark & Sivakumar, Aruna, 2012. "A review of urban energy system models: Approaches, challenges and opportunities," Renewable and Sustainable Energy Reviews, Elsevier, vol. 16(6), pages 3847-3866.
    19. Krarti, Moncef & Aldubyan, Mohammad & Williams, Eric, 2020. "Residential building stock model for evaluating energy retrofit programs in Saudi Arabia," Energy, Elsevier, vol. 195(C).
    20. Yang, Xining & Hu, Mingming & Heeren, Niko & Zhang, Chunbo & Verhagen, Teun & Tukker, Arnold & Steubing, Bernhard, 2020. "A combined GIS-archetype approach to model residential space heating energy: A case study for the Netherlands including validation," Applied Energy, Elsevier, vol. 280(C).
    21. Nageler, P. & Zahrer, G. & Heimrath, R. & Mach, T. & Mauthner, F. & Leusbrock, I. & Schranzhofer, H. & Hochenauer, C., 2017. "Novel validated method for GIS based automated dynamic urban building energy simulations," Energy, Elsevier, vol. 139(C), pages 142-154.
    22. Swan, Lukas G. & Ugursal, V. Ismet, 2009. "Modeling of end-use energy consumption in the residential sector: A review of modeling techniques," Renewable and Sustainable Energy Reviews, Elsevier, vol. 13(8), pages 1819-1835, October.
    23. Ahmed Gassar, Abdo Abdullah & Yun, Geun Young & Kim, Sumin, 2019. "Data-driven approach to prediction of residential energy consumption at urban scales in London," Energy, Elsevier, vol. 187(C).
    24. Chalal, Moulay Larbi & Benachir, Medjdoub & White, Michael & Shrahily, Raid, 2016. "Energy planning and forecasting approaches for supporting physical improvement strategies in the building sector: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 64(C), pages 761-776.
    25. Fathi, Soheil & Srinivasan, Ravi & Fenner, Andriel & Fathi, Sahand, 2020. "Machine learning applications in urban building energy performance forecasting: A systematic review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 133(C).
    26. Alhamwi, Alaa & Medjroubi, Wided & Vogt, Thomas & Agert, Carsten, 2018. "Modelling urban energy requirements using open source data and models," Applied Energy, Elsevier, vol. 231(C), pages 1100-1108.
    27. Frayssinet, Loïc & Merlier, Lucie & Kuznik, Frédéric & Hubert, Jean-Luc & Milliez, Maya & Roux, Jean-Jacques, 2018. "Modeling the heating and cooling energy demand of urban buildings at city scale," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P2), pages 2318-2327.
    28. Roth, Jonathan & Martin, Amory & Miller, Clayton & Jain, Rishee K., 2020. "SynCity: Using open data to create a synthetic city of hourly building energy estimates by integrating data-driven and physics-based methods," Applied Energy, Elsevier, vol. 280(C).
    29. Fonseca, Jimeno A. & Schlueter, Arno, 2015. "Integrated model for characterization of spatiotemporal building energy consumption patterns in neighborhoods and city districts," Applied Energy, Elsevier, vol. 142(C), pages 247-265.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Piotr Michalak, 2022. "Thermal—Airflow Coupling in Hourly Energy Simulation of a Building with Natural Stack Ventilation," Energies, MDPI, vol. 15(11), pages 1-18, June.
    2. Ehsan Kamel, 2022. "A Systematic Literature Review of Physics-Based Urban Building Energy Modeling (UBEM) Tools, Data Sources, and Challenges for Energy Conservation," Energies, MDPI, vol. 15(22), pages 1-24, November.
    3. Bass, Brett & New, Joshua & Clinton, Nicholas & Adams, Mark & Copeland, Bill & Amoo, Charles, 2022. "How close are urban scale building simulations to measured data? Examining bias derived from building metadata in urban building energy modeling," Applied Energy, Elsevier, vol. 327(C).
    4. Perwez, Usama & Yamaguchi, Yohei & Ma, Tao & Dai, Yanjun & Shimoda, Yoshiyuki, 2022. "Multi-scale GIS-synthetic hybrid approach for the development of commercial building stock energy model," Applied Energy, Elsevier, vol. 323(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Perwez, Usama & Yamaguchi, Yohei & Ma, Tao & Dai, Yanjun & Shimoda, Yoshiyuki, 2022. "Multi-scale GIS-synthetic hybrid approach for the development of commercial building stock energy model," Applied Energy, Elsevier, vol. 323(C).
    2. Kristensen, Martin Heine & Hedegaard, Rasmus Elbæk & Petersen, Steffen, 2020. "Long-term forecasting of hourly district heating loads in urban areas using hierarchical archetype modeling," Energy, Elsevier, vol. 201(C).
    3. Ali, Usman & Shamsi, Mohammad Haris & Bohacek, Mark & Purcell, Karl & Hoare, Cathal & Mangina, Eleni & O’Donnell, James, 2020. "A data-driven approach for multi-scale GIS-based building energy modeling for analysis, planning and support decision making," Applied Energy, Elsevier, vol. 279(C).
    4. Ang, Yu Qian & Berzolla, Zachary Michael & Reinhart, Christoph F., 2020. "From concept to application: A review of use cases in urban building energy modeling," Applied Energy, Elsevier, vol. 279(C).
    5. Wang, Wei & Hong, Tianzhen & Xu, Xiaodong & Chen, Jiayu & Liu, Ziang & Xu, Ning, 2019. "Forecasting district-scale energy dynamics through integrating building network and long short-term memory learning algorithm," Applied Energy, Elsevier, vol. 248(C), pages 217-230.
    6. Johari, F. & Peronato, G. & Sadeghian, P. & Zhao, X. & Widén, J., 2020. "Urban building energy modeling: State of the art and future prospects," Renewable and Sustainable Energy Reviews, Elsevier, vol. 128(C).
    7. Viktor Bukovszki & Ábel Magyari & Marina Kristina Braun & Kitti Párdi & András Reith, 2020. "Energy Modelling as a Trigger for Energy Communities: A Joint Socio-Technical Perspective," Energies, MDPI, vol. 13(9), pages 1-44, May.
    8. Langevin, J. & Reyna, J.L. & Ebrahimigharehbaghi, S. & Sandberg, N. & Fennell, P. & Nägeli, C. & Laverge, J. & Delghust, M. & Mata, É. & Van Hove, M. & Webster, J. & Federico, F. & Jakob, M. & Camaras, 2020. "Developing a common approach for classifying building stock energy models," Renewable and Sustainable Energy Reviews, Elsevier, vol. 133(C).
    9. Abbasabadi, Narjes & Ashayeri, Mehdi & Azari, Rahman & Stephens, Brent & Heidarinejad, Mohammad, 2019. "An integrated data-driven framework for urban energy use modeling (UEUM)," Applied Energy, Elsevier, vol. 253(C), pages 1-1.
    10. Ye, Zhongnan & Cheng, Kuangly & Hsu, Shu-Chien & Wei, Hsi-Hsien & Cheung, Clara Man, 2021. "Identifying critical building-oriented features in city-block-level building energy consumption: A data-driven machine learning approach," Applied Energy, Elsevier, vol. 301(C).
    11. Yamaguchi, Yohei & Shoda, Yuto & Yoshizawa, Shinya & Imai, Tatsuya & Perwez, Usama & Shimoda, Yoshiyuki & Hayashi, Yasuhiro, 2023. "Feasibility assessment of net zero-energy transformation of building stock using integrated synthetic population, building stock, and power distribution network framework," Applied Energy, Elsevier, vol. 333(C).
    12. Martin Eriksson & Jan Akander & Bahram Moshfegh, 2022. "Investigating Energy Use in a City District in Nordic Climate Using Energy Signature," Energies, MDPI, vol. 15(5), pages 1-22, March.
    13. Aldubyan, Mohammad & Krarti, Moncef, 2022. "Impact of stay home living on energy demand of residential buildings: Saudi Arabian case study," Energy, Elsevier, vol. 238(PA).
    14. Bianchi, Carlo & Zhang, Liang & Goldwasser, David & Parker, Andrew & Horsey, Henry, 2020. "Modeling occupancy-driven building loads for large and diversified building stocks through the use of parametric schedules," Applied Energy, Elsevier, vol. 276(C).
    15. Kazas, Georgios & Fabrizio, Enrico & Perino, Marco, 2017. "Energy demand profile generation with detailed time resolution at an urban district scale: A reference building approach and case study," Applied Energy, Elsevier, vol. 193(C), pages 243-262.
    16. Wenliang Li, 2020. "Quantifying the Building Energy Dynamics of Manhattan, New York City, Using an Urban Building Energy Model and Localized Weather Data," Energies, MDPI, vol. 13(12), pages 1-22, June.
    17. Ferrari, Simone & Zagarella, Federica & Caputo, Paola & D'Amico, Antonino, 2019. "Results of a literature review on methods for estimating buildings energy demand at district level," Energy, Elsevier, vol. 175(C), pages 1130-1137.
    18. Yanxia Li & Chao Wang & Sijie Zhu & Junyan Yang & Shen Wei & Xinkai Zhang & Xing Shi, 2020. "A Comparison of Various Bottom-Up Urban Energy Simulation Methods Using a Case Study in Hangzhou, China," Energies, MDPI, vol. 13(18), pages 1-23, September.
    19. Mauree, Dasaraden & Naboni, Emanuele & Coccolo, Silvia & Perera, A.T.D. & Nik, Vahid M. & Scartezzini, Jean-Louis, 2019. "A review of assessment methods for the urban environment and its energy sustainability to guarantee climate adaptation of future cities," Renewable and Sustainable Energy Reviews, Elsevier, vol. 112(C), pages 733-746.
    20. Wang, Wei & Liu, Ke & Zhang, Muxing & Shen, Yuchi & Jing, Rui & Xu, Xiaodong, 2021. "From simulation to data-driven approach: A framework of integrating urban morphology to low-energy urban design," Renewable Energy, Elsevier, vol. 179(C), pages 2016-2035.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:rensus:v:158:y:2022:i:c:s1364032121012405. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/600126/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.