IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v135y2014icp320-328.html
   My bibliography  Save this article

Bootstrap techniques for sensitivity analysis and model selection in building thermal performance analysis

Author

Listed:
  • Tian, Wei
  • Song, Jitian
  • Li, Zhanyong
  • de Wilde, Pieter

Abstract

In regression analysis, there are two main aims: interpretation and prediction, which can be also applied in building performance analysis. Interpretation is used to understand the relationship between input parameters and building energy performance (also called sensitivity analysis), whereas prediction is used to create a reliable energy model to estimate building energy consumption. This article explores the implementation of a distribution-free bootstrap method for these two purposes. The bootstrap is a resampling method that enables assessment of the accuracy of an estimator by random sampling with replacement from an original dataset. An office building is used as a case study to demonstrate the application of this method in assessing building thermal performance. The results indicate that the probabilistic sensitivity analysis incorporating the bootstrap approach provides valuable insights into the variations in sensitivity indicators, which are not available from typical deterministic sensitivity analysis. The single point values from deterministic methods may lead to misleading prioritization of energy saving measures because they do not provide the distributions of sensitivity indicators. Information on prediction errors obtained from the bootstrap method can facilitate the selection of an appropriate building energy metamodel to more accurately predict the energy consumption of buildings, compared with the traditional one-time data splitting method (also called holdout cross-validation method), which partitions the data into a training set and a test set.

Suggested Citation

  • Tian, Wei & Song, Jitian & Li, Zhanyong & de Wilde, Pieter, 2014. "Bootstrap techniques for sensitivity analysis and model selection in building thermal performance analysis," Applied Energy, Elsevier, vol. 135(C), pages 320-328.
    • Handle: RePEc:eee:appene:v:135:y:2014:i:c:p:320-328
    DOI: 10.1016/j.apenergy.2014.08.110
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261914009337
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.apenergy.2014.08.110?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Sigal Levy & David Steinberg, 2010. "Computer experiments: a review," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 94(4), pages 311-324, December.
    2. Kleijnen, Jack P.C., 2009. "Kriging metamodeling in simulation: A review," European Journal of Operational Research, Elsevier, vol. 192(3), pages 707-716, February.
    3. Janssen, Hans, 2013. "Monte-Carlo based uncertainty analysis: Sampling efficiency and sampling convergence," Reliability Engineering and System Safety, Elsevier, vol. 109(C), pages 123-132.
    4. Kusiak, Andrew & Xu, Guanglin, 2012. "Modeling and optimization of HVAC systems using a dynamic neural network," Energy, Elsevier, vol. 42(1), pages 241-250.
    5. Heiselberg, Per & Brohus, Henrik & Hesselholt, Allan & Rasmussen, Henrik & Seinre, Erkki & Thomas, Sara, 2009. "Application of sensitivity analysis in design of sustainable buildings," Renewable Energy, Elsevier, vol. 34(9), pages 2030-2036.
    6. Marszal, Anna Joanna & Heiselberg, Per, 2011. "Life cycle cost analysis of a multi-storey residential Net Zero Energy Building in Denmark," Energy, Elsevier, vol. 36(9), pages 5600-5609.
    7. Kalogirou, Soteris A. & Bojic, Milorad, 2000. "Artificial neural networks for the prediction of the energy consumption of a passive solar building," Energy, Elsevier, vol. 25(5), pages 479-491.
    8. Mechri, Houcem Eddine & Capozzoli, Alfonso & Corrado, Vincenzo, 2010. "USE of the ANOVA approach for sensitive building energy design," Applied Energy, Elsevier, vol. 87(10), pages 3073-3083, October.
    9. Jack P.C. Kleijnen, 2015. "Design and Analysis of Simulation Experiments," International Series in Operations Research and Management Science, Springer, edition 2, number 978-3-319-18087-8, December.
    10. Buonomano, Annamaria & Palombo, Adolfo, 2014. "Building energy performance analysis by an in-house developed dynamic simulation code: An investigation for different case studies," Applied Energy, Elsevier, vol. 113(C), pages 788-807.
    11. Hoinka, Krzysztof & Ziębik, Andrzej, 2010. "Mathematical model for the choice of an energy management structure of complex buildings," Energy, Elsevier, vol. 35(2), pages 1146-1156.
    12. Lin, Hung-Wen & Hong, Tianzhen, 2013. "On variations of space-heating energy use in office buildings," Applied Energy, Elsevier, vol. 111(C), pages 515-528.
    13. Zhao, Hai-xiang & Magoulès, Frédéric, 2012. "A review on the prediction of building energy consumption," Renewable and Sustainable Energy Reviews, Elsevier, vol. 16(6), pages 3586-3592.
    14. Storlie, Curtis B. & Swiler, Laura P. & Helton, Jon C. & Sallaberry, Cedric J., 2009. "Implementation and evaluation of nonparametric regression procedures for sensitivity analysis of computationally demanding models," Reliability Engineering and System Safety, Elsevier, vol. 94(11), pages 1735-1763.
    15. Popescu, Daniela & Ungureanu, Florina & Hernández-Guerrero, Abel, 2009. "Simulation models for the analysis of space heat consumption of buildings," Energy, Elsevier, vol. 34(10), pages 1447-1453.
    16. Tian, Wei, 2013. "A review of sensitivity analysis methods in building energy analysis," Renewable and Sustainable Energy Reviews, Elsevier, vol. 20(C), pages 411-419.
    17. Li, Qiong & Meng, Qinglin & Cai, Jiejin & Yoshino, Hiroshi & Mochida, Akashi, 2009. "Applying support vector machine to predict hourly cooling load in the building," Applied Energy, Elsevier, vol. 86(10), pages 2249-2256, October.
    18. Zhao, Jing & Xin, Yajuan & Tong, Dingding, 2012. "Energy consumption quota of public buildings based on statistical analysis," Energy Policy, Elsevier, vol. 43(C), pages 362-370.
    19. Yıldız, Yusuf & Arsan, Zeynep Durmuş, 2011. "Identification of the building parameters that influence heating and cooling energy loads for apartment buildings in hot-humid climates," Energy, Elsevier, vol. 36(7), pages 4287-4296.
    20. Capozzoli, Alfonso & Gorrino, Alice & Corrado, Vincenzo, 2013. "A building thermal bridges sensitivity analysis," Applied Energy, Elsevier, vol. 107(C), pages 229-243.
    21. Helton, J.C. & Johnson, J.D. & Sallaberry, C.J. & Storlie, C.B., 2006. "Survey of sampling-based methods for uncertainty and sensitivity analysis," Reliability Engineering and System Safety, Elsevier, vol. 91(10), pages 1175-1209.
    22. Yildiz, Yusuf & Korkmaz, Koray & Göksal Özbalta, Türkan & Durmus Arsan, Zeynep, 2012. "An approach for developing sensitive design parameter guidelines to reduce the energy requirements of low-rise apartment buildings," Applied Energy, Elsevier, vol. 93(C), pages 337-347.
    23. Yao, Jian, 2014. "Determining the energy performance of manually controlled solar shades: A stochastic model based co-simulation analysis," Applied Energy, Elsevier, vol. 127(C), pages 64-80.
    24. Mustafaraj, Giorgio & Marini, Dashamir & Costa, Andrea & Keane, Marcus, 2014. "Model calibration for building energy efficiency simulation," Applied Energy, Elsevier, vol. 130(C), pages 72-85.
    25. Nguyen, Anh-Tuan & Reiter, Sigrid & Rigo, Philippe, 2014. "A review on simulation-based optimization methods applied to building performance analysis," Applied Energy, Elsevier, vol. 113(C), pages 1043-1058.
    26. Hansen, Clifford W. & Helton, Jon C. & Sallaberry, Cédric J., 2012. "Use of replicated Latin hypercube sampling to estimate sampling variance in uncertainty and sensitivity analysis results for the geologic disposal of radioactive waste," Reliability Engineering and System Safety, Elsevier, vol. 107(C), pages 139-148.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Tian, Wei & Heo, Yeonsook & de Wilde, Pieter & Li, Zhanyong & Yan, Da & Park, Cheol Soo & Feng, Xiaohang & Augenbroe, Godfried, 2018. "A review of uncertainty analysis in building energy assessment," Renewable and Sustainable Energy Reviews, Elsevier, vol. 93(C), pages 285-301.
    2. Shilei Lu & Ran Wang & Shaoqun Zheng, 2017. "Passive Optimization Design Based on Particle Swarm Optimization in Rural Buildings of the Hot Summer and Warm Winter Zone of China," Sustainability, MDPI, vol. 9(12), pages 1-30, December.
    3. Dimitrios Sarris & Evangelos Spiliotis & Vassilios Assimakopoulos, 2020. "Exploiting resampling techniques for model selection in forecasting: an empirical evaluation using out-of-sample tests," Operational Research, Springer, vol. 20(2), pages 701-721, June.
    4. Chen, Xi & Yang, Hongxing & Wang, Yuanhao, 2017. "Parametric study of passive design strategies for high-rise residential buildings in hot and humid climates: miscellaneous impact factors," Renewable and Sustainable Energy Reviews, Elsevier, vol. 69(C), pages 442-460.
    5. Calama-González, Carmen María & Symonds, Phil & Petrou, Giorgos & Suárez, Rafael & León-Rodríguez, Ángel Luis, 2021. "Bayesian calibration of building energy models for uncertainty analysis through test cells monitoring," Applied Energy, Elsevier, vol. 282(PA).
    6. Wang, Ran & Lu, Shilei & Feng, Wei, 2020. "Impact of adjustment strategies on building design process in different climates oriented by multiple performance," Applied Energy, Elsevier, vol. 266(C).
    7. Tian, Wei & Liu, Yunliang & Heo, Yeonsook & Yan, Da & Li, Zhanyong & An, Jingjing & Yang, Song, 2016. "Relative importance of factors influencing building energy in urban environment," Energy, Elsevier, vol. 111(C), pages 237-250.
    8. Chen, Xi & Yang, Hongxing & Lu, Lin, 2015. "A comprehensive review on passive design approaches in green building rating tools," Renewable and Sustainable Energy Reviews, Elsevier, vol. 50(C), pages 1425-1436.
    9. Aste, Niccolò & Manfren, Massimiliano & Marenzi, Giorgia, 2017. "Building Automation and Control Systems and performance optimization: A framework for analysis," Renewable and Sustainable Energy Reviews, Elsevier, vol. 75(C), pages 313-330.
    10. Edwards, Richard E. & New, Joshua & Parker, Lynne E. & Cui, Borui & Dong, Jin, 2017. "Constructing large scale surrogate models from big data and artificial intelligence," Applied Energy, Elsevier, vol. 202(C), pages 685-699.
    11. Chen, Xi & Yang, Hongxing, 2018. "Integrated energy performance optimization of a passively designed high-rise residential building in different climatic zones of China," Applied Energy, Elsevier, vol. 215(C), pages 145-158.
    12. Ramkishore Singh & Dharam Buddhi & Samar Thapa & Chander Prakash & Rajesh Singh & Atul Sharma & Shane Sheoran & Kuldeep Kumar Saxena, 2022. "Sensitivity Analysis for Decisive Design Parameters for Energy and Indoor Visual Performances of a Glazed Façade Office Building," Sustainability, MDPI, vol. 14(21), pages 1-27, October.
    13. Qi Dong & Kai Xing & Hongrui Zhang, 2017. "Artificial Neural Network for Assessment of Energy Consumption and Cost for Cross Laminated Timber Office Building in Severe Cold Regions," Sustainability, MDPI, vol. 10(1), pages 1-15, December.
    14. Pang, Zhihong & O'Neill, Zheng, 2018. "Uncertainty quantification and sensitivity analysis of the domestic hot water usage in hotels," Applied Energy, Elsevier, vol. 232(C), pages 424-442.
    15. Yulong Xie & Mark Halverson & Rosemarie Bartlett & Yan Chen & Michael Rosenberg & Todd Taylor & Jeremiah Williams & Michael Reiner, 2020. "Evaluating Building Energy Code Compliance and Savings Potential through Large-Scale Simulation with Models Inferred by Field Data," Energies, MDPI, vol. 13(9), pages 1-19, May.
    16. Chen, Xi & Yang, Hongxing, 2017. "A multi-stage optimization of passively designed high-rise residential buildings in multiple building operation scenarios," Applied Energy, Elsevier, vol. 206(C), pages 541-557.
    17. Singh, Ramkishore & Lazarus, I.J. & Kishore, V.V.N., 2016. "Uncertainty and sensitivity analyses of energy and visual performances of office building with external venetian blind shading in hot-dry climate," Applied Energy, Elsevier, vol. 184(C), pages 155-170.
    18. Zhaoxia Wang & Jing Zhao, 2018. "Optimization of Passive Envelop Energy Efficient Measures for Office Buildings in Different Climate Regions of China Based on Modified Sensitivity Analysis," Sustainability, MDPI, vol. 10(4), pages 1-28, March.
    19. Østergård, Torben & Jensen, Rasmus L. & Maagaard, Steffen E., 2016. "Building simulations supporting decision making in early design – A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 61(C), pages 187-201.
    20. Prataviera, Enrico & Vivian, Jacopo & Lombardo, Giulia & Zarrella, Angelo, 2022. "Evaluation of the impact of input uncertainty on urban building energy simulations using uncertainty and sensitivity analysis," Applied Energy, Elsevier, vol. 311(C).
    21. Chen, Xi & Yang, Hongxing & Sun, Ke, 2017. "Developing a meta-model for sensitivity analyses and prediction of building performance for passively designed high-rise residential buildings," Applied Energy, Elsevier, vol. 194(C), pages 422-439.
    22. Hou, D. & Hassan, I.G. & Wang, L., 2021. "Review on building energy model calibration by Bayesian inference," Renewable and Sustainable Energy Reviews, Elsevier, vol. 143(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tian, Wei, 2013. "A review of sensitivity analysis methods in building energy analysis," Renewable and Sustainable Energy Reviews, Elsevier, vol. 20(C), pages 411-419.
    2. Tian, Wei & Heo, Yeonsook & de Wilde, Pieter & Li, Zhanyong & Yan, Da & Park, Cheol Soo & Feng, Xiaohang & Augenbroe, Godfried, 2018. "A review of uncertainty analysis in building energy assessment," Renewable and Sustainable Energy Reviews, Elsevier, vol. 93(C), pages 285-301.
    3. Singh, Ramkishore & Lazarus, I.J. & Kishore, V.V.N., 2016. "Uncertainty and sensitivity analyses of energy and visual performances of office building with external venetian blind shading in hot-dry climate," Applied Energy, Elsevier, vol. 184(C), pages 155-170.
    4. Edwards, Richard E. & New, Joshua & Parker, Lynne E. & Cui, Borui & Dong, Jin, 2017. "Constructing large scale surrogate models from big data and artificial intelligence," Applied Energy, Elsevier, vol. 202(C), pages 685-699.
    5. Yuan, Jun & Nian, Victor & Su, Bin & Meng, Qun, 2017. "A simultaneous calibration and parameter ranking method for building energy models," Applied Energy, Elsevier, vol. 206(C), pages 657-666.
    6. Ramos Ruiz, Germán & Fernández Bandera, Carlos & Gómez-Acebo Temes, Tomás & Sánchez-Ostiz Gutierrez, Ana, 2016. "Genetic algorithm for building envelope calibration," Applied Energy, Elsevier, vol. 168(C), pages 691-705.
    7. Enrico Fabrizio & Valentina Monetti, 2015. "Methodologies and Advancements in the Calibration of Building Energy Models," Energies, MDPI, vol. 8(4), pages 1-27, March.
    8. Zhao, Zeming & Li, Hangxin & Wang, Shengwei, 2022. "Identification of the key design parameters of Zero/low energy buildings and the impacts of climate and building morphology," Applied Energy, Elsevier, vol. 328(C).
    9. Yildiz, Yusuf & Korkmaz, Koray & Göksal Özbalta, Türkan & Durmus Arsan, Zeynep, 2012. "An approach for developing sensitive design parameter guidelines to reduce the energy requirements of low-rise apartment buildings," Applied Energy, Elsevier, vol. 93(C), pages 337-347.
    10. Chen, Xi & Yang, Hongxing & Wang, Yuanhao, 2017. "Parametric study of passive design strategies for high-rise residential buildings in hot and humid climates: miscellaneous impact factors," Renewable and Sustainable Energy Reviews, Elsevier, vol. 69(C), pages 442-460.
    11. Su, Ziyi & Li, Xiaofeng, 2022. "Extraction of key parameters and simplification of sub-system energy models using sensitivity analysis in subway stations," Energy, Elsevier, vol. 261(PA).
    12. Waqas Ahmed Mahar & Griet Verbeeck & Sigrid Reiter & Shady Attia, 2020. "Sensitivity Analysis of Passive Design Strategies for Residential Buildings in Cold Semi-Arid Climates," Sustainability, MDPI, vol. 12(3), pages 1-22, February.
    13. Wang, Ran & Lu, Shilei & Feng, Wei, 2020. "Impact of adjustment strategies on building design process in different climates oriented by multiple performance," Applied Energy, Elsevier, vol. 266(C).
    14. Wei, Pengfei & Lu, Zhenzhou & Song, Jingwen, 2015. "Variable importance analysis: A comprehensive review," Reliability Engineering and System Safety, Elsevier, vol. 142(C), pages 399-432.
    15. Chen, Xi & Yang, Hongxing & Sun, Ke, 2017. "Developing a meta-model for sensitivity analyses and prediction of building performance for passively designed high-rise residential buildings," Applied Energy, Elsevier, vol. 194(C), pages 422-439.
    16. Ascione, Fabrizio & Bianco, Nicola & De Stasio, Claudio & Mauro, Gerardo Maria & Vanoli, Giuseppe Peter, 2016. "Multi-stage and multi-objective optimization for energy retrofitting a developed hospital reference building: A new approach to assess cost-optimality," Applied Energy, Elsevier, vol. 174(C), pages 37-68.
    17. Østergård, Torben & Jensen, Rasmus L. & Maagaard, Steffen E., 2016. "Building simulations supporting decision making in early design – A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 61(C), pages 187-201.
    18. Rocío Escandón & Rafael Suárez & Juan José Sendra & Fabrizio Ascione & Nicola Bianco & Gerardo Maria Mauro, 2019. "Predicting the Impact of Climate Change on Thermal Comfort in A Building Category: The Case of Linear-type Social Housing Stock in Southern Spain," Energies, MDPI, vol. 12(12), pages 1-21, June.
    19. Tatsuya Sakurahara & Seyed Reihani & Ernie Kee & Zahra Mohaghegh, 2020. "Global importance measure methodology for integrated probabilistic risk assessment," Journal of Risk and Reliability, , vol. 234(2), pages 377-396, April.
    20. Chen, Xi & Yang, Hongxing & Zhang, Weilong, 2015. "A comprehensive sensitivity study of major passive design parameters for the public rental housing development in Hong Kong," Energy, Elsevier, vol. 93(P2), pages 1804-1818.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:135:y:2014:i:c:p:320-328. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.