IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v109y2013icp123-132.html
   My bibliography  Save this article

Monte-Carlo based uncertainty analysis: Sampling efficiency and sampling convergence

Author

Listed:
  • Janssen, Hans

Abstract

Monte Carlo analysis has become nearly ubiquitous since its introduction, now over 65 years ago. It is an important tool in many assessments of the reliability and robustness of systems, structures or solutions. As the deterministic core simulation can be lengthy, the computational costs of Monte Carlo can be a limiting factor. To reduce that computational expense as much as possible, sampling efficiency and convergence for Monte Carlo are investigated in this paper. The first section shows that non-collapsing space-filling sampling strategies, illustrated here with the maximin and uniform Latin hypercube designs, highly enhance the sampling efficiency, and render a desired level of accuracy of the outcomes attainable with far lesser runs. In the second section it is demonstrated that standard sampling statistics are inapplicable for Latin hypercube strategies. A sample-splitting approach is put forward, which in combination with a replicated Latin hypercube sampling allows assessing the accuracy of Monte Carlo outcomes. The assessment in turn permits halting the Monte Carlo simulation when the desired levels of accuracy are reached. Both measures form fairly noncomplex upgrades of the current state-of-the-art in Monte-Carlo based uncertainty analysis but give a substantial further progress with respect to its applicability.

Suggested Citation

  • Janssen, Hans, 2013. "Monte-Carlo based uncertainty analysis: Sampling efficiency and sampling convergence," Reliability Engineering and System Safety, Elsevier, vol. 109(C), pages 123-132.
  • Handle: RePEc:eee:reensy:v:109:y:2013:i:c:p:123-132
    DOI: 10.1016/j.ress.2012.08.003
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832012001536
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2012.08.003?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Husslage, B.G.M. & Rennen, G. & van Dam, E.R. & den Hertog, D., 2011. "Space-filling Latin hypercube designs for computer experiments," Other publications TiSEM 694f73df-a373-46a7-aa4d-1, Tilburg University, School of Economics and Management.
    2. Durga Rao, K. & Gopika, V. & Sanyasi Rao, V.V.S. & Kushwaha, H.S. & Verma, A.K. & Srividya, A., 2009. "Dynamic fault tree analysis using Monte Carlo simulation in probabilistic safety assessment," Reliability Engineering and System Safety, Elsevier, vol. 94(4), pages 872-883.
    3. Christian Dehlendorff & Murat Kulahci & Klaus Kaae Andersen, 2011. "Designing simulation experiments with controllable and uncontrollable factors for applications in healthcare," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 60(1), pages 31-49, January.
    4. Sallaberry, C.J. & Helton, J.C. & Hora, S.C., 2008. "Extension of Latin hypercube samples with correlated variables," Reliability Engineering and System Safety, Elsevier, vol. 93(7), pages 1047-1059.
    5. David E. Burmaster & Paul D. Anderson, 1994. "Principles of Good Practice for the Use of Monte Carlo Techniques in Human Health and Ecological Risk Assessments," Risk Analysis, John Wiley & Sons, vol. 14(4), pages 477-481, August.
    6. van Groenendaal, W.J.H. & Kleijnen, J.P.C., 1997. "On the assessment of economic risk : Factorial design versus Monte Carlo methods," Other publications TiSEM fd2a2307-0812-4543-8151-7, Tilburg University, School of Economics and Management.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hou, Tianfeng & Nuyens, Dirk & Roels, Staf & Janssen, Hans, 2019. "Quasi-Monte Carlo based uncertainty analysis: Sampling efficiency and error estimation in engineering applications," Reliability Engineering and System Safety, Elsevier, vol. 191(C).
    2. Levitin, Gregory & Xing, Liudong & Dai, Yuanshun, 2018. "Heterogeneous 1-out-of-N warm standby systems with online checkpointing," Reliability Engineering and System Safety, Elsevier, vol. 169(C), pages 127-136.
    3. Olivier Chanel, 2022. "Impact of COVID‑19 Activity Restrictions on Air Pollution: Methodological Considerations in the Economic Valuation of the Long‑Term Effects on Mortality [Impact sur la pollution de l’air des restri," Working Papers hal-03778336, HAL.
    4. Yan-Feng Li & Jinhua Mi & Yu Liu & Yuan-Jian Yang & Hong-Zhong Huang, 2015. "Dynamic fault tree analysis based on continuous-time Bayesian networks under fuzzy numbers," Journal of Risk and Reliability, , vol. 229(6), pages 530-541, December.
    5. Charles N. Haas, 1997. "Importance of Distributional Form in Characterizing Inputs to Monte Carlo Risk Assessments," Risk Analysis, John Wiley & Sons, vol. 17(1), pages 107-113, February.
    6. Gayathri, P. & Umesh, K. & Ganguli, R., 2010. "Effect of matrix cracking and material uncertainty on composite plates," Reliability Engineering and System Safety, Elsevier, vol. 95(7), pages 716-728.
    7. W C M van Beers & J P C Kleijnen, 2003. "Kriging for interpolation in random simulation," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 54(3), pages 255-262, March.
    8. Timothy M. Barry, 1996. "Recommendations on the Testing and Use of Pseudo‐Random Number Generators Used in Monte Carlo Analysis for Risk Assessment," Risk Analysis, John Wiley & Sons, vol. 16(1), pages 93-105, February.
    9. Xing, Liudong & Shrestha, Akhilesh & Dai, Yuanshun, 2011. "Exact combinatorial reliability analysis of dynamic systems with sequence-dependent failures," Reliability Engineering and System Safety, Elsevier, vol. 96(10), pages 1375-1385.
    10. Bibartiu, Otto & Dürr, Frank & Rothermel, Kurt & Ottenwälder, Beate & Grau, Andreas, 2021. "Scalable k-out-of-n models for dependability analysis with Bayesian networks," Reliability Engineering and System Safety, Elsevier, vol. 210(C).
    11. Olivier Chanel, 2022. "Impact of COVID-19 Activity Restrictions on Air Pollution: Methodological Considerations in the Economic Valuation of the Long-Term Effects on Mortality," Economie et Statistique / Economics and Statistics, Institut National de la Statistique et des Etudes Economiques (INSEE), issue 534-35, pages 103-118.
    12. Lindhe, Andreas & Norberg, Tommy & Rosén, Lars, 2012. "Approximate dynamic fault tree calculations for modelling water supply risks," Reliability Engineering and System Safety, Elsevier, vol. 106(C), pages 61-71.
    13. Vikram V. Garg & Roy H. Stogner, 2017. "Hierarchical Latin Hypercube Sampling," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(518), pages 673-682, April.
    14. Van Groenendaal, Willem J. H. & Kleijnen, Jack P. C., 2002. "Deterministic versus stochastic sensitivity analysis in investment problems: An environmental case study," European Journal of Operational Research, Elsevier, vol. 141(1), pages 8-20, August.
    15. Azeem Ali & Sanku Dey & Haseeb Ur Rehman & Zeeshan Ali, 2019. "On Bayesian reliability estimation of a 1-out-of-k load sharing system model of modified Burr-III distribution," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 10(5), pages 1052-1081, October.
    16. Zhang, Yimin & Shortle, John & Sherry, Lance, 2015. "Methodology for collision risk assessment of an airspace flow corridor concept," Reliability Engineering and System Safety, Elsevier, vol. 142(C), pages 444-455.
    17. Chenxi Liu & Nan Chen & Jianing Yang, 2015. "New method for multi-state system reliability analysis based on linear algebraic representation," Journal of Risk and Reliability, , vol. 229(5), pages 469-482, October.
    18. Frédéric Dor & Pascal Empereur‐Bissonnet & Denis Zmirou & Vincent Nedellec & Jean‐Marie Haguenoer & Frans Jongeneelen & Alain Person & William Dab & Colin Ferguson, 2003. "Validation of Multimedia Models Assessing Exposure to PAHs—The SOLEX Study," Risk Analysis, John Wiley & Sons, vol. 23(5), pages 1047-1057, October.
    19. Vodopivec, Neža & Miller-Hooks, Elise, 2019. "Transit system resilience: Quantifying the impacts of disruptions on diverse populations," Reliability Engineering and System Safety, Elsevier, vol. 191(C).
    20. Qianwen Li & Ruyin Long & Hong Chen & Jichao Geng, 2017. "Low Purchase Willingness for Battery Electric Vehicles: Analysis and Simulation Based on the Fault Tree Model," Sustainability, MDPI, vol. 9(5), pages 1-20, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:109:y:2013:i:c:p:123-132. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.