IDEAS home Printed from https://ideas.repec.org/a/wly/riskan/v37y2017i7p1315-1340.html

A Critical Discussion and Practical Recommendations on Some Issues Relevant to the Nonprobabilistic Treatment of Uncertainty in Engineering Risk Assessment

Author

Listed:
  • Nicola Pedroni
  • Enrico Zio
  • Alberto Pasanisi
  • Mathieu Couplet

Abstract

Models for the assessment of the risk of complex engineering systems are affected by uncertainties due to the randomness of several phenomena involved and the incomplete knowledge about some of the characteristics of the system. The objective of this article is to provide operative guidelines to handle some conceptual and technical issues related to the treatment of uncertainty in risk assessment for engineering practice. In particular, the following issues are addressed: (1) quantitative modeling and representation of uncertainty coherently with the information available on the system of interest; (2) propagation of the uncertainty from the input(s) to the output(s) of the system model; (3) (Bayesian) updating as new information on the system becomes available; and (4) modeling and representation of dependences among the input variables and parameters of the system model. Different approaches and methods are recommended for efficiently tackling each of issues (1)‒(4) above; the tools considered are derived from both classical probability theory as well as alternative, nonfully probabilistic uncertainty representation frameworks (e.g., possibility theory). The recommendations drawn are supported by the results obtained in illustrative applications of literature.

Suggested Citation

  • Nicola Pedroni & Enrico Zio & Alberto Pasanisi & Mathieu Couplet, 2017. "A Critical Discussion and Practical Recommendations on Some Issues Relevant to the Nonprobabilistic Treatment of Uncertainty in Engineering Risk Assessment," Risk Analysis, John Wiley & Sons, vol. 37(7), pages 1315-1340, July.
    • Handle: RePEc:wly:riskan:v:37:y:2017:i:7:p:1315-1340
    DOI: 10.1111/risa.12705
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/risa.12705
    Download Restriction: no
    File URL: https://libkey.io/10.1111/risa.12705?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Dubois, Didier, 2006. "Possibility theory and statistical reasoning," Computational Statistics & Data Analysis, Elsevier, vol. 51(1), pages 47-69, November.
    2. F. Owen Hoffman & Jana S. Hammonds, 1994. "Propagation of Uncertainty in Risk Assessments: The Need to Distinguish Between Uncertainty Due to Lack of Knowledge and Uncertainty Due to Variability," Risk Analysis, John Wiley & Sons, vol. 14(5), pages 707-712, October.
    3. Aven, Terje & Heide, Bjørnar, 2009. "Reliability and validity of risk analysis," Reliability Engineering and System Safety, Elsevier, vol. 94(11), pages 1862-1868.
    4. Hansen, C.W. & Birkholzer, J.T. & Blink, J. & Bryan, C.R. & Chen, Y. & Gross, M.B. & Hardin, E. & Houseworth, J. & Howard, R. & Jarek, R. & Lee, K.P. & Lester, B. & Mariner, P. & Mattie, P.D. & Mehta,, 2014. "Overview of total system model used for the 2008 performance assessment for the proposed high-level radioactive waste repository at Yucca Mountain, Nevada," Reliability Engineering and System Safety, Elsevier, vol. 122(C), pages 249-266.
    5. Enrico Zio, 2013. "The Monte Carlo Simulation Method for System Reliability and Risk Analysis," Springer Series in Reliability Engineering, Springer, edition 127, number 978-1-4471-4588-2, January.
    6. D. Warner North, 2010. "Probability Theory and Consistent Reasoning," Risk Analysis, John Wiley & Sons, vol. 30(3), pages 377-380, March.
    7. Aven, T., 2011. "Interpretations of alternative uncertainty representations in a reliability and risk analysis context," Reliability Engineering and System Safety, Elsevier, vol. 96(3), pages 353-360.
    8. Roger Flage & Piero Baraldi & Enrico Zio & Terje Aven, 2013. "Probability and Possibility‐Based Representations of Uncertainty in Fault Tree Analysis," Risk Analysis, John Wiley & Sons, vol. 33(1), pages 121-133, January.
    9. Enrico Zio, 2013. "System Reliability and Risk Analysis by Monte Carlo Simulation," Springer Series in Reliability Engineering, in: The Monte Carlo Simulation Method for System Reliability and Risk Analysis, edition 127, chapter 0, pages 59-81, Springer.
    10. Refaul Ferdous & Faisal Khan & Rehan Sadiq & Paul Amyotte & Brian Veitch, 2011. "Fault and Event Tree Analyses for Process Systems Risk Analysis: Uncertainty Handling Formulations," Risk Analysis, John Wiley & Sons, vol. 31(1), pages 86-107, January.
    11. Helton, Jon C. & Johnson, Jay D., 2011. "Quantification of margins and uncertainties: Alternative representations of epistemic uncertainty," Reliability Engineering and System Safety, Elsevier, vol. 96(9), pages 1034-1052.
    12. Didier Dubois, 2010. "Representation, Propagation, and Decision Issues in Risk Analysis Under Incomplete Probabilistic Information," Risk Analysis, John Wiley & Sons, vol. 30(3), pages 361-368, March.
    13. Enrico Zio & Giovanni Sansavini, 2011. "Component Criticality in Failure Cascade Processes of Network Systems," Risk Analysis, John Wiley & Sons, vol. 31(8), pages 1196-1210, August.
    14. Piero Baraldi & Enrico Zio, 2008. "A Combined Monte Carlo and Possibilistic Approach to Uncertainty Propagation in Event Tree Analysis," Risk Analysis, John Wiley & Sons, vol. 28(5), pages 1309-1326, October.
    15. Sallaberry, C.J. & Hansen, C.W. & Helton, J.C., 2014. "Expected dose for the igneous scenario classes in the 2008 performance assessment for the proposed high-level radioactive waste repository at Yucca Mountain, Nevada," Reliability Engineering and System Safety, Elsevier, vol. 122(C), pages 339-353.
    16. Nicola Pedroni & Enrico Zio, 2013. "Uncertainty Analysis in Fault Tree Models with Dependent Basic Events," Risk Analysis, John Wiley & Sons, vol. 33(6), pages 1146-1173, June.
    17. Vaurio, Jussi K., 2007. "Consistent mapping of common cause failure rates and alpha factors," Reliability Engineering and System Safety, Elsevier, vol. 92(5), pages 628-645.
    18. Marc C. Kennedy & Anthony O'Hagan, 2001. "Bayesian calibration of computer models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 63(3), pages 425-464.
    19. Aven, Terje, 2016. "Risk assessment and risk management: Review of recent advances on their foundation," European Journal of Operational Research, Elsevier, vol. 253(1), pages 1-13.
    20. Bo Bergman, 2009. "Conceptualistic Pragmatism: A framework for Bayesian analysis?," IISE Transactions, Taylor & Francis Journals, vol. 41(1), pages 86-93.
    21. Helton, J.C. & Hansen, C.W. & Sallaberry, C.J., 2014. "Expected dose for the nominal scenario class in the 2008 performance assessment for the proposed high-level radioactive waste repository at Yucca Mountain, Nevada," Reliability Engineering and System Safety, Elsevier, vol. 122(C), pages 267-271.
    22. Dana Kelly & Curtis Smith, 2011. "Bayesian Inference for Probabilistic Risk Assessment," Springer Series in Reliability Engineering, Springer, number 978-1-84996-187-5, January.
    23. Jon C. Helton & William L. Oberkampf & Jay D. Johnson, 2005. "Competing Failure Risk Analysis Using Evidence Theory," Risk Analysis, John Wiley & Sons, vol. 25(4), pages 973-995, August.
    24. Helton, J.C. & Gross, M.G. & Hansen, C.W. & Sallaberry, C.J. & Sevougian, S.D., 2014. "Expected dose for the seismic scenario classes in the 2008 performance assessment for the proposed high-level radioactive waste repository at Yucca Mountain, Nevada," Reliability Engineering and System Safety, Elsevier, vol. 122(C), pages 380-398.
    25. Enrico Zio, 2013. "Monte Carlo Simulation: The Method," Springer Series in Reliability Engineering, in: The Monte Carlo Simulation Method for System Reliability and Risk Analysis, edition 127, chapter 0, pages 19-58, Springer.
    26. Baudrit, C. & Dubois, D., 2006. "Practical representations of incomplete probabilistic knowledge," Computational Statistics & Data Analysis, Elsevier, vol. 51(1), pages 86-108, November.
    27. Terje Aven, 2010. "On the Need for Restricting the Probabilistic Analysis in Risk Assessments to Variability," Risk Analysis, John Wiley & Sons, vol. 30(3), pages 354-360, March.
    28. Aven, Terje, 2016. "On the use of conservatism in risk assessments," Reliability Engineering and System Safety, Elsevier, vol. 146(C), pages 33-38.
    29. Aven, Terje, 2010. "Some reflections on uncertainty analysis and management," Reliability Engineering and System Safety, Elsevier, vol. 95(3), pages 195-201.
    30. Durga Rao Karanki & Hari Shankar Kushwaha & Ajit Kumar Verma & Srividya Ajit, 2009. "Uncertainty Analysis Based on Probability Bounds (P‐Box) Approach in Probabilistic Safety Assessment," Risk Analysis, John Wiley & Sons, vol. 29(5), pages 662-675, May.
    31. H. Christopher Frey & David E. Burmaster, 1999. "Methods for Characterizing Variability and Uncertainty: Comparison of Bootstrap Simulation and Likelihood‐Based Approaches," Risk Analysis, John Wiley & Sons, vol. 19(1), pages 109-130, February.
    32. Enrico Zio, 2013. "System Reliability and Risk Analysis," Springer Series in Reliability Engineering, in: The Monte Carlo Simulation Method for System Reliability and Risk Analysis, edition 127, chapter 0, pages 7-17, Springer.
    33. Helton, J.C. & Hansen, C.W. & Sallaberry, C.J., 2014. "Conceptual structure and computational organization of the 2008 performance assessment for the proposed high-level radioactive waste repository at Yucca Mountain, Nevada," Reliability Engineering and System Safety, Elsevier, vol. 122(C), pages 223-248.
    34. Aven, T. & Steen, R., 2010. "The concept of ignorance in a risk assessment and risk management context," Reliability Engineering and System Safety, Elsevier, vol. 95(11), pages 1117-1122.
    35. Helton, Jon C. & Pilch, Martin & Sallaberry, Cédric J., 2014. "Probability of loss of assured safety in systems with multiple time-dependent failure modes: Representations with aleatory and epistemic uncertainty," Reliability Engineering and System Safety, Elsevier, vol. 124(C), pages 171-200.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Isadora Antoniano‐Villalobos & Emanuele Borgonovo & Sumeda Siriwardena, 2018. "Which Parameters Are Important? Differential Importance Under Uncertainty," Risk Analysis, John Wiley & Sons, vol. 38(11), pages 2459-2477, November.
    2. Enrico Zio & Franck Guarnieri, 2025. "Industry 5.0: Do risk assessment and risk management need to update? And if yes, how?," Journal of Risk and Reliability, , vol. 239(2), pages 389-396, April.
    3. Bjørnsen, Kjartan & Selvik, Jon Tømmerås & Aven, Terje, 2019. "A semi-quantitative assessment process for improved use of the expected value of information measure in safety management," Reliability Engineering and System Safety, Elsevier, vol. 188(C), pages 494-502.
    4. Zio, E., 2018. "The future of risk assessment," Reliability Engineering and System Safety, Elsevier, vol. 177(C), pages 176-190.
    5. Guizhen Zhang & Vinh V. Thai & Adrian Wing‐Keung Law & Kum Fai Yuen & Hui Shan Loh & Qingji Zhou, 2020. "Quantitative Risk Assessment of Seafarers’ Nonfatal Injuries Due to Occupational Accidents Based on Bayesian Network Modeling," Risk Analysis, John Wiley & Sons, vol. 40(1), pages 8-23, January.
    6. Zhiguo Zeng & Tasneem Bani-Mustafa & Roger Flage & Enrico Zio, 2021. "An integrated risk index accounting for epistemic uncertainty in probability risk assessment," Journal of Risk and Reliability, , vol. 235(4), pages 711-728, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nicola Pedroni & Enrico Zio & Alberto Pasanisi & Mathieu Couplet, 2017. "A critical discussion and practical recommendations on some issues relevant to the non-probabilistic treatment of uncertainty in engineering risk assessment," Post-Print hal-01652230, HAL.
    2. Nicola Pedroni & Enrico Zio, 2013. "Uncertainty Analysis in Fault Tree Models with Dependent Basic Events," Risk Analysis, John Wiley & Sons, vol. 33(6), pages 1146-1173, June.
    3. Edoardo Tosoni & Ahti Salo & Enrico Zio, 2018. "Scenario Analysis for the Safety Assessment of Nuclear Waste Repositories: A Critical Review," Risk Analysis, John Wiley & Sons, vol. 38(4), pages 755-776, April.
    4. Tosoni, E. & Salo, A. & Govaerts, J. & Zio, E., 2019. "Comprehensiveness of scenarios in the safety assessment of nuclear waste repositories," Reliability Engineering and System Safety, Elsevier, vol. 188(C), pages 561-573.
    5. Helton, Jon C. & Brooks, Dusty M. & Sallaberry, Cédric J., 2020. "Margins associated with loss of assured safety for systems with multiple weak links and strong links," Reliability Engineering and System Safety, Elsevier, vol. 195(C).
    6. Roger Flage & Terje Aven & Enrico Zio & Piero Baraldi, 2014. "Concerns, Challenges, and Directions of Development for the Issue of Representing Uncertainty in Risk Assessment," Risk Analysis, John Wiley & Sons, vol. 34(7), pages 1196-1207, July.
    7. Salomon, Julian & Winnewisser, Niklas & Wei, Pengfei & Broggi, Matteo & Beer, Michael, 2021. "Efficient reliability analysis of complex systems in consideration of imprecision," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    8. Smith, Curtis L., 2020. "Representing external hazard initiating events using a Bayesian approach and a generalized extreme value model," Reliability Engineering and System Safety, Elsevier, vol. 193(C).
    9. Michele Compare & Francesco Di Maio & Enrico Zio & Fausto Carlevaro & Sara Mattafirri, 2016. "Improving scheduled maintenance by missing data reconstruction: A double-loop Monte Carlo approach," Journal of Risk and Reliability, , vol. 230(5), pages 502-511, October.
    10. Breitung, Karl, 2024. "The return of the design points," Reliability Engineering and System Safety, Elsevier, vol. 247(C).
    11. Di Maio, Francesco & Pettorossi, Chiara & Zio, Enrico, 2023. "Entropy-driven Monte Carlo simulation method for approximating the survival signature of complex infrastructures," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    12. Terje Aven, 2012. "Foundational Issues in Risk Assessment and Risk Management," Risk Analysis, John Wiley & Sons, vol. 32(10), pages 1647-1656, October.
    13. Wang, Fan & Li, Heng, 2018. "System reliability under prescribed marginals and correlations: Are we correct about the effect of correlations?," Reliability Engineering and System Safety, Elsevier, vol. 173(C), pages 94-104.
    14. Tito G. Amaral & Vitor Fernão Pires & Armando Cordeiro & Daniel Foito & João F. Martins & Julia Yamnenko & Tetyana Tereschenko & Liudmyla Laikova & Ihor Fedin, 2023. "Incipient Fault Diagnosis of a Grid-Connected T-Type Multilevel Inverter Using Multilayer Perceptron and Walsh Transform," Energies, MDPI, vol. 16(6), pages 1-18, March.
    15. Penttinen, Jussi-Pekka & Niemi, Arto & Gutleber, Johannes & Koskinen, Kari T. & Coatanéa, Eric & Laitinen, Jouko, 2019. "An open modelling approach for availability and reliability of systems," Reliability Engineering and System Safety, Elsevier, vol. 183(C), pages 387-399.
    16. Goerlandt, Floris & Montewka, Jakub, 2015. "Maritime transportation risk analysis: Review and analysis in light of some foundational issues," Reliability Engineering and System Safety, Elsevier, vol. 138(C), pages 115-134.
    17. Rocco, Claudio M. & Moronta, José & Ramirez-Marquez, José E. & Barker, Kash, 2017. "Effects of multi-state links in network community detection," Reliability Engineering and System Safety, Elsevier, vol. 163(C), pages 46-56.
    18. Tu Duong Le Duy & Laurence Dieulle & Dominique Vasseur & Christophe Bérenguer & Mathieu Couplet, 2013. "An alternative comprehensive framework using belief functions for parameter and model uncertainty analysis in nuclear probabilistic risk assessment applications," Journal of Risk and Reliability, , vol. 227(5), pages 471-490, October.
    19. Babykina, Génia & Brînzei, Nicolae & Aubry, Jean-François & Deleuze, Gilles, 2016. "Modeling and simulation of a controlled steam generator in the context of dynamic reliability using a Stochastic Hybrid Automaton," Reliability Engineering and System Safety, Elsevier, vol. 152(C), pages 115-136.
    20. Compare, Michele & Bellani, Luca & Zio, Enrico, 2017. "Reliability model of a component equipped with PHM capabilities," Reliability Engineering and System Safety, Elsevier, vol. 168(C), pages 4-11.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:riskan:v:37:y:2017:i:7:p:1315-1340. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://doi.org/10.1111/(ISSN)1539-6924 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.