IDEAS home Printed from https://ideas.repec.org/p/hal/journl/hal-01652230.html
   My bibliography  Save this paper

A critical discussion and practical recommendations on some issues relevant to the non-probabilistic treatment of uncertainty in engineering risk assessment

Author

Listed:
  • Nicola Pedroni

    (LGI - Laboratoire Génie Industriel - EA 2606 - CentraleSupélec)

  • Enrico Zio

    (LGI - Laboratoire Génie Industriel - EA 2606 - CentraleSupélec, SSEC - Chaire Sciences des Systèmes et Défis Energétiques EDF/ECP/Supélec - Ecole Centrale Paris - Ecole Supérieure d'Electricité - SUPELEC (FRANCE) - CentraleSupélec - EDF R&D - EDF R&D - EDF - EDF)

  • Alberto Pasanisi

    (EIFER - European Institute For Energy Research - TH - Universität Karlsruhe - EDF R&D - EDF R&D - EDF - EDF)

  • Mathieu Couplet

    (EDF R&D STEP - Simulation et Traitement de l'information pour l'Exploitation des systèmes de Production - EDF R&D - EDF R&D - EDF - EDF)

Abstract

Models for the assessment of the risk of complex engineering systems are affected by uncertainties, due to the randomness of several phenomena involved and the incomplete knowledge about some of the characteristics of the system. The objective of the present paper is to provide operative guidelines to handle some conceptual and technical issues related to the treatment of uncertainty in risk assessment for engineering practice. In particular, the following issues are addressed: (1) quantitative modeling and representation of uncertainty coherently with the information available on the system of interest; (2) propagation of the uncertainty from the input(s) to the output(s) of the system model; (3) (Bayesian) updating as new information on the system becomes available; (4) modeling and representation of dependences among the input variables and parameters of the system model. Different approaches and methods are recommended for efficiently tackling each of the issues (1)‒(4) above; the tools considered are derived from both classical probability theory as well as alternative, non-fully probabilistic uncertainty representation frameworks (e.g., possibility theory). The recommendations drawn are supported by the results obtained in illustrative applications of literature.

Suggested Citation

  • Nicola Pedroni & Enrico Zio & Alberto Pasanisi & Mathieu Couplet, 2017. "A critical discussion and practical recommendations on some issues relevant to the non-probabilistic treatment of uncertainty in engineering risk assessment," Post-Print hal-01652230, HAL.
    • Handle: RePEc:hal:journl:hal-01652230
    DOI: 10.1111/risa.12705
    Note: View the original document on HAL open archive server: https://hal.science/hal-01652230
    as

    Download full text from publisher

    File URL: https://hal.science/hal-01652230/document
    Download Restriction: no
    File URL: https://libkey.io/10.1111/risa.12705?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Dubois, Didier, 2006. "Possibility theory and statistical reasoning," Computational Statistics & Data Analysis, Elsevier, vol. 51(1), pages 47-69, November.
    2. F. Owen Hoffman & Jana S. Hammonds, 1994. "Propagation of Uncertainty in Risk Assessments: The Need to Distinguish Between Uncertainty Due to Lack of Knowledge and Uncertainty Due to Variability," Risk Analysis, John Wiley & Sons, vol. 14(5), pages 707-712, October.
    3. Aven, Terje & Heide, Bjørnar, 2009. "Reliability and validity of risk analysis," Reliability Engineering and System Safety, Elsevier, vol. 94(11), pages 1862-1868.
    4. Helton, J.C. & Hansen, C.W. & Sallaberry, C.J., 2014. "Expected dose for the early failure scenario classes in the 2008 performance assessment for the proposed high-level radioactive waste repository at Yucca Mountain, Nevada," Reliability Engineering and System Safety, Elsevier, vol. 122(C), pages 297-309.
    5. Hansen, C.W. & Birkholzer, J.T. & Blink, J. & Bryan, C.R. & Chen, Y. & Gross, M.B. & Hardin, E. & Houseworth, J. & Howard, R. & Jarek, R. & Lee, K.P. & Lester, B. & Mariner, P. & Mattie, P.D. & Mehta,, 2014. "Overview of total system model used for the 2008 performance assessment for the proposed high-level radioactive waste repository at Yucca Mountain, Nevada," Reliability Engineering and System Safety, Elsevier, vol. 122(C), pages 249-266.
    6. Enrico Zio, 2013. "The Monte Carlo Simulation Method for System Reliability and Risk Analysis," Springer Series in Reliability Engineering, Springer, edition 127, number 978-1-4471-4588-2, January.
    7. D. Warner North, 2010. "Probability Theory and Consistent Reasoning," Risk Analysis, John Wiley & Sons, vol. 30(3), pages 377-380, March.
    8. Aven, T., 2011. "Interpretations of alternative uncertainty representations in a reliability and risk analysis context," Reliability Engineering and System Safety, Elsevier, vol. 96(3), pages 353-360.
    9. Roger Flage & Piero Baraldi & Enrico Zio & Terje Aven, 2013. "Probability and Possibility‐Based Representations of Uncertainty in Fault Tree Analysis," Risk Analysis, John Wiley & Sons, vol. 33(1), pages 121-133, January.
    10. Enrico Zio, 2013. "System Reliability and Risk Analysis by Monte Carlo Simulation," Springer Series in Reliability Engineering, in: The Monte Carlo Simulation Method for System Reliability and Risk Analysis, edition 127, chapter 0, pages 59-81, Springer.
    11. Refaul Ferdous & Faisal Khan & Rehan Sadiq & Paul Amyotte & Brian Veitch, 2011. "Fault and Event Tree Analyses for Process Systems Risk Analysis: Uncertainty Handling Formulations," Risk Analysis, John Wiley & Sons, vol. 31(1), pages 86-107, January.
    12. Helton, Jon C. & Johnson, Jay D., 2011. "Quantification of margins and uncertainties: Alternative representations of epistemic uncertainty," Reliability Engineering and System Safety, Elsevier, vol. 96(9), pages 1034-1052.
    13. Didier Dubois, 2010. "Representation, Propagation, and Decision Issues in Risk Analysis Under Incomplete Probabilistic Information," Risk Analysis, John Wiley & Sons, vol. 30(3), pages 361-368, March.
    14. Enrico Zio & Giovanni Sansavini, 2011. "Component Criticality in Failure Cascade Processes of Network Systems," Risk Analysis, John Wiley & Sons, vol. 31(8), pages 1196-1210, August.
    15. Piero Baraldi & Enrico Zio, 2008. "A Combined Monte Carlo and Possibilistic Approach to Uncertainty Propagation in Event Tree Analysis," Risk Analysis, John Wiley & Sons, vol. 28(5), pages 1309-1326, October.
    16. Sallaberry, C.J. & Hansen, C.W. & Helton, J.C., 2014. "Expected dose for the igneous scenario classes in the 2008 performance assessment for the proposed high-level radioactive waste repository at Yucca Mountain, Nevada," Reliability Engineering and System Safety, Elsevier, vol. 122(C), pages 339-353.
    17. Nicola Pedroni & Enrico Zio, 2013. "Uncertainty Analysis in Fault Tree Models with Dependent Basic Events," Risk Analysis, John Wiley & Sons, vol. 33(6), pages 1146-1173, June.
    18. Vaurio, Jussi K., 2007. "Consistent mapping of common cause failure rates and alpha factors," Reliability Engineering and System Safety, Elsevier, vol. 92(5), pages 628-645.
    19. Krzykacz-Hausmann, Bernard, 2006. "An approximate sensitivity analysis of results from complex computer models in the presence of epistemic and aleatory uncertainties," Reliability Engineering and System Safety, Elsevier, vol. 91(10), pages 1210-1218.
    20. Marc C. Kennedy & Anthony O'Hagan, 2001. "Bayesian calibration of computer models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 63(3), pages 425-464.
    21. Aven, Terje, 2016. "Risk assessment and risk management: Review of recent advances on their foundation," European Journal of Operational Research, Elsevier, vol. 253(1), pages 1-13.
    22. Bo Bergman, 2009. "Conceptualistic Pragmatism: A framework for Bayesian analysis?," IISE Transactions, Taylor & Francis Journals, vol. 41(1), pages 86-93.
    23. Helton, J.C. & Hansen, C.W. & Sallaberry, C.J., 2014. "Expected dose for the nominal scenario class in the 2008 performance assessment for the proposed high-level radioactive waste repository at Yucca Mountain, Nevada," Reliability Engineering and System Safety, Elsevier, vol. 122(C), pages 267-271.
    24. Dana Kelly & Curtis Smith, 2011. "Bayesian Inference for Probabilistic Risk Assessment," Springer Series in Reliability Engineering, Springer, number 978-1-84996-187-5, January.
    25. Jon C. Helton & William L. Oberkampf & Jay D. Johnson, 2005. "Competing Failure Risk Analysis Using Evidence Theory," Risk Analysis, John Wiley & Sons, vol. 25(4), pages 973-995, August.
    26. Helton, J.C. & Gross, M.G. & Hansen, C.W. & Sallaberry, C.J. & Sevougian, S.D., 2014. "Expected dose for the seismic scenario classes in the 2008 performance assessment for the proposed high-level radioactive waste repository at Yucca Mountain, Nevada," Reliability Engineering and System Safety, Elsevier, vol. 122(C), pages 380-398.
    27. Helton, J.C. & Hansen, C.W. & Sallaberry, C.J., 2014. "Expected dose and associated uncertainty and sensitivity analysis results for all scenario classes in the 2008 performance assessment for the proposed high-level radioactive waste repository at Yucca ," Reliability Engineering and System Safety, Elsevier, vol. 122(C), pages 421-435.
    28. Enrico Zio, 2013. "Monte Carlo Simulation: The Method," Springer Series in Reliability Engineering, in: The Monte Carlo Simulation Method for System Reliability and Risk Analysis, edition 127, chapter 0, pages 19-58, Springer.
    29. Baudrit, C. & Dubois, D., 2006. "Practical representations of incomplete probabilistic knowledge," Computational Statistics & Data Analysis, Elsevier, vol. 51(1), pages 86-108, November.
    30. Terje Aven, 2010. "On the Need for Restricting the Probabilistic Analysis in Risk Assessments to Variability," Risk Analysis, John Wiley & Sons, vol. 30(3), pages 354-360, March.
    31. Aven, Terje, 2016. "On the use of conservatism in risk assessments," Reliability Engineering and System Safety, Elsevier, vol. 146(C), pages 33-38.
    32. Helton, J.C. & Johnson, J.D. & Sallaberry, C.J. & Storlie, C.B., 2006. "Survey of sampling-based methods for uncertainty and sensitivity analysis," Reliability Engineering and System Safety, Elsevier, vol. 91(10), pages 1175-1209.
    33. Aven, Terje, 2010. "Some reflections on uncertainty analysis and management," Reliability Engineering and System Safety, Elsevier, vol. 95(3), pages 195-201.
    34. Durga Rao Karanki & Hari Shankar Kushwaha & Ajit Kumar Verma & Srividya Ajit, 2009. "Uncertainty Analysis Based on Probability Bounds (P‐Box) Approach in Probabilistic Safety Assessment," Risk Analysis, John Wiley & Sons, vol. 29(5), pages 662-675, May.
    35. Terje Aven, 2010. "Reply to Discussants on “The Need for Restricting the Probabilistic Analysis in Risk Assessments to Variability”," Risk Analysis, John Wiley & Sons, vol. 30(3), pages 381-384, March.
    36. H. Christopher Frey & David E. Burmaster, 1999. "Methods for Characterizing Variability and Uncertainty: Comparison of Bootstrap Simulation and Likelihood‐Based Approaches," Risk Analysis, John Wiley & Sons, vol. 19(1), pages 109-130, February.
    37. Enrico Zio, 2013. "System Reliability and Risk Analysis," Springer Series in Reliability Engineering, in: The Monte Carlo Simulation Method for System Reliability and Risk Analysis, edition 127, chapter 0, pages 7-17, Springer.
    38. Helton, J.C. & Hansen, C.W. & Sallaberry, C.J., 2014. "Conceptual structure and computational organization of the 2008 performance assessment for the proposed high-level radioactive waste repository at Yucca Mountain, Nevada," Reliability Engineering and System Safety, Elsevier, vol. 122(C), pages 223-248.
    39. Aven, T. & Steen, R., 2010. "The concept of ignorance in a risk assessment and risk management context," Reliability Engineering and System Safety, Elsevier, vol. 95(11), pages 1117-1122.
    40. Helton, Jon C. & Pilch, Martin & Sallaberry, Cédric J., 2014. "Probability of loss of assured safety in systems with multiple time-dependent failure modes: Representations with aleatory and epistemic uncertainty," Reliability Engineering and System Safety, Elsevier, vol. 124(C), pages 171-200.
    41. Limbourg, Philipp & de Rocquigny, Etienne, 2010. "Uncertainty analysis using evidence theory – confronting level-1 and level-2 approaches with data availability and computational constraints," Reliability Engineering and System Safety, Elsevier, vol. 95(5), pages 550-564.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bjørnsen, Kjartan & Selvik, Jon Tømmerås & Aven, Terje, 2019. "A semi-quantitative assessment process for improved use of the expected value of information measure in safety management," Reliability Engineering and System Safety, Elsevier, vol. 188(C), pages 494-502.
    2. Zio, E., 2018. "The future of risk assessment," Reliability Engineering and System Safety, Elsevier, vol. 177(C), pages 176-190.
    3. Guizhen Zhang & Vinh V. Thai & Adrian Wing‐Keung Law & Kum Fai Yuen & Hui Shan Loh & Qingji Zhou, 2020. "Quantitative Risk Assessment of Seafarers’ Nonfatal Injuries Due to Occupational Accidents Based on Bayesian Network Modeling," Risk Analysis, John Wiley & Sons, vol. 40(1), pages 8-23, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nicola Pedroni & Enrico Zio & Alberto Pasanisi & Mathieu Couplet, 2017. "A Critical Discussion and Practical Recommendations on Some Issues Relevant to the Nonprobabilistic Treatment of Uncertainty in Engineering Risk Assessment," Risk Analysis, John Wiley & Sons, vol. 37(7), pages 1315-1340, July.
    2. Edoardo Tosoni & Ahti Salo & Enrico Zio, 2018. "Scenario Analysis for the Safety Assessment of Nuclear Waste Repositories: A Critical Review," Risk Analysis, John Wiley & Sons, vol. 38(4), pages 755-776, April.
    3. Nicola Pedroni & Enrico Zio, 2013. "Uncertainty Analysis in Fault Tree Models with Dependent Basic Events," Risk Analysis, John Wiley & Sons, vol. 33(6), pages 1146-1173, June.
    4. Tosoni, E. & Salo, A. & Govaerts, J. & Zio, E., 2019. "Comprehensiveness of scenarios in the safety assessment of nuclear waste repositories," Reliability Engineering and System Safety, Elsevier, vol. 188(C), pages 561-573.
    5. Helton, Jon C. & Brooks, Dusty M. & Sallaberry, Cédric J., 2020. "Margins associated with loss of assured safety for systems with multiple weak links and strong links," Reliability Engineering and System Safety, Elsevier, vol. 195(C).
    6. Cadini, F. & Gioletta, A. & Zio, E., 2015. "Improved metamodel-based importance sampling for the performance assessment of radioactive waste repositories," Reliability Engineering and System Safety, Elsevier, vol. 134(C), pages 188-197.
    7. Roger Flage & Terje Aven & Enrico Zio & Piero Baraldi, 2014. "Concerns, Challenges, and Directions of Development for the Issue of Representing Uncertainty in Risk Assessment," Risk Analysis, John Wiley & Sons, vol. 34(7), pages 1196-1207, July.
    8. Salomon, Julian & Winnewisser, Niklas & Wei, Pengfei & Broggi, Matteo & Beer, Michael, 2021. "Efficient reliability analysis of complex systems in consideration of imprecision," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    9. Penttinen, Jussi-Pekka & Niemi, Arto & Gutleber, Johannes & Koskinen, Kari T. & Coatanéa, Eric & Laitinen, Jouko, 2019. "An open modelling approach for availability and reliability of systems," Reliability Engineering and System Safety, Elsevier, vol. 183(C), pages 387-399.
    10. Tu Duong Le Duy & Laurence Dieulle & Dominique Vasseur & Christophe Bérenguer & Mathieu Couplet, 2013. "An alternative comprehensive framework using belief functions for parameter and model uncertainty analysis in nuclear probabilistic risk assessment applications," Journal of Risk and Reliability, , vol. 227(5), pages 471-490, October.
    11. Aven, Terje & Zio, Enrico, 2011. "Some considerations on the treatment of uncertainties in risk assessment for practical decision making," Reliability Engineering and System Safety, Elsevier, vol. 96(1), pages 64-74.
    12. Chabridon, Vincent & Balesdent, Mathieu & Bourinet, Jean-Marc & Morio, Jérôme & Gayton, Nicolas, 2018. "Reliability-based sensitivity estimators of rare event probability in the presence of distribution parameter uncertainty," Reliability Engineering and System Safety, Elsevier, vol. 178(C), pages 164-178.
    13. Smith, Curtis L., 2020. "Representing external hazard initiating events using a Bayesian approach and a generalized extreme value model," Reliability Engineering and System Safety, Elsevier, vol. 193(C).
    14. Guowang Meng & Hongle Li & Bo Wu & Guangyang Liu & Huazheng Ye & Yiming Zuo, 2023. "Prediction of the Tunnel Collapse Probability Using SVR-Based Monte Carlo Simulation: A Case Study," Sustainability, MDPI, vol. 15(9), pages 1-21, April.
    15. Michael Saidani & Alissa Kendall & Bernard Yannou & Yann Leroy & François Cluzel, 2019. "Closing the loop on platinum from catalytic converters: Contributions from material flow analysis and circularity indicators," Post-Print hal-02094798, HAL.
    16. Michele Compare & Francesco Di Maio & Enrico Zio & Fausto Carlevaro & Sara Mattafirri, 2016. "Improving scheduled maintenance by missing data reconstruction: A double-loop Monte Carlo approach," Journal of Risk and Reliability, , vol. 230(5), pages 502-511, October.
    17. Chiacchio, Ferdinando & D’Urso, Diego & Famoso, Fabio & Brusca, Sebastian & Aizpurua, Jose Ignacio & Catterson, Victoria M., 2018. "On the use of dynamic reliability for an accurate modelling of renewable power plants," Energy, Elsevier, vol. 151(C), pages 605-621.
    18. Di Maio, Francesco & Pettorossi, Chiara & Zio, Enrico, 2023. "Entropy-driven Monte Carlo simulation method for approximating the survival signature of complex infrastructures," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    19. Terje Aven, 2012. "Foundational Issues in Risk Assessment and Risk Management," Risk Analysis, John Wiley & Sons, vol. 32(10), pages 1647-1656, October.
    20. Wang, Fan & Li, Heng, 2018. "System reliability under prescribed marginals and correlations: Are we correct about the effect of correlations?," Reliability Engineering and System Safety, Elsevier, vol. 173(C), pages 94-104.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hal:journl:hal-01652230. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: CCSD (email available below). General contact details of provider: https://hal.archives-ouvertes.fr/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.