IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v96y2011i9p1014-1033.html
   My bibliography  Save this article

Quantification of margins and uncertainties: Example analyses from reactor safety and radioactive waste disposal involving the separation of aleatory and epistemic uncertainty

Author

Listed:
  • Helton, Jon C.
  • Johnson, Jay D.
  • Sallaberry, Cédric J.

Abstract

In 2001, the National Nuclear Security Administration (NNSA) of the U.S. Department of Energy (DOE) in conjunction with the national security laboratories (i.e., Los Alamos National Laboratory, Lawrence Livermore National Laboratory, and Sandia National Laboratories) initiated development of a process designated quantification of margins and uncertainties (QMU) for the use of risk assessment methodologies in the certification of the reliability and safety of the nation's nuclear weapons stockpile. A previous presentation, “Quantification of Margins and Uncertainties: Conceptual and Computational Basis,†describes the basic ideas that underlie QMU and illustrates these ideas with two notional examples. The basic ideas and challenges that underlie NNSA's mandate for QMU are present, and have been successfully addressed, in a number of past analyses for complex systems. To provide perspective on the implementation of a requirement for QMU in the analysis of a complex system, three past analyses are presented as examples: (i) the probabilistic risk assessment carried out for the Surry Nuclear Power Station as part of the U.S. Nuclear Regulatory Commission's (NRC's) reassessment of the risk from commercial nuclear power in the United States (i.e., the NUREG-1150 study), (ii) the performance assessment for the Waste Isolation Pilot Plant carried out by the DOE in support of a successful compliance certification application to the U.S. Environmental Agency, and (iii) the performance assessment for the proposed high-level radioactive waste repository at Yucca Mountain, Nevada, carried out by the DOE in support of a license application to the NRC. Each of the preceding analyses involved a detailed treatment of uncertainty and produced results used to establish compliance with specific numerical requirements on the performance of the system under study. As a result, these studies illustrate the determination of both margins and the uncertainty in margins in real analyses.

Suggested Citation

  • Helton, Jon C. & Johnson, Jay D. & Sallaberry, Cédric J., 2011. "Quantification of margins and uncertainties: Example analyses from reactor safety and radioactive waste disposal involving the separation of aleatory and epistemic uncertainty," Reliability Engineering and System Safety, Elsevier, vol. 96(9), pages 1014-1033.
  • Handle: RePEc:eee:reensy:v:96:y:2011:i:9:p:1014-1033
    DOI: 10.1016/j.ress.2011.02.012
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832011000573
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2011.02.012?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. J. C. Helton & D. R. Anderson & M. G. Marietta & R. P. Rechard, 1997. "Performance Assessment for the Waste Isolation Pilot Plant: From Regulation to Calculation for 40 CFR 191.13," Operations Research, INFORMS, vol. 45(2), pages 157-177, April.
    2. Storlie, Curtis B. & Helton, Jon C., 2008. "Multiple predictor smoothing methods for sensitivity analysis: Description of techniques," Reliability Engineering and System Safety, Elsevier, vol. 93(1), pages 28-54.
    3. Storlie, Curtis B. & Helton, Jon C., 2008. "Multiple predictor smoothing methods for sensitivity analysis: Example results," Reliability Engineering and System Safety, Elsevier, vol. 93(1), pages 55-77.
    4. J. Michael Griesmeyer & David Okrent, 1981. "Risk Management and Decision Rules for Light Water Reactors," Risk Analysis, John Wiley & Sons, vol. 1(2), pages 121-136, June.
    5. Helton, Jon C. & Sallaberry, Cedric J., 2009. "Conceptual basis for the definition and calculation of expected dose in performance assessments for the proposed high-level radioactive waste repository at Yucca Mountain, Nevada," Reliability Engineering and System Safety, Elsevier, vol. 94(3), pages 677-698.
    6. Storlie, Curtis B. & Swiler, Laura P. & Helton, Jon C. & Sallaberry, Cedric J., 2009. "Implementation and evaluation of nonparametric regression procedures for sensitivity analysis of computationally demanding models," Reliability Engineering and System Safety, Elsevier, vol. 94(11), pages 1735-1763.
    7. Daniel G. Brooks, 1990. "Using Related Samples in Assessing Conformance to Safety Goals: A Nuclear Reactor Safety Application," Risk Analysis, John Wiley & Sons, vol. 10(2), pages 229-237, June.
    8. Helton, J.C. & Johnson, J.D. & Sallaberry, C.J. & Storlie, C.B., 2006. "Survey of sampling-based methods for uncertainty and sensitivity analysis," Reliability Engineering and System Safety, Elsevier, vol. 91(10), pages 1175-1209.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ali, Wahid & Duong, Pham Luu Trung & Khan, Mohd Shariq & Getu, Mesfin & Lee, Moonyong, 2018. "Measuring the reliability of a natural gas refrigeration plant: Uncertainty propagation and quantification with polynomial chaos expansion based sensitivity analysis," Reliability Engineering and System Safety, Elsevier, vol. 172(C), pages 103-117.
    2. Di Maio, Francesco & Bandini, Alessandro & Zio, Enrico & Alberola, Sofia Carlos & Sanchez-Saez, Francisco & Martorell, Sebastián, 2016. "Bootstrapped-ensemble-based Sensitivity Analysis of a trace thermal-hydraulic model based on a limited number of PWR large break loca simulations," Reliability Engineering and System Safety, Elsevier, vol. 153(C), pages 122-134.
    3. Helton, Jon C. & Pilch, Martin & Sallaberry, Cédric J., 2014. "Probability of loss of assured safety in systems with multiple time-dependent failure modes: Representations with aleatory and epistemic uncertainty," Reliability Engineering and System Safety, Elsevier, vol. 124(C), pages 171-200.
    4. Helton, Jon C. & Brooks, Dusty M. & Sallaberry, Cédric J., 2020. "Property values associated with the failure of individual links in a system with multiple weak and strong links," Reliability Engineering and System Safety, Elsevier, vol. 195(C).
    5. Helton, Jon C. & Brooks, Dusty M. & Sallaberry, Cédric J., 2022. "Probability of Loss of Assured Safety in Systems with Multiple Time-Dependent Failure Modes: Incorporation of Delayed Link Failure in the Presence of Aleatory Uncertainty," Reliability Engineering and System Safety, Elsevier, vol. 223(C).
    6. Helton, Jon C. & Johnson, Jay D., 2011. "Quantification of margins and uncertainties: Alternative representations of epistemic uncertainty," Reliability Engineering and System Safety, Elsevier, vol. 96(9), pages 1034-1052.
    7. Pasanisi, Alberto & Keller, Merlin & Parent, Eric, 2012. "Estimation of a quantity of interest in uncertainty analysis: Some help from Bayesian decision theory," Reliability Engineering and System Safety, Elsevier, vol. 100(C), pages 93-101.
    8. Tang, Zhang-Chun & Zuo, Ming J. & Xiao, Ningcong, 2016. "An efficient method for evaluating the effect of input parameters on the integrity of safety systems," Reliability Engineering and System Safety, Elsevier, vol. 145(C), pages 111-123.
    9. Sarat Sivaprasad & Cameron A. MacKenzie, 2018. "The Hurwicz Decision Rule’s Relationship to Decision Making with the Triangle and Beta Distributions and Exponential Utility," Decision Analysis, INFORMS, vol. 15(3), pages 139-153, September.
    10. Cao, Jiaokun & Du, Farong & Ding, Shuiting, 2013. "Global sensitivity analysis for dynamic systems with stochastic input processes," Reliability Engineering and System Safety, Elsevier, vol. 118(C), pages 106-117.
    11. Helton, Jon C. & Brooks, Dusty M. & Sallaberry, Cédric J., 2020. "Margins associated with loss of assured safety for systems with multiple weak links and strong links," Reliability Engineering and System Safety, Elsevier, vol. 195(C).
    12. Auffray, Yves & Barbillon, Pierre & Marin, Jean-Michel, 2014. "Bounding rare event probabilities in computer experiments," Computational Statistics & Data Analysis, Elsevier, vol. 80(C), pages 153-166.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Helton, Jon C. & Hansen, Clifford W. & Sallaberry, Cédric J., 2012. "Uncertainty and sensitivity analysis in performance assessment for the proposed high-level radioactive waste repository at Yucca Mountain, Nevada," Reliability Engineering and System Safety, Elsevier, vol. 107(C), pages 44-63.
    2. Blatman, Géraud & Sudret, Bruno, 2010. "Efficient computation of global sensitivity indices using sparse polynomial chaos expansions," Reliability Engineering and System Safety, Elsevier, vol. 95(11), pages 1216-1229.
    3. Hansen, C.W. & Behie, G.A. & Bier, A. & Brooks, K.M. & Chen, Y. & Helton, J.C. & Hommel, S.P. & Lee, K.P. & Lester, B. & Mattie, P.D. & Mehta, S. & Miller, S.P. & Sallaberry, C.J. & Sevougian, S.D. & , 2014. "Uncertainty and sensitivity analysis for the nominal scenario class in the 2008 performance assessment for the proposed high-level radioactive waste repository at Yucca Mountain, Nevada," Reliability Engineering and System Safety, Elsevier, vol. 122(C), pages 272-296.
    4. Wei, Pengfei & Lu, Zhenzhou & Song, Jingwen, 2015. "Variable importance analysis: A comprehensive review," Reliability Engineering and System Safety, Elsevier, vol. 142(C), pages 399-432.
    5. Helton, Jon C. & Brooks, Dusty M. & Sallaberry, Cédric J., 2020. "Margins associated with loss of assured safety for systems with multiple weak links and strong links," Reliability Engineering and System Safety, Elsevier, vol. 195(C).
    6. Di Maio, Francesco & Bandini, Alessandro & Zio, Enrico & Alberola, Sofia Carlos & Sanchez-Saez, Francisco & Martorell, Sebastián, 2016. "Bootstrapped-ensemble-based Sensitivity Analysis of a trace thermal-hydraulic model based on a limited number of PWR large break loca simulations," Reliability Engineering and System Safety, Elsevier, vol. 153(C), pages 122-134.
    7. Helton, Jon C. & Pilch, Martin & Sallaberry, Cédric J., 2014. "Probability of loss of assured safety in systems with multiple time-dependent failure modes: Representations with aleatory and epistemic uncertainty," Reliability Engineering and System Safety, Elsevier, vol. 124(C), pages 171-200.
    8. Helton, Jon C., 2011. "Quantification of margins and uncertainties: Conceptual and computational basis," Reliability Engineering and System Safety, Elsevier, vol. 96(9), pages 976-1013.
    9. Storlie, Curtis B. & Reich, Brian J. & Helton, Jon C. & Swiler, Laura P. & Sallaberry, Cedric J., 2013. "Analysis of computationally demanding models with continuous and categorical inputs," Reliability Engineering and System Safety, Elsevier, vol. 113(C), pages 30-41.
    10. Tatsuya Sakurahara & Seyed Reihani & Ernie Kee & Zahra Mohaghegh, 2020. "Global importance measure methodology for integrated probabilistic risk assessment," Journal of Risk and Reliability, , vol. 234(2), pages 377-396, April.
    11. Martorell, S. & Villamizar, M. & Martón, I. & Villanueva, J.F. & Carlos, S. & Sánchez, A.I., 2014. "Evaluation of risk impact of changes to surveillance requirements addressing model and parameter uncertainties," Reliability Engineering and System Safety, Elsevier, vol. 126(C), pages 153-165.
    12. Tang, Zhang-Chun & Zuo, Ming J. & Xiao, Ningcong, 2016. "An efficient method for evaluating the effect of input parameters on the integrity of safety systems," Reliability Engineering and System Safety, Elsevier, vol. 145(C), pages 111-123.
    13. Touzani, Samir & Busby, Daniel, 2013. "Smoothing spline analysis of variance approach for global sensitivity analysis of computer codes," Reliability Engineering and System Safety, Elsevier, vol. 112(C), pages 67-81.
    14. Hu, Zhen & Mahadevan, Sankaran, 2019. "Probability models for data-Driven global sensitivity analysis," Reliability Engineering and System Safety, Elsevier, vol. 187(C), pages 40-57.
    15. Zhai, Qingqing & Yang, Jun & Xie, Min & Zhao, Yu, 2014. "Generalized moment-independent importance measures based on Minkowski distance," European Journal of Operational Research, Elsevier, vol. 239(2), pages 449-455.
    16. Storlie, Curtis B. & Swiler, Laura P. & Helton, Jon C. & Sallaberry, Cedric J., 2009. "Implementation and evaluation of nonparametric regression procedures for sensitivity analysis of computationally demanding models," Reliability Engineering and System Safety, Elsevier, vol. 94(11), pages 1735-1763.
    17. Buzzard, Gregery T., 2012. "Global sensitivity analysis using sparse grid interpolation and polynomial chaos," Reliability Engineering and System Safety, Elsevier, vol. 107(C), pages 82-89.
    18. Pilch, Martin & Trucano, Timothy G. & Helton, Jon C., 2011. "Ideas underlying the Quantification of Margins and Uncertainties," Reliability Engineering and System Safety, Elsevier, vol. 96(9), pages 965-975.
    19. Tian, Wei & Song, Jitian & Li, Zhanyong & de Wilde, Pieter, 2014. "Bootstrap techniques for sensitivity analysis and model selection in building thermal performance analysis," Applied Energy, Elsevier, vol. 135(C), pages 320-328.
    20. Zio, E. & Pedroni, N., 2010. "An optimized Line Sampling method for the estimation of the failure probability of nuclear passive systems," Reliability Engineering and System Safety, Elsevier, vol. 95(12), pages 1300-1313.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:96:y:2011:i:9:p:1014-1033. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.