IDEAS home Printed from https://ideas.repec.org/a/wly/riskan/v38y2018i11p2459-2477.html
   My bibliography  Save this article

Which Parameters Are Important? Differential Importance Under Uncertainty

Author

Listed:
  • Isadora Antoniano‐Villalobos
  • Emanuele Borgonovo
  • Sumeda Siriwardena

Abstract

In probabilistic risk assessment, attention is often focused on the expected value of a risk metric. The sensitivity of this expectation to changes in the parameters of the distribution characterizing uncertainty in the inputs becomes of interest. Approaches based on differentiation encounter limitations when (i) distributional parameters are expressed in different units or (ii) the analyst wishes to transfer sensitivity insights from individual parameters to parameter groups, when alternating between different levels of a probabilistic safety assessment model. Moreover, the analyst may also wish to examine the effect of assuming independence among inputs. This work proposes an approach based on the differential importance measure, which solves these issues. Estimation aspects are discussed in detail, in particular the problem of obtaining all sensitivity measures from a single Monte Carlo sample, thus avoiding potentially costly model runs. The approach is illustrated through an analytical example, highlighting how it can be used to assess the impact of removing the independence assumption. An application to the probabilistic risk assessment model of the Advanced Test Reactor large loss of coolant accident sequence concludes the work.

Suggested Citation

  • Isadora Antoniano‐Villalobos & Emanuele Borgonovo & Sumeda Siriwardena, 2018. "Which Parameters Are Important? Differential Importance Under Uncertainty," Risk Analysis, John Wiley & Sons, vol. 38(11), pages 2459-2477, November.
  • Handle: RePEc:wly:riskan:v:38:y:2018:i:11:p:2459-2477
    DOI: 10.1111/risa.13125
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/risa.13125
    Download Restriction: no

    File URL: https://libkey.io/10.1111/risa.13125?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Paul Glasserman & Zongjian Liu, 2010. "Sensitivity Estimates from Characteristic Functions," Operations Research, INFORMS, vol. 58(6), pages 1611-1623, December.
    2. Reuven Y. Rubinstein, 1989. "Sensitivity Analysis and Performance Extrapolation for Computer Simulation Models," Operations Research, INFORMS, vol. 37(1), pages 72-81, February.
    3. Storlie, Curtis B. & Swiler, Laura P. & Helton, Jon C. & Sallaberry, Cedric J., 2009. "Implementation and evaluation of nonparametric regression procedures for sensitivity analysis of computationally demanding models," Reliability Engineering and System Safety, Elsevier, vol. 94(11), pages 1735-1763.
    4. Emanuele Borgonovo & Gordon B. Hazen & Elmar Plischke, 2016. "A Common Rationale for Global Sensitivity Measures and Their Estimation," Risk Analysis, John Wiley & Sons, vol. 36(10), pages 1871-1895, October.
    5. George E. Apostolakis, 2004. "How Useful Is Quantitative Risk Assessment?," Risk Analysis, John Wiley & Sons, vol. 24(3), pages 515-520, June.
    6. Stanley Kaplan & B. John Garrick, 1981. "On The Quantitative Definition of Risk," Risk Analysis, John Wiley & Sons, vol. 1(1), pages 11-27, March.
    7. H. Christopher Frey & Sumeet R. Patil, 2002. "Identification and Review of Sensitivity Analysis Methods," Risk Analysis, John Wiley & Sons, vol. 22(3), pages 553-578, June.
    8. Roustant, O. & Fruth, J. & Iooss, B. & Kuhnt, S., 2014. "Crossed-derivative based sensitivity measures for interaction screening," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 105(C), pages 105-118.
    9. Andreas Tsanakas & Pietro Millossovich, 2016. "Sensitivity Analysis Using Risk Measures," Risk Analysis, John Wiley & Sons, vol. 36(1), pages 30-48, January.
    10. D. Warner North, 2010. "Probability Theory and Consistent Reasoning," Risk Analysis, John Wiley & Sons, vol. 30(3), pages 377-380, March.
    11. E. E. Koks & M. Bočkarjova & H. de Moel & J. C. J. H. Aerts, 2015. "Integrated Direct and Indirect Flood Risk Modeling: Development and Sensitivity Analysis," Risk Analysis, John Wiley & Sons, vol. 35(5), pages 882-900, May.
    12. Roger Flage & Piero Baraldi & Enrico Zio & Terje Aven, 2013. "Probability and Possibility‐Based Representations of Uncertainty in Fault Tree Analysis," Risk Analysis, John Wiley & Sons, vol. 33(1), pages 121-133, January.
    13. Radboud J. Duintjer Tebbens & Mark A. Pallansch & Olen M. Kew & Roland W. Sutter & R. Bruce Aylward & Margaret Watkins & Howard Gary & James Alexander & Hamid Jafari & Stephen L. Cochi & Kimberly M. T, 2008. "Uncertainty and Sensitivity Analyses of a Decision Analytic Model for Posteradication Polio Risk Management," Risk Analysis, John Wiley & Sons, vol. 28(4), pages 855-876, August.
    14. Lamboni, M. & Iooss, B. & Popelin, A.-L. & Gamboa, F., 2013. "Derivative-based global sensitivity measures: General links with Sobol’ indices and numerical tests," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 87(C), pages 45-54.
    15. Ward Whitt, 2006. "Sensitivity of Performance in the Erlang-A Queueing Model to Changes in the Model Parameters," Operations Research, INFORMS, vol. 54(2), pages 247-260, April.
    16. Ted G. Eschenbach, 1992. "Spiderplots versus Tornado Diagrams for Sensitivity Analysis," Interfaces, INFORMS, vol. 22(6), pages 40-46, December.
    17. Saltelli A. & Tarantola S., 2002. "On the Relative Importance of Input Factors in Mathematical Models: Safety Assessment for Nuclear Waste Disposal," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 702-709, September.
    18. Borgonovo, Emanuele & Plischke, Elmar, 2016. "Sensitivity analysis: A review of recent advances," European Journal of Operational Research, Elsevier, vol. 248(3), pages 869-887.
    19. Terje Aven, 2012. "Foundational Issues in Risk Assessment and Risk Management," Risk Analysis, John Wiley & Sons, vol. 32(10), pages 1647-1656, October.
    20. Terje Aven, 2010. "On the Need for Restricting the Probabilistic Analysis in Risk Assessments to Variability," Risk Analysis, John Wiley & Sons, vol. 30(3), pages 354-360, March.
    21. Ronald L. Iman & Jon C. Helton, 1988. "An Investigation of Uncertainty and Sensitivity Analysis Techniques for Computer Models," Risk Analysis, John Wiley & Sons, vol. 8(1), pages 71-90, March.
    22. Guangwu Liu & Liu Jeff Hong, 2009. "Kernel estimation of quantile sensitivities," Naval Research Logistics (NRL), John Wiley & Sons, vol. 56(6), pages 511-525, September.
    23. Michael C. Fu & L. Jeff Hong & Jian-Qiang Hu, 2009. "Conditional Monte Carlo Estimation of Quantile Sensitivities," Management Science, INFORMS, vol. 55(12), pages 2019-2027, December.
    24. Barry Anderson & Emanuele Borgonovo & Marzio Galeotti & Roberto Roson, 2014. "Uncertainty in Climate Change Modeling: Can Global Sensitivity Analysis Be of Help?," Risk Analysis, John Wiley & Sons, vol. 34(2), pages 271-293, February.
    25. Ronald A. Howard, 1988. "Decision Analysis: Practice and Promise," Management Science, INFORMS, vol. 34(6), pages 679-695, June.
    26. Jeremy E. Oakley & Anthony O'Hagan, 2004. "Probabilistic sensitivity analysis of complex models: a Bayesian approach," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 66(3), pages 751-769, August.
    27. Emanuele Borgonovo, 2006. "Measuring Uncertainty Importance: Investigation and Comparison of Alternative Approaches," Risk Analysis, John Wiley & Sons, vol. 26(5), pages 1349-1361, October.
    28. Stan Kaplan & Yacov Y. Haimes & B. John Garrick, 2001. "Fitting Hierarchical Holographic Modeling into the Theory of Scenario Structuring and a Resulting Refinement to the Quantitative Definition of Risk," Risk Analysis, John Wiley & Sons, vol. 21(5), pages 807-807, October.
    29. J. C. Helton & F. J. Davis, 2002. "Illustration of Sampling‐Based Methods for Uncertainty and Sensitivity Analysis," Risk Analysis, John Wiley & Sons, vol. 22(3), pages 591-622, June.
    30. Ronald L. Iman & Stephen C. Hora, 1990. "A Robust Measure of Uncertainty Importance for Use in Fault Tree System Analysis," Risk Analysis, John Wiley & Sons, vol. 10(3), pages 401-406, September.
    31. Philippe Artzner & Freddy Delbaen & Jean‐Marc Eber & David Heath, 1999. "Coherent Measures of Risk," Mathematical Finance, Wiley Blackwell, vol. 9(3), pages 203-228, July.
    32. L. Jeff Hong, 2009. "Estimating Quantile Sensitivities," Operations Research, INFORMS, vol. 57(1), pages 118-130, February.
    33. Emanuele Borgonovo, 2008. "Sensitivity Analysis of Model Output with Input Constraints: A Generalized Rationale for Local Methods," Risk Analysis, John Wiley & Sons, vol. 28(3), pages 667-680, June.
    34. Li, Jinghui & Mosleh, Ali & Kang, Rui, 2011. "Likelihood ratio gradient estimation for dynamic reliability applications," Reliability Engineering and System Safety, Elsevier, vol. 96(12), pages 1667-1679.
    35. Anne E. Smith & Will Gans, 2015. "Enhancing the Characterization of Epistemic Uncertainties in PM2.5 Risk Analyses," Risk Analysis, John Wiley & Sons, vol. 35(3), pages 361-378, March.
    36. Ronald L. Iman & Mark E. Johnson & Charles C. Watson, 2005. "Sensitivity Analysis for Computer Model Projections of Hurricane Losses," Risk Analysis, John Wiley & Sons, vol. 25(5), pages 1277-1297, October.
    37. Nicola Pedroni & Enrico Zio & Alberto Pasanisi & Mathieu Couplet, 2017. "A Critical Discussion and Practical Recommendations on Some Issues Relevant to the Nonprobabilistic Treatment of Uncertainty in Engineering Risk Assessment," Risk Analysis, John Wiley & Sons, vol. 37(7), pages 1315-1340, July.
    38. D. Warner North, 2011. "Uncertainties, Precaution, and Science: Focus on the State of Knowledge and How It May Change," Risk Analysis, John Wiley & Sons, vol. 31(10), pages 1526-1529, October.
    39. Aven, Terje, 2016. "Risk assessment and risk management: Review of recent advances on their foundation," European Journal of Operational Research, Elsevier, vol. 253(1), pages 1-13.
    40. Terje Aven & Enrico Zio, 2014. "Foundational Issues in Risk Assessment and Risk Management," Risk Analysis, John Wiley & Sons, vol. 34(7), pages 1164-1172, July.
    41. Sobol’, I.M. & Kucherenko, S., 2009. "Derivative based global sensitivity measures and their link with global sensitivity indices," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 79(10), pages 3009-3017.
    42. Andrea Saltelli, 2002. "Sensitivity Analysis for Importance Assessment," Risk Analysis, John Wiley & Sons, vol. 22(3), pages 579-590, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Silvana M. Pesenti & Pietro Millossovich & Andreas Tsanakas, 2023. "Differential Sensitivity in Discontinuous Models," Papers 2310.06151, arXiv.org.
    2. Rabitti, Giovanni & Borgonovo, Emanuele, 2020. "Is mortality or interest rate the most important risk in annuity models? A comparison of sensitivity analysis methods," Insurance: Mathematics and Economics, Elsevier, vol. 95(C), pages 48-58.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. S. Cucurachi & E. Borgonovo & R. Heijungs, 2016. "A Protocol for the Global Sensitivity Analysis of Impact Assessment Models in Life Cycle Assessment," Risk Analysis, John Wiley & Sons, vol. 36(2), pages 357-377, February.
    2. Emanuele Borgonovo & Gordon B. Hazen & Elmar Plischke, 2016. "A Common Rationale for Global Sensitivity Measures and Their Estimation," Risk Analysis, John Wiley & Sons, vol. 36(10), pages 1871-1895, October.
    3. Elmar Plischke & Emanuele Borgonovo, 2020. "Fighting the Curse of Sparsity: Probabilistic Sensitivity Measures From Cumulative Distribution Functions," Risk Analysis, John Wiley & Sons, vol. 40(12), pages 2639-2660, December.
    4. Pesenti, Silvana M. & Millossovich, Pietro & Tsanakas, Andreas, 2019. "Reverse sensitivity testing: What does it take to break the model?," European Journal of Operational Research, Elsevier, vol. 274(2), pages 654-670.
    5. Andreas Tsanakas & Pietro Millossovich, 2016. "Sensitivity Analysis Using Risk Measures," Risk Analysis, John Wiley & Sons, vol. 36(1), pages 30-48, January.
    6. Emanuele Borgonovo & William Castaings & Stefano Tarantola, 2011. "Moment Independent Importance Measures: New Results and Analytical Test Cases," Risk Analysis, John Wiley & Sons, vol. 31(3), pages 404-428, March.
    7. Sinan Xiao & Zhenzhou Lu & Pan Wang, 2018. "Multivariate Global Sensitivity Analysis Based on Distance Components Decomposition," Risk Analysis, John Wiley & Sons, vol. 38(12), pages 2703-2721, December.
    8. Barry Anderson & Emanuele Borgonovo & Marzio Galeotti & Roberto Roson, 2014. "Uncertainty in Climate Change Modeling: Can Global Sensitivity Analysis Be of Help?," Risk Analysis, John Wiley & Sons, vol. 34(2), pages 271-293, February.
    9. Makam, Vaishno Devi & Millossovich, Pietro & Tsanakas, Andreas, 2021. "Sensitivity analysis with χ2-divergences," Insurance: Mathematics and Economics, Elsevier, vol. 100(C), pages 372-383.
    10. Tatsuya Sakurahara & Seyed Reihani & Ernie Kee & Zahra Mohaghegh, 2020. "Global importance measure methodology for integrated probabilistic risk assessment," Journal of Risk and Reliability, , vol. 234(2), pages 377-396, April.
    11. Emanuele Borgonovo, 2008. "Sensitivity Analysis of Model Output with Input Constraints: A Generalized Rationale for Local Methods," Risk Analysis, John Wiley & Sons, vol. 28(3), pages 667-680, June.
    12. Borgonovo, Emanuele & Hazen, Gordon B. & Jose, Victor Richmond R. & Plischke, Elmar, 2021. "Probabilistic sensitivity measures as information value," European Journal of Operational Research, Elsevier, vol. 289(2), pages 595-610.
    13. Lu, Xuefei & Borgonovo, Emanuele, 2023. "Global sensitivity analysis in epidemiological modeling," European Journal of Operational Research, Elsevier, vol. 304(1), pages 9-24.
    14. Zio, E., 2018. "The future of risk assessment," Reliability Engineering and System Safety, Elsevier, vol. 177(C), pages 176-190.
    15. Emanuele Borgonovo, 2006. "Measuring Uncertainty Importance: Investigation and Comparison of Alternative Approaches," Risk Analysis, John Wiley & Sons, vol. 26(5), pages 1349-1361, October.
    16. Katja Schilling & Daniel Bauer & Marcus C. Christiansen & Alexander Kling, 2020. "Decomposing Dynamic Risks into Risk Components," Management Science, INFORMS, vol. 66(12), pages 5738-5756, December.
    17. Pengfei Wei & Zhenzhou Lu & Jingwen Song, 2014. "Moment‐Independent Sensitivity Analysis Using Copula," Risk Analysis, John Wiley & Sons, vol. 34(2), pages 210-222, February.
    18. Terje Aven, 2020. "Risk Science Contributions: Three Illustrating Examples," Risk Analysis, John Wiley & Sons, vol. 40(10), pages 1889-1899, October.
    19. Emanuele Borgonovo & Alessandra Cillo, 2017. "Deciding with Thresholds: Importance Measures and Value of Information," Risk Analysis, John Wiley & Sons, vol. 37(10), pages 1828-1848, October.
    20. L. Jeff Hong & Sandeep Juneja & Jun Luo, 2014. "Estimating Sensitivities of Portfolio Credit Risk Using Monte Carlo," INFORMS Journal on Computing, INFORMS, vol. 26(4), pages 848-865, November.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:riskan:v:38:y:2018:i:11:p:2459-2477. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://doi.org/10.1111/(ISSN)1539-6924 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.