IDEAS home Printed from https://ideas.repec.org/a/wly/riskan/v26y2006i5p1349-1361.html
   My bibliography  Save this article

Measuring Uncertainty Importance: Investigation and Comparison of Alternative Approaches

Author

Listed:
  • Emanuele Borgonovo

Abstract

Uncertainty importance measures are quantitative tools aiming at identifying the contribution of uncertain inputs to output uncertainty. Their application ranges from food safety (Frey & Patil (2002)) to hurricane losses (Iman et al. (2005a, 2005b)). Results and indications an analyst derives depend on the method selected for the study. In this work, we investigate the assumptions at the basis of various indicator families to discuss the information they convey to the analyst/decisionmaker. We start with nonparametric techniques, and then present variance‐based methods. By means of an example we show that output variance does not always reflect a decisionmaker state of knowledge of the inputs. We then examine the use of moment‐independent approaches to global sensitivity analysis, i.e., techniques that look at the entire output distribution without a specific reference to its moments. Numerical results demonstrate that both moment‐independent and variance‐based indicators agree in identifying noninfluential parameters. However, differences in the ranking of the most relevant factors show that inputs that influence variance the most are not necessarily the ones that influence the output uncertainty distribution the most.

Suggested Citation

  • Emanuele Borgonovo, 2006. "Measuring Uncertainty Importance: Investigation and Comparison of Alternative Approaches," Risk Analysis, John Wiley & Sons, vol. 26(5), pages 1349-1361, October.
  • Handle: RePEc:wly:riskan:v:26:y:2006:i:5:p:1349-1361
    DOI: 10.1111/j.1539-6924.2006.00806.x
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/j.1539-6924.2006.00806.x
    Download Restriction: no

    File URL: https://libkey.io/10.1111/j.1539-6924.2006.00806.x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Ronald L. Iman & Mark E. Johnson & Charles C. Watson, 2005. "Uncertainty Analysis for Computer Model Projections of Hurricane Losses," Risk Analysis, John Wiley & Sons, vol. 25(5), pages 1299-1312, October.
    2. Ronald L. Iman, 1987. "A Matrix‐Based Approach to Uncertainty and Sensitivity Analysis for Fault Trees," Risk Analysis, John Wiley & Sons, vol. 7(1), pages 21-33, March.
    3. H. Christopher Frey & Sumeet R. Patil, 2002. "Identification and Review of Sensitivity Analysis Methods," Risk Analysis, John Wiley & Sons, vol. 22(3), pages 553-578, June.
    4. Saltelli A. & Tarantola S., 2002. "On the Relative Importance of Input Factors in Mathematical Models: Safety Assessment for Nuclear Waste Disposal," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 702-709, September.
    5. Jeremy E. Oakley & Anthony O'Hagan, 2004. "Probabilistic sensitivity analysis of complex models: a Bayesian approach," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 66(3), pages 751-769, August.
    6. Ronald L. Iman & Stephen C. Hora, 1990. "A Robust Measure of Uncertainty Importance for Use in Fault Tree System Analysis," Risk Analysis, John Wiley & Sons, vol. 10(3), pages 401-406, September.
    7. Sumeet R. Patil & H. Christopher Frey, 2004. "Comparison of Sensitivity Analysis Methods Based on Applications to a Food Safety Risk Assessment Model," Risk Analysis, John Wiley & Sons, vol. 24(3), pages 573-585, June.
    8. Ronald L. Iman & Mark E. Johnson & Charles C. Watson, 2005. "Sensitivity Analysis for Computer Model Projections of Hurricane Losses," Risk Analysis, John Wiley & Sons, vol. 25(5), pages 1277-1297, October.
    9. Andrea Saltelli, 2002. "Sensitivity Analysis for Importance Assessment," Risk Analysis, John Wiley & Sons, vol. 22(3), pages 579-590, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. S. Cucurachi & E. Borgonovo & R. Heijungs, 2016. "A Protocol for the Global Sensitivity Analysis of Impact Assessment Models in Life Cycle Assessment," Risk Analysis, John Wiley & Sons, vol. 36(2), pages 357-377, February.
    2. Emanuele Borgonovo & Gordon B. Hazen & Elmar Plischke, 2016. "A Common Rationale for Global Sensitivity Measures and Their Estimation," Risk Analysis, John Wiley & Sons, vol. 36(10), pages 1871-1895, October.
    3. Emanuele Borgonovo & William Castaings & Stefano Tarantola, 2011. "Moment Independent Importance Measures: New Results and Analytical Test Cases," Risk Analysis, John Wiley & Sons, vol. 31(3), pages 404-428, March.
    4. Sinan Xiao & Zhenzhou Lu & Pan Wang, 2018. "Multivariate Global Sensitivity Analysis Based on Distance Components Decomposition," Risk Analysis, John Wiley & Sons, vol. 38(12), pages 2703-2721, December.
    5. Barry Anderson & Emanuele Borgonovo & Marzio Galeotti & Roberto Roson, 2014. "Uncertainty in Climate Change Modeling: Can Global Sensitivity Analysis Be of Help?," Risk Analysis, John Wiley & Sons, vol. 34(2), pages 271-293, February.
    6. Emanuele Borgonovo, 2008. "Sensitivity Analysis of Model Output with Input Constraints: A Generalized Rationale for Local Methods," Risk Analysis, John Wiley & Sons, vol. 28(3), pages 667-680, June.
    7. Isadora Antoniano‐Villalobos & Emanuele Borgonovo & Sumeda Siriwardena, 2018. "Which Parameters Are Important? Differential Importance Under Uncertainty," Risk Analysis, John Wiley & Sons, vol. 38(11), pages 2459-2477, November.
    8. Elmar Plischke & Emanuele Borgonovo, 2020. "Fighting the Curse of Sparsity: Probabilistic Sensitivity Measures From Cumulative Distribution Functions," Risk Analysis, John Wiley & Sons, vol. 40(12), pages 2639-2660, December.
    9. Tatsuya Sakurahara & Seyed Reihani & Ernie Kee & Zahra Mohaghegh, 2020. "Global importance measure methodology for integrated probabilistic risk assessment," Journal of Risk and Reliability, , vol. 234(2), pages 377-396, April.
    10. Xin Xu & Zhenzhou Lu & Xiaopeng Luo, 2014. "A Stable Approach Based on Asymptotic Space Integration for Moment‐Independent Uncertainty Importance Measure," Risk Analysis, John Wiley & Sons, vol. 34(2), pages 235-251, February.
    11. C. L. Smith & E. Borgonovo, 2007. "Decision Making During Nuclear Power Plant Incidents—A New Approach to the Evaluation of Precursor Events," Risk Analysis, John Wiley & Sons, vol. 27(4), pages 1027-1042, August.
    12. Pengfei Wei & Zhenzhou Lu & Jingwen Song, 2014. "Moment‐Independent Sensitivity Analysis Using Copula," Risk Analysis, John Wiley & Sons, vol. 34(2), pages 210-222, February.
    13. Borgonovo, E., 2007. "A new uncertainty importance measure," Reliability Engineering and System Safety, Elsevier, vol. 92(6), pages 771-784.
    14. Emanuele Borgonovo, 2008. "Epistemic Uncertainty in the Ranking and Categorization of Probabilistic Safety Assessment Model Elements: Issues and Findings," Risk Analysis, John Wiley & Sons, vol. 28(4), pages 983-1001, August.
    15. Emanuele Borgonovo, 2010. "A Methodology for Determining Interactions in Probabilistic Safety Assessment Models by Varying One Parameter at a Time," Risk Analysis, John Wiley & Sons, vol. 30(3), pages 385-399, March.
    16. Mirko Ginocchi & Ferdinanda Ponci & Antonello Monti, 2021. "Sensitivity Analysis and Power Systems: Can We Bridge the Gap? A Review and a Guide to Getting Started," Energies, MDPI, vol. 14(24), pages 1-59, December.
    17. Makam, Vaishno Devi & Millossovich, Pietro & Tsanakas, Andreas, 2021. "Sensitivity analysis with χ2-divergences," Insurance: Mathematics and Economics, Elsevier, vol. 100(C), pages 372-383.
    18. Plischke, Elmar & Borgonovo, Emanuele, 2019. "Copula theory and probabilistic sensitivity analysis: Is there a connection?," European Journal of Operational Research, Elsevier, vol. 277(3), pages 1046-1059.
    19. Lu, Xuefei & Borgonovo, Emanuele, 2023. "Global sensitivity analysis in epidemiological modeling," European Journal of Operational Research, Elsevier, vol. 304(1), pages 9-24.
    20. Wenbin Ruan & Zhenzhou Lu & Pengfei Wei, 2013. "Estimation of conditional moment by moving least squares and its application for importance analysis," Journal of Risk and Reliability, , vol. 227(6), pages 641-650, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:riskan:v:26:y:2006:i:5:p:1349-1361. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://doi.org/10.1111/(ISSN)1539-6924 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.