IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v107y2012icp107-114.html
   My bibliography  Save this article

A variance-based sensitivity index function for factor prioritization

Author

Listed:
  • Allaire, Douglas L.
  • Willcox, Karen E.

Abstract

Among the many uses for sensitivity analysis is factor prioritization—that is, the determination of which factor, once fixed to its true value, on average leads to the greatest reduction in the variance of an output. A key assumption is that a given factor can, through further research, be fixed to some point on its domain. In general, this is an optimistic assumption, which can lead to inappropriate resource allocation. This research develops an original method that apportions output variance as a function of the amount of variance reduction that can be achieved for a particular factor. This variance-based sensitivity index function provides a main effect sensitivity index for a given factor as a function of the amount of variance of that factor that can be reduced. An aggregate measure of which factors would on average cause the greatest reduction in output variance given future research is also defined and assumes the portion of a particular factors variance that can be reduced is a random variable. An average main effect sensitivity index is then calculated by taking the mean of the variance-based sensitivity index function. A key aspect of the method is that the analysis is performed directly on the samples that were generated during a global sensitivity analysis using rejection sampling. The method is demonstrated on the Ishigami function and an additive function, where the rankings for future research are shown to be different than those of a traditional global sensitivity analysis.

Suggested Citation

  • Allaire, Douglas L. & Willcox, Karen E., 2012. "A variance-based sensitivity index function for factor prioritization," Reliability Engineering and System Safety, Elsevier, vol. 107(C), pages 107-114.
  • Handle: RePEc:eee:reensy:v:107:y:2012:i:c:p:107-114
    DOI: 10.1016/j.ress.2011.08.007
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832011001712
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2011.08.007?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Borgonovo, E., 2007. "A new uncertainty importance measure," Reliability Engineering and System Safety, Elsevier, vol. 92(6), pages 771-784.
    2. Storlie, Curtis B. & Swiler, Laura P. & Helton, Jon C. & Sallaberry, Cedric J., 2009. "Implementation and evaluation of nonparametric regression procedures for sensitivity analysis of computationally demanding models," Reliability Engineering and System Safety, Elsevier, vol. 94(11), pages 1735-1763.
    3. Ratto, M. & Pagano, A. & Young, P.C., 2009. "Non-parametric estimation of conditional moments for sensitivity analysis," Reliability Engineering and System Safety, Elsevier, vol. 94(2), pages 237-243.
    4. Tarantola, S. & Gatelli, D. & Mara, T.A., 2006. "Random balance designs for the estimation of first order global sensitivity indices," Reliability Engineering and System Safety, Elsevier, vol. 91(6), pages 717-727.
    5. Saltelli A. & Tarantola S., 2002. "On the Relative Importance of Input Factors in Mathematical Models: Safety Assessment for Nuclear Waste Disposal," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 702-709, September.
    6. Jeremy E. Oakley & Anthony O'Hagan, 2004. "Probabilistic sensitivity analysis of complex models: a Bayesian approach," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 66(3), pages 751-769, August.
    7. Helton, J.C. & Johnson, J.D. & Sallaberry, C.J. & Storlie, C.B., 2006. "Survey of sampling-based methods for uncertainty and sensitivity analysis," Reliability Engineering and System Safety, Elsevier, vol. 91(10), pages 1175-1209.
    8. Saltelli, Andrea & Bolado, Ricardo, 1998. "An alternative way to compute Fourier amplitude sensitivity test (FAST)," Computational Statistics & Data Analysis, Elsevier, vol. 26(4), pages 445-460, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Allaire, Douglas & Noel, George & Willcox, Karen & Cointin, Rebecca, 2014. "Uncertainty quantification of an Aviation Environmental Toolsuite," Reliability Engineering and System Safety, Elsevier, vol. 126(C), pages 14-24.
    2. Jingwen Song & Zhenzhou Lu & Pengfei Wei & Yanping Wang, 2015. "Global sensitivity analysis for model with random inputs characterized by probability-box," Journal of Risk and Reliability, , vol. 229(3), pages 237-253, June.
    3. Jiayan Chen & Jia Yu & Jiahong Wen & Chuanrong Zhang & Zhan’e Yin & Jianping Wu & Shenjun Yao, 2019. "Pre-evacuation Time Estimation Based Emergency Evacuation Simulation in Urban Residential Communities," IJERPH, MDPI, vol. 16(23), pages 1-25, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wei, Pengfei & Lu, Zhenzhou & Song, Jingwen, 2015. "Variable importance analysis: A comprehensive review," Reliability Engineering and System Safety, Elsevier, vol. 142(C), pages 399-432.
    2. Borgonovo, Emanuele & Plischke, Elmar, 2016. "Sensitivity analysis: A review of recent advances," European Journal of Operational Research, Elsevier, vol. 248(3), pages 869-887.
    3. Plischke, Elmar & Borgonovo, Emanuele & Smith, Curtis L., 2013. "Global sensitivity measures from given data," European Journal of Operational Research, Elsevier, vol. 226(3), pages 536-550.
    4. S. Cucurachi & E. Borgonovo & R. Heijungs, 2016. "A Protocol for the Global Sensitivity Analysis of Impact Assessment Models in Life Cycle Assessment," Risk Analysis, John Wiley & Sons, vol. 36(2), pages 357-377, February.
    5. Emanuele Borgonovo & Gordon B. Hazen & Elmar Plischke, 2016. "A Common Rationale for Global Sensitivity Measures and Their Estimation," Risk Analysis, John Wiley & Sons, vol. 36(10), pages 1871-1895, October.
    6. Hu, Zhen & Mahadevan, Sankaran, 2019. "Probability models for data-Driven global sensitivity analysis," Reliability Engineering and System Safety, Elsevier, vol. 187(C), pages 40-57.
    7. Xu, Chonggang & Gertner, George, 2011. "Understanding and comparisons of different sampling approaches for the Fourier Amplitudes Sensitivity Test (FAST)," Computational Statistics & Data Analysis, Elsevier, vol. 55(1), pages 184-198, January.
    8. Plischke, Elmar, 2012. "An adaptive correlation ratio method using the cumulative sum of the reordered output," Reliability Engineering and System Safety, Elsevier, vol. 107(C), pages 149-156.
    9. Cheng, Lei & Lu, Zhenzhou & Zhang, Leigang, 2015. "Application of Rejection Sampling based methodology to variance based parametric sensitivity analysis," Reliability Engineering and System Safety, Elsevier, vol. 142(C), pages 9-18.
    10. Mirko Ginocchi & Ferdinanda Ponci & Antonello Monti, 2021. "Sensitivity Analysis and Power Systems: Can We Bridge the Gap? A Review and a Guide to Getting Started," Energies, MDPI, vol. 14(24), pages 1-59, December.
    11. Plischke, Elmar & Borgonovo, Emanuele, 2019. "Copula theory and probabilistic sensitivity analysis: Is there a connection?," European Journal of Operational Research, Elsevier, vol. 277(3), pages 1046-1059.
    12. Tianyang Wang & James S. Dyer & Warren J. Hahn, 2017. "Sensitivity analysis of decision making under dependent uncertainties using copulas," EURO Journal on Decision Processes, Springer;EURO - The Association of European Operational Research Societies, vol. 5(1), pages 117-139, November.
    13. Wei, Pengfei & Lu, Zhenzhou & Yuan, Xiukai, 2013. "Monte Carlo simulation for moment-independent sensitivity analysis," Reliability Engineering and System Safety, Elsevier, vol. 110(C), pages 60-67.
    14. Zhai, Qingqing & Yang, Jun & Zhao, Yu, 2014. "Space-partition method for the variance-based sensitivity analysis: Optimal partition scheme and comparative study," Reliability Engineering and System Safety, Elsevier, vol. 131(C), pages 66-82.
    15. Wu, Qiong-Li & Cournède, Paul-Henry & Mathieu, Amélie, 2012. "An efficient computational method for global sensitivity analysis and its application to tree growth modelling," Reliability Engineering and System Safety, Elsevier, vol. 107(C), pages 35-43.
    16. Zio, E. & Pedroni, N., 2012. "Monte Carlo simulation-based sensitivity analysis of the model of a thermal–hydraulic passive system," Reliability Engineering and System Safety, Elsevier, vol. 107(C), pages 90-106.
    17. Song, Xiaodong & Bryan, Brett A. & Almeida, Auro C. & Paul, Keryn I. & Zhao, Gang & Ren, Yin, 2013. "Time-dependent sensitivity of a process-based ecological model," Ecological Modelling, Elsevier, vol. 265(C), pages 114-123.
    18. Ge, Qiao & Menendez, Monica, 2017. "Extending Morris method for qualitative global sensitivity analysis of models with dependent inputs," Reliability Engineering and System Safety, Elsevier, vol. 162(C), pages 28-39.
    19. Tang, Zhang-Chun & Zuo, Ming J. & Xiao, Ningcong, 2016. "An efficient method for evaluating the effect of input parameters on the integrity of safety systems," Reliability Engineering and System Safety, Elsevier, vol. 145(C), pages 111-123.
    20. Cui, Lijie & Lu, Zhenzhou & Wang, Pan & Wang, Weihu, 2014. "The ordering importance measure of random variable and its estimation," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 105(C), pages 132-143.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:107:y:2012:i:c:p:107-114. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.