IDEAS home Printed from https://ideas.repec.org/a/bla/scjsta/v49y2022i3p1274-1303.html
   My bibliography  Save this article

Interactions and computer experiments

Author

Listed:
  • Emanuele Borgonovo
  • Elmar Plischke
  • Giovanni Rabitti

Abstract

Identifying interactions and understanding the underlying generating mechanism is essential for interpreting the response of black‐box models. We offer a systematic analysis of interaction types and corresponding sources, merging results of the broad statistical literature with findings developed within the computer experiment literature. Piecewise‐definiteness emerges a self‐standing interaction mechanism, alternative to the presence of interaction terms. We find that the scale of the analysis is essential for interpretation, and that no single method is capable of providing the correct identification of the underlying interaction generating mechanisms; conversely a combined approach involving indicators at difference scales is required. We propose a graphical tool called Mikado plot that exploits the link between interaction indicators at the finite scale and global scales to ease the regional visualization of two‐factor interactions. The findings are illustrated via numerical experiments with three well‐known computer models of different dimensionality and structure.

Suggested Citation

  • Emanuele Borgonovo & Elmar Plischke & Giovanni Rabitti, 2022. "Interactions and computer experiments," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 49(3), pages 1274-1303, September.
    • Handle: RePEc:bla:scjsta:v:49:y:2022:i:3:p:1274-1303
    DOI: 10.1111/sjos.12560
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/sjos.12560
    Download Restriction: no
    File URL: https://libkey.io/10.1111/sjos.12560?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Yong-Dao Zhou & Hongquan Xu, 2017. "Composite Designs Based on Orthogonal Arrays and Definitive Screening Designs," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(520), pages 1675-1683, October.
    2. S. M. Lewis & A. M. Dean, 2001. "Detection of interactions in experiments on large numbers of factors," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 63(4), pages 633-672.
    3. Shubhadeep Chakraborty & Xianyang Zhang, 2019. "Distance Metrics for Measuring Joint Dependence with Application to Causal Inference," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(528), pages 1638-1650, October.
    4. Jeremy E. Oakley & Anthony O'Hagan, 2004. "Probabilistic sensitivity analysis of complex models: a Bayesian approach," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 66(3), pages 751-769, August.
    5. E. Borgonovo & L. Peccati, 2010. "Moment calculations for piecewise-defined functions: an application to stochastic optimization with coherent risk measures," Annals of Operations Research, Springer, vol. 176(1), pages 235-258, April.
    6. Liu, Ruixue & Owen, Art B., 2006. "Estimating Mean Dimensionality of Analysis of Variance Decompositions," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 712-721, June.
    7. Durrande, N. & Ginsbourger, D. & Roustant, O. & Carraro, L., 2013. "ANOVA kernels and RKHS of zero mean functions for model-based sensitivity analysis," Journal of Multivariate Analysis, Elsevier, vol. 115(C), pages 57-67.
    8. Wang, P.C., 2007. "Planning experiments when some specified interactions are investigated," Computational Statistics & Data Analysis, Elsevier, vol. 51(9), pages 4143-4151, May.
    9. Eric D. Schoen & Nha Vo-Thanh & Peter Goos, 2017. "Two-Level Orthogonal Screening Designs With 24, 28, 32, and 36 Runs," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(519), pages 1354-1369, July.
    10. Johannes A Landsheer & Godfried van den Wittenboer, 2015. "Unbalanced 2 x 2 Factorial Designs and the Interaction Effect: A Troublesome Combination," PLOS ONE, Public Library of Science, vol. 10(3), pages 1-18, March.
    11. Roustant, O. & Fruth, J. & Iooss, B. & Kuhnt, S., 2014. "Crossed-derivative based sensitivity measures for interaction screening," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 105(C), pages 105-118.
    12. Borgonovo, E., 2010. "Sensitivity analysis with finite changes: An application to modified EOQ models," European Journal of Operational Research, Elsevier, vol. 200(1), pages 127-138, January.
    13. Saltelli A. & Tarantola S., 2002. "On the Relative Importance of Input Factors in Mathematical Models: Safety Assessment for Nuclear Waste Disposal," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 702-709, September.
    14. Kim, Hyoung-Moon & Mallick, Bani K. & Holmes, C.C., 2005. "Analyzing Nonstationary Spatial Data Using Piecewise Gaussian Processes," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 653-668, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Borgonovo, Emanuele & Plischke, Elmar, 2016. "Sensitivity analysis: A review of recent advances," European Journal of Operational Research, Elsevier, vol. 248(3), pages 869-887.
    2. S. Cucurachi & E. Borgonovo & R. Heijungs, 2016. "A Protocol for the Global Sensitivity Analysis of Impact Assessment Models in Life Cycle Assessment," Risk Analysis, John Wiley & Sons, vol. 36(2), pages 357-377, February.
    3. Barry Anderson & Emanuele Borgonovo & Marzio Galeotti & Roberto Roson, 2014. "Uncertainty in Climate Change Modeling: Can Global Sensitivity Analysis Be of Help?," Risk Analysis, John Wiley & Sons, vol. 34(2), pages 271-293, February.
    4. Isadora Antoniano‐Villalobos & Emanuele Borgonovo & Sumeda Siriwardena, 2018. "Which Parameters Are Important? Differential Importance Under Uncertainty," Risk Analysis, John Wiley & Sons, vol. 38(11), pages 2459-2477, November.
    5. Borgonovo, Emanuele & Buzzard, Gregery T. & Wendell, Richard E., 2018. "A global tolerance approach to sensitivity analysis in linear programming," European Journal of Operational Research, Elsevier, vol. 267(1), pages 321-337.
    6. Mirko Ginocchi & Ferdinanda Ponci & Antonello Monti, 2021. "Sensitivity Analysis and Power Systems: Can We Bridge the Gap? A Review and a Guide to Getting Started," Energies, MDPI, vol. 14(24), pages 1-59, December.
    7. Lu, Xuefei & Borgonovo, Emanuele, 2023. "Global sensitivity analysis in epidemiological modeling," European Journal of Operational Research, Elsevier, vol. 304(1), pages 9-24.
    8. Xuefei Lu & Alessandro Rudi & Emanuele Borgonovo & Lorenzo Rosasco, 2020. "Faster Kriging: Facing High-Dimensional Simulators," Operations Research, INFORMS, vol. 68(1), pages 233-249, January.
    9. Emanuele Borgonovo, 2006. "Measuring Uncertainty Importance: Investigation and Comparison of Alternative Approaches," Risk Analysis, John Wiley & Sons, vol. 26(5), pages 1349-1361, October.
    10. Ge, Qiao & Menendez, Monica, 2017. "Extending Morris method for qualitative global sensitivity analysis of models with dependent inputs," Reliability Engineering and System Safety, Elsevier, vol. 162(C), pages 28-39.
    11. Pronzato, Luc, 2019. "Sensitivity analysis via Karhunen–Loève expansion of a random field model: Estimation of Sobol’ indices and experimental design," Reliability Engineering and System Safety, Elsevier, vol. 187(C), pages 93-109.
    12. Lamboni, Matieyendou, 2021. "Derivative-based integral equalities and inequality: A proxy-measure for sensitivity analysis," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 179(C), pages 137-161.
    13. Emanuele Borgonovo & Gordon B. Hazen & Elmar Plischke, 2016. "A Common Rationale for Global Sensitivity Measures and Their Estimation," Risk Analysis, John Wiley & Sons, vol. 36(10), pages 1871-1895, October.
    14. Borgonovo, Emanuele & Tonoli, Fabio, 2014. "Decision-network polynomials and the sensitivity of decision-support models," European Journal of Operational Research, Elsevier, vol. 239(2), pages 490-503.
    15. Emanuele Borgonovo & William Castaings & Stefano Tarantola, 2011. "Moment Independent Importance Measures: New Results and Analytical Test Cases," Risk Analysis, John Wiley & Sons, vol. 31(3), pages 404-428, March.
    16. Mara, Thierry A. & Tarantola, Stefano, 2012. "Variance-based sensitivity indices for models with dependent inputs," Reliability Engineering and System Safety, Elsevier, vol. 107(C), pages 115-121.
    17. Wei, Pengfei & Lu, Zhenzhou & Song, Jingwen, 2015. "Variable importance analysis: A comprehensive review," Reliability Engineering and System Safety, Elsevier, vol. 142(C), pages 399-432.
    18. Lamboni, Matieyendou, 2020. "Derivative-based generalized sensitivity indices and Sobol’ indices," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 170(C), pages 236-256.
    19. Sinan Xiao & Zhenzhou Lu & Pan Wang, 2018. "Multivariate Global Sensitivity Analysis Based on Distance Components Decomposition," Risk Analysis, John Wiley & Sons, vol. 38(12), pages 2703-2721, December.
    20. Borgonovo, E., 2007. "A new uncertainty importance measure," Reliability Engineering and System Safety, Elsevier, vol. 92(6), pages 771-784.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:scjsta:v:49:y:2022:i:3:p:1274-1303. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0303-6898 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.