IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v237y2023ics095183202300279x.html
   My bibliography  Save this article

An efficient elementary effect-based method for sensitivity analysis in identifying main and two-factor interaction effects

Author

Listed:
  • Shi, Wen
  • Zhou, Qing
  • Zhou, Yanju

Abstract

The analysis of engineering systems via computer-based models often confronts the intricacy of high-dimensional input spaces and notable interrelationships between inputs. This, in turn, necessitates the implementation of sensitivity analysis as a means of guiding reliability engineering. However, the query of effectively identifying significant effects, particularly interaction effects, remains unresolved. In this paper, we present a two-stage elementary effect-based sensitivity analysis method that effectively identifies main and interaction effects by fully utilizing the sequential characteristics of simulation experiments. Not only can the proposed method efficiently identify factors with important (a) main effects and (b) interaction and/or non-linear effects, but more importantly, it can discern the important two-factor interaction effects. Compared to state-of-the-art elementary effect-based methods, the proposed procedure can additionally identify specific interaction effects between two factors. Compared to traditional second-order elementary effect-based method, our method can achieve enormous computational savings without sacrificing statistical effectiveness. The Monte Carlo simulation experiments verify the feasibility and the real-world case study conducted to design a reliable cross-docking center manifests the robustness of the proposed method.

Suggested Citation

  • Shi, Wen & Zhou, Qing & Zhou, Yanju, 2023. "An efficient elementary effect-based method for sensitivity analysis in identifying main and two-factor interaction effects," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
  • Handle: RePEc:eee:reensy:v:237:y:2023:i:c:s095183202300279x
    DOI: 10.1016/j.ress.2023.109365
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S095183202300279X
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2023.109365?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Yang Li & Jun S. Liu, 2019. "Robust Variable and Interaction Selection for Logistic Regression and General Index Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(525), pages 271-286, January.
    2. Galushin, Sergey & Grishchenko, Dmitry & Kudinov, Pavel, 2020. "Implementation of framework for assessment of severe accident management effectiveness in Nordic BWR," Reliability Engineering and System Safety, Elsevier, vol. 203(C).
    3. Wen Shi & Xi Chen & Jennifer Shang, 2019. "An Efficient Morris Method-Based Framework for Simulation Factor Screening," INFORMS Journal on Computing, INFORMS, vol. 31(4), pages 745-770, October.
    4. Qian, Gengjian & Massenzio, Michel & Brizard, Denis & Ichchou, Mohamed, 2019. "Sensitivity analysis of complex engineering systems: Approaches study and their application to vehicle restraint system crash simulation," Reliability Engineering and System Safety, Elsevier, vol. 187(C), pages 110-118.
    5. Zhou, Xiaoyi & Lu, Pan & Zheng, Zijian & Tolliver, Denver & Keramati, Amin, 2020. "Accident Prediction Accuracy Assessment for Highway-Rail Grade Crossings Using Random Forest Algorithm Compared with Decision Tree," Reliability Engineering and System Safety, Elsevier, vol. 200(C).
    6. Awad, Majdi & Senga Kiesse, Tristan & Assaghir, Zainab & Ventura, Anne, 2019. "Convergence of sensitivity analysis methods for evaluating combined influences of model inputs," Reliability Engineering and System Safety, Elsevier, vol. 189(C), pages 109-122.
    7. Pujol, Gilles, 2009. "Simplex-based screening designs for estimating metamodels," Reliability Engineering and System Safety, Elsevier, vol. 94(7), pages 1156-1160.
    8. Michail Tsagris & Christina Beneki & Hossein Hassani, 2014. "On the Folded Normal Distribution," Mathematics, MDPI, vol. 2(1), pages 1-17, February.
    9. Fu, Lipeng & Wang, Xueqing & Zhao, Heng & Li, Mengnan, 2022. "Interactions among safety risks in metro deep foundation pit projects: An association rule mining-based modeling framework," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    10. Russell R. Barton & Barry L. Nelson & Wei Xie, 2014. "Quantifying Input Uncertainty via Simulation Confidence Intervals," INFORMS Journal on Computing, INFORMS, vol. 26(1), pages 74-87, February.
    11. Ge, Qiao & Menendez, Monica, 2017. "Extending Morris method for qualitative global sensitivity analysis of models with dependent inputs," Reliability Engineering and System Safety, Elsevier, vol. 162(C), pages 28-39.
    12. Sanchez, Susan M. & Moeeni, Farhad & Sanchez, Paul J., 2006. "So many factors, so little time...Simulation experiments in the frequency domain," International Journal of Production Economics, Elsevier, vol. 103(1), pages 149-165, September.
    13. Wang, Zhenqiang & Jia, Gaofeng, 2023. "Extended sample-based approach for efficient sensitivity analysis of group of random variables," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    14. Lee, Dongjin & Pan, Rong, 2018. "A nonparametric Bayesian network approach to assessing system reliability at early design stages," Reliability Engineering and System Safety, Elsevier, vol. 171(C), pages 57-66.
    15. Shi, Wen & Chen, Xi, 2019. "Controlled Morris method: A new factor screening approach empowered by a distribution-free sequential multiple testing procedure," Reliability Engineering and System Safety, Elsevier, vol. 189(C), pages 299-314.
    16. Hong Wan & Bruce E. Ankenman & Barry L. Nelson, 2010. "Improving the Efficiency and Efficacy of Controlled Sequential Bifurcation for Simulation Factor Screening," INFORMS Journal on Computing, INFORMS, vol. 22(3), pages 482-492, August.
    17. Lamboni, Matieyendou & Kucherenko, Sergei, 2021. "Multivariate sensitivity analysis and derivative-based global sensitivity measures with dependent variables," Reliability Engineering and System Safety, Elsevier, vol. 212(C).
    18. Becker, William, 2020. "Metafunctions for benchmarking in sensitivity analysis," Reliability Engineering and System Safety, Elsevier, vol. 204(C).
    19. Neves Costa, João & Ambrósio, Jorge & Andrade, António R. & Frey, Daniel, 2023. "Safety assessment using computer experiments and surrogate modeling: Railway vehicle safety and track quality indices," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    20. Borgonovo, Emanuele & Plischke, Elmar, 2016. "Sensitivity analysis: A review of recent advances," European Journal of Operational Research, Elsevier, vol. 248(3), pages 869-887.
    21. Morris, Max D., 2006. "Input screening: Finding the important model inputs on a budget," Reliability Engineering and System Safety, Elsevier, vol. 91(10), pages 1252-1256.
    22. Kim, Wongon & Lee, Guesuk & Son, Hyejeong & Choi, Hyunhee & Youn, Byeng D., 2022. "Estimation of fatigue crack initiation and growth in engineering product development using a digital twin approach," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    23. Li, Huanhuan & Ren, Xujie & Yang, Zaili, 2023. "Data-driven Bayesian network for risk analysis of global maritime accidents," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    24. Wang, Qun & Jia, Guozhu & Jia, Yuning & Song, Wenyan, 2021. "A new approach for risk assessment of failure modes considering risk interaction and propagation effects," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    25. Horiguchi, Akira & Pratola, Matthew T. & Santner, Thomas J., 2021. "Assessing variable activity for Bayesian regression trees," Reliability Engineering and System Safety, Elsevier, vol. 207(C).
    26. Pol, Johannes C. & Kindermann, Paulina & van der Krogt, Mark G. & van Bergeijk, Vera M. & Remmerswaal, Guido & Kanning, Willem & Jonkman, Sebastiaan N. & Kok, Matthijs, 2023. "The effect of interactions between failure mechanisms on the reliability of flood defenses," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wen Shi & Xi Chen & Jennifer Shang, 2019. "An Efficient Morris Method-Based Framework for Simulation Factor Screening," INFORMS Journal on Computing, INFORMS, vol. 31(4), pages 745-770, October.
    2. Shi, Wen & Chen, Xi, 2019. "Controlled Morris method: A new factor screening approach empowered by a distribution-free sequential multiple testing procedure," Reliability Engineering and System Safety, Elsevier, vol. 189(C), pages 299-314.
    3. Wen Shi & Xi Chen, 2018. "Efficient budget allocation strategies for elementary effects method in stochastic simulation," Naval Research Logistics (NRL), John Wiley & Sons, vol. 65(3), pages 218-241, April.
    4. Torii, André Jacomel & Novotny, Antonio André, 2021. "A priori error estimates for local reliability-based sensitivity analysis with Monte Carlo Simulation," Reliability Engineering and System Safety, Elsevier, vol. 213(C).
    5. Vuillod, Bruno & Montemurro, Marco & Panettieri, Enrico & Hallo, Ludovic, 2023. "A comparison between Sobol’s indices and Shapley’s effect for global sensitivity analysis of systems with independent input variables," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    6. Shang, Xiaobing & Su, Li & Fang, Hai & Zeng, Bowen & Zhang, Zhi, 2023. "An efficient multi-fidelity Kriging surrogate model-based method for global sensitivity analysis," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    7. Kleijnen, Jack P.C., 2017. "Regression and Kriging metamodels with their experimental designs in simulation: A review," European Journal of Operational Research, Elsevier, vol. 256(1), pages 1-16.
    8. Borgonovo, Emanuele & Rabitti, Giovanni, 2023. "Screening: From tornado diagrams to effective dimensions," European Journal of Operational Research, Elsevier, vol. 304(3), pages 1200-1211.
    9. Becker, William, 2020. "Metafunctions for benchmarking in sensitivity analysis," Reliability Engineering and System Safety, Elsevier, vol. 204(C).
    10. Li, Xin & Chen, Chao & Hong, Yi-du & Yang, Fu-qiang, 2023. "Exploring hazardous chemical explosion accidents with association rules and Bayesian networks," Reliability Engineering and System Safety, Elsevier, vol. 233(C).
    11. Xue, Gang & Liu, Shifeng & Ren, Long & Gong, Daqing, 2024. "Risk assessment of utility tunnels through risk interaction-based deep learning," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    12. Hai, Nan & Gong, Daqing & Liu, Shifeng & Dai, Zixuan, 2022. "Dynamic coupling risk assessment model of utility tunnels based on multimethod fusion," Reliability Engineering and System Safety, Elsevier, vol. 228(C).
    13. Xie, Wei & Barton, Russell R. & Nelson, Barry L. & Wang, Keqi, 2023. "Stochastic simulation uncertainty analysis to accelerate flexible biomanufacturing process development," European Journal of Operational Research, Elsevier, vol. 310(1), pages 238-248.
    14. Lan, He & Ma, Xiaoxue & Qiao, Weiliang & Deng, Wanyi, 2023. "Determining the critical risk factors for predicting the severity of ship collision accidents using a data-driven approach," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    15. Xu, Yanwen & Kohtz, Sara & Boakye, Jessica & Gardoni, Paolo & Wang, Pingfeng, 2023. "Physics-informed machine learning for reliability and systems safety applications: State of the art and challenges," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    16. Vincenzo Varriale & Antonello Cammarano & Francesca Michelino & Mauro Caputo, 2021. "Sustainable Supply Chains with Blockchain, IoT and RFID: A Simulation on Order Management," Sustainability, MDPI, vol. 13(11), pages 1-23, June.
    17. Hou, Hui & Liu, Chao & Wei, Ruizeng & He, Huan & Wang, Lei & Li, Weibo, 2023. "Outage duration prediction under typhoon disaster with stacking ensemble learning," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    18. Happe, K. & Kellermann, K., 2008. "Diese Modelle sind zu komplex! – oder doch nicht?: Experimentelles Design und Metamodellierung als möglicher Weg, das Kommunikationsproblem agentenbasierter Modelle in der Politikanalyse zu lösen," Proceedings “Schriften der Gesellschaft für Wirtschafts- und Sozialwissenschaften des Landbaues e.V.”, German Association of Agricultural Economists (GEWISOLA), vol. 43, March.
    19. Makam, Vaishno Devi & Millossovich, Pietro & Tsanakas, Andreas, 2021. "Sensitivity analysis with χ2-divergences," Insurance: Mathematics and Economics, Elsevier, vol. 100(C), pages 372-383.
    20. Zheng Liu & Xin Liu & Hong-Zhong Huang & Pingyu Zhu & Zhongwei Liang, 2022. "A new inherent reliability modeling and analysis method based on imprecise Dirichlet model for machine tool spindle," Annals of Operations Research, Springer, vol. 311(1), pages 295-310, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:237:y:2023:i:c:s095183202300279x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.