IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v214y2021ics0951832021002477.html
   My bibliography  Save this article

Information fusion and machine learning for sensitivity analysis using physics knowledge and experimental data

Author

Listed:
  • Kapusuzoglu, Berkcan
  • Mahadevan, Sankaran

Abstract

When computational models (either physics-based or data-driven) are used for the sensitivity analysis of engineering systems, the sensitivity estimate is affected by the accuracy and uncertainty of the model. This paper considers global sensitivity analysis (GSA) for situations where both a physics-based model and experimental observations are available, and investigates physics-informed machine learning strategies to effectively combine the two sources of information in order to maximize the accuracy of the sensitivity estimate. Two representative machine learning (ML) techniques are considered, namely, deep neural networks (DNN) and Gaussian process (GP) modeling, and two strategies for incorporating physics knowledge within these techniques are investigated, namely: (i) incorporating loss functions in the ML models to enforce physics constraints, and (ii) pre-training and updating the ML model using simulation and experimental data respectively. Four different models are built for each type (DNN and GP), and the uncertainties in these models are included in the Sobol’ indices computation. The DNN-based models, with many degrees of freedom in terms of model parameters and training options, are found to result in smaller bounds on the sensitivity estimates when compared to the GP-based models. The proposed methods are illustrated for additive manufacturing and lake temperature modeling examples.

Suggested Citation

  • Kapusuzoglu, Berkcan & Mahadevan, Sankaran, 2021. "Information fusion and machine learning for sensitivity analysis using physics knowledge and experimental data," Reliability Engineering and System Safety, Elsevier, vol. 214(C).
  • Handle: RePEc:eee:reensy:v:214:y:2021:i:c:s0951832021002477
    DOI: 10.1016/j.ress.2021.107712
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832021002477
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2021.107712?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Marrel, Amandine & Iooss, Bertrand & Laurent, Béatrice & Roustant, Olivier, 2009. "Calculations of Sobol indices for the Gaussian process metamodel," Reliability Engineering and System Safety, Elsevier, vol. 94(3), pages 742-751.
    2. Sudret, Bruno, 2008. "Global sensitivity analysis using polynomial chaos expansions," Reliability Engineering and System Safety, Elsevier, vol. 93(7), pages 964-979.
    3. Cousin, Areski & Maatouk, Hassan & Rullière, Didier, 2016. "Kriging of financial term-structures," European Journal of Operational Research, Elsevier, vol. 255(2), pages 631-648.
    4. Mara, Thierry A. & Tarantola, Stefano, 2012. "Variance-based sensitivity indices for models with dependent inputs," Reliability Engineering and System Safety, Elsevier, vol. 107(C), pages 115-121.
    5. Marc C. Kennedy & Anthony O'Hagan, 2001. "Bayesian calibration of computer models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 63(3), pages 425-464.
    6. Hu, Zhen & Mahadevan, Sankaran, 2019. "Probability models for data-Driven global sensitivity analysis," Reliability Engineering and System Safety, Elsevier, vol. 187(C), pages 40-57.
    7. Sankararaman, S. & Mahadevan, S., 2013. "Separating the contributions of variability and parameter uncertainty in probability distributions," Reliability Engineering and System Safety, Elsevier, vol. 112(C), pages 187-199.
    8. Tarantola, S. & Gatelli, D. & Mara, T.A., 2006. "Random balance designs for the estimation of first order global sensitivity indices," Reliability Engineering and System Safety, Elsevier, vol. 91(6), pages 717-727.
    9. Marrel, Amandine & Iooss, Bertrand & Van Dorpe, François & Volkova, Elena, 2008. "An efficient methodology for modeling complex computer codes with Gaussian processes," Computational Statistics & Data Analysis, Elsevier, vol. 52(10), pages 4731-4744, June.
    10. Borgonovo, Emanuele & Plischke, Elmar, 2016. "Sensitivity analysis: A review of recent advances," European Journal of Operational Research, Elsevier, vol. 248(3), pages 869-887.
    11. Jeremy E. Oakley & Anthony O'Hagan, 2004. "Probabilistic sensitivity analysis of complex models: a Bayesian approach," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 66(3), pages 751-769, August.
    12. Li, Chenzhao & Mahadevan, Sankaran, 2016. "An efficient modularized sample-based method to estimate the first-order Sobol׳ index," Reliability Engineering and System Safety, Elsevier, vol. 153(C), pages 110-121.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jung, WoongHee & Taflanidis, Alexandros A., 2023. "Efficient global sensitivity analysis for high-dimensional outputs combining data-driven probability models and dimensionality reduction," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    2. Cao, Bohan & Yin, Qishuai & Guo, Yingying & Yang, Jin & Zhang, Laibin & Wang, Zhenquan & Tyagi, Mayank & Sun, Ting & Zhou, Xu, 2023. "Field data analysis and risk assessment of shallow gas hazards based on neural networks during industrial deep-water drilling," Reliability Engineering and System Safety, Elsevier, vol. 232(C).
    3. Xu, Yanwen & Kohtz, Sara & Boakye, Jessica & Gardoni, Paolo & Wang, Pingfeng, 2023. "Physics-informed machine learning for reliability and systems safety applications: State of the art and challenges," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    4. Maroli, John M., 2023. "Generating discrete dynamical system equations from input–output data using neural network identification models," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    5. Yao, Wen & Zheng, Xiaohu & Zhang, Jun & Wang, Ning & Tang, Guijian, 2023. "Deep adaptive arbitrary polynomial chaos expansion: A mini-data-driven semi-supervised method for uncertainty quantification," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    6. Chen, Jie & Yu, Yang & Liu, Yongming, 2022. "Physics-guided mixture density networks for uncertainty quantification," Reliability Engineering and System Safety, Elsevier, vol. 228(C).
    7. Zhao, Yunjie & Cheng, Xi & Zhang, Taihong & Wang, Lei & Shao, Wei & Wiart, Joe, 2023. "A global–local attention network for uncertainty analysis of ground penetrating radar modeling," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    8. Moglen, Rachel L. & Barth, Julius & Gupta, Shagun & Kawai, Eiji & Klise, Katherine & Leibowicz, Benjamin D., 2023. "A nexus approach to infrastructure resilience planning under uncertainty," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    9. Hughes, William & Zhang, Wei & Cerrai, Diego & Bagtzoglou, Amvrossios & Wanik, David & Anagnostou, Emmanouil, 2022. "A Hybrid Physics-Based and Data-Driven Model for Power Distribution System Infrastructure Hardening and Outage Simulation," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    10. Xiong, Qingwen & Du, Peng & Deng, Jian & Huang, Daishun & Song, Gongle & Qian, Libo & Wu, Zenghui & Luo, Yuejian, 2022. "Global sensitivity analysis for nuclear reactor LBLOCA with time-dependent outputs," Reliability Engineering and System Safety, Elsevier, vol. 221(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jung, WoongHee & Taflanidis, Alexandros A., 2023. "Efficient global sensitivity analysis for high-dimensional outputs combining data-driven probability models and dimensionality reduction," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    2. Azzini, Ivano & Rosati, Rossana, 2021. "Sobol’ main effect index: an Innovative Algorithm (IA) using Dynamic Adaptive Variances," Reliability Engineering and System Safety, Elsevier, vol. 213(C).
    3. Hu, Zhen & Mahadevan, Sankaran, 2019. "Probability models for data-Driven global sensitivity analysis," Reliability Engineering and System Safety, Elsevier, vol. 187(C), pages 40-57.
    4. Konakli, Katerina & Sudret, Bruno, 2016. "Global sensitivity analysis using low-rank tensor approximations," Reliability Engineering and System Safety, Elsevier, vol. 156(C), pages 64-83.
    5. Lambert, Romain S.C. & Lemke, Frank & Kucherenko, Sergei S. & Song, Shufang & Shah, Nilay, 2016. "Global sensitivity analysis using sparse high dimensional model representations generated by the group method of data handling," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 128(C), pages 42-54.
    6. Deman, G. & Konakli, K. & Sudret, B. & Kerrou, J. & Perrochet, P. & Benabderrahmane, H., 2016. "Using sparse polynomial chaos expansions for the global sensitivity analysis of groundwater lifetime expectancy in a multi-layered hydrogeological model," Reliability Engineering and System Safety, Elsevier, vol. 147(C), pages 156-169.
    7. Chen, Xin & Molina-Cristóbal, Arturo & Guenov, Marin D. & Riaz, Atif, 2019. "Efficient method for variance-based sensitivity analysis," Reliability Engineering and System Safety, Elsevier, vol. 181(C), pages 97-115.
    8. Wei, Pengfei & Lu, Zhenzhou & Song, Jingwen, 2015. "Variable importance analysis: A comprehensive review," Reliability Engineering and System Safety, Elsevier, vol. 142(C), pages 399-432.
    9. Borgonovo, Emanuele & Plischke, Elmar, 2016. "Sensitivity analysis: A review of recent advances," European Journal of Operational Research, Elsevier, vol. 248(3), pages 869-887.
    10. Heredia, María Belén & Prieur, Clémentine & Eckert, Nicolas, 2021. "Nonparametric estimation of aggregated Sobol’ indices: Application to a depth averaged snow avalanche model," Reliability Engineering and System Safety, Elsevier, vol. 212(C).
    11. Marrel, Amandine & Iooss, Bertrand & Laurent, Béatrice & Roustant, Olivier, 2009. "Calculations of Sobol indices for the Gaussian process metamodel," Reliability Engineering and System Safety, Elsevier, vol. 94(3), pages 742-751.
    12. Tabandeh, Armin & Sharma, Neetesh & Gardoni, Paolo, 2022. "Uncertainty propagation in risk and resilience analysis of hierarchical systems," Reliability Engineering and System Safety, Elsevier, vol. 219(C).
    13. Mirko Ginocchi & Ferdinanda Ponci & Antonello Monti, 2021. "Sensitivity Analysis and Power Systems: Can We Bridge the Gap? A Review and a Guide to Getting Started," Energies, MDPI, vol. 14(24), pages 1-59, December.
    14. Matieyendou Lamboni, 2020. "Uncertainty quantification: a minimum variance unbiased (joint) estimator of the non-normalized Sobol’ indices," Statistical Papers, Springer, vol. 61(5), pages 1939-1970, October.
    15. Shang, Xiaobing & Su, Li & Fang, Hai & Zeng, Bowen & Zhang, Zhi, 2023. "An efficient multi-fidelity Kriging surrogate model-based method for global sensitivity analysis," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    16. Lu, Xuefei & Borgonovo, Emanuele, 2023. "Global sensitivity analysis in epidemiological modeling," European Journal of Operational Research, Elsevier, vol. 304(1), pages 9-24.
    17. Pesenti, Silvana M. & Millossovich, Pietro & Tsanakas, Andreas, 2019. "Reverse sensitivity testing: What does it take to break the model?," European Journal of Operational Research, Elsevier, vol. 274(2), pages 654-670.
    18. Pronzato, Luc, 2019. "Sensitivity analysis via Karhunen–Loève expansion of a random field model: Estimation of Sobol’ indices and experimental design," Reliability Engineering and System Safety, Elsevier, vol. 187(C), pages 93-109.
    19. Touzani, Samir & Busby, Daniel, 2013. "Smoothing spline analysis of variance approach for global sensitivity analysis of computer codes," Reliability Engineering and System Safety, Elsevier, vol. 112(C), pages 67-81.
    20. Zhang, Xufang & Pandey, Mahesh D., 2014. "An effective approximation for variance-based global sensitivity analysis," Reliability Engineering and System Safety, Elsevier, vol. 121(C), pages 164-174.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:214:y:2021:i:c:s0951832021002477. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.