IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v195y2020ics0951832019301498.html
   My bibliography  Save this article

Gaussian process regression with linear inequality constraints

Author

Listed:
  • Veiga, Sébastien Da
  • Marrel, Amandine

Abstract

The analysis of expensive numerical simulators usually requires metamodelling techniques, among which Gaussian process regression is one of the most popular approaches. Frequently, the code outputs correspond to physical quantities with a behavior which is known a priori: Chemical concentrations lie between 0 and 1, the output is increasing with respect to some parameter, etc. In this paper, a framework for incorporating any type of linear constraints in Gaussian process modeling is introduced, this including common bound and monotonicity constraints. The proposed methodology mainly relies on conditional expectations of the truncated multinormal distribution and a discretization of the input space. When dealing with high-dimensional functions, the discrete-location approximation requires many points and subsequent integral approximations suffers from the curse of dimensionality. We thus developed a sequential sampling strategy where the input space is explored via a criterion which maximizes the probability of respecting the given constraints. To further reduce the computational burden, we also recommended a correlation-free approximation to be used during the sequential sampling strategy. The proposed approaches are evaluated and compared on several analytical functions with up to 20 input variables, with bound or monotonicity constraints.

Suggested Citation

  • Veiga, Sébastien Da & Marrel, Amandine, 2020. "Gaussian process regression with linear inequality constraints," Reliability Engineering and System Safety, Elsevier, vol. 195(C).
    • Handle: RePEc:eee:reensy:v:195:y:2020:i:c:s0951832019301498
    DOI: 10.1016/j.ress.2019.106732
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832019301498
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ress.2019.106732?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. E.-H. Yoo & P. Kyriakidis, 2006. "Area-to-point Kriging with inequality-type data," Journal of Geographical Systems, Springer, vol. 8(4), pages 357-390, October.
    2. Marrel, Amandine & Iooss, Bertrand & Van Dorpe, François & Volkova, Elena, 2008. "An efficient methodology for modeling complex computer codes with Gaussian processes," Computational Statistics & Data Analysis, Elsevier, vol. 52(10), pages 4731-4744, June.
    3. William Griffiths, 2002. "A Gibbs’ Sampler for the Parameters of a Truncated Multivariate Normal Distribution," Department of Economics - Working Papers Series 856, The University of Melbourne.
    4. Jeremy E. Oakley & Anthony O'Hagan, 2004. "Probabilistic sensitivity analysis of complex models: a Bayesian approach," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 66(3), pages 751-769, August.
    5. Z. I. Botev, 2017. "The normal law under linear restrictions: simulation and estimation via minimax tilting," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(1), pages 125-148, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhang, Limao & Lin, Penghui, 2021. "Multi-objective optimization for limiting tunnel-induced damages considering uncertainties," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    2. Xu, Yanwen & Kohtz, Sara & Boakye, Jessica & Gardoni, Paolo & Wang, Pingfeng, 2023. "Physics-informed machine learning for reliability and systems safety applications: State of the art and challenges," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    3. Qu, Pengfei & Zhang, Limao & Zhu, Qizhi & Wu, Maozhi, 2023. "Probabilistic reliability assessment of twin tunnels considering fluid–solid coupling with physics-guided machine learning," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    4. Wang, Yuhao & Gao, Yi & Liu, Yongming & Ghosh, Sayan & Subber, Waad & Pandita, Piyush & Wang, Liping, 2021. "Bayesian-entropy gaussian process for constrained metamodeling," Reliability Engineering and System Safety, Elsevier, vol. 214(C).
    5. López-Lopera, Andrés F. & Idier, Déborah & Rohmer, Jérémy & Bachoc, François, 2022. "Multioutput Gaussian processes with functional data: A study on coastal flood hazard assessment," Reliability Engineering and System Safety, Elsevier, vol. 218(PA).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Touzani, Samir & Busby, Daniel, 2013. "Smoothing spline analysis of variance approach for global sensitivity analysis of computer codes," Reliability Engineering and System Safety, Elsevier, vol. 112(C), pages 67-81.
    2. Kapusuzoglu, Berkcan & Mahadevan, Sankaran, 2021. "Information fusion and machine learning for sensitivity analysis using physics knowledge and experimental data," Reliability Engineering and System Safety, Elsevier, vol. 214(C).
    3. Marrel, Amandine & Iooss, Bertrand & Laurent, Béatrice & Roustant, Olivier, 2009. "Calculations of Sobol indices for the Gaussian process metamodel," Reliability Engineering and System Safety, Elsevier, vol. 94(3), pages 742-751.
    4. Ge, Qiao & Ciuffo, Biagio & Menendez, Monica, 2015. "Combining screening and metamodel-based methods: An efficient sequential approach for the sensitivity analysis of model outputs," Reliability Engineering and System Safety, Elsevier, vol. 134(C), pages 334-344.
    5. Storlie, Curtis B. & Swiler, Laura P. & Helton, Jon C. & Sallaberry, Cedric J., 2009. "Implementation and evaluation of nonparametric regression procedures for sensitivity analysis of computationally demanding models," Reliability Engineering and System Safety, Elsevier, vol. 94(11), pages 1735-1763.
    6. Ye, Dongwei & Nikishova, Anna & Veen, Lourens & Zun, Pavel & Hoekstra, Alfons G., 2021. "Non-intrusive and semi-intrusive uncertainty quantification of a multiscale in-stent restenosis model," Reliability Engineering and System Safety, Elsevier, vol. 214(C).
    7. Storlie, Curtis B. & Reich, Brian J. & Helton, Jon C. & Swiler, Laura P. & Sallaberry, Cedric J., 2013. "Analysis of computationally demanding models with continuous and categorical inputs," Reliability Engineering and System Safety, Elsevier, vol. 113(C), pages 30-41.
    8. Iooss, Bertrand & Le Gratiet, Loïc, 2019. "Uncertainty and sensitivity analysis of functional risk curves based on Gaussian processes," Reliability Engineering and System Safety, Elsevier, vol. 187(C), pages 58-66.
    9. S. Cucurachi & E. Borgonovo & R. Heijungs, 2016. "A Protocol for the Global Sensitivity Analysis of Impact Assessment Models in Life Cycle Assessment," Risk Analysis, John Wiley & Sons, vol. 36(2), pages 357-377, February.
    10. Laura Liu & Hyungsik Roger Moon & Frank Schorfheide, 2023. "Forecasting with a panel Tobit model," Quantitative Economics, Econometric Society, vol. 14(1), pages 117-159, January.
    11. Jakub Bijak & Jason D. Hilton & Eric Silverman & Viet Dung Cao, 2013. "Reforging the Wedding Ring," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 29(27), pages 729-766.
    12. Acharki, Naoufal & Bertoncello, Antoine & Garnier, Josselin, 2023. "Robust prediction interval estimation for Gaussian processes by cross-validation method," Computational Statistics & Data Analysis, Elsevier, vol. 178(C).
    13. Xueping Chen & Yujie Gai & Xiaodi Wang, 2023. "A-optimal designs for non-parametric symmetrical global sensitivity analysis," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 86(2), pages 219-237, February.
    14. Matieyendou Lamboni, 2020. "Uncertainty quantification: a minimum variance unbiased (joint) estimator of the non-normalized Sobol’ indices," Statistical Papers, Springer, vol. 61(5), pages 1939-1970, October.
    15. Isaac Corro Ramos & Maureen P. M. H. Rutten-van Mölken & Maiwenn J. Al, 2013. "The Role of Value-of-Information Analysis in a Health Care Research Priority Setting," Medical Decision Making, , vol. 33(4), pages 472-489, May.
    16. Petropoulos, G. & Wooster, M.J. & Carlson, T.N. & Kennedy, M.C. & Scholze, M., 2009. "A global Bayesian sensitivity analysis of the 1d SimSphere soil–vegetation–atmospheric transfer (SVAT) model using Gaussian model emulation," Ecological Modelling, Elsevier, vol. 220(19), pages 2427-2440.
    17. Lu, Xuefei & Borgonovo, Emanuele, 2023. "Global sensitivity analysis in epidemiological modeling," European Journal of Operational Research, Elsevier, vol. 304(1), pages 9-24.
    18. Tianyang Wang & James S. Dyer & Warren J. Hahn, 2017. "Sensitivity analysis of decision making under dependent uncertainties using copulas," EURO Journal on Decision Processes, Springer;EURO - The Association of European Operational Research Societies, vol. 5(1), pages 117-139, November.
    19. Hemez, François M. & Atamturktur, Sezer, 2011. "The dangers of sparse sampling for the quantification of margin and uncertainty," Reliability Engineering and System Safety, Elsevier, vol. 96(9), pages 1220-1231.
    20. Gael M. Martin & David T. Frazier & Ruben Loaiza-Maya & Florian Huber & Gary Koop & John Maheu & Didier Nibbering & Anastasios Panagiotelis, 2023. "Bayesian Forecasting in the 21st Century: A Modern Review," Monash Econometrics and Business Statistics Working Papers 1/23, Monash University, Department of Econometrics and Business Statistics.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:195:y:2020:i:c:s0951832019301498. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.