IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v328y2026i1p216-231.html

Bayesian variable selection in Kriging metamodeling for quality design

Author

Listed:
  • Tao, Baoping
  • Han, Zifei
  • Shi, Wen
  • Wang, Min
  • Ouyang, Linhan

Abstract

The increasing complexity of production processes and rapid developments in digital technology have fueled the adoption of metamodels in quality design. Kriging has emerged as one of the most popular emulation methods for both deterministic and stochastic simulations. Conventional Kriging models with predetermined mean functions, such as ordinary or universal Kriging, may exhibit subpar predictive performance when strong trends exist. This paper proposes a novel variable selection procedure for the mean function that ensures prediction accuracy while using only a limited number of variables to capture the potential existing trends in deterministic simulations. The proposed method integrates the benefits of Bayesian variable selection and frequentist statistical tests. Initially, a group of potential models is chosen to build the mean function, employing the Bayesian method with priors designed to guarantee sparsity. This results in a significant reduction in the number of models to be considered in the next stage. Subsequently, each candidate model undergoes rigorous frequentist tests to thoroughly assess its reliability and validity. Extensive simulation studies are conducted using the well-known Borehole function and a real-life case. The results demonstrate the superiority of the proposed method over several existing approaches, establishing its effectiveness in achieving robust parameter design.

Suggested Citation

  • Tao, Baoping & Han, Zifei & Shi, Wen & Wang, Min & Ouyang, Linhan, 2026. "Bayesian variable selection in Kriging metamodeling for quality design," European Journal of Operational Research, Elsevier, vol. 328(1), pages 216-231.
  • Handle: RePEc:eee:ejores:v:328:y:2026:i:1:p:216-231
    DOI: 10.1016/j.ejor.2025.06.003
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221725004722
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ejor.2025.06.003?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Jack P. C. Kleijnen & Wim C. M. van Beers, 2022. "Statistical Tests for Cross-Validation of Kriging Models," INFORMS Journal on Computing, INFORMS, vol. 34(1), pages 607-621, January.
    2. Wen Shi & Xi Chen & Jennifer Shang, 2019. "An Efficient Morris Method-Based Framework for Simulation Factor Screening," INFORMS Journal on Computing, INFORMS, vol. 31(4), pages 745-770, October.
    3. Hu, Mingjie & Xu, Jie & Chen, Chun-Hung & Hu, Jian-Qiang, 2025. "Optimal computation budget allocation with Gaussian process regression," European Journal of Operational Research, Elsevier, vol. 322(1), pages 147-156.
    4. Kleijnen, Jack P.C., 2009. "Kriging metamodeling in simulation: A review," European Journal of Operational Research, Elsevier, vol. 192(3), pages 707-716, February.
    5. Berger J.O. & De Oliveira V. & Sanso B., 2001. "Objective Bayesian Analysis of Spatially Correlated Data," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 1361-1374, December.
    6. Songhao Wang & Szu Hui Ng & William Benjamin Haskell, 2022. "A Multilevel Simulation Optimization Approach for Quantile Functions," INFORMS Journal on Computing, INFORMS, vol. 34(1), pages 569-585, January.
    7. Rojas Gonzalez, Sebastian & Branke, Juergen & Van Nieuwenhuyse, Inneke, 2025. "Bi-objective ranking and selection using stochastic kriging," European Journal of Operational Research, Elsevier, vol. 322(2), pages 599-614.
    8. Erickson, Collin B. & Ankenman, Bruce E. & Sanchez, Susan M., 2018. "Comparison of Gaussian process modeling software," European Journal of Operational Research, Elsevier, vol. 266(1), pages 179-192.
    9. Jakubik, Johannes & Binding, Adrian & Feuerriegel, Stefan, 2021. "Directed particle swarm optimization with Gaussian-process-based function forecasting," European Journal of Operational Research, Elsevier, vol. 295(1), pages 157-169.
    10. MacDonald, Blake & Ranjan, Pritam & Chipman, Hugh, 2015. "GPfit: An R Package for Fitting a Gaussian Process Model to Deterministic Simulator Outputs," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 64(i12).
    11. Dupuy, Delphine & Helbert, Céline & Franco, Jessica, 2015. "DiceDesign and DiceEval: Two R Packages for Design and Analysis of Computer Experiments," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 65(i11).
    12. Villanueva-Cantillo, Jeyms & Munoz-Marquez, Manuel, 2021. "Methodology for calculating critical values of relevance measures in variable selection methods in data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 290(2), pages 657-670.
    13. Linhan Ouyang & Shichao Zhu & Keying Ye & Chanseok Park & Min Wang, 2022. "Robust Bayesian hierarchical modeling and inference using scale mixtures of normal distributions," IISE Transactions, Taylor & Francis Journals, vol. 54(7), pages 659-671, July.
    14. Ran Jin & Xinwei Deng, 2015. "Ensemble modeling for data fusion in manufacturing process scale-up," IISE Transactions, Taylor & Francis Journals, vol. 47(3), pages 203-214, March.
    15. Chen, Xi & Zhou, Qiang, 2017. "Sequential design strategies for mean response surface metamodeling via stochastic kriging with adaptive exploration and exploitation," European Journal of Operational Research, Elsevier, vol. 262(2), pages 575-585.
    16. P. J. Brown & M. Vannucci & T. Fearn, 2002. "Bayes model averaging with selection of regressors," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(3), pages 519-536, August.
    17. D den Hertog & J P C Kleijnen & A Y D Siem, 2006. "The correct Kriging variance estimated by bootstrapping," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 57(4), pages 400-409, April.
    18. Bruce Ankenman & Barry L. Nelson & Jeremy Staum, 2010. "Stochastic Kriging for Simulation Metamodeling," Operations Research, INFORMS, vol. 58(2), pages 371-382, April.
    19. Shi, Wen & Shang, Jennifer & Liu, Zhixue & Zuo, Xiaolu, 2014. "Optimal design of the auto parts supply chain for JIT operations: Sequential bifurcation factor screening and multi-response surface methodology," European Journal of Operational Research, Elsevier, vol. 236(2), pages 664-676.
    20. Price, Ilan & Fowkes, Jaroslav & Hopman, Daniel, 2019. "Gaussian processes for unconstraining demand," European Journal of Operational Research, Elsevier, vol. 275(2), pages 621-634.
    21. Gabriella Dellino & Jack P. C. Kleijnen & Carlo Meloni, 2012. "Robust Optimization in Simulation: Taguchi and Krige Combined," INFORMS Journal on Computing, INFORMS, vol. 24(3), pages 471-484, August.
    22. Batur, Demet & Bekki, Jennifer M. & Chen, Xi, 2018. "Quantile regression metamodeling: Toward improved responsiveness in the high-tech electronics manufacturing industry," European Journal of Operational Research, Elsevier, vol. 264(1), pages 212-224.
    23. Xie, Wei & Barton, Russell R. & Nelson, Barry L. & Wang, Keqi, 2023. "Stochastic simulation uncertainty analysis to accelerate flexible biomanufacturing process development," European Journal of Operational Research, Elsevier, vol. 310(1), pages 238-248.
    24. Kleijnen, Jack P.C., 2017. "Regression and Kriging metamodels with their experimental designs in simulation: A review," European Journal of Operational Research, Elsevier, vol. 256(1), pages 1-16.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kleijnen, Jack P.C., 2013. "Simulation-Optimization via Kriging and Bootstrapping : A Survey (Revision of CentER DP 2011-064)," Other publications TiSEM 6ac4e049-ad86-447f-aeec-a, Tilburg University, School of Economics and Management.
    2. Zhang, Wei & (Ato) Xu, Wangtu, 2017. "Simulation-based robust optimization for the schedule of single-direction bus transit route: The design of experiment," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 106(C), pages 203-230.
    3. Xuefei Lu & Alessandro Rudi & Emanuele Borgonovo & Lorenzo Rosasco, 2020. "Faster Kriging: Facing High-Dimensional Simulators," Operations Research, INFORMS, vol. 68(1), pages 233-249, January.
    4. Mehdad, E. & Kleijnen, Jack P.C., 2014. "Classic Kriging versus Kriging with Bootstrapping or Conditional Simulation : Classic Kriging's Robust Confidence Intervals and Optimization (Revised version of CentER DP 2013-038)," Other publications TiSEM 4915047b-afe4-4fc7-8a1c-4, Tilburg University, School of Economics and Management.
    5. Kleijnen, Jack P.C., 2017. "Regression and Kriging metamodels with their experimental designs in simulation: A review," European Journal of Operational Research, Elsevier, vol. 256(1), pages 1-16.
    6. Zilong Wang & Marianthi Ierapetritou, 2018. "Surrogate-based feasibility analysis for black-box stochastic simulations with heteroscedastic noise," Journal of Global Optimization, Springer, vol. 71(4), pages 957-985, August.
    7. Bing Wang & Jiaqiao Hu, 2018. "Some Monotonicity Results for Stochastic Kriging Metamodels in Sequential Settings," INFORMS Journal on Computing, INFORMS, vol. 30(2), pages 278-294, May.
    8. Jinbiao Huo & Ziyuan Gu & Zhiyuan Liu & Shuaian Wang & Gilbert Laporte, 2025. "A Heteroscedastic Robust Bayesian Optimization Method for Solving Simulation-Based Transportation Problems," Transportation Science, INFORMS, vol. 59(6), pages 1353-1374, November.
    9. Ding, Chunfeng & Wang, Jianjun & Zhang, Suying & Yang, Shijuan & Ma, Yizhong, 2025. "A novel active learning stochastic Kriging metamodel for improving reliability and stability of additive manufacturing processes," Reliability Engineering and System Safety, Elsevier, vol. 260(C).
    10. Gotherwal, Deepesh & Ranjan, Pritam & Lekivetz, Ryan, 2026. "Comprehensive Review of Various Verification and Validation Techniques for Business Simulation Models," EconStor Preprints 339750, ZBW - Leibniz Information Centre for Economics.
    11. Song, Zhouzhou & Zhang, Hanyu & Liu, Zhao & Zhu, Ping, 2023. "A two-stage Kriging estimation variance reduction method for efficient time-variant reliability-based design optimization," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    12. Xi Chen & Kyoung-Kuk Kim, 2016. "Efficient VaR and CVaR Measurement via Stochastic Kriging," INFORMS Journal on Computing, INFORMS, vol. 28(4), pages 629-644, November.
    13. Erickson, Collin B. & Ankenman, Bruce E. & Sanchez, Susan M., 2018. "Comparison of Gaussian process modeling software," European Journal of Operational Research, Elsevier, vol. 266(1), pages 179-192.
    14. J.-J. Sinou & L. Nechak & S. Besset, 2018. "Kriging Metamodeling in Rotordynamics: Application for Predicting Critical Speeds and Vibrations of a Flexible Rotor," Complexity, Hindawi, vol. 2018, pages 1-26, March.
    15. Cheng Li & Siyang Gao & Jianzhong Du, 2023. "Convergence Analysis of Stochastic Kriging-Assisted Simulation with Random Covariates," INFORMS Journal on Computing, INFORMS, vol. 35(2), pages 386-402, March.
    16. Liu, Yushan & Li, Luyi & Zhao, Sihan & Song, Shufang, 2021. "A global surrogate model technique based on principal component analysis and Kriging for uncertainty propagation of dynamic systems," Reliability Engineering and System Safety, Elsevier, vol. 207(C).
    17. Rodriguez, Sergio & Ludkovski, Michael, 2020. "Probabilistic bisection with spatial metamodels," European Journal of Operational Research, Elsevier, vol. 286(2), pages 588-603.
    18. Scott L. Rosen & Christopher P. Saunders & Samar K Guharay, 2015. "A Structured Approach for Rapidly Mapping Multilevel System Measures via Simulation Metamodeling," Systems Engineering, John Wiley & Sons, vol. 18(1), pages 87-101, January.
    19. Kleijnen, Jack P.C. & van Beers, W.C.M. & van Nieuwenhuyse, I., 2011. "Expected Improvement in Efficient Global Optimization Through Bootstrapped Kriging - Replaces CentER DP 2010-62," Discussion Paper 2011-015, Tilburg University, Center for Economic Research.
    20. J P C Kleijnen & W C M van Beers, 2013. "Monotonicity-preserving bootstrapped Kriging metamodels for expensive simulations," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 64(5), pages 708-717, May.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:328:y:2026:i:1:p:216-231. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.