IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v322y2025i1p147-156.html
   My bibliography  Save this article

Optimal computation budget allocation with Gaussian process regression

Author

Listed:
  • Hu, Mingjie
  • Xu, Jie
  • Chen, Chun-Hung
  • Hu, Jian-Qiang

Abstract

We consider Ranking and Selection (R&S) in the presence of spatial correlation among designs. The performance of each design can only be evaluated through stochastic simulation with heterogeneous noise. Our primary objective is to maximize the probability of correct selection (PCS) by optimally allocating the simulation budget considering the spatial correlation among designs. We propose using Gaussian process regression (GPR) to model the spatial correlation and develop a GPR-based optimal computing budget allocation (GPOCBA) framework to derive an asymptotically optimal allocation policy. Additionally, we analyze the impact of spatial correlation on allocation policy and quantify its benefits under specific cases. We also introduce a sequential implementation of GPOCBA and establish convergence results. Numerical experiments show that the proposed GPOCBA method significantly outperforms the widely used OCBA, demonstrating improved computational efficiency by considering spatial correlation in R&S problems.

Suggested Citation

  • Hu, Mingjie & Xu, Jie & Chen, Chun-Hung & Hu, Jian-Qiang, 2025. "Optimal computation budget allocation with Gaussian process regression," European Journal of Operational Research, Elsevier, vol. 322(1), pages 147-156.
    • Handle: RePEc:eee:ejores:v:322:y:2025:i:1:p:147-156
    DOI: 10.1016/j.ejor.2024.11.049
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221724009408
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ejor.2024.11.049?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jing Xie & Peter I. Frazier & Stephen E. Chick, 2016. "Bayesian Optimization via Simulation with Pairwise Sampling and Correlated Prior Beliefs," Operations Research, INFORMS, vol. 64(2), pages 542-559, April.
    2. Jianzhong Du & Siyang Gao & Chun-Hung Chen, 2024. "A Contextual Ranking and Selection Method for Personalized Medicine," Manufacturing & Service Operations Management, INFORMS, vol. 26(1), pages 167-181, January.
    3. Mark Brantley & Loo Lee & Chun-Hung Chen & Argon Chen, 2013. "Efficient simulation budget allocation with regression," IISE Transactions, Taylor & Francis Journals, vol. 45(3), pages 291-308.
    4. Haihui Shen & L. Jeff Hong & Xiaowei Zhang, 2021. "Ranking and Selection with Covariates for Personalized Decision Making," INFORMS Journal on Computing, INFORMS, vol. 33(4), pages 1500-1519, October.
    5. Bruce Ankenman & Barry L. Nelson & Jeremy Staum, 2010. "Stochastic Kriging for Simulation Metamodeling," Operations Research, INFORMS, vol. 58(2), pages 371-382, April.
    6. Michael C. Fu & Jian-Qiang Hu & Chun-Hung Chen & Xiaoping Xiong, 2007. "Simulation Allocation for Determining the Best Design in the Presence of Correlated Sampling," INFORMS Journal on Computing, INFORMS, vol. 19(1), pages 101-111, February.
    7. Travis Goodwin & Jie Xu & Nurcin Celik & Chun-Hung Chen, 2024. "Real-time digital twin-based optimization with predictive simulation learning," Journal of Simulation, Taylor & Francis Journals, vol. 18(1), pages 47-64, January.
    8. Chun-Hung Chen & Stephen E. Chick & Loo Hay Lee & Nugroho A. Pujowidianto, 2015. "Ranking and Selection: Efficient Simulation Budget Allocation," International Series in Operations Research & Management Science, in: Michael C Fu (ed.), Handbook of Simulation Optimization, edition 127, chapter 0, pages 45-80, Springer.
    9. Hui Xiao & Fei Gao & Loo Hay Lee, 2020. "Optimal computing budget allocation for complete ranking with input uncertainty," IISE Transactions, Taylor & Francis Journals, vol. 52(5), pages 489-499, May.
    10. Peter Frazier & Warren Powell & Savas Dayanik, 2009. "The Knowledge-Gradient Policy for Correlated Normal Beliefs," INFORMS Journal on Computing, INFORMS, vol. 21(4), pages 599-613, November.
    11. Haidong Li & Henry Lam & Yijie Peng, 2024. "Efficient Learning for Clustering and Optimizing Context-Dependent Designs," Operations Research, INFORMS, vol. 72(2), pages 617-638, March.
    12. David J. Eckman & Matthew Plumlee & Barry L. Nelson, 2022. "Plausible Screening Using Functional Properties for Simulations with Large Solution Spaces," Operations Research, INFORMS, vol. 70(6), pages 3473-3489, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Tianxiang & Xu, Jie & Branke, Juergen & Hu, Jian-Qiang & Chen, Chun-Hung, 2025. "Ranking and selection with two-stage decision," European Journal of Operational Research, Elsevier, vol. 322(1), pages 121-132.
    2. David J. Eckman & Shane G. Henderson, 2022. "Posterior-Based Stopping Rules for Bayesian Ranking-and-Selection Procedures," INFORMS Journal on Computing, INFORMS, vol. 34(3), pages 1711-1728, May.
    3. Stephen E. Chick & Noah Gans & Özge Yapar, 2022. "Bayesian Sequential Learning for Clinical Trials of Multiple Correlated Medical Interventions," Management Science, INFORMS, vol. 68(7), pages 4919-4938, July.
    4. Mark Semelhago & Barry L. Nelson & Eunhye Song & Andreas Wächter, 2021. "Rapid Discrete Optimization via Simulation with Gaussian Markov Random Fields," INFORMS Journal on Computing, INFORMS, vol. 33(3), pages 915-930, July.
    5. Xuefei Lu & Alessandro Rudi & Emanuele Borgonovo & Lorenzo Rosasco, 2020. "Faster Kriging: Facing High-Dimensional Simulators," Operations Research, INFORMS, vol. 68(1), pages 233-249, January.
    6. Cheng Li & Siyang Gao & Jianzhong Du, 2023. "Convergence Analysis of Stochastic Kriging-Assisted Simulation with Random Covariates," INFORMS Journal on Computing, INFORMS, vol. 35(2), pages 386-402, March.
    7. J P C Kleijnen & W C M van Beers, 2013. "Monotonicity-preserving bootstrapped Kriging metamodels for expensive simulations," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 64(5), pages 708-717, May.
    8. Jeffrey W. Herrmann & Kunal Mehta, 2020. "Lookahead and Hybrid Sample Allocation Procedures for Multiple Attribute Selection Decisions," Papers 2007.16119, arXiv.org.
    9. Kamiński, Bogumił, 2015. "A method for the updating of stochastic kriging metamodels," European Journal of Operational Research, Elsevier, vol. 247(3), pages 859-866.
    10. Diana M. Negoescu & Peter I. Frazier & Warren B. Powell, 2011. "The Knowledge-Gradient Algorithm for Sequencing Experiments in Drug Discovery," INFORMS Journal on Computing, INFORMS, vol. 23(3), pages 346-363, August.
    11. Kleijnen, Jack P.C. & van Beers, W.C.M. & van Nieuwenhuyse, I., 2011. "Expected Improvement in Efficient Global Optimization Through Bootstrapped Kriging - Replaces CentER DP 2010-62," Discussion Paper 2011-015, Tilburg University, Center for Economic Research.
    12. Huashuai Qu & Ilya O. Ryzhov & Michael C. Fu & Zi Ding, 2015. "Sequential Selection with Unknown Correlation Structures," Operations Research, INFORMS, vol. 63(4), pages 931-948, August.
    13. Guangxin Jiang & L. Jeff Hong & Haihui Shen, 2024. "Real-Time Derivative Pricing and Hedging with Consistent Metamodels," INFORMS Journal on Computing, INFORMS, vol. 36(5), pages 1168-1189, September.
    14. Kleijnen, Jack P.C., 2013. "Simulation-Optimization via Kriging and Bootstrapping : A Survey (Revision of CentER DP 2011-064)," Other publications TiSEM 6ac4e049-ad86-447f-aeec-a, Tilburg University, School of Economics and Management.
    15. Ilya O. Ryzhov, 2016. "On the Convergence Rates of Expected Improvement Methods," Operations Research, INFORMS, vol. 64(6), pages 1515-1528, December.
    16. Zhou, Tianli & Fields, Evan & Osorio, Carolina, 2023. "A data-driven discrete simulation-based optimization algorithm for car-sharing service design," Transportation Research Part B: Methodological, Elsevier, vol. 178(C).
    17. Corlu, Canan G. & Akcay, Alp & Xie, Wei, 2020. "Stochastic simulation under input uncertainty: A Review," Operations Research Perspectives, Elsevier, vol. 7(C).
    18. Jack Kleijnen & Wim Beers & Inneke Nieuwenhuyse, 2012. "Expected improvement in efficient global optimization through bootstrapped kriging," Journal of Global Optimization, Springer, vol. 54(1), pages 59-73, September.
    19. Bin Han & Ilya O. Ryzhov & Boris Defourny, 2016. "Optimal Learning in Linear Regression with Combinatorial Feature Selection," INFORMS Journal on Computing, INFORMS, vol. 28(4), pages 721-735, November.
    20. Jalali, Hamed & Van Nieuwenhuyse, Inneke & Picheny, Victor, 2017. "Comparison of Kriging-based algorithms for simulation optimization with heterogeneous noise," European Journal of Operational Research, Elsevier, vol. 261(1), pages 279-301.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:322:y:2025:i:1:p:147-156. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.