IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v202y2010i1p164-174.html
   My bibliography  Save this article

Constrained optimization in expensive simulation: Novel approach

Author

Listed:
  • Kleijnen, Jack P.C.
  • Beers, Wim van
  • Nieuwenhuyse, Inneke van

Abstract

This article presents a novel heuristic for constrained optimization of computationally expensive random simulation models. One output is selected as objective to be minimized, while other outputs must satisfy given threshold values. Moreover, the simulation inputs must be integer and satisfy linear or nonlinear constraints. The heuristic combines (i) sequentialized experimental designs to specify the simulation input combinations, (ii) Kriging (or Gaussian process or spatial correlation modeling) to analyze the global simulation input/output data resulting from these designs, and (iii) integer nonlinear programming to estimate the optimal solution from the Kriging metamodels. The heuristic is applied to an (s,S) inventory system and a call-center simulation, and compared with the popular commercial heuristic OptQuest embedded in the Arena versions 11 and 12. In these two applications the novel heuristic outperforms OptQuest in terms of number of simulated input combinations and quality of the estimated optimum.

Suggested Citation

  • Kleijnen, Jack P.C. & Beers, Wim van & Nieuwenhuyse, Inneke van, 2010. "Constrained optimization in expensive simulation: Novel approach," European Journal of Operational Research, Elsevier, vol. 202(1), pages 164-174, April.
  • Handle: RePEc:eee:ejores:v:202:y:2010:i:1:p:164-174
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377-2217(09)00313-0
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kleijnen, Jack P.C. & Deflandre, David, 2006. "Validation of regression metamodels in simulation: Bootstrap approach," European Journal of Operational Research, Elsevier, vol. 170(1), pages 120-131, April.
    2. D. Huang & T. Allen & W. Notz & N. Zeng, 2006. "Global Optimization of Stochastic Black-Box Systems via Sequential Kriging Meta-Models," Journal of Global Optimization, Springer, vol. 34(3), pages 441-466, March.
    3. Mehmet Tolga Cezik & Pierre L'Ecuyer, 2008. "Staffing Multiskill Call Centers via Linear Programming and Simulation," Management Science, INFORMS, vol. 54(2), pages 310-323, February.
    4. D den Hertog & J P C Kleijnen & A Y D Siem, 2006. "The correct Kriging variance estimated by bootstrapping," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 57(4), pages 400-409, April.
    5. Kleijnen, Jack P.C., 2009. "Kriging metamodeling in simulation: A review," European Journal of Operational Research, Elsevier, vol. 192(3), pages 707-716, February.
    6. van Beers, Wim C.M. & Kleijnen, Jack P.C., 2008. "Customized sequential designs for random simulation experiments: Kriging metamodeling and bootstrapping," European Journal of Operational Research, Elsevier, vol. 186(3), pages 1099-1113, May.
    7. Kleijnen, Jack P. C. & den Hertog, Dick & Angun, Ebru, 2004. "Response surface methodology's steepest ascent and step size revisited," European Journal of Operational Research, Elsevier, vol. 159(1), pages 121-131, November.
    8. Sridhar Bashyam & Michael C. Fu, 1998. "Optimization of (s, S) Inventory Systems with Random Lead Times and a Service Level Constraint," Management Science, INFORMS, vol. 44(12-Part-2), pages 243-256, December.
    9. James P. Kelly, 2002. "Simulation Optimization is Evolving," INFORMS Journal on Computing, INFORMS, vol. 14(3), pages 223-225, August.
    10. Driessen, L. & Brekelmans, R.C.M. & Gerichhausen, M. & Hamers, H.J.M. & den Hertog, D., 2006. "Why Methods for Optimization Problems with Time-Consuming Function Evaluations and Integer Variables Should Use Global Approximation Models," Discussion Paper 2006-4, Tilburg University, Center for Economic Research.
    11. Angun, M.E. & Gürkan, G. & den Hertog, D. & Kleijnen, J.P.C., 2002. "Response surface methodology revisited," Other publications TiSEM 32c35a04-3de9-4dee-a242-6, Tilburg University, School of Economics and Management.
    12. Jack P.C. Kleijnen, 2015. "Design and Analysis of Simulation Experiments," International Series in Operations Research and Management Science, Springer, edition 2, number 978-3-319-18087-8, December.
    13. Jürgen Branke & Stephen E. Chick & Christian Schmidt, 2007. "Selecting a Selection Procedure," Management Science, INFORMS, vol. 53(12), pages 1916-1932, December.
    14. Júlíus Atlason & Marina A. Epelman & Shane G. Henderson, 2008. "Optimizing Call Center Staffing Using Simulation and Analytic Center Cutting-Plane Methods," Management Science, INFORMS, vol. 54(2), pages 295-309, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kleijnen, Jack P.C. & van Beers, W.C.M. & van Nieuwenhuyse, I., 2011. "Expected Improvement in Efficient Global Optimization Through Bootstrapped Kriging - Replaces CentER DP 2010-62," Other publications TiSEM d3b15c46-27c4-493e-8c53-9, Tilburg University, School of Economics and Management.
    2. Zheng, Liang & Xue, Xinfeng & Xu, Chengcheng & Ran, Bin, 2019. "A stochastic simulation-based optimization method for equitable and efficient network-wide signal timing under uncertainties," Transportation Research Part B: Methodological, Elsevier, vol. 122(C), pages 287-308.
    3. Fani Boukouvala & M. M. Faruque Hasan & Christodoulos A. Floudas, 2017. "Global optimization of general constrained grey-box models: new method and its application to constrained PDEs for pressure swing adsorption," Journal of Global Optimization, Springer, vol. 67(1), pages 3-42, January.
    4. Kleijnen, Jack P.C. & Mehdad, E., 2014. "Multivariate Versus Univariate Kriging Metamodels for Multi-Response Simulation Models (Revision of 2012-039)," Discussion Paper 2014-012, Tilburg University, Center for Economic Research.
    5. Kleijnen, Jack P.C. & Mehdad, E., 2012. "Kriging in Multi-response Simulation, including a Monte Carlo Laboratory (Replaced by 2014-012)," Other publications TiSEM cf311469-5f8c-4c1e-ad4f-6, Tilburg University, School of Economics and Management.
    6. Arreola-Risa, Antonio & Giménez-García, Víctor M. & Martínez-Parra, José Luis, 2011. "Optimizing stochastic production-inventory systems: A heuristic based on simulation and regression analysis," European Journal of Operational Research, Elsevier, vol. 213(1), pages 107-118, August.
    7. Carolina Osorio & Michel Bierlaire, 2013. "A Simulation-Based Optimization Framework for Urban Transportation Problems," Operations Research, INFORMS, vol. 61(6), pages 1333-1345, December.
    8. Dhahri, Akrem & Gharbi, Ali & Ouhimmou, Mustapha, 2022. "Integrated production-delivery control policy for an unreliable manufacturing system and multiple retailers," International Journal of Production Economics, Elsevier, vol. 245(C).
    9. Hernandez, Andres F. & Grover, Martha A., 2013. "Error estimation properties of Gaussian process models in stochastic simulations," European Journal of Operational Research, Elsevier, vol. 228(1), pages 131-140.
    10. Kleijnen, Jack P.C., 2013. "Simulation-Optimization via Kriging and Bootstrapping : A Survey (Revision of CentER DP 2011-064)," Other publications TiSEM 6ac4e049-ad86-447f-aeec-a, Tilburg University, School of Economics and Management.
    11. Zhongshun Shi & Siyang Gao & Hui Xiao & Weiwei Chen, 2019. "A worst‐case formulation for constrained ranking and selection with input uncertainty," Naval Research Logistics (NRL), John Wiley & Sons, vol. 66(8), pages 648-662, December.
    12. Tsai, Shing Chih & Fu, Sheng Yang, 2014. "Genetic-algorithm-based simulation optimization considering a single stochastic constraint," European Journal of Operational Research, Elsevier, vol. 236(1), pages 113-125.
    13. Peter I. Frazier, 2014. "A Fully Sequential Elimination Procedure for Indifference-Zone Ranking and Selection with Tight Bounds on Probability of Correct Selection," Operations Research, INFORMS, vol. 62(4), pages 926-942, August.
    14. Kleijnen, Jack P.C., 2017. "Regression and Kriging metamodels with their experimental designs in simulation: A review," European Journal of Operational Research, Elsevier, vol. 256(1), pages 1-16.
    15. Kabirian, Alireza & Ólafsson, Sigurdur, 2011. "Continuous optimization via simulation using Golden Region search," European Journal of Operational Research, Elsevier, vol. 208(1), pages 19-27, January.
    16. Hainan Guo & Haobin Gu & Yu Zhou & Jiaxuan Peng, 2022. "A data-driven multi-fidelity simulation optimization for medical staff configuration at an emergency department in Hong Kong," Flexible Services and Manufacturing Journal, Springer, vol. 34(2), pages 238-262, June.
    17. Carolina Osorio & Linsen Chong, 2015. "A Computationally Efficient Simulation-Based Optimization Algorithm for Large-Scale Urban Transportation Problems," Transportation Science, INFORMS, vol. 49(3), pages 623-636, August.
    18. Nikolaos Ploskas & Nikolaos V. Sahinidis, 2022. "Review and comparison of algorithms and software for mixed-integer derivative-free optimization," Journal of Global Optimization, Springer, vol. 82(3), pages 433-462, March.
    19. Boukouvala, Fani & Misener, Ruth & Floudas, Christodoulos A., 2016. "Global optimization advances in Mixed-Integer Nonlinear Programming, MINLP, and Constrained Derivative-Free Optimization, CDFO," European Journal of Operational Research, Elsevier, vol. 252(3), pages 701-727.
    20. Miranda, Rafael de Carvalho & Montevechi, José Arnaldo Barra & da Silva, Aneirson Francisco & Marins, Fernando Augusto Silva, 2017. "Increasing the efficiency in integer simulation optimization: Reducing the search space through data envelopment analysis and orthogonal arrays," European Journal of Operational Research, Elsevier, vol. 262(2), pages 673-681.
    21. Osorio, Carolina, 2019. "High-dimensional offline origin-destination (OD) demand calibration for stochastic traffic simulators of large-scale road networks," Transportation Research Part B: Methodological, Elsevier, vol. 124(C), pages 18-43.
    22. Othmane Benmoussa, 2022. "Improving Replenishment Flows Using Simulation Results: A Case Study," Logistics, MDPI, vol. 6(2), pages 1-26, May.
    23. Strang, Kenneth David, 2012. "Importance of verifying queue model assumptions before planning with simulation software," European Journal of Operational Research, Elsevier, vol. 218(2), pages 493-504.
    24. Kleijnen, Jack P.C. & Mehdad, Ehsan, 2014. "Multivariate versus univariate Kriging metamodels for multi-response simulation models," European Journal of Operational Research, Elsevier, vol. 236(2), pages 573-582.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kleijnen, J.P.C. & van Beers, W.C.M. & van Nieuwenhuyse, I., 2008. "Constrained Optimization in Simulation : A Novel Approach," Discussion Paper 2008-95, Tilburg University, Center for Economic Research.
    2. Kleijnen, Jack P.C., 2013. "Simulation-Optimization via Kriging and Bootstrapping : A Survey (Revision of CentER DP 2011-064)," Discussion Paper 2013-064, Tilburg University, Center for Economic Research.
    3. Kleijnen, Jack P.C., 2009. "Kriging metamodeling in simulation: A review," European Journal of Operational Research, Elsevier, vol. 192(3), pages 707-716, February.
    4. Kleijnen, Jack P.C., 2017. "Regression and Kriging metamodels with their experimental designs in simulation: A review," European Journal of Operational Research, Elsevier, vol. 256(1), pages 1-16.
    5. Plischke, Elmar & Borgonovo, Emanuele & Smith, Curtis L., 2013. "Global sensitivity measures from given data," European Journal of Operational Research, Elsevier, vol. 226(3), pages 536-550.
    6. van Beers, Wim C.M. & Kleijnen, Jack P.C., 2008. "Customized sequential designs for random simulation experiments: Kriging metamodeling and bootstrapping," European Journal of Operational Research, Elsevier, vol. 186(3), pages 1099-1113, May.
    7. Kleijnen, Jack P.C. & Mehdad, E., 2013. "Conditional simulation for efficient global optimization," Other publications TiSEM 52e4860d-9887-4a63-b19a-7, Tilburg University, School of Economics and Management.
    8. J P C Kleijnen & W C M van Beers, 2013. "Monotonicity-preserving bootstrapped Kriging metamodels for expensive simulations," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 64(5), pages 708-717, May.
    9. Kleijnen, J.P.C., 2009. "Sensitivity Analysis of Simulation Models," Discussion Paper 2009-11, Tilburg University, Center for Economic Research.
    10. Mehdad, E. & Kleijnen, Jack P.C., 2014. "Classic Kriging versus Kriging with Bootstrapping or Conditional Simulation : Classic Kriging's Robust Confidence Intervals and Optimization (Revised version of CentER DP 2013-038)," Discussion Paper 2014-076, Tilburg University, Center for Economic Research.
    11. Bettonvil, Bert & del Castillo, Enrique & Kleijnen, Jack P.C., 2009. "Statistical testing of optimality conditions in multiresponse simulation-based optimization," European Journal of Operational Research, Elsevier, vol. 199(2), pages 448-458, December.
    12. Zhang, Wei & (Ato) Xu, Wangtu, 2017. "Simulation-based robust optimization for the schedule of single-direction bus transit route: The design of experiment," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 106(C), pages 203-230.
    13. Satyajith Amaran & Nikolaos V. Sahinidis & Bikram Sharda & Scott J. Bury, 2016. "Simulation optimization: a review of algorithms and applications," Annals of Operations Research, Springer, vol. 240(1), pages 351-380, May.
    14. Scott L. Rosen & Christopher P. Saunders & Samar K Guharay, 2015. "A Structured Approach for Rapidly Mapping Multilevel System Measures via Simulation Metamodeling," Systems Engineering, John Wiley & Sons, vol. 18(1), pages 87-101, January.
    15. Rommel Regis & Christine Shoemaker, 2013. "A quasi-multistart framework for global optimization of expensive functions using response surface models," Journal of Global Optimization, Springer, vol. 56(4), pages 1719-1753, August.
    16. Tian, Wei & Song, Jitian & Li, Zhanyong & de Wilde, Pieter, 2014. "Bootstrap techniques for sensitivity analysis and model selection in building thermal performance analysis," Applied Energy, Elsevier, vol. 135(C), pages 320-328.
    17. Angun, M.E. & Kleijnen, Jack P.C., 2012. "An asymptotic test of optimality conditions in multiresponse simulation optimization," Other publications TiSEM a69dfa59-b0e1-45bd-8cd6-a, Tilburg University, School of Economics and Management.
    18. Dellino, G. & Lino, P. & Meloni, C. & Rizzo, A., 2009. "Kriging metamodel management in the design optimization of a CNG injection system," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 79(8), pages 2345-2360.
    19. Strang, Kenneth David, 2012. "Importance of verifying queue model assumptions before planning with simulation software," European Journal of Operational Research, Elsevier, vol. 218(2), pages 493-504.
    20. Dawei Zhan & Huanlai Xing, 2020. "Expected improvement for expensive optimization: a review," Journal of Global Optimization, Springer, vol. 78(3), pages 507-544, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:202:y:2010:i:1:p:164-174. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.