IDEAS home Printed from https://ideas.repec.org/a/inm/orijoc/v34y2022i1p569-585.html
   My bibliography  Save this article

A Multilevel Simulation Optimization Approach for Quantile Functions

Author

Listed:
  • Songhao Wang

    (Department of Information Systems and Management Engineering, Southern University of Science and Technology, Shenzhen 518000, China)

  • Szu Hui Ng

    (Department of Industrial Systems Engineering and Management, National University of Singapore, Singapore 117576)

  • William Benjamin Haskell

    (Krannert School of Management, Purdue University, West Lafayette, Indiana 47906)

Abstract

A quantile is a popular performance measure for a stochastic system to evaluate its variability and risk. To reduce the risk, selecting the actions that minimize the tail quantiles of some loss distributions is typically of interest for decision makers. When the loss distribution is observed via simulations, evaluating and optimizing its quantile can be challenging, especially when the simulations are expensive as it may cost a large number of simulation runs to obtain accurate quantile estimators. In this work, we propose a multilevel metamodel (cokriging)-based algorithm to optimize quantiles more efficiently. Utilizing nondecreasing properties of quantiles, we first search on cheaper and informative lower quantiles, which are more accurate and easier to optimize. The quantile level iteratively increases to the objective level, and the search has a focus on the possible promising regions identified by the previous levels. This enables us to leverage the accurate information from the lower quantiles to find the optimums faster and improve algorithm efficiency.

Suggested Citation

  • Songhao Wang & Szu Hui Ng & William Benjamin Haskell, 2022. "A Multilevel Simulation Optimization Approach for Quantile Functions," INFORMS Journal on Computing, INFORMS, vol. 34(1), pages 569-585, January.
  • Handle: RePEc:inm:orijoc:v:34:y:2022:i:1:p:569-585
    DOI: 10.1287/ijoc.2020.1049
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/ijoc.2020.1049
    Download Restriction: no

    File URL: https://libkey.io/10.1287/ijoc.2020.1049?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jalali, Hamed & Van Nieuwenhuyse, Inneke & Picheny, Victor, 2017. "Comparison of Kriging-based algorithms for simulation optimization with heterogeneous noise," European Journal of Operational Research, Elsevier, vol. 261(1), pages 279-301.
    2. D. Huang & T. Allen & W. Notz & N. Zeng, 2006. "Global Optimization of Stochastic Black-Box Systems via Sequential Kriging Meta-Models," Journal of Global Optimization, Springer, vol. 34(3), pages 441-466, March.
    3. Jack Kleijnen & Wim Beers & Inneke Nieuwenhuyse, 2012. "Expected improvement in efficient global optimization through bootstrapped kriging," Journal of Global Optimization, Springer, vol. 54(1), pages 59-73, September.
    4. Jooyong Shim & Changha Hwang & Kyung Seok, 2009. "Non-crossing quantile regression via doubly penalized kernel machine," Computational Statistics, Springer, vol. 24(1), pages 83-94, February.
    5. Howard D. Bondell & Brian J. Reich & Huixia Wang, 2010. "Noncrossing quantile regression curve estimation," Biometrika, Biometrika Trust, vol. 97(4), pages 825-838.
    6. L. Jeff Hong & Guangwu Liu, 2009. "Simulating Sensitivities of Conditional Value at Risk," Management Science, INFORMS, vol. 55(2), pages 281-293, February.
    7. L. Jeff Hong & Barry L. Nelson, 2006. "Discrete Optimization via Simulation Using COMPASS," Operations Research, INFORMS, vol. 54(1), pages 115-129, February.
    8. Andrew F. Seila, 1982. "A Batching Approach to Quantile Estimation in Regenerative Simulations," Management Science, INFORMS, vol. 28(5), pages 573-581, May.
    9. Evert Wipplinger, 2007. "Philippe Jorion: Value at Risk – The New Benchmark for Managing Financial Risk," Financial Markets and Portfolio Management, Springer;Swiss Society for Financial Market Research, vol. 21(3), pages 397-398, September.
    10. Xi Chen & Kyoung-Kuk Kim, 2016. "Efficient VaR and CVaR Measurement via Stochastic Kriging," INFORMS Journal on Computing, INFORMS, vol. 28(4), pages 629-644, November.
    11. Bruce Ankenman & Barry L. Nelson & Jeremy Staum, 2010. "Stochastic Kriging for Simulation Metamodeling," Operations Research, INFORMS, vol. 58(2), pages 371-382, April.
    12. Dabo-Niang, Sophie & Thiam, Baba, 2010. "Robust quantile estimation and prediction for spatial processes," Statistics & Probability Letters, Elsevier, vol. 80(17-18), pages 1447-1458, September.
    13. Pedrielli, Giulia & Wang, Songhao & Ng, Szu Hui, 2020. "An extended Two-Stage Sequential Optimization approach: Properties and performance," European Journal of Operational Research, Elsevier, vol. 287(3), pages 929-945.
    14. Koenker, Roger, 1984. "A note on L-estimates for linear models," Statistics & Probability Letters, Elsevier, vol. 2(6), pages 323-325, December.
    15. G. Yi & J. Q. Shi & T. Choi, 2011. "Penalized Gaussian Process Regression and Classification for High-Dimensional Nonlinear Data," Biometrics, The International Biometric Society, vol. 67(4), pages 1285-1294, December.
    16. Rommel G. Regis & Christine A. Shoemaker, 2007. "A Stochastic Radial Basis Function Method for the Global Optimization of Expensive Functions," INFORMS Journal on Computing, INFORMS, vol. 19(4), pages 497-509, November.
    17. Richard E. Nance & Robert G. Sargent, 2002. "Perspectives on the Evolution of Simulation," Operations Research, INFORMS, vol. 50(1), pages 161-172, February.
    18. T. J. Cole, 1988. "Fitting Smoothed Centile Curves to Reference Data," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 151(3), pages 385-406, May.
    19. Ning Quan & Jun Yin & Szu Ng & Loo Lee, 2013. "Simulation optimization via kriging: a sequential search using expected improvement with computing budget constraints," IISE Transactions, Taylor & Francis Journals, vol. 45(7), pages 763-780.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jingxu Xu & Zeyu Zheng, 2023. "Gradient-Based Simulation Optimization Algorithms via Multi-Resolution System Approximations," INFORMS Journal on Computing, INFORMS, vol. 35(3), pages 633-651, May.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Qun Meng & Songhao Wang & Szu Hui Ng, 2022. "Combined Global and Local Search for Optimization with Gaussian Process Models," INFORMS Journal on Computing, INFORMS, vol. 34(1), pages 622-637, January.
    2. Xi Chen & Kyoung-Kuk Kim, 2016. "Efficient VaR and CVaR Measurement via Stochastic Kriging," INFORMS Journal on Computing, INFORMS, vol. 28(4), pages 629-644, November.
    3. Pedrielli, Giulia & Wang, Songhao & Ng, Szu Hui, 2020. "An extended Two-Stage Sequential Optimization approach: Properties and performance," European Journal of Operational Research, Elsevier, vol. 287(3), pages 929-945.
    4. Jalali, Hamed & Van Nieuwenhuyse, Inneke & Picheny, Victor, 2017. "Comparison of Kriging-based algorithms for simulation optimization with heterogeneous noise," European Journal of Operational Research, Elsevier, vol. 261(1), pages 279-301.
    5. Rojas Gonzalez, Sebastian & Jalali, Hamed & Van Nieuwenhuyse, Inneke, 2020. "A multiobjective stochastic simulation optimization algorithm," European Journal of Operational Research, Elsevier, vol. 284(1), pages 212-226.
    6. Ehsan Mehdad & Jack P. C. Kleijnen, 2018. "Efficient global optimisation for black-box simulation via sequential intrinsic Kriging," Journal of the Operational Research Society, Taylor & Francis Journals, vol. 69(11), pages 1725-1737, November.
    7. Xuefei Lu & Alessandro Rudi & Emanuele Borgonovo & Lorenzo Rosasco, 2020. "Faster Kriging: Facing High-Dimensional Simulators," Operations Research, INFORMS, vol. 68(1), pages 233-249, January.
    8. Mehdad, E. & Kleijnen, Jack P.C., 2014. "Global Optimization for Black-box Simulation via Sequential Intrinsic Kriging," Other publications TiSEM 8fa8d96f-a086-4c4b-88ab-9, Tilburg University, School of Economics and Management.
    9. Zilong Wang & Marianthi Ierapetritou, 2018. "Surrogate-based feasibility analysis for black-box stochastic simulations with heteroscedastic noise," Journal of Global Optimization, Springer, vol. 71(4), pages 957-985, August.
    10. Satyajith Amaran & Nikolaos V. Sahinidis & Bikram Sharda & Scott J. Bury, 2016. "Simulation optimization: a review of algorithms and applications," Annals of Operations Research, Springer, vol. 240(1), pages 351-380, May.
    11. Dawei Zhan & Huanlai Xing, 2020. "Expected improvement for expensive optimization: a review," Journal of Global Optimization, Springer, vol. 78(3), pages 507-544, November.
    12. Kleijnen, Jack P.C., 2013. "Simulation-Optimization via Kriging and Bootstrapping : A Survey (Revision of CentER DP 2011-064)," Other publications TiSEM 6ac4e049-ad86-447f-aeec-a, Tilburg University, School of Economics and Management.
    13. Lihua Sun & L. Jeff Hong & Zhaolin Hu, 2014. "Balancing Exploitation and Exploration in Discrete Optimization via Simulation Through a Gaussian Process-Based Search," Operations Research, INFORMS, vol. 62(6), pages 1416-1438, December.
    14. Jing Xie & Peter I. Frazier & Stephen E. Chick, 2016. "Bayesian Optimization via Simulation with Pairwise Sampling and Correlated Prior Beliefs," Operations Research, INFORMS, vol. 64(2), pages 542-559, April.
    15. Y. Andriyana & I. Gijbels & A. Verhasselt, 2018. "Quantile regression in varying-coefficient models: non-crossing quantile curves and heteroscedasticity," Statistical Papers, Springer, vol. 59(4), pages 1589-1621, December.
    16. Qi Fan & Jiaqiao Hu, 2018. "Surrogate-Based Promising Area Search for Lipschitz Continuous Simulation Optimization," INFORMS Journal on Computing, INFORMS, vol. 30(4), pages 677-693, November.
    17. Mehdad, E. & Kleijnen, Jack P.C., 2014. "Classic Kriging versus Kriging with Bootstrapping or Conditional Simulation : Classic Kriging's Robust Confidence Intervals and Optimization (Revised version of CentER DP 2013-038)," Other publications TiSEM 4915047b-afe4-4fc7-8a1c-4, Tilburg University, School of Economics and Management.
    18. Zhe Zhou & Fusheng Bai, 2018. "An adaptive framework for costly black-box global optimization based on radial basis function interpolation," Journal of Global Optimization, Springer, vol. 70(4), pages 757-781, April.
    19. Ilaria Lucrezia Amerise, 2013. "Weighted Non-Crossing Quantile Regressions," Working Papers 201308, Università della Calabria, Dipartimento di Economia, Statistica e Finanza "Giovanni Anania" - DESF.
    20. Taimoor Akhtar & Christine Shoemaker, 2016. "Multi objective optimization of computationally expensive multi-modal functions with RBF surrogates and multi-rule selection," Journal of Global Optimization, Springer, vol. 64(1), pages 17-32, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:orijoc:v:34:y:2022:i:1:p:569-585. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.