IDEAS home Printed from https://ideas.repec.org/a/inm/oropre/v54y2006i3p475-488.html
   My bibliography  Save this article

On the Asymptotic Validity of Fully Sequential Selection Procedures for Steady-State Simulation

Author

Listed:
  • Seong-Hee Kim

    (School of Industrial and Systems Engineering, Georgia Institute of Technology, Atlanta, Georgia 30332)

  • Barry L. Nelson

    (Department of Industrial Engineering and Management Sciences, Northwestern University, Evanston, Illinois 60208-3119)

Abstract

We present fully sequential procedures for steady-state simulation that are designed to select the best of a finite number of simulated systems when “best” is defined by the largest or smallest long-run average performance. We also provide a framework for establishing the asymptotic validity of such procedures and prove the validity of our procedures. An example based on the M/M /1 queue is given.

Suggested Citation

  • Seong-Hee Kim & Barry L. Nelson, 2006. "On the Asymptotic Validity of Fully Sequential Selection Procedures for Steady-State Simulation," Operations Research, INFORMS, vol. 54(3), pages 475-488, June.
    • Handle: RePEc:inm:oropre:v:54:y:2006:i:3:p:475-488
    DOI: 10.1287/opre.1060.0281
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/opre.1060.0281
    Download Restriction: no
    File URL: https://libkey.io/10.1287/opre.1060.0281?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Halim Damerdji, 1995. "Mean-Square Consistency of the Variance Estimator in Steady-State Simulation Output Analysis," Operations Research, INFORMS, vol. 43(2), pages 282-291, April.
    2. Chiahon Chien & David Goldsman & Benjamin Melamed, 1997. "Large-Sample Results for Batch Means," Management Science, INFORMS, vol. 43(9), pages 1288-1295, September.
    3. Robert S. Sargent & Keebom Kang & David Goldsman, 1992. "An Investigation of Finite-Sample Behavior of Confidence Interval Estimators," Operations Research, INFORMS, vol. 40(5), pages 898-913, October.
    4. Peter W. Glynn & Donald L. Iglehart, 1990. "Simulation Output Analysis Using Standardized Time Series," Mathematics of Operations Research, INFORMS, vol. 15(1), pages 1-16, February.
    5. Halim Damerdji & David Goldsman, 1995. "Consistency of several variants of the standardized time series area variance estimator," Naval Research Logistics (NRL), John Wiley & Sons, vol. 42(8), pages 1161-1176, December.
    6. David Goldsman & Seong-Hee Kim & William S. Marshall & Barry L. Nelson, 2002. "Ranking and Selection for Steady-State Simulation: Procedures and Perspectives," INFORMS Journal on Computing, INFORMS, vol. 14(1), pages 2-19, February.
    7. Stephen E. Chick & Koichiro Inoue, 2001. "New Two-Stage and Sequential Procedures for Selecting the Best Simulated System," Operations Research, INFORMS, vol. 49(5), pages 732-743, October.
    8. Halim Damerdji, 1994. "Strong Consistency of the Variance Estimator in Steady-State Simulation Output Analysis," Mathematics of Operations Research, INFORMS, vol. 19(2), pages 494-512, May.
    9. Lee Schruben, 1983. "Confidence Interval Estimation Using Standardized Time Series," Operations Research, INFORMS, vol. 31(6), pages 1090-1108, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yoon, Moonyoung & Bekker, James, 2019. "Considering sample means in Rinott’s procedure with a Bayesian approach," European Journal of Operational Research, Elsevier, vol. 273(1), pages 249-258.
    2. Ye Chen & Ilya O. Ryzhov, 2023. "Balancing Optimal Large Deviations in Sequential Selection," Management Science, INFORMS, vol. 69(6), pages 3457-3473, June.
    3. Tsai, Shing Chih & Chu, I-Hao, 2012. "Controlled multistage selection procedures for comparison with a standard," European Journal of Operational Research, Elsevier, vol. 223(3), pages 709-721.
    4. Shing Chih Tsai & Chen Hao Kuo, 2012. "Screening and selection procedures with control variates and correlation induction techniques," Naval Research Logistics (NRL), John Wiley & Sons, vol. 59(5), pages 340-361, August.
    5. Demet Batur & Lina Wang & F. Fred Choobineh, 2018. "Methods for System Selection Based on Sequential Mean–Variance Analysis," INFORMS Journal on Computing, INFORMS, vol. 30(4), pages 724-738, November.
    6. Wang, Honggang, 2012. "Retrospective optimization of mixed-integer stochastic systems using dynamic simplex linear interpolation," European Journal of Operational Research, Elsevier, vol. 217(1), pages 141-148.
    7. Healey, Christopher M. & Andradóttir, Sigrún & Kim, Seong-Hee, 2013. "Efficient comparison of constrained systems using dormancy," European Journal of Operational Research, Elsevier, vol. 224(2), pages 340-352.
    8. Demet Batur & F. Fred Choobineh, 2021. "Selecting the Best Alternative Based on Its Quantile," INFORMS Journal on Computing, INFORMS, vol. 33(2), pages 657-671, May.
    9. Flötteröd, Gunnar, 2017. "A search acceleration method for optimization problems with transport simulation constraints," Transportation Research Part B: Methodological, Elsevier, vol. 98(C), pages 239-260.
    10. Güzin Bayraksan & David P. Morton, 2011. "A Sequential Sampling Procedure for Stochastic Programming," Operations Research, INFORMS, vol. 59(4), pages 898-913, August.
    11. Qiushi Chen & Lei Zhao & Jan C. Fransoo & Zhe Li, 2019. "Dual-mode inventory management under a chance credit constraint," OR Spectrum: Quantitative Approaches in Management, Springer;Gesellschaft für Operations Research e.V., vol. 41(1), pages 147-178, March.
    12. Shing Chih Tsai & Jun Luo & Chi Ching Sung, 2017. "Combined variance reduction techniques in fully sequential selection procedures," Naval Research Logistics (NRL), John Wiley & Sons, vol. 64(6), pages 502-527, September.
    13. Marlin W. Ulmer, 2020. "Horizontal combinations of online and offline approximate dynamic programming for stochastic dynamic vehicle routing," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 28(1), pages 279-308, March.
    14. Marlin W. Ulmer & Justin C. Goodson & Dirk C. Mattfeld & Marco Hennig, 2019. "Offline–Online Approximate Dynamic Programming for Dynamic Vehicle Routing with Stochastic Requests," Service Science, INFORMS, vol. 53(1), pages 185-202, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Christos Alexopoulos & David Goldsman & Gamze Tokol, 2001. "Properties of Batched Quadratic-Form Variance Parameter Estimators for Simulations," INFORMS Journal on Computing, INFORMS, vol. 13(2), pages 149-156, May.
    2. Christos Alexopoulos & Nilay Tanık Argon & David Goldsman & Gamze Tokol & James R. Wilson, 2007. "Overlapping Variance Estimators for Simulation," Operations Research, INFORMS, vol. 55(6), pages 1090-1103, December.
    3. Gamze Tokol & David Goldsman & Daniel H. Ockerman & James J. Swain, 1998. "Standardized Time Series Lp-Norm Variance Estimators for Simulations," Management Science, INFORMS, vol. 44(2), pages 234-245, February.
    4. David Goldsman & Seong-Hee Kim & William S. Marshall & Barry L. Nelson, 2002. "Ranking and Selection for Steady-State Simulation: Procedures and Perspectives," INFORMS Journal on Computing, INFORMS, vol. 14(1), pages 2-19, February.
    5. Kin Wai Chan & Chun Yip Yau, 2017. "High-order Corrected Estimator of Asymptotic Variance with Optimal Bandwidth," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 44(4), pages 866-898, December.
    6. Meterelliyoz, Melike & Alexopoulos, Christos & Goldsman, David, 2012. "Folded overlapping variance estimators for simulation," European Journal of Operational Research, Elsevier, vol. 220(1), pages 135-146.
    7. David F. Muñoz & Peter W. Glynn, 2001. "Multivariate Standardized Time Series for Steady-State Simulation Output Analysis," Operations Research, INFORMS, vol. 49(3), pages 413-422, June.
    8. David Goldsman & Keebom Kang & Andrew F. Seila, 1999. "Cramér-von Mises Variance Estimators for Simulations," Operations Research, INFORMS, vol. 47(2), pages 299-309, April.
    9. Demet Batur & F. Fred Choobineh, 2021. "Selecting the Best Alternative Based on Its Quantile," INFORMS Journal on Computing, INFORMS, vol. 33(2), pages 657-671, May.
    10. Lee, Loo Hay & Chew, Ek Peng & Manikam, Puvaneswari, 2006. "A general framework on the simulation-based optimization under fixed computing budget," European Journal of Operational Research, Elsevier, vol. 174(3), pages 1828-1841, November.
    11. Nilay Tanık Argon & Sigrún Andradóttir, 2006. "Replicated batch means for steady‐state simulations," Naval Research Logistics (NRL), John Wiley & Sons, vol. 53(6), pages 508-524, September.
    12. Song, Wheyming T. & Chih, Mingchang, 2010. "Extended dynamic partial-overlapping batch means estimators for steady-state simulations," European Journal of Operational Research, Elsevier, vol. 203(3), pages 640-651, June.
    13. Christos Alexopoulos & Nilay Tanık Argon & David Goldsman & Natalie M. Steiger & Gamze Tokol & James R. Wilson, 2007. "Efficient Computation of Overlapping Variance Estimators for Simulation," INFORMS Journal on Computing, INFORMS, vol. 19(3), pages 314-327, August.
    14. Song, Wheyming Tina & Chih, Mingchang, 2013. "Run length not required: Optimal-mse dynamic batch means estimators for steady-state simulations," European Journal of Operational Research, Elsevier, vol. 229(1), pages 114-123.
    15. Halkos, George & Kevork, Ilias, 2002. "Confidence intervals in stationary autocorrelated time series," MPRA Paper 31840, University Library of Munich, Germany.
    16. James M. Calvin & Marvin K. Nakayama, 2006. "Permuted Standardized Time Series for Steady-State Simulations," Mathematics of Operations Research, INFORMS, vol. 31(2), pages 351-368, May.
    17. Sheth-Voss, Pieter A. & Willemain, Thomas R. & Haddock, Jorge, 2005. "Estimating the steady-state mean from short transient simulations," European Journal of Operational Research, Elsevier, vol. 162(2), pages 403-417, April.
    18. L. Jeff Hong & Guangwu Liu, 2010. "Pathwise Estimation of Probability Sensitivities Through Terminating or Steady-State Simulations," Operations Research, INFORMS, vol. 58(2), pages 357-370, April.
    19. Halim Damerdji & David Goldsman, 1995. "Consistency of several variants of the standardized time series area variance estimator," Naval Research Logistics (NRL), John Wiley & Sons, vol. 42(8), pages 1161-1176, December.
    20. Demet Batur & Lina Wang & F. Fred Choobineh, 2018. "Methods for System Selection Based on Sequential Mean–Variance Analysis," INFORMS Journal on Computing, INFORMS, vol. 30(4), pages 724-738, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:oropre:v:54:y:2006:i:3:p:475-488. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.