IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v223y2012i3p709-721.html
   My bibliography  Save this article

Controlled multistage selection procedures for comparison with a standard

Author

Listed:
  • Tsai, Shing Chih
  • Chu, I-Hao

Abstract

Comparison with a standard is a general multiple comparison problem, where each system is required to be compared to a single system, referred to as a “standard”, as well as to other alternative systems. The goal is to determine the best system among a number of systems that are better than the standard, or to select the standard when it is equal to or better than the other alternatives. Kim (2005) proposed an efficient fully sequential procedure for comparison with a standard, that obtains a single observation at each stage from the surviving systems, and is one of the most efficient existing procedures. We develop two provably valid multistage selection procedures that take a number of observations from each system and update the variance estimators at each stage. We also employ appropriate control variate technique for each procedure to further improve the efficiency. Empirical results are provided to demonstrate that the proposed procedures are statistically and computationally more efficient than existing fully sequential procedures.

Suggested Citation

  • Tsai, Shing Chih & Chu, I-Hao, 2012. "Controlled multistage selection procedures for comparison with a standard," European Journal of Operational Research, Elsevier, vol. 223(3), pages 709-721.
    • Handle: RePEc:eee:ejores:v:223:y:2012:i:3:p:709-721
    DOI: 10.1016/j.ejor.2012.06.041
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221712004961
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ejor.2012.06.041?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Batur, D. & Choobineh, F., 2010. "A quantile-based approach to system selection," European Journal of Operational Research, Elsevier, vol. 202(3), pages 764-772, May.
    2. S. S. Lavenberg & P. D. Welch, 1981. "A Perspective on the Use of Control Variables to Increase the Efficiency of Monte Carlo Simulations," Management Science, INFORMS, vol. 27(3), pages 322-335, March.
    3. Athanassios N. Avramidis & James R. Wilson, 1996. "Integrated Variance Reduction Strategies for Simulation," Operations Research, INFORMS, vol. 44(2), pages 327-346, April.
    4. Barry L. Nelson & David Goldsman, 2001. "Comparisons with a Standard in Simulation Experiments," Management Science, INFORMS, vol. 47(3), pages 449-463, March.
    5. Shing Tsai & Barry Nelson, 2010. "Fully sequential selection procedures with control variates," IISE Transactions, Taylor & Francis Journals, vol. 42(1), pages 71-82.
    6. Seong-Hee Kim & Barry L. Nelson, 2006. "On the Asymptotic Validity of Fully Sequential Selection Procedures for Steady-State Simulation," Operations Research, INFORMS, vol. 54(3), pages 475-488, June.
    7. Sriver, Todd A. & Chrissis, James W. & Abramson, Mark A., 2009. "Pattern search ranking and selection algorithms for mixed variable simulation-based optimization," European Journal of Operational Research, Elsevier, vol. 198(3), pages 878-890, November.
    8. Pichitlamken, Juta & Nelson, Barry L. & Hong, L. Jeff, 2006. "A sequential procedure for neighborhood selection-of-the-best in optimization via simulation," European Journal of Operational Research, Elsevier, vol. 173(1), pages 283-298, August.
    9. Shing Chih Tsai & Barry L. Nelson & Jeremy Staum, 2009. "Combined Screening and Selection of the Best with Control Variates," International Series in Operations Research & Management Science, in: Christos Alexopoulos & David Goldsman & James R. Wilson (ed.), Advancing the Frontiers of Simulation, pages 263-289, Springer.
    10. Barry L. Nelson & Julie Swann & David Goldsman & Wheyming Song, 2001. "Simple Procedures for Selecting the Best Simulated System When the Number of Alternatives is Large," Operations Research, INFORMS, vol. 49(6), pages 950-963, December.
    11. Vadim Lesnevski & Barry L. Nelson & Jeremy Staum, 2007. "Simulation of Coherent Risk Measures Based on Generalized Scenarios," Management Science, INFORMS, vol. 53(11), pages 1756-1769, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Tsai, Shing Chih & Yeh, Yingchieh & Kuo, Chen Yun, 2021. "Efficient optimization algorithms for surgical scheduling under uncertainty," European Journal of Operational Research, Elsevier, vol. 293(2), pages 579-593.
    2. Tsai, Shing Chih & Fu, Sheng Yang, 2014. "Genetic-algorithm-based simulation optimization considering a single stochastic constraint," European Journal of Operational Research, Elsevier, vol. 236(1), pages 113-125.
    3. Tsai, Shing Chih & Zheng, Ya-Xin, 2013. "A simulation optimization approach for a two-echelon inventory system with service level constraints," European Journal of Operational Research, Elsevier, vol. 229(2), pages 364-374.
    4. Shing Chih Tsai & Tse Yang, 2017. "Rapid screening algorithms for stochastically constrained problems," Annals of Operations Research, Springer, vol. 254(1), pages 425-447, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Shing Chih Tsai & Chen Hao Kuo, 2012. "Screening and selection procedures with control variates and correlation induction techniques," Naval Research Logistics (NRL), John Wiley & Sons, vol. 59(5), pages 340-361, August.
    2. Shing Chih Tsai, 2013. "Rapid Screening Procedures for Zero-One Optimization via Simulation," INFORMS Journal on Computing, INFORMS, vol. 25(2), pages 317-331, May.
    3. Shing Chih Tsai & Jun Luo & Chi Ching Sung, 2017. "Combined variance reduction techniques in fully sequential selection procedures," Naval Research Logistics (NRL), John Wiley & Sons, vol. 64(6), pages 502-527, September.
    4. Tsai, Shing Chih, 2011. "Selecting the best simulated system with weighted control-variate estimators," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 82(4), pages 705-717.
    5. Shing Chih Tsai & Tse Yang, 2017. "Rapid screening algorithms for stochastically constrained problems," Annals of Operations Research, Springer, vol. 254(1), pages 425-447, July.
    6. Healey, Christopher M. & Andradóttir, Sigrún & Kim, Seong-Hee, 2013. "Efficient comparison of constrained systems using dormancy," European Journal of Operational Research, Elsevier, vol. 224(2), pages 340-352.
    7. Demet Batur & Lina Wang & F. Fred Choobineh, 2018. "Methods for System Selection Based on Sequential Mean–Variance Analysis," INFORMS Journal on Computing, INFORMS, vol. 30(4), pages 724-738, November.
    8. Qiushi Chen & Lei Zhao & Jan C. Fransoo & Zhe Li, 2019. "Dual-mode inventory management under a chance credit constraint," OR Spectrum: Quantitative Approaches in Management, Springer;Gesellschaft für Operations Research e.V., vol. 41(1), pages 147-178, March.
    9. Yoon, Moonyoung & Bekker, James, 2019. "Considering sample means in Rinott’s procedure with a Bayesian approach," European Journal of Operational Research, Elsevier, vol. 273(1), pages 249-258.
    10. Zhongshun Shi & Yijie Peng & Leyuan Shi & Chun-Hung Chen & Michael C. Fu, 2022. "Dynamic Sampling Allocation Under Finite Simulation Budget for Feasibility Determination," INFORMS Journal on Computing, INFORMS, vol. 34(1), pages 557-568, January.
    11. Cheng, Zhenxia & Luo, Jun & Wu, Ruijing, 2023. "On the finite-sample statistical validity of adaptive fully sequential procedures," European Journal of Operational Research, Elsevier, vol. 307(1), pages 266-278.
    12. Batur, D. & Choobineh, F., 2010. "A quantile-based approach to system selection," European Journal of Operational Research, Elsevier, vol. 202(3), pages 764-772, May.
    13. Sigrún Andradóttir & Seong‐Hee Kim, 2010. "Fully sequential procedures for comparing constrained systems via simulation," Naval Research Logistics (NRL), John Wiley & Sons, vol. 57(5), pages 403-421, August.
    14. Shing Chih Tsai & Wu Hung Lin & Chia Cheng Wu & Shao Jen Weng & Ching Fen Tang, 2022. "Decision support algorithms for optimizing surgery start times considering the performance variation," Health Care Management Science, Springer, vol. 25(2), pages 208-221, June.
    15. Kabirian, Alireza & Ólafsson, Sigurdur, 2011. "Continuous optimization via simulation using Golden Region search," European Journal of Operational Research, Elsevier, vol. 208(1), pages 19-27, January.
    16. Eric C. Ni & Dragos F. Ciocan & Shane G. Henderson & Susan R. Hunter, 2017. "Efficient Ranking and Selection in Parallel Computing Environments," Operations Research, INFORMS, vol. 65(3), pages 821-836, June.
    17. Jun Luo & L. Jeff Hong & Barry L. Nelson & Yang Wu, 2015. "Fully Sequential Procedures for Large-Scale Ranking-and-Selection Problems in Parallel Computing Environments," Operations Research, INFORMS, vol. 63(5), pages 1177-1194, October.
    18. Demet Batur & F. Fred Choobineh, 2021. "Selecting the Best Alternative Based on Its Quantile," INFORMS Journal on Computing, INFORMS, vol. 33(2), pages 657-671, May.
    19. Justin Boesel & Barry L. Nelson & Seong-Hee Kim, 2003. "Using Ranking and Selection to “Clean Up” after Simulation Optimization," Operations Research, INFORMS, vol. 51(5), pages 814-825, October.
    20. Emily A. Heath & John E. Mitchell & Thomas C. Sharkey, 2016. "Applying ranking and selection procedures to long-term mitigation for improved network restoration," EURO Journal on Computational Optimization, Springer;EURO - The Association of European Operational Research Societies, vol. 4(3), pages 447-481, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:223:y:2012:i:3:p:709-721. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.