IDEAS home Printed from https://ideas.repec.org/a/pal/jorsoc/v61y2010i9d10.1057_jors.2009.87.html
   My bibliography  Save this article

Automating warm-up length estimation

Author

Listed:
  • K Hoad

    (Warwick Business School, The University of Warwick)

  • S Robinson

    (Warwick Business School, The University of Warwick)

  • R Davies

    (Warwick Business School, The University of Warwick)

Abstract

There are two key issues in assuring the accuracy of estimates of performance obtained from a simulation model. The first is the removal of any initialisation bias, the second is ensuring that enough output data is produced to obtain an accurate estimate of performance. This paper is concerned with the first issue, and more specifically warm-up estimation. Our aim is to produce an automated procedure, for inclusion into commercial simulation software, for estimating the length of warm-up and hence removing initialisation bias from simulation output data. This paper describes the extensive literature search that was carried out in order to find and assess the various existing warm-up methods, the process of short-listing and testing of candidate methods. In particular it details the extensive testing of the warm-up MSER-5 method.

Suggested Citation

  • K Hoad & S Robinson & R Davies, 2010. "Automating warm-up length estimation," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 61(9), pages 1389-1403, September.
    • Handle: RePEc:pal:jorsoc:v:61:y:2010:i:9:d:10.1057_jors.2009.87
    DOI: 10.1057/jors.2009.87
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1057/jors.2009.87
    File Function: Abstract
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1057/jors.2009.87?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. R. W. Conway, 1963. "Some Tactical Problems in Digital Simulation," Management Science, INFORMS, vol. 10(1), pages 47-61, October.
    2. Ockerman, Daniel H. & Goldsman, David, 1999. "Student t-tests and compound tests to detect transients in simulated time series," European Journal of Operational Research, Elsevier, vol. 116(3), pages 681-691, August.
    3. Lada, Emily K. & Wilson, James R., 2006. "A wavelet-based spectral procedure for steady-state simulation analysis," European Journal of Operational Research, Elsevier, vol. 174(3), pages 1769-1801, November.
    4. Lee W. Schruben, 1982. "Detecting Initialization Bias in Simulation Output," Operations Research, INFORMS, vol. 30(3), pages 569-590, June.
    5. L. Schruben & H. Singh & L. Tierney, 1983. "Optimal Tests for Initialization Bias in Simulation Output," Operations Research, INFORMS, vol. 31(6), pages 1167-1178, December.
    6. Sheth-Voss, Pieter A. & Willemain, Thomas R. & Haddock, Jorge, 2005. "Estimating the steady-state mean from short transient simulations," European Journal of Operational Research, Elsevier, vol. 162(2), pages 403-417, April.
    7. David Goldsman & Lee W. Schruben & James J. Swain, 1994. "Tests for transient means in simulated time series," Naval Research Logistics (NRL), John Wiley & Sons, vol. 41(2), pages 171-187, March.
    8. Mark A. Gallagher & Kenneth W. Bauer, Jr. & Peter S. Maybeck, 1996. "Initial Data Truncation for Univariate Output of Discrete-Event Simulations Using the Kalman Filter," Management Science, INFORMS, vol. 42(4), pages 559-575, April.
    9. Roth, Emily, 1994. "The relaxation time heuristic for the initial transient problem in M/M/k queueing systems," European Journal of Operational Research, Elsevier, vol. 72(2), pages 376-386, January.
    10. Sandikci, Burhaneddin & Sabuncuoglu, Ihsan, 2006. "Analysis of the behavior of the transient period in non-terminating simulations," European Journal of Operational Research, Elsevier, vol. 173(1), pages 252-267, August.
    11. George S. Fishman, 1971. "Estimating Sample Size in Computing Simulation Experiments," Management Science, INFORMS, vol. 18(1), pages 21-38, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Tasneem, Dina & Engle-Warnick, Jim & Benchekroun, Hassan, 2017. "An experimental study of a common property renewable resource game in continuous time," Journal of Economic Behavior & Organization, Elsevier, vol. 140(C), pages 91-119.
    2. Gerardo Amato & Roberto D’Amato & Alessandro Ruggiero, 2022. "Adaptive Rejection of a Sinusoidal Disturbance with Unknown Frequency in a Flexible Rotor with Lubricated Journal Bearings," Mathematics, MDPI, vol. 10(10), pages 1-26, May.
    3. Stewart Robinson & Stavrianna Dimitriou & Kathy Kotiadis, 2017. "Addressing the sample size problem in behavioural operational research: simulating the newsvendor problem," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(3), pages 253-268, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Robinson, Stewart, 2007. "A statistical process control approach to selecting a warm-up period for a discrete-event simulation," European Journal of Operational Research, Elsevier, vol. 176(1), pages 332-346, January.
    2. Enver Yücesan, 1993. "Randomization tests for initialization bias in simulation output," Naval Research Logistics (NRL), John Wiley & Sons, vol. 40(5), pages 643-663, August.
    3. J Martens & R Peeters & F Put, 2009. "Analysing steady-state simulation output using vector autoregressive processes with exogenous variables," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 60(5), pages 696-705, May.
    4. Sandikci, Burhaneddin & Sabuncuoglu, Ihsan, 2006. "Analysis of the behavior of the transient period in non-terminating simulations," European Journal of Operational Research, Elsevier, vol. 173(1), pages 252-267, August.
    5. Halkos, George & Kevork, Ilias, 2002. "Confidence intervals in stationary autocorrelated time series," MPRA Paper 31840, University Library of Munich, Germany.
    6. Halkos, George & Kevork, Ilias, 2006. "Estimating population means in covariance stationary process," MPRA Paper 31843, University Library of Munich, Germany.
    7. Jacobson, Sheldon H., 1997. "The effect of initial transient on the steady-state simulation harmonic analysis gradient estimators," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 43(2), pages 209-221.
    8. Song, Wheyming Tina, 2019. "The Song rule outperforms optimal-batch-size variance estimators in simulation output analysis," European Journal of Operational Research, Elsevier, vol. 275(3), pages 1072-1082.
    9. David Goldsman & Lee W. Schruben & James J. Swain, 1994. "Tests for transient means in simulated time series," Naval Research Logistics (NRL), John Wiley & Sons, vol. 41(2), pages 171-187, March.
    10. Angel Sevil & Alfonso Cruz & Tomas Reyes & Roberto Vassolo, 2022. "When Being Large Is Not an Advantage: How Innovation Impacts the Sustainability of Firm Performance in Natural Resource Industries," Sustainability, MDPI, vol. 14(23), pages 1-20, December.
    11. Mingchang Chih, 2019. "An Insight into the Data Structure of the Dynamic Batch Means Algorithm with Binary Tree Code," Mathematics, MDPI, vol. 7(9), pages 1-8, August.
    12. Ockerman, Daniel H. & Goldsman, David, 1999. "Student t-tests and compound tests to detect transients in simulated time series," European Journal of Operational Research, Elsevier, vol. 116(3), pages 681-691, August.
    13. D'Angelo, Andrea & Gastaldi, Massimo & Levialdi, Nathan, 2000. "Production variability and shop configuration: An experimental analysis," International Journal of Production Economics, Elsevier, vol. 68(1), pages 43-57, October.
    14. Haven, Emmanuel & Liu, Xiaoquan & Shen, Liya, 2012. "De-noising option prices with the wavelet method," European Journal of Operational Research, Elsevier, vol. 222(1), pages 104-112.
    15. Stefan Leye & Roland Ewald & Adelinde M Uhrmacher, 2014. "Composing Problem Solvers for Simulation Experimentation: A Case Study on Steady State Estimation," PLOS ONE, Public Library of Science, vol. 9(4), pages 1-13, April.
    16. Song, Wheyming Tina & Chih, Mingchang, 2013. "Run length not required: Optimal-mse dynamic batch means estimators for steady-state simulations," European Journal of Operational Research, Elsevier, vol. 229(1), pages 114-123.
    17. Kleijnen, Jack P.C., 1992. "Sensitivity analysis of simulation experiments: regression analysis and statistical design," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 34(3), pages 297-315.
    18. Vandin, Andrea & Giachini, Daniele & Lamperti, Francesco & Chiaromonte, Francesca, 2022. "Automated and distributed statistical analysis of economic agent-based models," Journal of Economic Dynamics and Control, Elsevier, vol. 143(C).
    19. Koning, A.J., 1999. "Goodness of fit for the constancy of a classical statistical model over time," Econometric Institute Research Papers EI 9959-/A, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    20. Sheth-Voss, Pieter A. & Willemain, Thomas R. & Haddock, Jorge, 2005. "Estimating the steady-state mean from short transient simulations," European Journal of Operational Research, Elsevier, vol. 162(2), pages 403-417, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pal:jorsoc:v:61:y:2010:i:9:d:10.1057_jors.2009.87. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.palgrave-journals.com/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.