IDEAS home Printed from https://ideas.repec.org/a/inm/oropre/v46y1998i4p574-591.html
   My bibliography  Save this article

Correlation-Induction Techniques for Estimating Quantiles in Simulation Experiments

Author

Listed:
  • Athanassios N. Avramidis

    (Cornell University, Ithaca, New York)

  • James R. Wilson

    (North Carolina State University, Raleigh, North Carolina)

Abstract

A simulation-based quantile estimator measures the level of system performance that can be delivered with a prespecified probability. To estimate selected quantiles of the response of a finite-horizon simulation, we develop procedures based on correlation induction techniques for variance reduction, with emphasis on antithetic variates and Latin hypercube sampling. These procedures achieve improved precision by controlling the simulation's random-number inputs as an integral part of the experimental design. The proposed multiple-sample quantile estimator is the average of negatively correlated quantile estimators computed from disjoint samples of the simulation response, where negative correlation is induced between corresponding responses in different samples while mutual independence of responses is maintained within each sample. The proposed single-sample quantile estimator is computed from negatively correlated simulation responses within one all-inclusive sample. The single-sample estimator based on Latin hypercube sampling is shown to be asymptotically normal and unbiased with smaller variance than the comparable direct-simulation estimator based on independent replications. Similar asymptotic comparisons of the multiple-sample and direct-simulation estimators focus on bias and mean square error. Monte Carlo results suggest that the proposed procedures can yield significant reductions in bias, variance, and mean square error when estimating quantiles of the completion time of a stochastic activity network.

Suggested Citation

  • Athanassios N. Avramidis & James R. Wilson, 1998. "Correlation-Induction Techniques for Estimating Quantiles in Simulation Experiments," Operations Research, INFORMS, vol. 46(4), pages 574-591, August.
  • Handle: RePEc:inm:oropre:v:46:y:1998:i:4:p:574-591
    DOI: 10.1287/opre.46.4.574
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/opre.46.4.574
    Download Restriction: no

    File URL: https://libkey.io/10.1287/opre.46.4.574?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jason C. Hsu & Barry L. Nelson, 1990. "Control Variates for Quantile Estimation," Management Science, INFORMS, vol. 36(7), pages 835-851, July.
    2. Timothy C. Hesterberg & Barry L. Nelson, 1998. "Control Variates for Probability and Quantile Estimation," Management Science, INFORMS, vol. 44(9), pages 1295-1312, September.
    3. Athanassios N. Avramidis & James R. Wilson, 1996. "Integrated Variance Reduction Strategies for Simulation," Operations Research, INFORMS, vol. 44(2), pages 327-346, April.
    4. C. Elliott Sigal & A. Alan B. Pritsker & James J. Solberg, 1980. "The Stochastic Shortest Route Problem," Operations Research, INFORMS, vol. 28(5), pages 1122-1129, October.
    5. Athanassios N. Avramidis & Kenneth W. Bauer & James R. Wilson, 1991. "Simulation of stochastic activity networks using path control variates," Naval Research Logistics (NRL), John Wiley & Sons, vol. 38(2), pages 183-201, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Samuel N. Cohen & Christoph Reisinger & Sheng Wang, 2022. "Estimating risks of option books using neural-SDE market models," Papers 2202.07148, arXiv.org.
    2. L. Jeff Hong, 2009. "Estimating Quantile Sensitivities," Operations Research, INFORMS, vol. 57(1), pages 118-130, February.
    3. Michael Freimer & Jeffrey Linderoth & Douglas Thomas, 2012. "The impact of sampling methods on bias and variance in stochastic linear programs," Computational Optimization and Applications, Springer, vol. 51(1), pages 51-75, January.
    4. Chang, Kuo-Hao, 2015. "A direct search method for unconstrained quantile-based simulation optimization," European Journal of Operational Research, Elsevier, vol. 246(2), pages 487-495.
    5. Shane G. Henderson & Peter W. Glynn, 2001. "Computing Densities for Markov Chains via Simulation," Mathematics of Operations Research, INFORMS, vol. 26(2), pages 375-400, May.
    6. T. Glenn Bailey & Paul A. Jensen & David P. Morton, 1999. "Response surface analysis of two‐stage stochastic linear programming with recourse," Naval Research Logistics (NRL), John Wiley & Sons, vol. 46(7), pages 753-776, October.
    7. Pierre L’Ecuyer & Florian Puchhammer & Amal Ben Abdellah, 2022. "Monte Carlo and Quasi–Monte Carlo Density Estimation via Conditioning," INFORMS Journal on Computing, INFORMS, vol. 34(3), pages 1729-1748, May.
    8. Chen, E. Jack & Kelton, W. David, 2006. "Quantile and tolerance-interval estimation in simulation," European Journal of Operational Research, Elsevier, vol. 168(2), pages 520-540, January.
    9. Christos Alexopoulos & David Goldsman & Anup C. Mokashi & Kai-Wen Tien & James R. Wilson, 2019. "Sequest: A Sequential Procedure for Estimating Quantiles in Steady-State Simulations," Operations Research, INFORMS, vol. 67(4), pages 1162-1183, July.
    10. Kilic, Onur A. & Tunc, Huseyin & Tarim, S. Armagan, 2018. "Heuristic policies for the stochastic economic lot sizing problem with remanufacturing under service level constraints," European Journal of Operational Research, Elsevier, vol. 267(3), pages 1102-1109.
    11. E Saliby & R J Paul, 2009. "A farewell to the use of antithetic variates in Monte Carlo simulation," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 60(7), pages 1026-1035, July.
    12. Chaitra H. Nagaraja & Haikady N. Nagaraja, 2020. "Distribution‐free Approximate Methods for Constructing Confidence Intervals for Quantiles," International Statistical Review, International Statistical Institute, vol. 88(1), pages 75-100, April.
    13. Huei-Wen Teng, 2023. "Importance Sampling for Calculating the Value-at-Risk and Expected Shortfall of the Quadratic Portfolio with t-Distributed Risk Factors," Computational Economics, Springer;Society for Computational Economics, vol. 62(3), pages 1125-1154, October.
    14. Jong Jun Park & Geon Ho Choe, 2016. "A new variance reduction method for option pricing based on sampling the vertices of a simplex," Quantitative Finance, Taylor & Francis Journals, vol. 16(8), pages 1165-1173, August.
    15. Xing Jin & Michael C. Fu & Xiaoping Xiong, 2003. "Probabilistic Error Bounds for Simulation Quantile Estimators," Management Science, INFORMS, vol. 49(2), pages 230-246, February.
    16. Xing Jin & Allen X. Zhang, 2006. "Reclaiming Quasi-Monte Carlo Efficiency in Portfolio Value-at-Risk Simulation Through Fourier Transform," Management Science, INFORMS, vol. 52(6), pages 925-938, June.
    17. He, Zhijian, 2022. "Sensitivity estimation of conditional value at risk using randomized quasi-Monte Carlo," European Journal of Operational Research, Elsevier, vol. 298(1), pages 229-242.
    18. Hui Dong & Marvin K. Nakayama, 2017. "Quantile Estimation with Latin Hypercube Sampling," Operations Research, INFORMS, vol. 65(6), pages 1678-1695, December.
    19. Pierre L'Ecuyer & Christiane Lemieux, 2000. "Variance Reduction via Lattice Rules," Management Science, INFORMS, vol. 46(9), pages 1214-1235, September.
    20. Grabaskas, Dave & Nakayama, Marvin K. & Denning, Richard & Aldemir, Tunc, 2016. "Advantages of variance reduction techniques in establishing confidence intervals for quantiles," Reliability Engineering and System Safety, Elsevier, vol. 149(C), pages 187-203.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kenneth W. Bauer & James R. Wilson, 1992. "Control‐variate selection criteria," Naval Research Logistics (NRL), John Wiley & Sons, vol. 39(3), pages 307-321, April.
    2. Xing Jin & Michael C. Fu & Xiaoping Xiong, 2003. "Probabilistic Error Bounds for Simulation Quantile Estimators," Management Science, INFORMS, vol. 49(2), pages 230-246, February.
    3. Samuel N. Cohen & Christoph Reisinger & Sheng Wang, 2022. "Estimating risks of option books using neural-SDE market models," Papers 2202.07148, arXiv.org.
    4. Chen, E. Jack & Kelton, W. David, 2006. "Quantile and tolerance-interval estimation in simulation," European Journal of Operational Research, Elsevier, vol. 168(2), pages 520-540, January.
    5. Huei-Wen Teng, 2023. "Importance Sampling for Calculating the Value-at-Risk and Expected Shortfall of the Quadratic Portfolio with t-Distributed Risk Factors," Computational Economics, Springer;Society for Computational Economics, vol. 62(3), pages 1125-1154, October.
    6. L. Jeff Hong, 2009. "Estimating Quantile Sensitivities," Operations Research, INFORMS, vol. 57(1), pages 118-130, February.
    7. Hui Dong & Marvin K. Nakayama, 2017. "Quantile Estimation with Latin Hypercube Sampling," Operations Research, INFORMS, vol. 65(6), pages 1678-1695, December.
    8. Lee, Jisun & Joung, Seulgi & Lee, Kyungsik, 2022. "A fully polynomial time approximation scheme for the probability maximizing shortest path problem," European Journal of Operational Research, Elsevier, vol. 300(1), pages 35-45.
    9. E Saliby & R J Paul, 2009. "A farewell to the use of antithetic variates in Monte Carlo simulation," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 60(7), pages 1026-1035, July.
    10. Xi Chen & Kyoung-Kuk Kim, 2016. "Efficient VaR and CVaR Measurement via Stochastic Kriging," INFORMS Journal on Computing, INFORMS, vol. 28(4), pages 629-644, November.
    11. Jeff Linderoth & Alexander Shapiro & Stephen Wright, 2006. "The empirical behavior of sampling methods for stochastic programming," Annals of Operations Research, Springer, vol. 142(1), pages 215-241, February.
    12. Ward Romeijnders & David P. Morton & Maarten H. van der Vlerk, 2017. "Assessing the Quality of Convex Approximations for Two-Stage Totally Unimodular Integer Recourse Models," INFORMS Journal on Computing, INFORMS, vol. 29(2), pages 211-231, May.
    13. Williams, Terry, 1999. "Towards realism in network simulation," Omega, Elsevier, vol. 27(3), pages 305-314, June.
    14. Elise D. Miller-Hooks & Hani S. Mahmassani, 2000. "Least Expected Time Paths in Stochastic, Time-Varying Transportation Networks," Transportation Science, INFORMS, vol. 34(2), pages 198-215, May.
    15. Barbosa, Valmir C. & Ferreira, Fernando M.L. & Kling, Daniel V. & Lopes, Eduardo & Protti, Fbio & Schmitz, Eber A., 2009. "Structured construction and simulation of nondeterministic stochastic activity networks," European Journal of Operational Research, Elsevier, vol. 198(1), pages 266-274, October.
    16. Modarres, Reza, 2002. "Efficient nonparametric estimation of a distribution function," Computational Statistics & Data Analysis, Elsevier, vol. 39(1), pages 75-95, March.
    17. Williams, Terry, 1995. "A classified bibliography of recent research relating to project risk management," European Journal of Operational Research, Elsevier, vol. 85(1), pages 18-38, August.
    18. N-H Shih, 2005. "Estimating completion-time distribution in stochastic activity networks," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 56(6), pages 744-749, June.
    19. Paul Glasserman & Bin Yu, 2005. "Large Sample Properties of Weighted Monte Carlo Estimators," Operations Research, INFORMS, vol. 53(2), pages 298-312, April.
    20. Pierre L’Ecuyer & Florian Puchhammer & Amal Ben Abdellah, 2022. "Monte Carlo and Quasi–Monte Carlo Density Estimation via Conditioning," INFORMS Journal on Computing, INFORMS, vol. 34(3), pages 1729-1748, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:oropre:v:46:y:1998:i:4:p:574-591. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.