IDEAS home Printed from https://ideas.repec.org/a/inm/oropre/v47y1999i4p585-600.html
   My bibliography  Save this article

Multilevel Splitting for Estimating Rare Event Probabilities

Author

Listed:
  • Paul Glasserman

    (403 Uris Hall, Columbia Business School, New York, New York 10027)

  • Philip Heidelberger

    (IBM T. J. Watson Research Center, P. O. Box 218, Yorktown Heights, New York 10598)

  • Perwez Shahabuddin

    (Department of Industrial Engineering and Operations Research, Columbia University, New York, New York 10027)

  • Tim Zajic

    (Lockheed Martin, P. O. Box 64525, MS U1P28, St. Paul, Minnesota 55164)

Abstract

We analyze the performance of a splitting technique for the estimation of rare event probabilities by simulation. A straightforward estimator of the probability of an event evaluates the proportion of simulated paths on which the event occurs. If the event is rare, even a large number of paths may produce little information about its probability using this approach. The method we study reinforces promising paths at intermediate thresholds by splitting them into subpaths which then evolve independently. If implemented appropriately, this has the effect of dedicating a greater fraction of the computational effort to informative runs. We analyze the method for a class of models in which, roughly speaking, the number of states through which each threshold can be crossed is bounded. Under additional assumptions, we identify the optimal degree of splitting at each threshold as the rarity of the event increases: It should be set so that the expected number of subpaths reaching each threshold remains roughly constant. Thus implemented, the method is provably effective in a sense appropriate to rare event simulations. These results follow from a branching-process analysis of the method. We illustrate our theoretical results with some numerical examples for queueing models.

Suggested Citation

  • Paul Glasserman & Philip Heidelberger & Perwez Shahabuddin & Tim Zajic, 1999. "Multilevel Splitting for Estimating Rare Event Probabilities," Operations Research, INFORMS, vol. 47(4), pages 585-600, August.
  • Handle: RePEc:inm:oropre:v:47:y:1999:i:4:p:585-600
    DOI: 10.1287/opre.47.4.585
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/opre.47.4.585
    Download Restriction: no

    File URL: https://libkey.io/10.1287/opre.47.4.585?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Hopmans, A.C.M. & Kleijnen, J.P.C., 1979. "Importance sampling in systems simulation: a practical failure?," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 21(2), pages 209-220.
    2. Peter W. Glynn & Ward Whitt, 1992. "The Asymptotic Efficiency of Simulation Estimators," Operations Research, INFORMS, vol. 40(3), pages 505-520, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zdravko I. Botev & Pierre L'Ecuyer & Gerardo Rubino & Richard Simard & Bruno Tuffin, 2013. "Static Network Reliability Estimation via Generalized Splitting," INFORMS Journal on Computing, INFORMS, vol. 25(1), pages 56-71, February.
    2. Fabian Dickmann & Nikolaus Schweizer, 2014. "Faster Comparison of Stopping Times by Nested Conditional Monte Carlo," Papers 1402.0243, arXiv.org.
    3. Krystul, Jaroslav & Le Gland, François & Lezaud, Pascal, 2012. "Sampling per mode for rare event simulation in switching diffusions," Stochastic Processes and their Applications, Elsevier, vol. 122(7), pages 2639-2667.
    4. Hao Ma & Henk A. P. Blom, 2022. "Random Assignment Versus Fixed Assignment in Multilevel Importance Splitting for Estimating Stochastic Reach Probabilities," Methodology and Computing in Applied Probability, Springer, vol. 24(4), pages 2313-2338, December.
    5. Kleijnen, Jack P.C. & Ridder, A.A.N. & Rubinstein, R.Y., 2010. "Variance Reduction Techniques in Monte Carlo Methods," Other publications TiSEM 87680d1a-53c1-4107-ada4-7, Tilburg University, School of Economics and Management.
    6. Paredes, R. & Dueñas-Osorio, L. & Meel, K.S. & Vardi, M.Y., 2019. "Principled network reliability approximation: A counting-based approach," Reliability Engineering and System Safety, Elsevier, vol. 191(C).
    7. Villén-Altamirano, José, 2010. "Importance functions for restart simulation of general Jackson networks," European Journal of Operational Research, Elsevier, vol. 203(1), pages 156-165, May.
    8. James Hodgson & Adam M. Johansen & Murray Pollock, 2022. "Unbiased Simulation of Rare Events in Continuous Time," Methodology and Computing in Applied Probability, Springer, vol. 24(3), pages 2123-2148, September.
    9. D.D. Riley & X. Koutsoukos, 2014. "Probabilistic verification of a biodiesel production system using statistical model checking," Mathematical and Computer Modelling of Dynamical Systems, Taylor & Francis Journals, vol. 20(5), pages 452-469, September.
    10. Lagnoux-Renaudie, Agnès, 2008. "Effective branching splitting method under cost constraint," Stochastic Processes and their Applications, Elsevier, vol. 118(10), pages 1820-1851, October.
    11. Kontosakos, Vasileios E. & Mendonca, Keegan & Pantelous, Athanasios A. & Zuev, Konstantin M., 2021. "Pricing discretely-monitored double barrier options with small probabilities of execution," European Journal of Operational Research, Elsevier, vol. 290(1), pages 313-330.
    12. Nam Kyoo Boots & Perwez Shahabuddin, 2001. "Simulating Tail Probabilities in GI/GI.1 Queues and Insurance Risk Processes with Subexponentail Distributions," Tinbergen Institute Discussion Papers 01-012/4, Tinbergen Institute.
    13. Zdravko I. Botev & Pierre L’Ecuyer, 2020. "Sampling Conditionally on a Rare Event via Generalized Splitting," INFORMS Journal on Computing, INFORMS, vol. 32(4), pages 986-995, October.
    14. Michael B. Giles, 2008. "Multilevel Monte Carlo Path Simulation," Operations Research, INFORMS, vol. 56(3), pages 607-617, June.
    15. Vergé, Christelle & Morio, Jérôme & Moral, Pierre Del, 2016. "An island particle algorithm for rare event analysis," Reliability Engineering and System Safety, Elsevier, vol. 149(C), pages 63-75.
    16. Kaynar, Bahar & Ridder, Ad, 2010. "The cross-entropy method with patching for rare-event simulation of large Markov chains," European Journal of Operational Research, Elsevier, vol. 207(3), pages 1380-1397, December.
    17. Paul Dupuis & Hui Wang, 2007. "Subsolutions of an Isaacs Equation and Efficient Schemes for Importance Sampling," Mathematics of Operations Research, INFORMS, vol. 32(3), pages 723-757, August.
    18. Tito Homem-de-Mello, 2007. "A Study on the Cross-Entropy Method for Rare-Event Probability Estimation," INFORMS Journal on Computing, INFORMS, vol. 19(3), pages 381-394, August.
    19. Paul Glasserman & Jeremy Staum, 2001. "Conditioning on One-Step Survival for Barrier Option Simulations," Operations Research, INFORMS, vol. 49(6), pages 923-937, December.
    20. Pierre L'Ecuyer & Christian Lécot & Bruno Tuffin, 2008. "A Randomized Quasi-Monte Carlo Simulation Method for Markov Chains," Operations Research, INFORMS, vol. 56(4), pages 958-975, August.
    21. Reuven Rubinstein, 2013. "Stochastic Enumeration Method for Counting NP-Hard Problems," Methodology and Computing in Applied Probability, Springer, vol. 15(2), pages 249-291, June.
    22. M. Garvels, 2011. "A combined splitting—cross entropy method for rare-event probability estimation of queueing networks," Annals of Operations Research, Springer, vol. 189(1), pages 167-185, September.
    23. Thomas Dean & Paul Dupuis, 2011. "The design and analysis of a generalized RESTART/DPR algorithm for rare event simulation," Annals of Operations Research, Springer, vol. 189(1), pages 63-102, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Giesecke, K. & Schwenkler, G., 2019. "Simulated likelihood estimators for discretely observed jump–diffusions," Journal of Econometrics, Elsevier, vol. 213(2), pages 297-320.
    2. Guay, François & Schwenkler, Gustavo, 2021. "Efficient estimation and filtering for multivariate jump–diffusions," Journal of Econometrics, Elsevier, vol. 223(1), pages 251-275.
    3. Michael B. Gordy & Sandeep Juneja, 2010. "Nested Simulation in Portfolio Risk Measurement," Management Science, INFORMS, vol. 56(10), pages 1833-1848, October.
    4. Bennet L. Fox, 2000. "Separability in Optimal Allocation," Operations Research, INFORMS, vol. 48(1), pages 173-176, February.
    5. Giesecke, Kay & Schwenkler, Gustavo, 2018. "Filtered likelihood for point processes," Journal of Econometrics, Elsevier, vol. 204(1), pages 33-53.
    6. Sunggon Kim & Jisu Yu, 2023. "Stratified importance sampling for a Bernoulli mixture model of portfolio credit risk," Annals of Operations Research, Springer, vol. 322(2), pages 819-849, March.
    7. Weber, Florian & Schmid, Thomas & Pietz, Matthäus & Kaserer, Christoph, 2010. "Simulation-based valuation of project finance: does model complexity really matter?," CEFS Working Paper Series 2010-03, Technische Universität München (TUM), Center for Entrepreneurial and Financial Studies (CEFS).
    8. Boyle, Phelim & Broadie, Mark & Glasserman, Paul, 1997. "Monte Carlo methods for security pricing," Journal of Economic Dynamics and Control, Elsevier, vol. 21(8-9), pages 1267-1321, June.
    9. Nanjing Jian & Shane G. Henderson, 2020. "Estimating the Probability that a Function Observed with Noise Is Convex," INFORMS Journal on Computing, INFORMS, vol. 32(2), pages 376-389, April.
    10. Georg Ch. Pflug & Philipp Thoma, 2016. "Efficient calculation of the Greeks for exponential Lévy processes: an application of measure valued differentiation," Quantitative Finance, Taylor & Francis Journals, vol. 16(2), pages 247-257, February.
    11. Andersson, Patrik & Kohatsu-Higa, Arturo & Yuasa, Tomooki, 2020. "Second order probabilistic parametrix method for unbiased simulation of stochastic differential equations," Stochastic Processes and their Applications, Elsevier, vol. 130(9), pages 5543-5574.
    12. Vladimir K. Kaishev & Dimitrina S. Dimitrova, 2009. "Dirichlet Bridge Sampling for the Variance Gamma Process: Pricing Path-Dependent Options," Management Science, INFORMS, vol. 55(3), pages 483-496, March.
    13. Bernd Heidergott & Taoying Farenhorst-Yuan, 2010. "Gradient Estimation for Multicomponent Maintenance Systems with Age-Replacement Policy," Operations Research, INFORMS, vol. 58(3), pages 706-718, June.
    14. Cliff C Kerr & Salvador Dura-Bernal & Tomasz G Smolinski & George L Chadderdon & David P Wilson, 2018. "Optimization by Adaptive Stochastic Descent," PLOS ONE, Public Library of Science, vol. 13(3), pages 1-16, March.
    15. Nabil Kahalé, 2020. "Randomized Dimension Reduction for Monte Carlo Simulations," Management Science, INFORMS, vol. 66(3), pages 1421-1439, March.
    16. Cui, Zhenyu & Fu, Michael C. & Peng, Yijie & Zhu, Lingjiong, 2020. "Optimal unbiased estimation for expected cumulative discounted cost," European Journal of Operational Research, Elsevier, vol. 286(2), pages 604-618.
    17. Sandjai Bhulai & Taoying Farenhorst-Yuan & Bernd Heidergott & Dinard Laan, 2012. "Optimal balanced control for call centers," Annals of Operations Research, Springer, vol. 201(1), pages 39-62, December.
    18. Heidergott, Bernd & Vazquez-Abad, Felisa J. & Volk-Makarewicz, Warren, 2008. "Sensitivity estimation for Gaussian systems," European Journal of Operational Research, Elsevier, vol. 187(1), pages 193-207, May.
    19. Eric C. Ni & Dragos F. Ciocan & Shane G. Henderson & Susan R. Hunter, 2017. "Efficient Ranking and Selection in Parallel Computing Environments," Operations Research, INFORMS, vol. 65(3), pages 821-836, June.
    20. Jose Blanchet & Juan Li & Marvin K. Nakayama, 2019. "Rare-Event Simulation for Distribution Networks," Operations Research, INFORMS, vol. 67(5), pages 1383-1396, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:oropre:v:47:y:1999:i:4:p:585-600. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.