IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2307.04676.html

Importance Sampling for Minimization of Tail Risks: A Tutorial

Author

Listed:
  • Anand Deo
  • Karthyek Murthy

Abstract

This paper provides an introductory overview of how one may employ importance sampling effectively as a tool for solving stochastic optimization formulations incorporating tail risk measures such as Conditional Value-at-Risk. Approximating the tail risk measure by its sample average approximation, while appealing due to its simplicity and universality in use, requires a large number of samples to be able to arrive at risk-minimizing decisions with high confidence. This is primarily due to the rarity with which the relevant tail events get observed in the samples. In simulation, Importance Sampling is among the most prominent methods for substantially reducing the sample requirement while estimating probabilities of rare events. Can importance sampling be used for optimization as well? If so, what are the ingredients required for making importance sampling an effective tool for optimization formulations involving rare events? This tutorial aims to provide an introductory overview of the two key ingredients in this regard, namely, (i) how one may arrive at an importance sampling change of measure prescription at every decision, and (ii) the prominent techniques available for integrating such a prescription within a solution paradigm for stochastic optimization formulations.

Suggested Citation

  • Anand Deo & Karthyek Murthy, 2023. "Importance Sampling for Minimization of Tail Risks: A Tutorial," Papers 2307.04676, arXiv.org.
    • Handle: RePEc:arx:papers:2307.04676
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2307.04676
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Raghu Pasupathy, 2010. "On Choosing Parameters in Retrospective-Approximation Algorithms for Stochastic Root Finding and Simulation Optimization," Operations Research, INFORMS, vol. 58(4-part-1), pages 889-901, August.
    2. Fabio Caccioli & Imre Kondor & Gábor Papp, 2018. "Portfolio optimization under Expected Shortfall: contour maps of estimation error," Quantitative Finance, Taylor & Francis Journals, vol. 18(8), pages 1295-1313, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yun Feng & Weijie Hou & Yuping Song, 2024. "Tail risk forecasting and its application to margin requirements in the commodity futures market," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 43(5), pages 1513-1529, August.
    2. Jinlong Lei & Uday V. Shanbhag, 2025. "Variance-Reduced Accelerated First-Order Methods: Central Limit Theorems and Confidence Statements," Mathematics of Operations Research, INFORMS, vol. 50(2), pages 1364-1397, May.
    3. Emelogu, Adindu & Chowdhury, Sudipta & Marufuzzaman, Mohammad & Bian, Linkan & Eksioglu, Burak, 2016. "An enhanced sample average approximation method for stochastic optimization," International Journal of Production Economics, Elsevier, vol. 182(C), pages 230-252.
    4. Stefania Bellavia & Nataša Krejić & Benedetta Morini, 2020. "Inexact restoration with subsampled trust-region methods for finite-sum minimization," Computational Optimization and Applications, Springer, vol. 76(3), pages 701-736, July.
    5. Hu, Shaolong & Dong, Zhijie Sasha & Dai, Rui, 2024. "A machine learning based sample average approximation for supplier selection with option contract in humanitarian relief," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 186(C).
    6. Wang, Honggang, 2012. "Retrospective optimization of mixed-integer stochastic systems using dynamic simplex linear interpolation," European Journal of Operational Research, Elsevier, vol. 217(1), pages 141-148.
    7. Nataša Krejić & Nataša Krklec Jerinkić, 2019. "Spectral projected gradient method for stochastic optimization," Journal of Global Optimization, Springer, vol. 73(1), pages 59-81, January.
    8. J. O. Royset & E. Y. Pee, 2012. "Rate of Convergence Analysis of Discretization and Smoothing Algorithms for Semiinfinite Minimax Problems," Journal of Optimization Theory and Applications, Springer, vol. 155(3), pages 855-882, December.
    9. Johannes Royset, 2013. "On sample size control in sample average approximations for solving smooth stochastic programs," Computational Optimization and Applications, Springer, vol. 55(2), pages 265-309, June.
    10. Shanshan Jiang & Jie Wang & Ruiting Dong & Yutong Li & Min Xia, 2023. "Systemic Risk with Multi-Channel Risk Contagion in the Interbank Market," Sustainability, MDPI, vol. 15(3), pages 1-24, February.
    11. Anand Deo, 2025. "EVT-Based Rate-Preserving Distributional Robustness for Tail Risk Functionals," Papers 2506.16230, arXiv.org, revised Jan 2026.
    12. Johannes O. Royset & Roger J-B Wets, 2016. "Optimality Functions and Lopsided Convergence," Journal of Optimization Theory and Applications, Springer, vol. 169(3), pages 965-983, June.
    13. Suvrajeet Sen & Yifan Liu, 2016. "Mitigating Uncertainty via Compromise Decisions in Two-Stage Stochastic Linear Programming: Variance Reduction," Operations Research, INFORMS, vol. 64(6), pages 1422-1437, December.
    14. Anand Deo & Karthyek Murthy, 2020. "Optimizing tail risks using an importance sampling based extrapolation for heavy-tailed objectives," Papers 2008.09818, arXiv.org.
    15. Henry Lam & Xinyu Zhang & Xuhui Zhang, 2023. "Enhanced Balancing of Bias-Variance Tradeoff in Stochastic Estimation: A Minimax Perspective," Operations Research, INFORMS, vol. 71(6), pages 2352-2373, November.
    16. Honggang Wang, 2017. "Subspace dynamic‐simplex linear interpolation search for mixed‐integer black‐box optimization problems," Naval Research Logistics (NRL), John Wiley & Sons, vol. 64(4), pages 305-322, June.
    17. Kyle Cooper & Susan R. Hunter & Kalyani Nagaraj, 2020. "Biobjective Simulation Optimization on Integer Lattices Using the Epsilon-Constraint Method in a Retrospective Approximation Framework," INFORMS Journal on Computing, INFORMS, vol. 32(4), pages 1080-1100, October.
    18. Tsai, Shing Chih & Zheng, Ya-Xin, 2013. "A simulation optimization approach for a two-echelon inventory system with service level constraints," European Journal of Operational Research, Elsevier, vol. 229(2), pages 364-374.
    19. Hu, Shaolong & Hu, Qingmi & Tao, Sha & Dong, Zhijie Sasha, 2023. "A multi-stage stochastic programming approach for pre-positioning of relief supplies considering returns," Socio-Economic Planning Sciences, Elsevier, vol. 88(C).
    20. Papp, Gábor & Kondor, Imre & Caccioli, Fabio, 2021. "Optimizing expected shortfall under an ℓ1 constraint—an analytic approach," LSE Research Online Documents on Economics 111051, London School of Economics and Political Science, LSE Library.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2307.04676. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.