IDEAS home Printed from https://ideas.repec.org/a/inm/oropre/v59y2011i4p998-1007.html
   My bibliography  Save this article

Efficient Nested Simulation for Estimating the Variance of a Conditional Expectation

Author

Listed:
  • Yunpeng Sun

    (Department of Industrial Engineering and Management Sciences, Northwestern University, Evanston, Illinois 60208)

  • Daniel W. Apley

    (Department of Industrial Engineering and Management Sciences, Northwestern University, Evanston, Illinois 60208)

  • Jeremy Staum

    (Department of Industrial Engineering and Management Sciences, Northwestern University, Evanston, Illinois 60208)

Abstract

In a two-level nested simulation, an outer level of simulation samples scenarios, while the inner level uses simulation to estimate a conditional expectation given the scenario. Applications include financial risk management, assessing the effects of simulation input uncertainty, and computing the expected value of gathering more information in decision theory. We show that an ANOVA-like estimator of the variance of the conditional expectation is unbiased under mild conditions, and we discuss the optimal number of inner-level samples to minimize this estimator's variance given a fixed computational budget. We show that as the computational budget increases, the optimal number of inner-level samples remains bounded. This finding contrasts with previous work on two-level simulation problems in which the inner- and outer-level sample sizes must both grow without bound for the estimation error to approach zero. The finding implies that the variance of a conditional expectation can be estimated to arbitrarily high precision by a simulation experiment with a fixed inner-level computational effort per scenario, which we call a one-and-a-half-level simulation. Because the optimal number of inner-level samples is often quite small, a one-and-a-half-level simulation can avoid the heavy computational burden typically associated with two-level simulation.

Suggested Citation

  • Yunpeng Sun & Daniel W. Apley & Jeremy Staum, 2011. "Efficient Nested Simulation for Estimating the Variance of a Conditional Expectation," Operations Research, INFORMS, vol. 59(4), pages 998-1007, August.
  • Handle: RePEc:inm:oropre:v:59:y:2011:i:4:p:998-1007
    DOI: 10.1287/opre.1110.0932
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/opre.1110.0932
    Download Restriction: no

    File URL: https://libkey.io/10.1287/opre.1110.0932?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Michael B. Gordy & Sandeep Juneja, 2010. "Nested Simulation in Portfolio Risk Measurement," Management Science, INFORMS, vol. 56(10), pages 1833-1848, October.
    2. Alan Brennan & Samer Kharroubi & Anthony O'Hagan & Jim Chilcott, 2007. "Calculating Partial Expected Value of Perfect Information via Monte Carlo Sampling Algorithms," Medical Decision Making, , vol. 27(4), pages 448-470, July.
    3. Stephen E. Chick, 2001. "Input Distribution Selection for Simulation Experiments: Accounting for Input Uncertainty," Operations Research, INFORMS, vol. 49(5), pages 744-758, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mohammed Shahid Abdulla & L Ramprasath, 2019. "ANOVA with two timescale stochastic approximation for estimating Variance of Conditional Expectation," Working papers 337, Indian Institute of Management Kozhikode.
    2. Pedro Godinho, 2015. "Estimating State-Dependent Volatility of Investment Projects: A Simulation Approach," GEMF Working Papers 2015-02, GEMF, Faculty of Economics, University of Coimbra.
    3. Mark Broadie & Yiping Du & Ciamac C. Moallemi, 2015. "Risk Estimation via Regression," Operations Research, INFORMS, vol. 63(5), pages 1077-1097, October.
    4. Guangxin Jiang & L. Jeff Hong & Barry L. Nelson, 2020. "Online Risk Monitoring Using Offline Simulation," INFORMS Journal on Computing, INFORMS, vol. 32(2), pages 356-375, April.
    5. Pedro Godinho, 2015. "Estimating State-Dependent Volatility of Investment Projects: A Simulation Approach," GEMF Working Papers 2015-02, GEMF, Faculty of Economics, University of Coimbra.
    6. Mark Broadie & Yiping Du & Ciamac C. Moallemi, 2011. "Efficient Risk Estimation via Nested Sequential Simulation," Management Science, INFORMS, vol. 57(6), pages 1172-1194, June.
    7. Liu, Xiaoyu & Yan, Xing & Zhang, Kun, 2024. "Kernel quantile estimators for nested simulation with application to portfolio value-at-risk measurement," European Journal of Operational Research, Elsevier, vol. 312(3), pages 1168-1177.
    8. Youngjun Choe & Henry Lam & Eunshin Byon, 2018. "Uncertainty Quantification of Stochastic Simulation for Black-box Computer Experiments," Methodology and Computing in Applied Probability, Springer, vol. 20(4), pages 1155-1172, December.
    9. Kamiński, Bogumił, 2015. "A method for the updating of stochastic kriging metamodels," European Journal of Operational Research, Elsevier, vol. 247(3), pages 859-866.
    10. Praveen Sugathan, 2019. "Evaluating price fairness in hedonic and co-created categories," Working papers 336, Indian Institute of Management Kozhikode.
    11. Wang, Tianxiang & Xu, Jie & Hu, Jian-Qiang & Chen, Chun-Hung, 2023. "Efficient estimation of a risk measure requiring two-stage simulation optimization," European Journal of Operational Research, Elsevier, vol. 305(3), pages 1355-1365.
    12. Qiyun Pan & Eunshin Byon & Young Myoung Ko & Henry Lam, 2020. "Adaptive importance sampling for extreme quantile estimation with stochastic black box computer models," Naval Research Logistics (NRL), John Wiley & Sons, vol. 67(7), pages 524-547, October.
    13. David J. Eckman & Shane G. Henderson & Sara Shashaani, 2023. "Diagnostic Tools for Evaluating and Comparing Simulation-Optimization Algorithms," INFORMS Journal on Computing, INFORMS, vol. 35(2), pages 350-367, March.
    14. Henry Lam, 2016. "Robust Sensitivity Analysis for Stochastic Systems," Mathematics of Operations Research, INFORMS, vol. 41(4), pages 1248-1275, November.
    15. Mingbin Ben Feng & Eunhye Song, 2020. "Optimal Nested Simulation Experiment Design via Likelihood Ratio Method," Papers 2008.13087, arXiv.org, revised Jul 2021.
    16. Wen Shi & Xi Chen, 2018. "Efficient budget allocation strategies for elementary effects method in stochastic simulation," Naval Research Logistics (NRL), John Wiley & Sons, vol. 65(3), pages 218-241, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Helin Zhu & Tianyi Liu & Enlu Zhou, 2015. "Risk Quantification in Stochastic Simulation under Input Uncertainty," Papers 1507.06015, arXiv.org, revised Dec 2017.
    2. Fabian Dickmann & Nikolaus Schweizer, 2014. "Faster Comparison of Stopping Times by Nested Conditional Monte Carlo," Papers 1402.0243, arXiv.org.
    3. Nteukam T., Oberlain & Planchet, Frédéric, 2012. "Stochastic evaluation of life insurance contracts: Model point on asset trajectories and measurement of the error related to aggregation," Insurance: Mathematics and Economics, Elsevier, vol. 51(3), pages 624-631.
    4. Alessandro Gnoatto & Athena Picarelli & Christoph Reisinger, 2020. "Deep xVA solver -- A neural network based counterparty credit risk management framework," Papers 2005.02633, arXiv.org, revised Dec 2022.
    5. Matthieu Chauvigny & Laurent Devineau & Stéphane Loisel & Véronique Maume-Deschamps, 2011. "Fast remote but not extreme quantiles with multiple factors. Applications to Solvency II and Enterprise Risk Management," Post-Print hal-00517766, HAL.
    6. Mehdi Najafzadeh & Carlo Marra & Eleni Galanis & David Patrick, 2009. "Cost Effectiveness of Herpes Zoster Vaccine in Canada," PharmacoEconomics, Springer, vol. 27(12), pages 991-1004, December.
    7. David J. Eckman & Shane G. Henderson & Sara Shashaani, 2023. "Diagnostic Tools for Evaluating and Comparing Simulation-Optimization Algorithms," INFORMS Journal on Computing, INFORMS, vol. 35(2), pages 350-367, March.
    8. Mingbin Ben Feng & Eunhye Song, 2020. "Optimal Nested Simulation Experiment Design via Likelihood Ratio Method," Papers 2008.13087, arXiv.org, revised Jul 2021.
    9. Wei Fang & Zhenru Wang & Michael B. Giles & Chris H. Jackson & Nicky J. Welton & Christophe Andrieu & Howard Thom, 2022. "Multilevel and Quasi Monte Carlo Methods for the Calculation of the Expected Value of Partial Perfect Information," Medical Decision Making, , vol. 42(2), pages 168-181, February.
    10. Xuefei Lu & Alessandro Rudi & Emanuele Borgonovo & Lorenzo Rosasco, 2020. "Faster Kriging: Facing High-Dimensional Simulators," Operations Research, INFORMS, vol. 68(1), pages 233-249, January.
    11. F Bourgey & S de Marco & Emmanuel Gobet & Alexandre Zhou, 2020. "Multilevel Monte-Carlo methods and lower-upper bounds in Initial Margin computations," Post-Print hal-02430430, HAL.
    12. Guay, François & Schwenkler, Gustavo, 2021. "Efficient estimation and filtering for multivariate jump–diffusions," Journal of Econometrics, Elsevier, vol. 223(1), pages 251-275.
    13. Lokman A. Abbas-Turki & Stéphane Crépey & Babacar Diallo, 2018. "Xva Principles, Nested Monte Carlo Strategies, And Gpu Optimizations," International Journal of Theoretical and Applied Finance (IJTAF), World Scientific Publishing Co. Pte. Ltd., vol. 21(06), pages 1-40, September.
    14. Mark Broadie & Yiping Du & Ciamac C. Moallemi, 2015. "Risk Estimation via Regression," Operations Research, INFORMS, vol. 63(5), pages 1077-1097, October.
    15. F Bourgey & S de Marco & Emmanuel Gobet & Alexandre Zhou, 2020. "Multilevel Monte-Carlo methods and lower-upper bounds in Initial Margin computations," Working Papers hal-02430430, HAL.
    16. Xi Chen & Kyoung-Kuk Kim, 2016. "Efficient VaR and CVaR Measurement via Stochastic Kriging," INFORMS Journal on Computing, INFORMS, vol. 28(4), pages 629-644, November.
    17. Russell R. Barton & Barry L. Nelson & Wei Xie, 2014. "Quantifying Input Uncertainty via Simulation Confidence Intervals," INFORMS Journal on Computing, INFORMS, vol. 26(1), pages 74-87, February.
    18. Weiwei Fan & L. Jeff Hong & Xiaowei Zhang, 2020. "Distributionally Robust Selection of the Best," Management Science, INFORMS, vol. 66(1), pages 190-208, January.
    19. Lotfi Boudabsa & Damir Filipovi'c, 2022. "Ensemble learning for portfolio valuation and risk management," Papers 2204.05926, arXiv.org.
    20. Runhuan Feng & Peng Li, 2021. "Sample Recycling Method -- A New Approach to Efficient Nested Monte Carlo Simulations," Papers 2106.06028, arXiv.org.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:oropre:v:59:y:2011:i:4:p:998-1007. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.