IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1901.06715.html
   My bibliography  Save this paper

A Backward Simulation Method for Stochastic Optimal Control Problems

Author

Listed:
  • Zhiyi Shen
  • Chengguo Weng

Abstract

A number of optimal decision problems with uncertainty can be formulated into a stochastic optimal control framework. The Least-Squares Monte Carlo (LSMC) algorithm is a popular numerical method to approach solutions of such stochastic control problems as analytical solutions are not tractable in general. This paper generalizes the LSMC algorithm proposed in Shen and Weng (2017) to solve a wide class of stochastic optimal control models. Our algorithm has three pillars: a construction of auxiliary stochastic control model, an artificial simulation of the post-action value of state process, and a shape-preserving sieve estimation method which equip the algorithm with a number of merits including bypassing forward simulation and control randomization, evading extrapolating the value function, and alleviating computational burden of the tuning parameter selection. The efficacy of the algorithm is corroborated by an application to pricing equity-linked insurance products.

Suggested Citation

  • Zhiyi Shen & Chengguo Weng, 2019. "A Backward Simulation Method for Stochastic Optimal Control Problems," Papers 1901.06715, arXiv.org.
    • Handle: RePEc:arx:papers:1901.06715
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/1901.06715
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Longstaff, Francis A & Schwartz, Eduardo S, 2001. "Valuing American Options by Simulation: A Simple Least-Squares Approach," The Review of Financial Studies, Society for Financial Studies, vol. 14(1), pages 113-147.
    2. Carriere, Jacques F., 1996. "Valuation of the early-exercise price for options using simulations and nonparametric regression," Insurance: Mathematics and Economics, Elsevier, vol. 19(1), pages 19-30, December.
    3. Chen, Xiaohong, 2007. "Large Sample Sieve Estimation of Semi-Nonparametric Models," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 76, Elsevier.
    4. Parsiad Azimzadeh & Peter A. Forsyth, 2015. "The existence of optimal bang-bang controls for GMxB contracts," Papers 1502.05743, arXiv.org, revised Nov 2015.
    5. Kharroubi Idris & Langrené Nicolas & Pham Huyên, 2014. "A numerical algorithm for fully nonlinear HJB equations: An approach by control randomization," Monte Carlo Methods and Applications, De Gruyter, vol. 20(2), pages 145-165, June.
    6. Cong, F. & Oosterlee, C.W., 2016. "Multi-period mean–variance portfolio optimization based on Monte-Carlo simulation," Journal of Economic Dynamics and Control, Elsevier, vol. 64(C), pages 23-38.
    7. Christophe Barrera-Esteve & Florent Bergeret & Charles Dossal & Emmanuel Gobet & Asma Meziou & Rémi Munos & Damien Reboul-Salze, 2006. "Numerical Methods for the Pricing of Swing Options: A Stochastic Control Approach," Methodology and Computing in Applied Probability, Springer, vol. 8(4), pages 517-540, December.
    8. Lars Stentoft, 2004. "Convergence of the Least Squares Monte Carlo Approach to American Option Valuation," Management Science, INFORMS, vol. 50(9), pages 1193-1203, September.
    9. Philip Protter & Emmanuelle Clément & Damien Lamberton, 2002. "An analysis of a least squares regression method for American option pricing," Finance and Stochastics, Springer, vol. 6(4), pages 449-471.
    10. Chen, Z. & Vetzal, K. & Forsyth, P.A., 2008. "The effect of modelling parameters on the value of GMWB guarantees," Insurance: Mathematics and Economics, Elsevier, vol. 43(1), pages 165-173, August.
    11. repec:dau:papers:123456789/12195 is not listed on IDEAS
    12. Daniel Zanger, 2009. "Convergence of a Least-Squares Monte Carlo Algorithm for Bounded Approximating Sets," Applied Mathematical Finance, Taylor & Francis Journals, vol. 16(2), pages 123-150.
    13. Yao Tung Huang & Yue Kuen Kwok, 2016. "Regression-based Monte Carlo methods for stochastic control models: variable annuities with lifelong guarantees," Quantitative Finance, Taylor & Francis Journals, vol. 16(6), pages 905-928, June.
    14. Denis Belomestny & Grigori Milstein & Vladimir Spokoiny, 2009. "Regression methods in pricing American and Bermudan options using consumption processes," Quantitative Finance, Taylor & Francis Journals, vol. 9(3), pages 315-327.
    15. Daniel Zanger, 2013. "Quantitative error estimates for a least-squares Monte Carlo algorithm for American option pricing," Finance and Stochastics, Springer, vol. 17(3), pages 503-534, July.
    16. Jeechul Woo & Chenru Liu & Jaehyuk Choi, 2018. "Leave-One-Out Least Square Monte Carlo Algorithm for Pricing American Options," Papers 1810.02071, arXiv.org, revised Sep 2020.
    17. Newey, Whitney K., 1997. "Convergence rates and asymptotic normality for series estimators," Journal of Econometrics, Elsevier, vol. 79(1), pages 147-168, July.
    18. Denis Belomestny, 2011. "Pricing Bermudan options by nonparametric regression: optimal rates of convergence for lower estimates," Finance and Stochastics, Springer, vol. 15(4), pages 655-683, December.
    19. Longstaff, Francis A & Schwartz, Eduardo S, 2001. "Valuing American Options by Simulation: A Simple Least-Squares Approach," University of California at Los Angeles, Anderson Graduate School of Management qt43n1k4jb, Anderson Graduate School of Management, UCLA.
    20. Min Dai & Yue Kuen Kwok & Jianping Zong, 2008. "Guaranteed Minimum Withdrawal Benefit In Variable Annuities," Mathematical Finance, Wiley Blackwell, vol. 18(4), pages 595-611, October.
    21. Lars Stentoft, 2004. "Assessing the Least Squares Monte-Carlo Approach to American Option Valuation," Review of Derivatives Research, Springer, vol. 7(2), pages 129-168, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Nicholas Davey & Nicolas Langrené & Wen Chen & Jonathan R. Rhodes & Simon Dunstall & Saman Halgamuge, 2023. "Designing higher value roads to preserve species at risk by optimally controlling traffic flow," Annals of Operations Research, Springer, vol. 320(2), pages 663-693, January.
    2. Arian, Hamid & Moghimi, Mehrdad & Tabatabaei, Ehsan & Zamani, Shiva, 2022. "Encoded Value-at-Risk: A machine learning approach for portfolio risk measurement," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 202(C), pages 500-525.
    3. Ivan Guo & Nicolas Langrené & Gregoire Loeper & Wei Ning, 2020. "Robust utility maximization under model uncertainty via a penalization approach," Working Papers hal-02910261, HAL.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fabozzi, Frank J. & Paletta, Tommaso & Tunaru, Radu, 2017. "An improved least squares Monte Carlo valuation method based on heteroscedasticity," European Journal of Operational Research, Elsevier, vol. 263(2), pages 698-706.
    2. Daniel Z. Zanger, 2020. "General Error Estimates for the Longstaff–Schwartz Least-Squares Monte Carlo Algorithm," Mathematics of Operations Research, INFORMS, vol. 45(3), pages 923-946, August.
    3. Chen Liu & Henry Schellhorn & Qidi Peng, 2019. "American Option Pricing With Regression: Convergence Analysis," International Journal of Theoretical and Applied Finance (IJTAF), World Scientific Publishing Co. Pte. Ltd., vol. 22(08), pages 1-31, December.
    4. Hongjun Ha & Daniel Bauer, 2022. "A least-squares Monte Carlo approach to the estimation of enterprise risk," Finance and Stochastics, Springer, vol. 26(3), pages 417-459, July.
    5. Maciej Klimek & Marcin Pitera, 2014. "The least squares method for option pricing revisited," Papers 1404.7438, arXiv.org, revised Nov 2015.
    6. S'ergio C. Bezerra & Alberto Ohashi & Francesco Russo & Francys de Souza, 2017. "Discrete-type approximations for non-Markovian optimal stopping problems: Part II," Papers 1707.05250, arXiv.org, revised Dec 2019.
    7. Claudio Fontana & Francesco Rotondi, 2022. "Valuation of general GMWB annuities in a low interest rate environment," Papers 2208.10183, arXiv.org, revised Aug 2023.
    8. Katarzyna Toporek, 2012. "Simple is better. Empirical comparison of American option valuation methods," Ekonomia journal, Faculty of Economic Sciences, University of Warsaw, vol. 29.
    9. Seyed Amir Hejazi & Kenneth R. Jackson, 2016. "A Neural Network Approach to Efficient Valuation of Large Portfolios of Variable Annuities," Papers 1606.07831, arXiv.org.
    10. Daniel Zanger, 2013. "Quantitative error estimates for a least-squares Monte Carlo algorithm for American option pricing," Finance and Stochastics, Springer, vol. 17(3), pages 503-534, July.
    11. Hampus Engsner, 2021. "Least Squares Monte Carlo applied to Dynamic Monetary Utility Functions," Papers 2101.10947, arXiv.org, revised Apr 2021.
    12. Nan Chen & Yanchu Liu, 2014. "American Option Sensitivities Estimation via a Generalized Infinitesimal Perturbation Analysis Approach," Operations Research, INFORMS, vol. 62(3), pages 616-632, June.
    13. Joseph Y. J. Chow & Hamid R. Sayarshad, 2016. "Reference Policies for Non-myopic Sequential Network Design and Timing Problems," Networks and Spatial Economics, Springer, vol. 16(4), pages 1183-1209, December.
    14. Hejazi, Seyed Amir & Jackson, Kenneth R., 2016. "A neural network approach to efficient valuation of large portfolios of variable annuities," Insurance: Mathematics and Economics, Elsevier, vol. 70(C), pages 169-181.
    15. Sérgio C. Bezerra & Alberto Ohashi & Francesco Russo & Francys Souza, 2020. "Discrete-type Approximations for Non-Markovian Optimal Stopping Problems: Part II," Methodology and Computing in Applied Probability, Springer, vol. 22(3), pages 1221-1255, September.
    16. Floryszczak, Anthony & Le Courtois, Olivier & Majri, Mohamed, 2016. "Inside the Solvency 2 Black Box: Net Asset Values and Solvency Capital Requirements with a least-squares Monte-Carlo approach," Insurance: Mathematics and Economics, Elsevier, vol. 71(C), pages 15-26.
    17. Jin, Xing & Yang, Cheng-Yu, 2016. "Efficient estimation of lower and upper bounds for pricing higher-dimensional American arithmetic average options by approximating their payoff functions," International Review of Financial Analysis, Elsevier, vol. 44(C), pages 65-77.
    18. Yao Tung Huang & Yue Kuen Kwok, 2016. "Regression-based Monte Carlo methods for stochastic control models: variable annuities with lifelong guarantees," Quantitative Finance, Taylor & Francis Journals, vol. 16(6), pages 905-928, June.
    19. Fontana, Claudio & Rotondi, Francesco, 2023. "Valuation of general GMWB annuities in a low interest rate environment," Insurance: Mathematics and Economics, Elsevier, vol. 112(C), pages 142-167.
    20. R. Mark Reesor & T. James Marshall, 2020. "Forest of Stochastic Trees: A Method for Valuing Multiple Exercise Options," JRFM, MDPI, vol. 13(5), pages 1-31, May.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1901.06715. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.