IDEAS home Printed from https://ideas.repec.org/a/kap/compec/v54y2019i3d10.1007_s10614-018-9865-y.html
   My bibliography  Save this article

On the Numerical Solution of Mertonian Control Problems: A Survey of the Markov Chain Approximation Method for the Working Economist

Author

Listed:
  • Simon Ellersgaard

    (University of Copenhagen)

Abstract

Analytic solutions to HJB equation in mathematical finance are relatively hard to come by, which stresses the need for numerical procedures. In this paper we provide a self-contained exposition of the finite-horizon Markov chain approximation method as championed by Kushner and Dupuis. Furthermore, we provide full details as to how well the algorithm fares when we deploy it in the context of Merton type optimisation problems. Assorted issues relating to implementation and numerical accuracy are thoroughly reviewed, including multidimensionality and the positive probability requirement, the question of boundary conditions, and the choice of parametric values.

Suggested Citation

  • Simon Ellersgaard, 2019. "On the Numerical Solution of Mertonian Control Problems: A Survey of the Markov Chain Approximation Method for the Working Economist," Computational Economics, Springer;Society for Computational Economics, vol. 54(3), pages 1179-1211, October.
    • Handle: RePEc:kap:compec:v:54:y:2019:i:3:d:10.1007_s10614-018-9865-y
    DOI: 10.1007/s10614-018-9865-y
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10614-018-9865-y
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10614-018-9865-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ben G. Fitzpatrick & Wendell H. Fleming, 1991. "Numerical Methods for an Optimal Investment-Consumption Model," Mathematics of Operations Research, INFORMS, vol. 16(4), pages 823-841, November.
    2. Holger Kraft, 2005. "Optimal portfolios and Heston's stochastic volatility model: an explicit solution for power utility," Quantitative Finance, Taylor & Francis Journals, vol. 5(3), pages 303-313.
    3. Cvitanic, Jaksa & Goukasian, Levon & Zapatero, Fernando, 2003. "Monte Carlo computation of optimal portfolios in complete markets," Journal of Economic Dynamics and Control, Elsevier, vol. 27(6), pages 971-986, April.
    4. Jérôme B. Detemple & Ren Garcia & Marcel Rindisbacher, 2003. "A Monte Carlo Method for Optimal Portfolios," Journal of Finance, American Finance Association, vol. 58(1), pages 401-446, February.
    5. Heston, Steven L, 1993. "A Closed-Form Solution for Options with Stochastic Volatility with Applications to Bond and Currency Options," The Review of Financial Studies, Society for Financial Studies, vol. 6(2), pages 327-343.
    6. Hindy, Ayman & Huang, Chi-fu & Zhu, Steven H., 1997. "Numerical analysis of a free-boundary singular control problem in financial economics," Journal of Economic Dynamics and Control, Elsevier, vol. 21(2-3), pages 297-327.
    7. Claus Munk, 1999. "The Valuation of Contingent Claims under Portfolio Constraints: Reservation Buying and Selling Prices," Review of Finance, European Finance Association, vol. 3(3), pages 347-388.
    8. Munk, Claus, 2000. "Optimal consumption/investment policies with undiversifiable income risk and liquidity constraints," Journal of Economic Dynamics and Control, Elsevier, vol. 24(9), pages 1315-1343, August.
    9. Merton, Robert C, 1969. "Lifetime Portfolio Selection under Uncertainty: The Continuous-Time Case," The Review of Economics and Statistics, MIT Press, vol. 51(3), pages 247-257, August.
    10. Jun Liu, 2007. "Portfolio Selection in Stochastic Environments," The Review of Financial Studies, Society for Financial Studies, vol. 20(1), pages 1-39, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chenxu Li & O. Scaillet & Yiwen Shen, 2020. "Decomposition of Optimal Dynamic Portfolio Choice with Wealth-Dependent Utilities in Incomplete Markets," Swiss Finance Institute Research Paper Series 20-22, Swiss Finance Institute.
    2. Chenxu Li & Olivier Scaillet & Yiwen Shen, 2020. "Wealth Effect on Portfolio Allocation in Incomplete Markets," Papers 2004.10096, arXiv.org, revised Aug 2021.
    3. Larsen, Linda Sandris & Munk, Claus, 2012. "The costs of suboptimal dynamic asset allocation: General results and applications to interest rate risk, stock volatility risk, and growth/value tilts," Journal of Economic Dynamics and Control, Elsevier, vol. 36(2), pages 266-293.
    4. Legendre, François & Togola, Djibril, 2016. "Explicit solutions to dynamic portfolio choice problems: A continuous-time detour," Economic Modelling, Elsevier, vol. 58(C), pages 627-641.
    5. Yichen Zhu & Marcos Escobar-Anel, 2021. "A Neural Network Monte Carlo Approximation for Expected Utility Theory," JRFM, MDPI, vol. 14(7), pages 1-18, July.
    6. Munk, Claus & Sørensen, Carsten, 2010. "Dynamic asset allocation with stochastic income and interest rates," Journal of Financial Economics, Elsevier, vol. 96(3), pages 433-462, June.
    7. Simon Ellersgaard & Martin Tegnér, 2018. "Stochastic volatility for utility maximizers — A martingale approach," International Journal of Financial Engineering (IJFE), World Scientific Publishing Co. Pte. Ltd., vol. 5(01), pages 1-39, March.
    8. Suleyman Basak & Georgy Chabakauri, 2010. "Dynamic Mean-Variance Asset Allocation," The Review of Financial Studies, Society for Financial Studies, vol. 23(8), pages 2970-3016, August.
    9. Björn Bick & Holger Kraft & Claus Munk, 2013. "Solving Constrained Consumption-Investment Problems by Simulation of Artificial Market Strategies," Management Science, INFORMS, vol. 59(2), pages 485-503, June.
    10. Kasper Larsen & Oleksii Mostovyi & Gordan v{Z}itkovi'c, 2014. "An expansion in the model space in the context of utility maximization," Papers 1410.0946, arXiv.org, revised Aug 2016.
    11. Boyle, Phelim & Imai, Junichi & Tan, Ken Seng, 2008. "Computation of optimal portfolios using simulation-based dimension reduction," Insurance: Mathematics and Economics, Elsevier, vol. 43(3), pages 327-338, December.
    12. Kasper Larsen & Oleksii Mostovyi & Gordan Žitković, 2018. "An expansion in the model space in the context of utility maximization," Finance and Stochastics, Springer, vol. 22(2), pages 297-326, April.
    13. Yumo Zhang, 2023. "Utility maximization in a stochastic affine interest rate and CIR risk premium framework: a BSDE approach," Decisions in Economics and Finance, Springer;Associazione per la Matematica, vol. 46(1), pages 97-128, June.
    14. Escobar, Marcos & Ferrando, Sebastian & Rubtsov, Alexey, 2016. "Portfolio choice with stochastic interest rates and learning about stock return predictability," International Review of Economics & Finance, Elsevier, vol. 41(C), pages 347-370.
    15. Marcos Escobar-Anel & Harold A. Moreno-Franco, 2019. "Dynamic portfolio strategies under a fully correlated jump-diffusion process," Annals of Finance, Springer, vol. 15(3), pages 421-453, September.
    16. Cheng, Yuyang & Escobar-Anel, Marcos, 2023. "A class of portfolio optimization solvable problems," Finance Research Letters, Elsevier, vol. 52(C).
    17. Farina Weiss, 2021. "A numerical approach to solve consumption-portfolio problems with predictability in income, stock prices, and house prices," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 93(1), pages 33-81, February.
    18. Yi, Bo & Li, Zhongfei & Viens, Frederi G. & Zeng, Yan, 2013. "Robust optimal control for an insurer with reinsurance and investment under Heston’s stochastic volatility model," Insurance: Mathematics and Economics, Elsevier, vol. 53(3), pages 601-614.
    19. Zheng, Xiaoxiao & Zhou, Jieming & Sun, Zhongyang, 2016. "Robust optimal portfolio and proportional reinsurance for an insurer under a CEV model," Insurance: Mathematics and Economics, Elsevier, vol. 67(C), pages 77-87.
    20. Nicole Branger & Matthias Muck & Stefan Weisheit, 2019. "Correlation risk and international portfolio choice," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 39(1), pages 128-146, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:compec:v:54:y:2019:i:3:d:10.1007_s10614-018-9865-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.