The Markov Chain Approximation Approach for Numerical Solution of Stochastic Control Problems: Experiences from Merton's Problem
Many problems in modern financial economics involve the solution of continuous-time, continuous-state stochastic control problems. Since explicit solutions of such problems are extremely rare, efficient numerical methods are called for. The Markov chain approximation approach provides a class of methods that are simple to understand and implement. In this paper, we compare the performance of different variations of the approach on a problem with a well-known solution, namely Merton's consumption/portfolio problem. We suggest a variant of the method, which outperforms the known variants, at least when applied to this specific problem. We document that the size of the contraction parameter of the control problem is of great importance for the accuracy of the numerical results. We also demonstrate that the Richardson extrapolation technique can improce accuracy significantly.
|Date of creation:||11 Feb 1998|
|Note:||Type of Document - Latex 2e; prepared on PC; to print on PostScript; pages: 31 ; figures: included|
|Contact details of provider:|| Web page: http://econwpa.repec.org|
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Merton, Robert C., 1971.
"Optimum consumption and portfolio rules in a continuous-time model,"
Journal of Economic Theory,
Elsevier, vol. 3(4), pages 373-413, December.
- R. C. Merton, 1970. "Optimum Consumption and Portfolio Rules in a Continuous-time Model," Working papers 58, Massachusetts Institute of Technology (MIT), Department of Economics.
- Rust, John, 1996. "Numerical dynamic programming in economics," Handbook of Computational Economics,in: H. M. Amman & D. A. Kendrick & J. Rust (ed.), Handbook of Computational Economics, edition 1, volume 1, chapter 14, pages 619-729 Elsevier.
- Bunch, David S & Johnson, Herb, 1992. " A Simple and Numerically Efficient Valuation Method for American Puts Using a Modified Geske-Johnson Approach," Journal of Finance, American Finance Association, vol. 47(2), pages 809-816, June. Full references (including those not matched with items on IDEAS)
When requesting a correction, please mention this item's handle: RePEc:wpa:wuwpfi:9802002. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (EconWPA)
If references are entirely missing, you can add them using this form.