This file is part of IDEAS, which uses RePEc data


[ Papers | Articles | Software | Books | Chapters | Authors | Institutions | JEL Classification | NEP reports | Search | New papers by email | Author registration | Rankings | Volunteers | FAQ | Blog | Help! ]

A Malliavin-based Monte-Carlo Approach for Numerical Solution of Stochastic Control Problems: Experiences from Merton's Problem

Author info | Abstract | Publisher info | Download info | Related research | Statistics
Author Info
Simon Lysbjerg Hansen () (Accounting and Finance University of Southern Denmark)
Abstract

The problem of choosing optimal investment and consumption strategies has been widely studied. In continuous time theory the pioneering work by Merton (1969) is a standard reference. In his work, Merton studied a continuous time economy with constant investment opportunities. Since then Merton's problem has been extended in many ways to capture empirically observed investment and consumption behavior. As more realism is incorporated into a model, the problem of optimal investment and consumption becomes harder to solve. Only rarely can analytical solutions be found, and only for problems possessing nice characteristics. To solve problems lacking analytical solutions we must apply numerical methods. Many realistic problems, however, are difficult to solve even numerically, due to their dimensionality. The purpose of this paper is to present a numerical procedure for solving high-dimensional stochastic control problems arising in the study of optimal portfolio choice. For expositional reasons we develop the algorithm in one dimension, but the mathematical results needed can be generalized to a multi-dimensional setting. The starting point of the algorithm is an initial guess about the agent's investment and consumption strategies at all times and wealth levels. Given this guess it is possible to simulate the wealth process until the investment horizon of the agent. We exploit the dynamic programming principle to break the problem into a series of smaller one-period problems, which can be solved recursively backwards. To be specific we determine first-order conditions relating the optimal controls to the value function in the next period. Starting from the final date we now numerically solve the first-order conditions for all simulated paths iteratively backwards. The investment and consumption strategies resulting from this procedure are used to update the simulated wealth paths, and the procedure can be repeated until it converges. The numerical properties of the algorithm are analyzed by testing it on Merton's optimal portfolio choice problem. The reason for this is that the solution to Merton's problem is explicitly known and can therefore serve as a benchmark for the algorithm. Our results indicate that it is possible to obtain some sort of convergence for both the initial controls and the distribution of their future values. Bearing in mind that we intend to apply the algorithm to a multi-dimensional setting, we also consider the possible complications that might arise. However, the state variables added will in most cases be exogenous non-controllable processes, which does not complicate the optimization routine in the proposed algorithm. Problems with computer storage could arise, but they should be solvable with clever computer programming

Download Info
To download:

If you experience problems downloading a file, check if you have the proper application to view it first. Information about this may be contained in the File-Format links below. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://www.sam.sdu.dk/~slh/papers/mmc.pdf
File Format: application/pdf
File Function: main text
Download Restriction: no

Publisher Info
Paper provided by Society for Computational Economics in its series Computing in Economics and Finance 2005 with number 391.

Download reference. The following formats are available: HTML (with abstract), plain text (with abstract), BibTeX, RIS (EndNote, RefMan, ProCite), ReDIF
Length:
Date of creation: 11 Nov 2005
Date of revision:
Handle: RePEc:sce:scecf5:391

Contact details of provider:
Email:
Web page: http://comp-econ.org/
More information through EDIRC

For technical questions regarding this item, or to correct its listing, contact: (Christopher F. Baum).

Related research
Keywords:

Find related papers by JEL classification:
C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: General - - - Statistical Simulation Methods
G11 - Financial Economics - - General Financial Markets - - - Portfolio Choice; Investment Decisions

This paper has been announced in the following NEP Reports:

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
  1. Longstaff, Francis A & Schwartz, Eduardo S, 2001. "Valuing American Options by Simulation: A Simple Least-Squares Approach," Review of Financial Studies, Oxford University Press for Society for Financial Studies, vol. 14(1), pages 113-47.
  2. John Y. Campbell & Joao F. Cocco, 2003. "Household Risk Management and Optimal Mortgage Choice," NBER Working Papers 9759, National Bureau of Economic Research, Inc. [Downloadable!] (restricted)
    Other versions:
  3. Samuelson, Paul A, 1969. "Lifetime Portfolio Selection by Dynamic Stochastic Programming," The Review of Economics and Statistics, MIT Press, vol. 51(3), pages 239-46, August. [Downloadable!] (restricted)
  4. Michael W. Brandt & Amit Goyal & Pedro Santa-Clara & Jonathan R. Stroud, 2005. "A Simulation Approach to Dynamic Portfolio Choice with an Application to Learning About Return Predictability," Review of Financial Studies, Oxford University Press for Society for Financial Studies, vol. 18(3), pages 831-873. [Downloadable!] (restricted)
  5. Bruno Bouchard & Ivar Ekeland & Nizar Touzi, 2004. "On the Malliavin approach to Monte Carlo approximation of conditional expectations," Finance and Stochastics, Springer, vol. 8(1), pages 45-71, January. [Downloadable!] (restricted)
  6. Longstaff, Francis A, 2001. "Optimal Portfolio Choice and the Valuation of Illiquid Securities," Review of Financial Studies, Oxford University Press for Society for Financial Studies, vol. 14(2), pages 407-31.
  7. Merton, Robert C, 1969. "Lifetime Portfolio Selection under Uncertainty: The Continuous-Time Case," The Review of Economics and Statistics, MIT Press, vol. 51(3), pages 247-57, August. [Downloadable!] (restricted)
Full references

Statistics
Access and download statistics

Did you know? No RePEc service, like IDEAS, charges for the use or the display of bibliographic data.

This page was last updated on 2009-10-31.


This information is provided to you by IDEAS at the Department of Economics, College of Liberal Arts and Sciences, University of Connecticut using RePEc data on a server sponsored by the Society for Economic Dynamics.