Persistently optimal policies in stochastic dynamic programming with generalized discounting
In this paper we study a Markov decision process with a non-linear discount function. Our approach is in spirit of the von Neumann-Morgenstern concept and is based on the notion of expectation. First, we define a utility on the space of trajectories of the process in the finite and infinite time horizon and then take their expected values. It turns out that the associated optimization problem leads to a non-stationary dynamic programming and an infinite system of Bellman equations, which result in obtaining persistently optimal policies. Our theory is enriched by examples.
|Date of creation:||21 Jun 2011|
|Date of revision:|
|Contact details of provider:|| Postal: |
Web page: http://mpra.ub.uni-muenchen.de
More information through EDIRC
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Schäl, Manfred, 1975. "On dynamic programming: Compactness of the space of policies," Stochastic Processes and their Applications, Elsevier, vol. 3(4), pages 345-364, October.
- Kreps, David M & Porteus, Evan L, 1978.
"Temporal Resolution of Uncertainty and Dynamic Choice Theory,"
Econometric Society, vol. 46(1), pages 185-200, January.
- David M Kreps & Evan L Porteus, 1978. "Temporal Resolution of Uncertainty and Dynamic Choice Theory," Levine's Working Paper Archive 625018000000000009, David K. Levine.
- Lucas, Robert Jr. & Stokey, Nancy L., 1984.
"Optimal growth with many consumers,"
Journal of Economic Theory,
Elsevier, vol. 32(1), pages 139-171, February.
- Grandmont, Jean-Michel, 1993.
"Temporary general equilibrium theory,"
Handbook of Mathematical Economics,
in: K. J. Arrow & M.D. Intriligator (ed.), Handbook of Mathematical Economics, edition 4, volume 2, chapter 19, pages 879-922
- Tjalling C. Koopmans, 1959. "Stationary Ordinal Utility and Impatience," Cowles Foundation Discussion Papers 81, Cowles Foundation for Research in Economics, Yale University.
- Brock, William A. & Mirman, Leonard J., 1972. "Optimal economic growth and uncertainty: The discounted case," Journal of Economic Theory, Elsevier, vol. 4(3), pages 479-513, June.
- Boud, John III, 1990. "Recursive utility and the Ramsey problem," Journal of Economic Theory, Elsevier, vol. 50(2), pages 326-345, April.
When requesting a correction, please mention this item's handle: RePEc:pra:mprapa:31755. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Ekkehart Schlicht)
If references are entirely missing, you can add them using this form.