Persistently optimal policies in stochastic dynamic programming with generalized discounting
In this paper we study a Markov decision process with a non-linear discount function. Our approach is in spirit of the von Neumann-Morgenstern concept and is based on the notion of expectation. First, we define a utility on the space of trajectories of the process in the finite and infinite time horizon and then take their expected values. It turns out that the associated optimization problem leads to a non-stationary dynamic programming and an infinite system of Bellman equations, which result in obtaining persistently optimal policies. Our theory is enriched by examples.
|Date of creation:||21 Jun 2011|
|Date of revision:|
|Contact details of provider:|| Postal: Ludwigstraße 33, D-80539 Munich, Germany|
Web page: https://mpra.ub.uni-muenchen.de
More information through EDIRC
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- David M Kreps & Evan L Porteus, 1978.
"Temporal Resolution of Uncertainty and Dynamic Choice Theory,"
Levine's Working Paper Archive
625018000000000009, David K. Levine.
- Kreps, David M & Porteus, Evan L, 1978. "Temporal Resolution of Uncertainty and Dynamic Choice Theory," Econometrica, Econometric Society, vol. 46(1), pages 185-200, January.
- Brock, William A. & Mirman, Leonard J., 1972. "Optimal economic growth and uncertainty: The discounted case," Journal of Economic Theory, Elsevier, vol. 4(3), pages 479-513, June.
- Robert E. Lucas Jr. & Nancy L. Stokey, 1982.
"Optimal Growth with Many Consumers,"
518, Northwestern University, Center for Mathematical Studies in Economics and Management Science.
- Grandmont, Jean-Michel, 1993.
"Temporary general equilibrium theory,"
Handbook of Mathematical Economics,
in: K. J. Arrow & M.D. Intriligator (ed.), Handbook of Mathematical Economics, edition 4, volume 2, chapter 19, pages 879-922
- Tjalling C. Koopmans, 1959. "Stationary Ordinal Utility and Impatience," Cowles Foundation Discussion Papers 81, Cowles Foundation for Research in Economics, Yale University.
- Boud, John III, 1990. "Recursive utility and the Ramsey problem," Journal of Economic Theory, Elsevier, vol. 50(2), pages 326-345, April.
- Schäl, Manfred, 1975. "On dynamic programming: Compactness of the space of policies," Stochastic Processes and their Applications, Elsevier, vol. 3(4), pages 345-364, October.
When requesting a correction, please mention this item's handle: RePEc:pra:mprapa:31755. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Joachim Winter)
If references are entirely missing, you can add them using this form.