IDEAS home Printed from https://ideas.repec.org/
MyIDEAS: Log in (now much improved!) to save this paper

Elementary Results on Solutions to the Bellman Equation of Dynamic Programming: Existence, Uniqueness, and Convergence

Listed author(s):
  • Takashi Kamihigashi

    (Research Institute for Economics & Business Administration (RIEB), Kobe University, Japan)

We establish some elementary results on solutions to the Bellman equation without introducing any topological assumption. Under a small number of conditions, we show that the Bellman equation has a unique solution in a certain set, that this solution is the value function, and that the value function can be computed by value iteration with an appropriate initial condition. We also show that the value function can be computed by the same procedure under alternative conditions. We apply our results to two optimal growth models, one with a discontinuous production function, the other with "roughly increasing" returns.

To our knowledge, this item is not available for download. To find whether it is available, there are three options:
1. Check below under "Related research" whether another version of this item is available online.
2. Check on the provider's web page whether it is in fact available.
3. Perform a search for a similarly titled item that would be available.

Paper provided by Research Institute for Economics & Business Administration, Kobe University in its series Discussion Paper Series with number DP2012-31.

as
in new window

Length: 30 pages
Date of creation: Nov 2012
Handle: RePEc:kob:dpaper:dp2012-31
Contact details of provider: Postal:
2-1 Rokkodai, Nada, Kobe 657-8501 JAPAN

Phone: +81-(0)78 803 7036
Fax: +81-(0)78 803 7059
Web page: http://www.rieb.kobe-u.ac.jp/index-e.html

More information through EDIRC

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as
in new window


  1. Reis, Catarina, 2006. "Taxation without Commitment," MPRA Paper 2071, University Library of Munich, Germany.
  2. Alvarez, Fernando & Stokey, Nancy L., 1998. "Dynamic Programming with Homogeneous Functions," Journal of Economic Theory, Elsevier, vol. 82(1), pages 167-189, September.
  3. Kamihigashi, Takashi & Roy, Santanu, 2007. "A nonsmooth, nonconvex model of optimal growth," Journal of Economic Theory, Elsevier, vol. 132(1), pages 435-460, January.
  4. Juan Rincón-Zapatero & Carlos Rodríguez-Palmero, 2007. "Recursive utility with unbounded aggregators," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 33(2), pages 381-391, November.
  5. Le Van, Cuong & Morhaim, Lisa, 2002. "Optimal Growth Models with Bounded or Unbounded Returns: A Unifying Approach," Journal of Economic Theory, Elsevier, vol. 105(1), pages 158-187, July.
  6. repec:dau:papers:123456789/4077 is not listed on IDEAS
  7. Janusz Matkowski & Andrzej Nowak, 2011. "On discounted dynamic programming with unbounded returns," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 46(3), pages 455-474, April.
  8. Duran, Jorge, 1997. "On dynamic programming with unbounded returns," CEPREMAP Working Papers (Couverture Orange) 9710, CEPREMAP.
  9. Helios Herrera & César Martinelli, 2013. "Oligarchy, democracy, and state capacity," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 52(1), pages 165-186, January.
  10. Gaston Llanes & Stefano Trento, 2009. "Patent policy, patent pools, and the accumulation of claims in sequential innovation," Harvard Business School Working Papers 10-005, Harvard Business School.
  11. Muradian, Roldan, 2001. "Ecological thresholds: a survey," Ecological Economics, Elsevier, vol. 38(1), pages 7-24, July.
  12. Romer, Paul M, 1986. "Increasing Returns and Long-run Growth," Journal of Political Economy, University of Chicago Press, vol. 94(5), pages 1002-1037, October.
  13. Yann Algan & Edouard Challe & Xavier Ragot, 2008. "Incomplete Markets and the Output-inflation Tradeoff," Sciences Po publications 2006 - 45, Sciences Po.
  14. Francis Bloch & Nicolas Houy, 2012. "Optimal assignment of durable objects to successive agents," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 51(1), pages 13-33, September.
  15. Santanu Roy & Itzhak Zilcha, 2012. "Stochastic growth with short-run prediction of shocks," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 51(3), pages 539-580, November.
  16. Takashi Kamihigashi & Santanu Roy, 2006. "Dynamic optimization with a nonsmooth, nonconvex technology: the case of a linear objective function," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 29(2), pages 325-340, October.
  17. Mihaela Schaar & Jie Xu & William Zame, 2013. "Efficient online exchange via fiat money," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 54(2), pages 211-248, October.
  18. Larry Karp & Jiangfeng Zhang, 2012. "Taxes versus quantities for a stock pollutant with endogenous abatement costs and asymmetric information," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 49(2), pages 371-409, February.
  19. Prajit Dutta & Roy Radner, 2012. "Capital growth in a global warming model: will China and India sign a climate treaty?," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 49(2), pages 411-443, February.
  20. Dutta, Prajit K & Mitra, Tapan, 1989. "On Continuity of the Utility Function in Intertemporal Allocation Models: An Example," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 30(3), pages 527-536, August.
  21. Takashi Kamihigashi & John Stachurski, 2011. "Existence, Stability and Computation of Stationary Distributions: An Extension of the Hopenhayn-Prescott Theorem," Discussion Paper Series DP2011-32, Research Institute for Economics & Business Administration, Kobe University.
  22. V. Filipe Martins-da-Rocha & Yiannis Vailakis, 2010. "Existence and Uniqueness of a Fixed Point for Local Contractions," Econometrica, Econometric Society, vol. 78(3), pages 1127-1141, 05.
  23. Aditya Goenka & Lin Liu, 2012. "Infectious diseases and endogenous fluctuations," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 50(1), pages 125-149, May.
  24. Takashi Kamihigashi & Taiji Furusawa, 2010. "Global Dynamics in Repeated Games with Additively Separable Payoffs," Discussion Paper Series DP2010-04, Research Institute for Economics & Business Administration, Kobe University, revised Jun 2010.
  25. Michel, Philippe, 1990. "Some Clarifications on the Transversality Condition," Econometrica, Econometric Society, vol. 58(3), pages 705-723, May.
  26. Takashi Kamihigashi, 2007. "On the Principle of Optimality for Nonstationary Deterministic Dynamic Programming," Discussion Paper Series 200, Research Institute for Economics & Business Administration, Kobe University.
  27. Dutta, Prajit K. & Mitra, Tapan, 1989. "Maximum theorems for convex structures with an application to the theory of optimal intertemporal allocation," Journal of Mathematical Economics, Elsevier, vol. 18(1), pages 77-86, February.
  28. Takashi Kamihigashi, 2013. "An Order-Theoretic Approach to Dynamic Programming: An Exposition," Discussion Paper Series DP2013-29, Research Institute for Economics & Business Administration, Kobe University, revised Nov 2013.
  29. Juan Pablo RincÛn-Zapatero & Carlos RodrÌguez-Palmero, 2003. "Existence and Uniqueness of Solutions to the Bellman Equation in the Unbounded Case," Econometrica, Econometric Society, vol. 71(5), pages 1519-1555, 09.
  30. Costas Azariadis & Allan Drazen, 1990. "Threshold Externalities in Economic Development," The Quarterly Journal of Economics, Oxford University Press, vol. 105(2), pages 501-526.
  31. Amir, Rabah & Mirman, Leonard J & Perkins, William R, 1991. "One-Sector Nonclassical Optimal Growth: Optimality Conditions and Comparative Dynamics," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 32(3), pages 625-644, August.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:kob:dpaper:dp2012-31. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Office of Promoting Research Collaboration, Research Institute for Economics & Business Administration, Kobe University)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.