IDEAS home Printed from https://ideas.repec.org/
MyIDEAS: Login to save this paper or follow this series

Elementary Results on Solutions to the Bellman Equation of Dynamic Programming: Existence, Uniqueness, and Convergence

  • Takashi Kamihigashi

    (Research Institute for Economics & Business Administration (RIEB), Kobe University, Japan)

We establish some elementary results on solutions to the Bellman equation without introducing any topological assumption. Under a small number of conditions, we show that the Bellman equation has a unique solution in a certain set, that this solution is the value function, and that the value function can be computed by value iteration with an appropriate initial condition. We also show that the value function can be computed by the same procedure under alternative conditions. We apply our results to two optimal growth models, one with a discontinuous production function, the other with "roughly increasing" returns.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://www.rieb.kobe-u.ac.jp/academic/ra/dp/English/DP2012-31.pdf
Our checks indicate that this address may not be valid because: 404 Not Found. If this is indeed the case, please notify (Office of Promoting Research Collaboration, Research Institute for Economics & Business Administration, Kobe University)


File Function: First version, 2012
Download Restriction: no

Paper provided by Research Institute for Economics & Business Administration, Kobe University in its series Discussion Paper Series with number DP2012-31.

as
in new window

Length: 30 pages
Date of creation: Nov 2012
Date of revision:
Handle: RePEc:kob:dpaper:dp2012-31
Contact details of provider: Postal: 2-1 Rokkodai, Nada, Kobe 657-8501 JAPAN
Phone: +81-(0)78 803 7036
Fax: +81-(0)78 803 7059
Web page: http://www.rieb.kobe-u.ac.jp/index-e.html

More information through EDIRC

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as in new window
  1. Le Van, Cuong & Morhaim, Lisa, 2002. "Optimal Growth Models with Bounded or Unbounded Returns: A Unifying Approach," Journal of Economic Theory, Elsevier, vol. 105(1), pages 158-187, July.
  2. Santanu Roy & Itzhak Zilcha, 2012. "Stochastic growth with short-run prediction of shocks," Economic Theory, Springer, vol. 51(3), pages 539-580, November.
  3. Yann Algan & Edouard Challe & Xavier Ragot, 2008. "Incomplete Markets and the Output-inflation Tradeoff," Sciences Po publications 2006 - 45, Sciences Po.
  4. Francis Bloch & Nicolas Houy, 2009. "Optimal Assignment of Durable Objects to Successive Agents," Working Papers hal-00435385, HAL.
  5. Alvarez, Fernando & Stokey, Nancy L., 1998. "Dynamic Programming with Homogeneous Functions," Journal of Economic Theory, Elsevier, vol. 82(1), pages 167-189, September.
  6. Jie Xu & Mihaela van der Schaar & William Zame, 2013. "Efficient Online Exchange via Fiat Money," EIEF Working Papers Series 1315, Einaudi Institute for Economics and Finance (EIEF), revised May 2013.
  7. Vailakis, Yiannis & Martins-da-Rocha, Victor Filipe, 2008. "Existence and Uniqueness of a Fixed-Point for Local Contractions," Economics Working Papers (Ensaios Economicos da EPGE) 677, FGV/EPGE Escola Brasileira de Economia e Finanças, Getulio Vargas Foundation (Brazil).
  8. Takashi Kamihigashi & Santanu Roy, 2004. "Dynamic Optimization with a Nonsmooth, Nonconvex Technology: The Case of a Linear Objective Function," Discussion Paper Series 161, Research Institute for Economics & Business Administration, Kobe University.
  9. Takashi Kamihigashi & John Stachurski, 2011. "Existence, Stability and Computation of Stationary Distributions: An Extension of the Hopenhayn-Prescott Theorem," Discussion Paper Series DP2011-32, Research Institute for Economics & Business Administration, Kobe University.
  10. Takashi Kamihigashi, 2013. "An Order-Theoretic Approach to Dynamic Programming: An Exposition," Discussion Paper Series DP2013-29, Research Institute for Economics & Business Administration, Kobe University, revised Nov 2013.
  11. Takashi Kamihigashi & Santanu Roy, 2005. "A nonsmooth, nonconvex model of optimal growth," Discussion Paper Series 173, Research Institute for Economics & Business Administration, Kobe University.
  12. Paul M Romer, 1999. "Increasing Returns and Long-Run Growth," Levine's Working Paper Archive 2232, David K. Levine.
  13. Juan Rincón-Zapatero & Carlos Rodríguez-Palmero, 2007. "Recursive utility with unbounded aggregators," Economic Theory, Springer, vol. 33(2), pages 381-391, November.
  14. Gastón Llanes & Stefano Trento, 2012. "Patent policy, patent pools, and the accumulation of claims in sequential innovation," Economic Theory, Springer, vol. 50(3), pages 703-725, August.
  15. Janusz Matkowski & Andrzej Nowak, 2011. "On discounted dynamic programming with unbounded returns," Economic Theory, Springer, vol. 46(3), pages 455-474, April.
  16. Juan Pablo RincÛn-Zapatero & Carlos RodrÌguez-Palmero, 2003. "Existence and Uniqueness of Solutions to the Bellman Equation in the Unbounded Case," Econometrica, Econometric Society, vol. 71(5), pages 1519-1555, 09.
  17. Michel, Philippe, 1990. "Some Clarifications on the Transversality Condition," Econometrica, Econometric Society, vol. 58(3), pages 705-23, May.
  18. Takashi Kamihigashi & Taiji Furusawa, 2010. "Global Dynamics in Repeated Games with Additively Separable Payoffs," Discussion Paper Series DP2010-04, Research Institute for Economics & Business Administration, Kobe University, revised Jun 2010.
  19. Dutta, Prajit K. & Mitra, Tapan, 1989. "Maximum theorems for convex structures with an application to the theory of optimal intertemporal allocation," Journal of Mathematical Economics, Elsevier, vol. 18(1), pages 77-86, February.
  20. Azariadis, Costas & Drazen, Allan, 1990. "Threshold Externalities in Economic Development," The Quarterly Journal of Economics, MIT Press, vol. 105(2), pages 501-26, May.
  21. Dutta, Prajit K & Mitra, Tapan, 1989. "On Continuity of the Utility Function in Intertemporal Allocation Models: An Example," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 30(3), pages 527-36, August.
  22. Duran, Jorge, 1997. "On dynamic programming with unbounded returns," CEPREMAP Working Papers (Couverture Orange) 9710, CEPREMAP.
  23. Muradian, Roldan, 2001. "Ecological thresholds: a survey," Ecological Economics, Elsevier, vol. 38(1), pages 7-24, July.
  24. Catarina Reis, 2013. "Taxation without commitment," Economic Theory, Springer, vol. 52(2), pages 565-588, March.
  25. Karp, Larry & Zhang, Jiangfeng, 2008. "Taxes Versus Quantities for a Stock Pollutant with Endogenous Abatement Costs and Asymmetric Information," Department of Agricultural & Resource Economics, UC Berkeley, Working Paper Series qt84q0s8tb, Department of Agricultural & Resource Economics, UC Berkeley.
  26. Cesar Martinelli & Helios Herrera, 2011. "Oligarchy, Democracy and State Capacity," 2011 Meeting Papers 97, Society for Economic Dynamics.
  27. Yann Algan & Edouard Challe & Xavier Ragot, 2008. "Incomplete markets and the output-inflation tradeoff," PSE Working Papers halshs-00589134, HAL.
  28. Aditya Goenka & Lin Liu, 2012. "Infectious diseases and endogenous fluctuations," Economic Theory, Springer, vol. 50(1), pages 125-149, May.
  29. Takashi Kamihigashi, 2008. "On the principle of optimality for nonstationary deterministic dynamic programming," International Journal of Economic Theory, The International Society for Economic Theory, vol. 4(4), pages 519-525.
  30. Prajit Dutta & Roy Radner, 2012. "Capital growth in a global warming model: will China and India sign a climate treaty?," Economic Theory, Springer, vol. 49(2), pages 411-443, February.
  31. Amir, Rabah & Mirman, Leonard J & Perkins, William R, 1991. "One-Sector Nonclassical Optimal Growth: Optimality Conditions and Comparative Dynamics," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 32(3), pages 625-44, August.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:kob:dpaper:dp2012-31. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Office of Promoting Research Collaboration, Research Institute for Economics & Business Administration, Kobe University)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.