IDEAS home Printed from https://ideas.repec.org/p/cte/werepe/35342.html
   My bibliography  Save this paper

Existence and uniqueness of solutions to the Bellman equation in stochastic dynamic programming

Author

Listed:
  • Rincón-Zapatero, Juan Pablo

Abstract

In this paper we develop a general framework to analyze stochastic dynamic optimization problems in discrete time. We obtain new results of the existence and uniqueness of solutions to the Bellman equation through a general xed point theorem that generalizes known results for Banach contractions and local contractions. We study an endogenous growth model as well as the Lucas asset pricing model in an exchange economy, signicantly expanding their range of applicability.

Suggested Citation

  • Rincón-Zapatero, Juan Pablo, 2022. "Existence and uniqueness of solutions to the Bellman equation in stochastic dynamic programming," UC3M Working papers. Economics 35342, Universidad Carlos III de Madrid. Departamento de Economía.
    • Handle: RePEc:cte:werepe:35342
    as

    Download full text from publisher

    File URL: https://e-archivo.uc3m.es/bitstream/handle/10016/35342/we2207.pdf?sequence=1
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Donaldson, John B. & Mehra, Rajnish, 1983. "Stochastic growth with correlated production shocks," Journal of Economic Theory, Elsevier, vol. 29(2), pages 282-312, April.
    2. Mukul Majumdar & Tapan Mitra & Yaw Nyarko, 1989. "Dynamic Optimization Under Uncertainty: Non-convex Feasible Set," Palgrave Macmillan Books, in: George R. Feiwel (ed.), Joan Robinson and Modern Economic Theory, chapter 19, pages 545-590, Palgrave Macmillan.
    3. Le Van, Cuong & Vailakis, Yiannis, 2005. "Recursive utility and optimal growth with bounded or unbounded returns," Journal of Economic Theory, Elsevier, vol. 123(2), pages 187-209, August.
    4. Hopenhayn, Hugo A & Prescott, Edward C, 1992. "Stochastic Monotonicity and Stationary Distributions for Dynamic Economies," Econometrica, Econometric Society, vol. 60(6), pages 1387-1406, November.
    5. Mirman, Leonard J. & Zilcha, Itzhak, 1975. "On optimal growth under uncertainty," Journal of Economic Theory, Elsevier, vol. 11(3), pages 329-339, December.
    6. Stachurski, John, 2002. "Stochastic Optimal Growth with Unbounded Shock," Journal of Economic Theory, Elsevier, vol. 106(1), pages 40-65, September.
    7. Le Van, Cuong & Morhaim, Lisa, 2002. "Optimal Growth Models with Bounded or Unbounded Returns: A Unifying Approach," Journal of Economic Theory, Elsevier, vol. 105(1), pages 158-187, July.
    8. Lucas, Robert E, Jr, 1978. "Asset Prices in an Exchange Economy," Econometrica, Econometric Society, vol. 46(6), pages 1429-1445, November.
    9. Alvarez, Fernando & Stokey, Nancy L., 1998. "Dynamic Programming with Homogeneous Functions," Journal of Economic Theory, Elsevier, vol. 82(1), pages 167-189, September.
    10. Larry E. Jones & Rodolfo E. Manuelli & Henry E. Siu & Ennio Stacchetti, 2005. "Fluctuations in Convex Models of Endogenous Growth I: Growth Effects," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 8(4), pages 780-804, October.
    11. Lars J. Olson & Santanu Roy, 2006. "Theory of Stochastic Optimal Economic Growth," Springer Books, in: Rose-Anne Dana & Cuong Le Van & Tapan Mitra & Kazuo Nishimura (ed.), Handbook on Optimal Growth 1, chapter 11, pages 297-335, Springer.
    12. Boud, John III, 1990. "Recursive utility and the Ramsey problem," Journal of Economic Theory, Elsevier, vol. 50(2), pages 326-345, April.
    13. Larry E. Jones & Rodolfo E. Manuelli & Henry E. Siu, 2005. "Fluctuations in Convex Models of Endogenous Growth II: Business Cycle Properties," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 8(4), pages 805-828, October.
    14. Kamihigashi, Takashi, 2007. "Stochastic optimal growth with bounded or unbounded utility and with bounded or unbounded shocks," Journal of Mathematical Economics, Elsevier, vol. 43(3-4), pages 477-500, April.
    15. Binder, Michael & Pesaran, M Hashem, 1999. "Stochastic Growth Models and Their Econometric Implications," Journal of Economic Growth, Springer, vol. 4(2), pages 139-183, June.
    16. Danthine, Jean-Pierre & Donaldson, John B, 1981. "Stochastic Properties of Fast vs. Slow Growing Economies," Econometrica, Econometric Society, vol. 49(4), pages 1007-1033, June.
    17. V. Filipe Martins-da-Rocha & Yiannis Vailakis, 2010. "Existence and Uniqueness of a Fixed Point for Local Contractions," Econometrica, Econometric Society, vol. 78(3), pages 1127-1141, May.
    18. William A. Brock & Leonard J. Mirman, 2001. "Optimal Economic Growth And Uncertainty: The Discounted Case," Chapters, in: W. D. Dechert (ed.), Growth Theory, Nonlinear Dynamics and Economic Modelling, chapter 1, pages 3-37, Edward Elgar Publishing.
    19. Janusz Matkowski & Andrzej Nowak, 2011. "On discounted dynamic programming with unbounded returns," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 46(3), pages 455-474, April.
    20. Onésimo Hernández-Lerma & Jean B. Lasserre, 2000. "Fatou's Lemma and Lebesgue's convergence theorem for measures," International Journal of Stochastic Analysis, Hindawi, vol. 13, pages 1-10, January.
    21. Kaushik Mitra, 1998. "On capital accumulation paths in a neoclassical stochastic growth model," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 11(2), pages 457-464.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Juan Pablo Rinc'on-Zapatero, 2019. "Existence and Uniqueness of Solutions to the Stochastic Bellman Equation with Unbounded Shock," Papers 1907.07343, arXiv.org.
    2. John Stachurski, 2009. "Economic Dynamics: Theory and Computation," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262012774, December.
    3. Lars J. Olson & Santanu Roy, 2006. "Theory of Stochastic Optimal Economic Growth," Springer Books, in: Rose-Anne Dana & Cuong Le Van & Tapan Mitra & Kazuo Nishimura (ed.), Handbook on Optimal Growth 1, chapter 11, pages 297-335, Springer.
    4. Bäuerle, Nicole & Jaśkiewicz, Anna, 2018. "Stochastic optimal growth model with risk sensitive preferences," Journal of Economic Theory, Elsevier, vol. 173(C), pages 181-200.
    5. Nicole Bauerle & Anna Ja'skiewicz, 2015. "Stochastic Optimal Growth Model with Risk Sensitive Preferences," Papers 1509.05638, arXiv.org.
    6. Tapan Mitra & Santanu Roy, 2022. "Propensity to consume and the optimality of Ramsey–Euler policies," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 73(1), pages 55-89, February.
    7. Philippe Bich & Jean-Pierre Drugeon & Lisa Morhaim, 2015. "On Aggregators and Dynamic Programming," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-01169552, HAL.
    8. Kazuo Nishimura & John Stachurski, 2012. "Stability of Stochastic Optimal Growth Models: A New Approach," Springer Books, in: John Stachurski & Alain Venditti & Makoto Yano (ed.), Nonlinear Dynamics in Equilibrium Models, edition 127, chapter 0, pages 289-307, Springer.
    9. Philippe Bich & Jean-Pierre Drugeon & Lisa Morhaim, 2018. "On temporal aggregators and dynamic programming," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 66(3), pages 787-817, October.
    10. Cai, Yiyong & Kamihigashi, Takashi & Stachurski, John, 2014. "Stochastic optimal growth with risky labor supply," Journal of Mathematical Economics, Elsevier, vol. 50(C), pages 167-176.
    11. Philippe Bich & Jean-Pierre Drugeon & Lisa Morhaim, 2015. "On Aggregators and Dynamic Programming," Post-Print halshs-01169552, HAL.
    12. Philippe Bich & Jean-Pierre Drugeon & Lisa Morhaim, 2018. "On Temporal Aggregators and Dynamic Programming," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-01437496, HAL.
    13. Manjira Datta & Leonard Mirman & Kevin Reffett, "undated". "Nonclassical Brock-Mirman Economies," Working Papers 2179544, Department of Economics, W. P. Carey School of Business, Arizona State University.
    14. Takashi Kamihigashi & John Stachurski, 2011. "Stability of Stationary Distributions in Monotone Economies," ANU Working Papers in Economics and Econometrics 2011-561, Australian National University, College of Business and Economics, School of Economics.
    15. Thomas J. Sargent & John Stachurski, 2024. "Dynamic Programming: Finite States," Papers 2401.10473, arXiv.org.
    16. Philippe Bich & Jean-Pierre Drugeon & Lisa Morhaim, 2015. "On Aggregators and Dynamic Programming," Documents de travail du Centre d'Economie de la Sorbonne 15053, Université Panthéon-Sorbonne (Paris 1), Centre d'Economie de la Sorbonne.
    17. Kazuo Nishimura & Ryszard Rudnicki & John Stachurski, 2004. "Stochastic Growth With Nonconvexities:The Optimal Case," Department of Economics - Working Papers Series 897, The University of Melbourne.
    18. Takashi Kamihigashi & John Stachurski, 2011. "Existence, Stability and Computation of Stationary Distributions: An Extension of the Hopenhayn-Prescott Theorem," Discussion Paper Series DP2011-32, Research Institute for Economics & Business Administration, Kobe University.
    19. Zhang, Yuzhe, 2007. "Stochastic optimal growth with a non-compact state space," Journal of Mathematical Economics, Elsevier, vol. 43(2), pages 115-129, February.
    20. Tapan Mitra & Santanu Roy, 2023. "Stochastic growth, conservation of capital and convergence to a positive steady state," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 76(1), pages 311-351, July.

    More about this item

    Keywords

    Stochastic Dynamic Programming;

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cte:werepe:35342. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Ana Poveda (email available below). General contact details of provider: http://www.eco.uc3m.es/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.