IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1812.05748.html
   My bibliography  Save this paper

Dynamic Programming with Recursive Preferences: Optimality and Applications

Author

Listed:
  • Guanlong Ren
  • John Stachurski

Abstract

This paper provides new conditions for dynamic optimality in discrete time and uses them to establish fundamental dynamic programming results for several commonly used recursive preference specifications. These include Epstein-Zin preferences, risk-sensitive preferences, narrow framing models and recursive preferences with sensitivity to ambiguity. The results obtained for these applications include (i) existence of optimal policies, (ii) uniqueness of solutions to the Bellman equation, (iii) a complete characterization of optimal policies via Bellman's principle of optimality, and (iv) a globally convergent method of computation via value function iteration.

Suggested Citation

  • Guanlong Ren & John Stachurski, 2018. "Dynamic Programming with Recursive Preferences: Optimality and Applications," Papers 1812.05748, arXiv.org, revised Jun 2020.
    • Handle: RePEc:arx:papers:1812.05748
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/1812.05748
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Morand, Olivier F. & Reffett, Kevin L., 2003. "Existence and uniqueness of equilibrium in nonoptimal unbounded infinite horizon economies," Journal of Monetary Economics, Elsevier, vol. 50(6), pages 1351-1373, September.
    2. John Stachurski, 2009. "Economic Dynamics: Theory and Computation," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262012774, December.
    3. Piero Gottardi & Atsushi Kajii & Tomoyuki Nakajima, 2015. "Optimal Taxation and Debt with Uninsurable Risks to Human Capital Accumulation," American Economic Review, American Economic Association, vol. 105(11), pages 3443-3470, November.
    4. Datta, Manjira & Mirman, Leonard J. & Reffett, Kevin L., 2002. "Existence and Uniqueness of Equilibrium in Distorted Dynamic Economies with Capital and Labor," Journal of Economic Theory, Elsevier, vol. 103(2), pages 377-410, April.
    5. Le Van, Cuong & Vailakis, Yiannis, 2005. "Recursive utility and optimal growth with bounded or unbounded returns," Journal of Economic Theory, Elsevier, vol. 123(2), pages 187-209, August.
    6. Cuong Le Van & Lisa Morhaim & Yiannis Vailakis, 2008. "Monotone concave operators: An application to the existence and uniqueness of solutions to the Bellman equation," Discussion Papers 0803, University of Exeter, Department of Economics.
    7. Frank Schorfheide & Dongho Song & Amir Yaron, 2018. "Identifying Long‐Run Risks: A Bayesian Mixed‐Frequency Approach," Econometrica, Econometric Society, vol. 86(2), pages 617-654, March.
    8. Susanto Basu & Brent Bundick, 2017. "Uncertainty Shocks in a Model of Effective Demand," Econometrica, Econometric Society, vol. 85, pages 937-958, May.
    9. David K. Backus & Bryan R. Routledge & Stanley E. Zin, 2005. "Exotic Preferences for Macroeconomists," NBER Chapters, in: NBER Macroeconomics Annual 2004, Volume 19, pages 319-414, National Bureau of Economic Research, Inc.
    10. Klibanoff, Peter & Marinacci, Massimo & Mukerji, Sujoy, 2009. "Recursive smooth ambiguity preferences," Journal of Economic Theory, Elsevier, vol. 144(3), pages 930-976, May.
    11. Larry G. Epstein & Stanley E. Zin, 2013. "Substitution, risk aversion and the temporal behavior of consumption and asset returns: A theoretical framework," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 12, pages 207-239, World Scientific Publishing Co. Pte. Ltd..
    12. Nengjiu Ju & Jianjun Miao, 2012. "Ambiguity, Learning, and Asset Returns," Econometrica, Econometric Society, vol. 80(2), pages 559-591, March.
    13. , & ,, 2011. "Intertemporal substitution and recursive smooth ambiguity preferences," Theoretical Economics, Econometric Society, vol. 6(3), September.
    14. Farhi, Emmanuel & Werning, Iván, 2008. "Optimal savings distortions with recursive preferences," Journal of Monetary Economics, Elsevier, vol. 55(1), pages 21-42, January.
    15. Ravi Bansal & Amir Yaron, 2004. "Risks for the Long Run: A Potential Resolution of Asset Pricing Puzzles," Journal of Finance, American Finance Association, vol. 59(4), pages 1481-1509, August.
    16. Ozaki, Hiroyuki & Streufert, Peter A., 1996. "Dynamic programming for non-additive stochastic objectives," Journal of Mathematical Economics, Elsevier, vol. 25(4), pages 391-442.
    17. Anastasios G Karantounias, 2018. "Optimal Fiscal Policy with Recursive Preferences," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 85(4), pages 2283-2317.
    18. Boud, John III, 1990. "Recursive utility and the Ramsey problem," Journal of Economic Theory, Elsevier, vol. 50(2), pages 326-345, April.
    19. Marinacci, Massimo & Montrucchio, Luigi, 2010. "Unique solutions for stochastic recursive utilities," Journal of Economic Theory, Elsevier, vol. 145(5), pages 1776-1804, September.
    20. Lucas, Robert Jr. & Stokey, Nancy L., 1984. "Optimal growth with many consumers," Journal of Economic Theory, Elsevier, vol. 32(1), pages 139-171, February.
    21. Greg Kaplan & Giovanni L. Violante, 2014. "A Model of the Consumption Response to Fiscal Stimulus Payments," Econometrica, Econometric Society, vol. 82(4), pages 1199-1239, July.
    22. Hall, Robert E, 1988. "Intertemporal Substitution in Consumption," Journal of Political Economy, University of Chicago Press, vol. 96(2), pages 339-357, April.
    23. V. Filipe Martins-da-Rocha & Yiannis Vailakis, 2010. "Existence and Uniqueness of a Fixed Point for Local Contractions," Econometrica, Econometric Society, vol. 78(3), pages 1127-1141, May.
    24. Philippe Bich & Jean-Pierre Drugeon & Lisa Morhaim, 2018. "On temporal aggregators and dynamic programming," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 66(3), pages 787-817, October.
    25. Bloise, Gaetano & Vailakis, Yiannis, 2018. "Convex dynamic programming with (bounded) recursive utility," Journal of Economic Theory, Elsevier, vol. 173(C), pages 118-141.
    26. Lars Peter Hansen & Jose A. Scheinkman, 2012. "Recursive utility in a Markov environment with stochastic growth," Working Papers 1380, Princeton University, Department of Economics, Econometric Research Program..
    27. Philippe Bich & Jean-Pierre Drugeon & Lisa Morhaim, 2018. "On Temporal Aggregators and Dynamic Programming," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-01437496, HAL.
    28. Kreps, David M & Porteus, Evan L, 1978. "Temporal Resolution of Uncertainty and Dynamic Choice Theory," Econometrica, Econometric Society, vol. 46(1), pages 185-200, January.
    29. Charalambos D. Aliprantis & Kim C. Border, 2006. "Infinite Dimensional Analysis," Springer Books, Springer, edition 0, number 978-3-540-29587-7, December.
    30. Cuong Le Van & Lisa Morhaim & Yiannis Vailakis, 2008. "Monotone Concave Operators: An application to the existence and uniqueness of solutions to the Bellman equation," Working Papers hal-00294828, HAL.
    31. Mikhail Golosov & David Evans & anmol bhandari, 2017. "Risk and Monetary Policy in a New Keynesian Model," 2017 Meeting Papers 1359, Society for Economic Dynamics.
    32. Cuong Le Van & Yiannis Vailakis, 2005. "Recursive utility and optimal growth with bounded or unbounded returns," Post-Print halshs-00101201, HAL.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jaroslav Borovička & John Stachurski, 2020. "Necessary and Sufficient Conditions for Existence and Uniqueness of Recursive Utilities," Journal of Finance, American Finance Association, vol. 75(3), pages 1457-1493, June.
    2. Bloise, Gaetano & Vailakis, Yiannis, 2018. "Convex dynamic programming with (bounded) recursive utility," Journal of Economic Theory, Elsevier, vol. 173(C), pages 118-141.
    3. Thomas J. Sargent & John Stachurski, 2024. "Dynamic Programming: Finite States," Papers 2401.10473, arXiv.org.
    4. Christensen, Timothy M., 2022. "Existence and uniqueness of recursive utilities without boundedness," Journal of Economic Theory, Elsevier, vol. 200(C).
    5. Łukasz Balbus, 2020. "On recursive utilities with non-affine aggregator and conditional certainty equivalent," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 70(2), pages 551-577, September.
    6. Robert Becker & Juan Pablo Rincon-Zapatero, 2018. "Recursive Utility and Thompson Aggregators, II: Uniqueness of the Recursive Utility Representation," CAEPR Working Papers 2018-008, Center for Applied Economics and Policy Research, Department of Economics, Indiana University Bloomington.
    7. Jing Guo & Xue Dong He, 2021. "Recursive Utility with Investment Gains and Losses: Existence, Uniqueness, and Convergence," Papers 2107.05163, arXiv.org.
    8. Backus, David & Ferriere, Axelle & Zin, Stanley, 2015. "Risk and ambiguity in models of business cycles," Journal of Monetary Economics, Elsevier, vol. 69(C), pages 42-63.
    9. Becker, Robert A. & Rincón-Zapatero, Juan Pablo, 2021. "Thompson aggregators, Scott continuous Koopmans operators, and Least Fixed Point theory," Mathematical Social Sciences, Elsevier, vol. 112(C), pages 84-97.
    10. Balbus, Łukasz & Reffett, Kevin & Woźny, Łukasz, 2022. "Time-consistent equilibria in dynamic models with recursive payoffs and behavioral discounting," Journal of Economic Theory, Elsevier, vol. 204(C).
    11. Timothy M. Christensen, 2020. "Existence and uniqueness of recursive utilities without boundedness," Papers 2008.00963, arXiv.org, revised Aug 2021.
    12. Robert A. Becker & Juan Pablo Rincón-Zapatero, 2017. "Arbitration and Renegotiation in Trade Agreements," CAEPR Working Papers 2017-007, Center for Applied Economics and Policy Research, Department of Economics, Indiana University Bloomington.
    13. Nengjiu Ju & Jianjun Miao, 2012. "Ambiguity, Learning, and Asset Returns," Econometrica, Econometric Society, vol. 80(2), pages 559-591, March.
    14. Robert Becker & Juan Pablo Rincon-Zapatero, 2018. "Recursive Utility and Thompson Aggregators, I: Constructive Existence Theory for the Koopmans Equation," CAEPR Working Papers 2018-006, Center for Applied Economics and Policy Research, Department of Economics, Indiana University Bloomington.
    15. Marinacci, Massimo & Montrucchio, Luigi, 2010. "Unique solutions for stochastic recursive utilities," Journal of Economic Theory, Elsevier, vol. 145(5), pages 1776-1804, September.
    16. A. Ronald Gallant & Mohammad Jahan-Parvar & Hening Liu, 2015. "Measuring Ambiguity Aversion," Finance and Economics Discussion Series 2015-105, Board of Governors of the Federal Reserve System (U.S.).
    17. Gaetano Bloise & Cuong Le Van & Yiannis Vailakis, 2024. "Do not Blame Bellman: It Is Koopmans' Fault," Econometrica, Econometric Society, vol. 92(1), pages 111-140, January.
    18. Hui Chen & Nengjiu Ju & Jianjun Miao, 2014. "Dynamic Asset Allocation with Ambiguous Return Predictability," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 17(4), pages 799-823, October.
    19. Anna Jaśkiewicz & Janusz Matkowski & Andrzej Nowak, 2014. "On variable discounting in dynamic programming: applications to resource extraction and other economic models," Annals of Operations Research, Springer, vol. 220(1), pages 263-278, September.
    20. Julian Thimme & Clemens Völkert, 2015. "High order smooth ambiguity preferences and asset prices," Review of Financial Economics, John Wiley & Sons, vol. 27(1), pages 1-15, November.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1812.05748. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.