IDEAS home Printed from https://ideas.repec.org/p/sgh/kaewps/2016020.html
   My bibliography  Save this paper

On uniqueness of time-consistent Markov policies for quasi-hyperbolic consumers under uncertainty

Author

Listed:
  • Lukasz Balbus
  • Kevin Reffett
  • Lukasz Wozny

Abstract

We give a set of sufficient conditions for uniqueness of a time-consistent Markov stationary consumption policy for a quasi-hyperbolic household under uncertainty. To the best of our knowledge, this uniqueness result is the first presented in the literature for general settings, i.e. under standard assumptions on preferences, as well as some new condition on a transition probability. This paper advocates a ''generalized Bellman equation'' method to overcome some predicaments of the known methods and also extends our recent existence result. Our method also works for returns unbounded from above. We provide few natural followers of optimal policy uniqueness: convergent and accurate computational algorithm, monotone comparative statics results and generalized Euler equation.

Suggested Citation

  • Lukasz Balbus & Kevin Reffett & Lukasz Wozny, 2016. "On uniqueness of time-consistent Markov policies for quasi-hyperbolic consumers under uncertainty," KAE Working Papers 2016-020, Warsaw School of Economics, Collegium of Economic Analysis.
  • Handle: RePEc:sgh:kaewps:2016020
    as

    Download full text from publisher

    File URL: http://kolegia.sgh.waw.pl/pl/KAE/Documents/WorkingPapersKAE/WPKAE_2016_020.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Per Krusell & Anthony A. Smith, Jr., 2003. "Consumption--Savings Decisions with Quasi--Geometric Discounting," Econometrica, Econometric Society, vol. 71(1), pages 365-375, January.
    2. Krusell, Per & Kuruscu, Burhanettin & Smith, Anthony Jr., 2002. "Equilibrium Welfare and Government Policy with Quasi-geometric Discounting," Journal of Economic Theory, Elsevier, vol. 105(1), pages 42-72, July.
    3. Chatterjee, Satyajit & Eyigungor, Burcu, 2016. "Continuous Markov equilibria with quasi-geometric discounting," Journal of Economic Theory, Elsevier, vol. 163(C), pages 467-494.
    4. Wolfgang Leininger, 1986. "The Existence of Perfect Equilibria in a Model of Growth with Altruism between Generations," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 53(3), pages 349-367.
    5. Drugeon, Jean-Pierre & Wigniolle, Bertrand, 2016. "On time-consistent policy rules for heterogeneous discounting programs," Journal of Mathematical Economics, Elsevier, vol. 63(C), pages 174-187.
    6. Gong, Liutang & Smith, William & Zou, Heng-fu, 2007. "Consumption and Risk with hyperbolic discounting," Economics Letters, Elsevier, vol. 96(2), pages 153-160, August.
    7. Bezalel Peleg & Menahem E. Yaari, 1973. "On the Existence of a Consistent Course of Action when Tastes are Changing," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 40(3), pages 391-401.
    8. Maliar, Lilia & Maliar, Serguei, 2006. "Indeterminacy in a log-linearized neoclassical growth model with quasi-geometric discounting," Economic Modelling, Elsevier, vol. 23(3), pages 492-505, May.
    9. B. Douglas Bernheim & Debraj Ray & Şevin Yeltekin, 2015. "Poverty and Self‐Control," Econometrica, Econometric Society, vol. 83(5), pages 1877-1911, September.
    10. Harris, Christopher & Laibson, David, 2001. "Dynamic Choices of Hyperbolic Consumers," Econometrica, Econometric Society, vol. 69(4), pages 935-957, July.
    11. Sylvain Chassang, 2010. "Fear of Miscoordination and the Robustness of Cooperation in Dynamic Global Games With Exit," Econometrica, Econometric Society, vol. 78(3), pages 973-1006, May.
    12. Steven M. Goldman, 1980. "Consistent Plans," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 47(3), pages 533-537.
    13. Balbus, Łukasz & Reffett, Kevin & Woźny, Łukasz, 2014. "A constructive study of Markov equilibria in stochastic games with strategic complementarities," Journal of Economic Theory, Elsevier, vol. 150(C), pages 815-840.
    14. Sorger, Gerhard, 2004. "Consistent planning under quasi-geometric discounting," Journal of Economic Theory, Elsevier, vol. 118(1), pages 118-129, September.
    15. Janusz Matkowski & Andrzej Nowak, 2011. "On discounted dynamic programming with unbounded returns," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 46(3), pages 455-474, April.
    16. E. S. Phelps & R. A. Pollak, 1968. "On Second-Best National Saving and Game-Equilibrium Growth," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 35(2), pages 185-199.
    17. Łukasz Balbus & Kevin Reffett & Łukasz Woźny, 2015. "Time consistent Markov policies in dynamic economies with quasi-hyperbolic consumers," International Journal of Game Theory, Springer;Game Theory Society, vol. 44(1), pages 83-112, February.
    18. Caplin, Andrew & Leahy, John, 2006. "The recursive approach to time inconsistency," Journal of Economic Theory, Elsevier, vol. 131(1), pages 134-156, November.
    19. Amir, Rabah, 1996. "Strategic Intergenerational Bequests with Stochastic Convex Production," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 8(2), pages 367-376, August.
    20. Maskin, Eric & Tirole, Jean, 2001. "Markov Perfect Equilibrium: I. Observable Actions," Journal of Economic Theory, Elsevier, vol. 100(2), pages 191-219, October.
    21. Kocherlakota, Narayana R., 1996. "Reconsideration-Proofness: A Refinement for Infinite Horizon Time Inconsistency," Games and Economic Behavior, Elsevier, vol. 15(1), pages 33-54, July.
    22. B. Douglas Bernheim & Debraj Ray, 1986. "On the Existence of Markov-Consistent Plans under Production Uncertainty," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 53(5), pages 877-882.
    23. Matthew O. Jackson & Leeat Yariv, 2015. "Collective Dynamic Choice: The Necessity of Time Inconsistency," American Economic Journal: Microeconomics, American Economic Association, vol. 7(4), pages 150-178, November.
    24. Matthew O. Jackson & Leeat Yariv, 2014. "Present Bias and Collective Dynamic Choice in the Lab," American Economic Review, American Economic Association, vol. 104(12), pages 4184-4204, December.
    25. Kydland, Finn E. & Prescott, Edward C., 1980. "Dynamic optimal taxation, rational expectations and optimal control," Journal of Economic Dynamics and Control, Elsevier, vol. 2(1), pages 79-91, May.
    26. Juan Pablo RincÛn-Zapatero & Carlos RodrÌguez-Palmero, 2003. "Existence and Uniqueness of Solutions to the Bellman Equation in the Unbounded Case," Econometrica, Econometric Society, vol. 71(5), pages 1519-1555, September.
    27. Peter C. B. Phillips, 2012. "Folklore Theorems, Implicit Maps, and Indirect Inference," Econometrica, Econometric Society, vol. 80(1), pages 425-454, January.
    28. Lilia Maliar & Serguei Maliar, 2016. "Ruling Out Multiplicity of Smooth Equilibria in Dynamic Games: A Hyperbolic Discounting Example," Dynamic Games and Applications, Springer, vol. 6(2), pages 243-261, June.
    29. Donald M. Topkis, 1978. "Minimizing a Submodular Function on a Lattice," Operations Research, INFORMS, vol. 26(2), pages 305-321, April.
    30. Amir, Rabah, 1997. "A new look at optimal growth under uncertainty," Journal of Economic Dynamics and Control, Elsevier, vol. 22(1), pages 67-86, November.
    31. Andrzej Nowak, 2006. "On perfect equilibria in stochastic models of growth with intergenerational altruism," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 28(1), pages 73-83, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Balbus, Łukasz & Reffett, Kevin & Woźny, Łukasz, 2022. "Time-consistent equilibria in dynamic models with recursive payoffs and behavioral discounting," Journal of Economic Theory, Elsevier, vol. 204(C).
    2. Maria Arvaniti & Chandra K. Krishnamurthy & Anne-Sophie Crépin, 2019. "Time-consistent resource management with regime shifts," CER-ETH Economics working paper series 19/329, CER-ETH - Center of Economic Research (CER-ETH) at ETH Zurich.
    3. Jean-Pierre Drugeon & Bertrand Wigniolle, 2021. "On Markovian collective choice with heterogeneous quasi-hyperbolic discounting," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 72(4), pages 1257-1296, November.
    4. Lilia Maliar & Serguei Maliar, 2016. "Ruling Out Multiplicity of Smooth Equilibria in Dynamic Games: A Hyperbolic Discounting Example," Dynamic Games and Applications, Springer, vol. 6(2), pages 243-261, June.
    5. Anna Jaśkiewicz & Andrzej S. Nowak, 2021. "Markov decision processes with quasi-hyperbolic discounting," Finance and Stochastics, Springer, vol. 25(2), pages 189-229, April.
    6. Juan Pablo Rinc'on-Zapatero, 2019. "Existence and Uniqueness of Solutions to the Stochastic Bellman Equation with Unbounded Shock," Papers 1907.07343, arXiv.org.
    7. Thomas J. Sargent & John Stachurski, 2024. "Dynamic Programming: Finite States," Papers 2401.10473, arXiv.org.
    8. Arvaniti, Maria & Krishnamurthy, Chandra Kiran B. & Crépin, Anne-Sophie, 2023. "Time-consistent renewable resource management with present bias and regime shifts," Journal of Economic Behavior & Organization, Elsevier, vol. 207(C), pages 479-495.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Łukasz Balbus & Kevin Reffett & Łukasz Woźny, 2015. "Time consistent Markov policies in dynamic economies with quasi-hyperbolic consumers," International Journal of Game Theory, Springer;Game Theory Society, vol. 44(1), pages 83-112, February.
    2. Lilia Maliar & Serguei Maliar, 2016. "Ruling Out Multiplicity of Smooth Equilibria in Dynamic Games: A Hyperbolic Discounting Example," Dynamic Games and Applications, Springer, vol. 6(2), pages 243-261, June.
    3. Balbus, Łukasz & Reffett, Kevin & Woźny, Łukasz, 2022. "Time-consistent equilibria in dynamic models with recursive payoffs and behavioral discounting," Journal of Economic Theory, Elsevier, vol. 204(C).
    4. Maria Arvaniti & Chandra K. Krishnamurthy & Anne-Sophie Crépin, 2019. "Time-consistent resource management with regime shifts," CER-ETH Economics working paper series 19/329, CER-ETH - Center of Economic Research (CER-ETH) at ETH Zurich.
    5. Balbus, Łukasz & Jaśkiewicz, Anna & Nowak, Andrzej S., 2016. "Non-paternalistic intergenerational altruism revisited," Journal of Mathematical Economics, Elsevier, vol. 63(C), pages 27-33.
    6. Jaśkiewicz, Anna & Nowak, Andrzej S., 2014. "Stationary Markov perfect equilibria in risk sensitive stochastic overlapping generations models," Journal of Economic Theory, Elsevier, vol. 151(C), pages 411-447.
    7. Balbus, Łukasz & Reffett, Kevin & Woźny, Łukasz, 2012. "Stationary Markovian equilibrium in altruistic stochastic OLG models with limited commitment," Journal of Mathematical Economics, Elsevier, vol. 48(2), pages 115-132.
    8. Arvaniti, Maria & Krishnamurthy, Chandra Kiran B. & Crépin, Anne-Sophie, 2023. "Time-consistent renewable resource management with present bias and regime shifts," Journal of Economic Behavior & Organization, Elsevier, vol. 207(C), pages 479-495.
    9. Doruk Cetemen & Felix Zhiyu Feng & Can Urgun, 2019. "Contracting with Non-Exponential Discounting: Moral Hazard and Dynamic Inconsistency," Working Papers 2019-17, Princeton University. Economics Department..
    10. Anna Jaśkiewicz & Andrzej S. Nowak, 2021. "Markov decision processes with quasi-hyperbolic discounting," Finance and Stochastics, Springer, vol. 25(2), pages 189-229, April.
    11. Łukasz Balbus & Anna Jaśkiewicz & Andrzej S. Nowak, 2015. "Existence of Stationary Markov Perfect Equilibria in Stochastic Altruistic Growth Economies," Journal of Optimization Theory and Applications, Springer, vol. 165(1), pages 295-315, April.
    12. Chatterjee, Satyajit & Eyigungor, Burcu, 2016. "Continuous Markov equilibria with quasi-geometric discounting," Journal of Economic Theory, Elsevier, vol. 163(C), pages 467-494.
    13. Wozny Lukasz & Growiec Jakub, 2012. "Intergenerational Interactions in Human Capital Accumulation," The B.E. Journal of Theoretical Economics, De Gruyter, vol. 12(1), pages 1-47, June.
    14. Kirill Borissov & Mikhail Pakhnin & Ronald Wendner, 2020. "Naive Agents with Quasi-hyperbolic Discounting and Perfect Foresight," EUSP Department of Economics Working Paper Series 2020/03, European University at St. Petersburg, Department of Economics.
    15. Balbus, Łukasz & Jaśkiewicz, Anna & Nowak, Andrzej S., 2015. "Stochastic bequest games," Games and Economic Behavior, Elsevier, vol. 90(C), pages 247-256.
    16. Balbus, Łukasz & Reffett, Kevin & Woźny, Łukasz, 2013. "A constructive geometrical approach to the uniqueness of Markov stationary equilibrium in stochastic games of intergenerational altruism," Journal of Economic Dynamics and Control, Elsevier, vol. 37(5), pages 1019-1039.
    17. Jean-Pierre Drugeon & Bertrand Wigniolle, 2021. "On Markovian collective choice with heterogeneous quasi-hyperbolic discounting," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 72(4), pages 1257-1296, November.
    18. Chade, Hector & Prokopovych, Pavlo & Smith, Lones, 2008. "Repeated games with present-biased preferences," Journal of Economic Theory, Elsevier, vol. 139(1), pages 157-175, March.
    19. Tyson, Christopher J., 2008. "Management of a capital stock by Strotz's naive planner," Journal of Economic Dynamics and Control, Elsevier, vol. 32(7), pages 2214-2239, July.
    20. Nicolas Vieille & Jörgen Weibull, 2009. "Multiple solutions under quasi-exponential discounting," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 39(3), pages 513-526, June.

    More about this item

    Keywords

    Time consistency; Markov equilibria; Uniqueness; Stochastic games; Generalized Bellman equation;
    All these keywords.

    JEL classification:

    • C62 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Existence and Stability Conditions of Equilibrium
    • C73 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Stochastic and Dynamic Games; Evolutionary Games
    • D91 - Microeconomics - - Micro-Based Behavioral Economics - - - Role and Effects of Psychological, Emotional, Social, and Cognitive Factors on Decision Making

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sgh:kaewps:2016020. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Dariusz Nojszewski (email available below). General contact details of provider: https://edirc.repec.org/data/kawawpl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.