IDEAS home Printed from https://ideas.repec.org/a/eee/jetheo/v151y2014icp411-447.html
   My bibliography  Save this article

Stationary Markov perfect equilibria in risk sensitive stochastic overlapping generations models

Author

Listed:
  • Jaśkiewicz, Anna
  • Nowak, Andrzej S.

Abstract

In this paper, we study intergenerational stochastic games that can be viewed as a special class of overlapping generations models under uncertainty. Making use of the theorem of Dvoretzky, Wald and Wolfowitz [27] from the statistical decision theory, we obtain new results on stationary Markov perfect equilibria for the aforementioned games, with a general state space, satisfying rather mild continuity and compactness conditions. A novel feature of our approach is the fact that we consider risk averse generations in the sense that they aggregate partial utilities using an exponential function. As a byproduct, we also provide a new existence theorem for intergenerational stochastic game within the standard framework where the aggregator is linear. Our assumptions imposed on the transition probability and utility functions allow to embrace a pretty large class of intergenerational stochastic games analysed recently in macroeconomics. Finally, we formulate a set of assumptions under which the stochastic process induced by the stationary Markov perfect equilibrium possesses an invariant distribution.

Suggested Citation

  • Jaśkiewicz, Anna & Nowak, Andrzej S., 2014. "Stationary Markov perfect equilibria in risk sensitive stochastic overlapping generations models," Journal of Economic Theory, Elsevier, vol. 151(C), pages 411-447.
  • Handle: RePEc:eee:jetheo:v:151:y:2014:i:c:p:411-447
    DOI: 10.1016/j.jet.2014.01.005
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0022053114000180
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jet.2014.01.005?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Duffie, Darrell, et al, 1994. "Stationary Markov Equilibria," Econometrica, Econometric Society, vol. 62(4), pages 745-781, July.
    2. Balbus, Łukasz & Reffett, Kevin & Woźny, Łukasz, 2013. "A constructive geometrical approach to the uniqueness of Markov stationary equilibrium in stochastic games of intergenerational altruism," Journal of Economic Dynamics and Control, Elsevier, vol. 37(5), pages 1019-1039.
    3. John Duggan, 2012. "Noisy Stochastic Games," Econometrica, Econometric Society, vol. 80(5), pages 2017-2045, September.
    4. Balder, E. J., 1980. "An extension of the usual model in statistical decision theory with applications to stochastic optimization problems," Journal of Multivariate Analysis, Elsevier, vol. 10(3), pages 385-397, September.
    5. Mertens, J.-F. & Parthasarathy, T., 1987. "Equilibria for discounted stochastic games," LIDAM Discussion Papers CORE 1987050, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    6. Harris, Christopher & Laibson, David, 2001. "Dynamic Choices of Hyperbolic Consumers," Econometrica, Econometric Society, vol. 69(4), pages 935-957, July.
    7. Balbus, Łukasz & Reffett, Kevin & Woźny, Łukasz, 2012. "Stationary Markovian equilibrium in altruistic stochastic OLG models with limited commitment," Journal of Mathematical Economics, Elsevier, vol. 48(2), pages 115-132.
    8. Rolando Cavazos-Cadena & Emmanuel Fernández-Gaucherand, 1999. "Controlled Markov chains with risk-sensitive criteria: Average cost, optimality equations, and optimal solutions," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 49(2), pages 299-324, April.
    9. Per Krusell & Anthony A. Smith, Jr., 2003. "Consumption--Savings Decisions with Quasi--Geometric Discounting," Econometrica, Econometric Society, vol. 71(1), pages 365-375, January.
    10. Hori, Hajime, 1997. "Dynamic Allocation in an Altruistic Overlapping Generations Economy," Journal of Economic Theory, Elsevier, vol. 73(2), pages 292-315, April.
    11. Balder, E. J., 1985. "Elimination of randomization in statistical decision theory reconsidered," Journal of Multivariate Analysis, Elsevier, vol. 16(2), pages 260-264, April.
    12. E. S. Phelps & R. A. Pollak, 1968. "On Second-Best National Saving and Game-Equilibrium Growth," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 35(2), pages 185-199.
    13. Maskin, Eric & Tirole, Jean, 2001. "Markov Perfect Equilibrium: I. Observable Actions," Journal of Economic Theory, Elsevier, vol. 100(2), pages 191-219, October.
    14. TallariniJr., Thomas D., 2000. "Risk-sensitive real business cycles," Journal of Monetary Economics, Elsevier, vol. 45(3), pages 507-532, June.
    15. Amir, Rabah, 1996. "Strategic Intergenerational Bequests with Stochastic Convex Production," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 8(2), pages 367-376, August.
    16. Parthasarathy, T & Sinha, S, 1989. "Existence of Stationary Equilibrium Strategies in Non-zero Sum Discounted Stochastic Games with Uncountable State Space and State-Independent Transitions," International Journal of Game Theory, Springer;Game Theory Society, vol. 18(2), pages 189-194.
    17. José Luis Montiel Olea & Tomasz Strzalecki, 2014. "Axiomatization and Measurement of Quasi-Hyperbolic Discounting," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 129(3), pages 1449-1499.
    18. Drew Fudenberg & Jean Tirole, 1991. "Game Theory," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262061414, December.
    19. A. S. Nowak, 2010. "On a Noncooperative Stochastic Game Played by Internally Cooperating Generations," Journal of Optimization Theory and Applications, Springer, vol. 144(1), pages 88-106, January.
    20. Eilon Solan, 1998. "Discounted Stochastic Games," Mathematics of Operations Research, INFORMS, vol. 23(4), pages 1010-1021, November.
    21. Horst, Ulrich, 2005. "Stationary equilibria in discounted stochastic games with weakly interacting players," Games and Economic Behavior, Elsevier, vol. 51(1), pages 83-108, April.
    22. Karp, Larry, 2005. "Global warming and hyperbolic discounting," Journal of Public Economics, Elsevier, vol. 89(2-3), pages 261-282, February.
    23. John Geanakoplos, 2008. "Overlapping Generations Models of General Equilibrium," Cowles Foundation Discussion Papers 1663, Cowles Foundation for Research in Economics, Yale University.
    24. Curtat, Laurent O., 1996. "Markov Equilibria of Stochastic Games with Complementarities," Games and Economic Behavior, Elsevier, vol. 17(2), pages 177-199, December.
    25. Andrzej Nowak, 2006. "On perfect equilibria in stochastic models of growth with intergenerational altruism," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 28(1), pages 73-83, May.
    26. Peled, Dan, 1985. "Stochastic inflation and government provision of indexed bonds," Journal of Monetary Economics, Elsevier, vol. 15(3), pages 291-308, May.
    27. Caravani, Paolo & Papavassilopoulos, George, 1990. "A class of risk-sensitive noncooperative games," Journal of Economic Dynamics and Control, Elsevier, vol. 14(1), pages 117-149, February.
    28. , & ,, 2014. "Stochastic stability in monotone economies," Theoretical Economics, Econometric Society, vol. 9(2), May.
    29. Wolfgang Leininger, 1986. "The Existence of Perfect Equilibria in a Model of Growth with Altruism between Generations," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 53(3), pages 349-367.
    30. Ashok P. Maitra & William D. Sudderth, 2007. "Subgame-Perfect Equilibria for Stochastic Games," Mathematics of Operations Research, INFORMS, vol. 32(3), pages 711-722, August.
    31. John Geanakoplos, 2008. "Overlapping Generations Models of General Equilibrium," Levine's Working Paper Archive 122247000000002225, David K. Levine.
    32. Anderson, Evan W. & Hansen, Lars Peter & Sargent, Thomas J., 2012. "Small noise methods for risk-sensitive/robust economies," Journal of Economic Dynamics and Control, Elsevier, vol. 36(4), pages 468-500.
    33. Lars Ljungqvist & Thomas J. Sargent, 2004. "Recursive Macroeconomic Theory, 2nd Edition," MIT Press Books, The MIT Press, edition 2, volume 1, number 026212274x, December.
    34. Futia, Carl A, 1982. "Invariant Distributions and the Limiting Behavior of Markovian Economic Models," Econometrica, Econometric Society, vol. 50(2), pages 377-408, March.
    35. Amir, Rabah, 1996. "Continuous Stochastic Games of Capital Accumulation with Convex Transitions," Games and Economic Behavior, Elsevier, vol. 15(2), pages 111-131, August.
    36. Dutta, Prajit K & Sundaram, Rangarajan, 1992. "Markovian Equilibrium in a Class of Stochastic Games: Existence Theorems for Discounted and Undiscounted Models," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 2(2), pages 197-214, April.
    37. John Duggan, 2012. "Noisy Stochastic Games," RCER Working Papers 570, University of Rochester - Center for Economic Research (RCER).
    38. anonymous, 2007. "Bank asset growth robust, statistics show," Financial Update, Federal Reserve Bank of Atlanta, vol. 20(2).
    39. Lars Peter Hansen & Thomas J. Sargent, 2007. "Introduction to Robustness," Introductory Chapters, in: Robustness, Princeton University Press.
    40. Yehuda Levy, 2013. "Discounted Stochastic Games With No Stationary Nash Equilibrium: Two Examples," Econometrica, Econometric Society, vol. 81(5), pages 1973-2007, September.
    41. Alain Haurie, 2005. "A Multigenerational Game Model to Analyze Sustainable Development," Annals of Operations Research, Springer, vol. 137(1), pages 369-386, July.
    42. Monahan, George E. & Sobel, Matthew J., 1997. "Risk-Sensitive Dynamic Market Share Attraction Games," Games and Economic Behavior, Elsevier, vol. 20(2), pages 149-160, August.
    43. Ronald A. Howard & James E. Matheson, 1972. "Risk-Sensitive Markov Decision Processes," Management Science, INFORMS, vol. 18(7), pages 356-369, March.
    44. Andrzej Nowak, 2007. "On stochastic games in economics," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 66(3), pages 513-530, December.
    45. A. S. Nowak & T. E. S. Raghavan, 1992. "Existence of Stationary Correlated Equilibria with Symmetric Information for Discounted Stochastic Games," Mathematics of Operations Research, INFORMS, vol. 17(3), pages 519-526, August.
    46. Donald M. Topkis, 1978. "Minimizing a Submodular Function on a Lattice," Operations Research, INFORMS, vol. 26(2), pages 305-321, April.
    47. Andrzej Nowak, 2003. "On a new class of nonzero-sum discounted stochastic games having stationary Nash equilibrium points," International Journal of Game Theory, Springer;Game Theory Society, vol. 32(1), pages 121-132, December.
    48. Harris, Christopher & Reny, Philip & Robson, Arthur, 1995. "The Existence of Subgame-Perfect Equilibrium in Continuous Games with Almost Perfect Information: A Case for Public Randomization," Econometrica, Econometric Society, vol. 63(3), pages 507-544, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Elena Parilina & Stepan Akimochkin, 2021. "Cooperative Stochastic Games with Mean-Variance Preferences," Mathematics, MDPI, vol. 9(3), pages 1-15, January.
    2. Łukasz Balbus & Anna Jaśkiewicz & Andrzej S. Nowak, 2020. "Markov perfect equilibria in a dynamic decision model with quasi-hyperbolic discounting," Annals of Operations Research, Springer, vol. 287(2), pages 573-591, April.
    3. Elena M. Parilina & Alessandro Tampieri, 2018. "Stability and cooperative solution in stochastic games," Theory and Decision, Springer, vol. 84(4), pages 601-625, June.
    4. Anna Jaśkiewicz & Andrzej S. Nowak, 2021. "Markov decision processes with quasi-hyperbolic discounting," Finance and Stochastics, Springer, vol. 25(2), pages 189-229, April.
    5. Balbus, Łukasz & Jaśkiewicz, Anna & Nowak, Andrzej S., 2016. "Non-paternalistic intergenerational altruism revisited," Journal of Mathematical Economics, Elsevier, vol. 63(C), pages 27-33.
    6. Gustavo Portillo-Ramírez & Rolando Cavazos-Cadena & Hugo Cruz-Suárez, 2023. "Contractive approximations in average Markov decision chains driven by a risk-seeking controller," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 98(1), pages 75-91, August.
    7. Qingda Wei & Xian Chen, 2021. "Nonzero-sum Risk-Sensitive Average Stochastic Games: The Case of Unbounded Costs," Dynamic Games and Applications, Springer, vol. 11(4), pages 835-862, December.
    8. Łukasz Balbus & Anna Jaśkiewicz & Andrzej S. Nowak, 2015. "Existence of Stationary Markov Perfect Equilibria in Stochastic Altruistic Growth Economies," Journal of Optimization Theory and Applications, Springer, vol. 165(1), pages 295-315, April.
    9. Kutay Cingiz & János Flesch & P. Jean-Jacques Herings & Arkadi Predtetchinski, 2020. "Perfect information games where each player acts only once," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 69(4), pages 965-985, June.
    10. Barelli, Paulo & Duggan, John, 2015. "Extremal choice equilibrium with applications to large games, stochastic games, & endogenous institutions," Journal of Economic Theory, Elsevier, vol. 155(C), pages 95-130.
    11. Thomas J. Sargent & John Stachurski, 2024. "Dynamic Programming: Finite States," Papers 2401.10473, arXiv.org.
    12. Julio Saucedo-Zul & Rolando Cavazos-Cadena & Hugo Cruz-Suárez, 2020. "A Discounted Approach in Communicating Average Markov Decision Chains Under Risk-Aversion," Journal of Optimization Theory and Applications, Springer, vol. 187(2), pages 585-606, November.
    13. He, Wei & Sun, Yeneng, 2017. "Stationary Markov perfect equilibria in discounted stochastic games," Journal of Economic Theory, Elsevier, vol. 169(C), pages 35-61.
    14. Bäuerle, Nicole & Rieder, Ulrich, 2017. "Zero-sum risk-sensitive stochastic games," Stochastic Processes and their Applications, Elsevier, vol. 127(2), pages 622-642.
    15. Hubert Asienkiewicz & Łukasz Balbus, 2019. "Existence of Nash equilibria in stochastic games of resource extraction with risk-sensitive players," TOP: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 27(3), pages 502-518, October.
    16. Balbus, Łukasz & Jaśkiewicz, Anna & Nowak, Andrzej S., 2015. "Stochastic bequest games," Games and Economic Behavior, Elsevier, vol. 90(C), pages 247-256.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. He, Wei & Sun, Yeneng, 2017. "Stationary Markov perfect equilibria in discounted stochastic games," Journal of Economic Theory, Elsevier, vol. 169(C), pages 35-61.
    2. Anna Jaśkiewicz & Andrzej S. Nowak, 2016. "Stationary Almost Markov Perfect Equilibria in Discounted Stochastic Games," Mathematics of Operations Research, INFORMS, vol. 41(2), pages 430-441, May.
    3. A. S. Nowak, 2010. "On a Noncooperative Stochastic Game Played by Internally Cooperating Generations," Journal of Optimization Theory and Applications, Springer, vol. 144(1), pages 88-106, January.
    4. Łukasz Balbus & Kevin Reffett & Łukasz Woźny, 2013. "Markov Stationary Equilibria in Stochastic Supermodular Games with Imperfect Private and Public Information," Dynamic Games and Applications, Springer, vol. 3(2), pages 187-206, June.
    5. Page, Frank, 2016. "Stationary Markov equilibria for approximable discounted stochastic games," LSE Research Online Documents on Economics 67808, London School of Economics and Political Science, LSE Library.
    6. Balbus, Łukasz & Reffett, Kevin & Woźny, Łukasz, 2014. "A constructive study of Markov equilibria in stochastic games with strategic complementarities," Journal of Economic Theory, Elsevier, vol. 150(C), pages 815-840.
    7. Duggan, John & Kalandrakis, Tasos, 2012. "Dynamic legislative policy making," Journal of Economic Theory, Elsevier, vol. 147(5), pages 1653-1688.
    8. Balbus, Łukasz & Jaśkiewicz, Anna & Nowak, Andrzej S., 2015. "Stochastic bequest games," Games and Economic Behavior, Elsevier, vol. 90(C), pages 247-256.
    9. Balbus, Łukasz & Jaśkiewicz, Anna & Nowak, Andrzej S., 2016. "Non-paternalistic intergenerational altruism revisited," Journal of Mathematical Economics, Elsevier, vol. 63(C), pages 27-33.
    10. Balbus, Łukasz & Reffett, Kevin & Woźny, Łukasz, 2013. "A constructive geometrical approach to the uniqueness of Markov stationary equilibrium in stochastic games of intergenerational altruism," Journal of Economic Dynamics and Control, Elsevier, vol. 37(5), pages 1019-1039.
    11. Barelli, Paulo & Duggan, John, 2014. "A note on semi-Markov perfect equilibria in discounted stochastic games," Journal of Economic Theory, Elsevier, vol. 151(C), pages 596-604.
    12. John Duggan, 2012. "Noisy Stochastic Games," RCER Working Papers 570, University of Rochester - Center for Economic Research (RCER).
    13. Wozny Lukasz & Growiec Jakub, 2012. "Intergenerational Interactions in Human Capital Accumulation," The B.E. Journal of Theoretical Economics, De Gruyter, vol. 12(1), pages 1-47, June.
    14. Escobar, Juan F., 2013. "Equilibrium analysis of dynamic models of imperfect competition," International Journal of Industrial Organization, Elsevier, vol. 31(1), pages 92-101.
    15. Łukasz Balbus & Anna Jaśkiewicz & Andrzej S. Nowak, 2015. "Existence of Stationary Markov Perfect Equilibria in Stochastic Altruistic Growth Economies," Journal of Optimization Theory and Applications, Springer, vol. 165(1), pages 295-315, April.
    16. John Duggan, 2011. "Noisy Stochastic Games," RCER Working Papers 562, University of Rochester - Center for Economic Research (RCER).
    17. Łukasz Balbus & Kevin Reffett & Łukasz Woźny, 2015. "Time consistent Markov policies in dynamic economies with quasi-hyperbolic consumers," International Journal of Game Theory, Springer;Game Theory Society, vol. 44(1), pages 83-112, February.
    18. Anna Jaśkiewicz & Andrzej S. Nowak, 2021. "Markov decision processes with quasi-hyperbolic discounting," Finance and Stochastics, Springer, vol. 25(2), pages 189-229, April.
    19. Wei He, 2022. "Discontinuous stochastic games," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 73(4), pages 827-858, June.
    20. Balbus, Łukasz & Reffett, Kevin & Woźny, Łukasz, 2018. "On uniqueness of time-consistent Markov policies for quasi-hyperbolic consumers under uncertainty," Journal of Economic Theory, Elsevier, vol. 176(C), pages 293-310.

    More about this item

    Keywords

    Overlapping generations model; Intergenerational stochastic game; Risk sensitive optimisation; Stationary Markov perfect equilibrium;
    All these keywords.

    JEL classification:

    • C62 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Existence and Stability Conditions of Equilibrium
    • C73 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Stochastic and Dynamic Games; Evolutionary Games
    • D91 - Microeconomics - - Micro-Based Behavioral Economics - - - Role and Effects of Psychological, Emotional, Social, and Cognitive Factors on Decision Making
    • O40 - Economic Development, Innovation, Technological Change, and Growth - - Economic Growth and Aggregate Productivity - - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jetheo:v:151:y:2014:i:c:p:411-447. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/622869 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.