IDEAS home Printed from https://ideas.repec.org/p/roc/rocher/570.html
   My bibliography  Save this paper

Noisy Stochastic Games

Author

Listed:
  • John Duggan

    () (W. Allen Wallis Institute of Political Economy, 107 Harkness Hall, University of Rochester, Rochester, NY 14627-0158)

Abstract

This paper establishes existence of a stationary Markov perfect equilibrium in general stochastic games with noise—a component of the state that is nonatomically distributed and not directly affected by the previous period’s state and actions. Noise may be simply a payoff-irrelevant public randomization device, delivering known results on existence of correlated equilibrium as a special case. More generally, noise can take the form of shocks that enter into players’ stage payoffs and the transition probability on states. The existence result is applied to a model of industry dynamics and to a model of dynamic electoral competition.

Suggested Citation

  • John Duggan, 2012. "Noisy Stochastic Games," RCER Working Papers 570, University of Rochester - Center for Economic Research (RCER).
  • Handle: RePEc:roc:rocher:570
    as

    Download full text from publisher

    File URL: http://rcer.econ.rochester.edu/RCERPAPERS/rcer_570.pdf
    File Function: full text
    Download Restriction: None

    References listed on IDEAS

    as
    1. Doraszelski, Ulrich & Escobar, Juan, 2010. "A theory of regular Markov perfect equilibria in dynamic stochastic games: genericity, stability, and purification," Theoretical Economics, Econometric Society, vol. 5(3), September.
    2. Bergin, James & Bernhardt, Dan, 1992. "Anonymous sequential games with aggregate uncertainty," Journal of Mathematical Economics, Elsevier, vol. 21(6), pages 543-562.
    3. James Bergin & Dan Bernhardt, 2008. "Industry dynamics with stochastic demand," RAND Journal of Economics, RAND Corporation, vol. 39(1), pages 41-68.
    4. Herings, P. Jean-Jacques & Peeters, Ronald J. A. P., 2004. "Stationary equilibria in stochastic games: structure, selection, and computation," Journal of Economic Theory, Elsevier, vol. 118(1), pages 32-60, September.
    5. repec:spr:compst:v:66:y:2007:i:3:p:513-530 is not listed on IDEAS
    6. Horst, Ulrich, 2005. "Stationary equilibria in discounted stochastic games with weakly interacting players," Games and Economic Behavior, Elsevier, vol. 51(1), pages 83-108, April.
    7. Alesina, Alberto, 1987. "Macroeconomic Policy in a Two-party System as a Repeated Game," Scholarly Articles 4552531, Harvard University Department of Economics.
    8. Andrzej Nowak, 2007. "On stochastic games in economics," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 66(3), pages 513-530, December.
    9. A. S. Nowak & T. E. S. Raghavan, 1992. "Existence of Stationary Correlated Equilibria with Symmetric Information for Discounted Stochastic Games," Mathematics of Operations Research, INFORMS, vol. 17(3), pages 519-526, August.
    10. Andrzej Nowak, 2003. "On a new class of nonzero-sum discounted stochastic games having stationary Nash equilibrium points," International Journal of Game Theory, Springer;Game Theory Society, vol. 32(1), pages 121-132, December.
    11. Harris, Christopher & Reny, Philip & Robson, Arthur, 1995. "The Existence of Subgame-Perfect Equilibrium in Continuous Games with Almost Perfect Information: A Case for Public Randomization," Econometrica, Econometric Society, vol. 63(3), pages 507-544, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. He, Wei & Sun, Yeneng, 2013. "Stationary Markov Perfect Equilibria in Discounted Stochastic Games," MPRA Paper 51274, University Library of Munich, Germany.
    2. Balbus, Łukasz & Reffett, Kevin & Woźny, Łukasz, 2014. "A constructive study of Markov equilibria in stochastic games with strategic complementarities," Journal of Economic Theory, Elsevier, vol. 150(C), pages 815-840.
    3. repec:spr:joecth:v:66:y:2018:i:2:d:10.1007_s00199-017-1067-7 is not listed on IDEAS
    4. Łukasz Balbus & Kevin Reffett & Łukasz Woźny, 2013. "Markov Stationary Equilibria in Stochastic Supermodular Games with Imperfect Private and Public Information," Dynamic Games and Applications, Springer, vol. 3(2), pages 187-206, June.
    5. Duggan, John, 2017. "Existence of stationary bargaining equilibria," Games and Economic Behavior, Elsevier, vol. 102(C), pages 111-126.
    6. Barelli, Paulo & Duggan, John, 2015. "Extremal choice equilibrium with applications to large games, stochastic games, & endogenous institutions," Journal of Economic Theory, Elsevier, vol. 155(C), pages 95-130.
    7. repec:eee:jetheo:v:169:y:2017:i:c:p:35-61 is not listed on IDEAS
    8. Łukasz Balbus & Łukasz Woźny, 2016. "A Strategic Dynamic Programming Method for Studying Short-Memory Equilibria of Stochastic Games with Uncountable Number of States," Dynamic Games and Applications, Springer, vol. 6(2), pages 187-208, June.
    9. Anna Jaśkiewicz & Andrzej S. Nowak, 2016. "Stationary Almost Markov Perfect Equilibria in Discounted Stochastic Games," Mathematics of Operations Research, INFORMS, vol. 41(2), pages 430-441, May.
    10. Jean Guillaume Forand & John Duggan, 2013. "Markovian Elections," Working Papers 1305, University of Waterloo, Department of Economics, revised Oct 2013.
    11. César Martinelli & John Duggan, 2014. "The Political Economy of Dynamic Elections: A Survey and Some New Results," Working Papers 1403, Centro de Investigacion Economica, ITAM.
    12. Wei He & Yeneng Sun, 2013. "Stationary Markov Perfect Equilibria in Discounted Stochastic Games," Papers 1311.1562, arXiv.org, revised Jan 2017.
    13. Hannu Vartiainen, 2015. "Dynamic stable set as a tournament solution," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 45(2), pages 309-327, September.
    14. Jaśkiewicz, Anna & Nowak, Andrzej S., 2014. "Stationary Markov perfect equilibria in risk sensitive stochastic overlapping generations models," Journal of Economic Theory, Elsevier, vol. 151(C), pages 411-447.
    15. Barelli, Paulo & Duggan, John, 2015. "Purification of Bayes Nash equilibrium with correlated types and interdependent payoffs," Games and Economic Behavior, Elsevier, vol. 94(C), pages 1-14.
    16. Otero, Karina V., 2016. "Nonparametric identification of dynamic multinomial choice games: unknown payoffs and shocks without interchangeability," MPRA Paper 86784, University Library of Munich, Germany.
    17. Barelli, Paulo & Duggan, John, 2014. "A note on semi-Markov perfect equilibria in discounted stochastic games," Journal of Economic Theory, Elsevier, vol. 151(C), pages 596-604.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:roc:rocher:570. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Richard DiSalvo). General contact details of provider: .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.