A Foundation for Markov Equilibria in Infinite Horizon Perfect Information Games
Abstract
We study perfect information games with an infinite horizon played by an arbitrary number of players. This class of games includes infinitely repeated perfect information games, repeated games with asynchronous moves, games with long and short run players, games with overlapping generations of players, and canonical non-cooperative models of bargaining. We consider two restrictions on equilibria. An equilibrium is purifiable if close by behavior is consistent with equilibrium when agents’ payoffs at each node are perturbed additively and independently. An equilibrium has bounded recall if there exists K such that at most one player’s strategy depends on what happened more than K periods earlier. We show that only Markov equilibria have bounded memory and are purifiable. Thus if a game has at most one long-run player, all purifiable equilibria are Markov.Download Info
If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.Bibliographic Info
Paper provided by Penn Institute for Economic Research, Department of Economics, University of Pennsylvania in its series PIER Working Paper Archive with number 09-029.Length: 29 pages
Date of creation: 05 Aug 2009
Date of revision:
Handle: RePEc:pen:papers:09-029
Contact details of provider:
Postal: 3718 Locust Walk, Philadelphia, PA 19104
Phone: 215-898-9992
Fax: 215-573-2378
Email:
Web page: http://economics.sas.upenn.edu/pier
More information through EDIRC
Related research
Keywords: Markov; bounded recall; purification;Other versions of this item:
- V. Bhaskar & George J. Mailathy & Stephen Morris, 2009. "A Foundation for Markov Equilibria in Infinite Horizon Perfect Information Games," Levine's Working Paper Archive 814577000000000178, David K. Levine.
- V. Bhaskar & George J. Mailath & Stephen Morris, 2012. "A Foundation for Markov Equilibria in Infinite Horizon Perfect Information Games," PIER Working Paper Archive 12-043, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
- C72 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Noncooperative Games
- C73 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Stochastic and Dynamic Games; Evolutionary Games
This paper has been announced in the following NEP Reports:
- NEP-ALL-2009-09-05 (All new papers)
- NEP-GTH-2009-09-05 (Game Theory)
- NEP-HPE-2009-09-05 (History & Philosophy of Economics)
- NEP-ORE-2009-09-05 (Operations Research)
References
References listed on IDEASPlease report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Bhaskar, V. & Vega-Redondo, Fernando, 2002. "Asynchronous Choice and Markov Equilibria," Journal of Economic Theory, Elsevier, vol. 103(2), pages 334-350, April.
- Ariel Rubinstein, 2010.
"Perfect Equilibrium in a Bargaining Model,"
Levine's Working Paper Archive
252, David K. Levine.
- Rubinstein, Ariel, 1982. "Perfect Equilibrium in a Bargaining Model," Econometrica, Econometric Society, vol. 50(1), pages 97-109, January.
- Ariel Rubinstein, 2010. "Perfect Equilibrium in a Bargaining Model," Levine's Working Paper Archive 661465000000000387, David K. Levine.
- Maskin, Eric & Tirole, Jean, 1987. "A theory of dynamic oligopoly, III : Cournot competition," European Economic Review, Elsevier, vol. 31(4), pages 947-968, June.
- George Mailath & Stephen Morris, .
""Repeated Games with Almost-Public Monitoring'',"
CARESS Working Papres
99-09, University of Pennsylvania Center for Analytic Research and Economics in the Social Sciences.
- Mailath, George J. & Morris, Stephen, 2002. "Repeated Games with Almost-Public Monitoring," Journal of Economic Theory, Elsevier, vol. 102(1), pages 189-228, January.
- George J. Mailath & Stephen Morris, 2000. "Repeated Games with Almost-Public Monitoring," Econometric Society World Congress 2000 Contributed Papers 0661, Econometric Society.
- George J. Mailath & Stephen Morris, 1999. "Repeated Games with Almost-Public Monitoring," CARESS Working Papres almost-pub, University of Pennsylvania Center for Analytic Research and Economics in the Social Sciences, revised 01 Sep 2000.
- George J Mailath & Stephen Morris, 2001. "Repeated Games with Almost-Public Monitoring," NajEcon Working Paper Reviews 625018000000000257, www.najecon.org.
- George Mailath & Stephen Morris, . "Repeated Games with Almost-Public Monitoring," Penn CARESS Working Papers 6bf0f633ff55148107994e092, Penn Economics Department.
- George J. Mailath & Stephen Morris, 1999. "Repeated Games with Almost-Public Monitoring," Cowles Foundation Discussion Papers 1236, Cowles Foundation for Research in Economics, Yale University.
- George J Mailath & Stephen Morris, 2001. "Repeated Games with Almost-Public Monitoring," Levine's Working Paper Archive 625018000000000257, David K. Levine.
- George J Mailath & Stephen Morris, 1999. "Repeated Games with Almost Public Monitoring," Levine's Working Paper Archive 2107, David K. Levine.
- Matsui Akihiko & Matsuyama Kiminori, 1995.
"An Approach to Equilibrium Selection,"
Journal of Economic Theory,
Elsevier, vol. 65(2), pages 415-434, April.
- Matsui, A. & Matsuyama, K., 1991. "An Approach to Equilibrium Selection," Working Papers e-91-14, Hoover Institution, Stanford University.
- Akihiko Matsui & Kiminori Matsuyama, 1991. "An Approach to Equilibrium Selection," Discussion Papers 1065, Northwestern University, Center for Mathematical Studies in Economics and Management Science.
- Akihiko Matsui & Kiminori Matsuyama, 1990. "An Approach to Equilibrium Selection," Discussion Papers 970, Northwestern University, Center for Mathematical Studies in Economics and Management Science.
- George J. Mailath & Wojciech Olszewski, 2008.
"Folk Theorems with Bounded Recall under (Almost) Perfect Monitoring,"
PIER Working Paper Archive
08-019, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
- Mailath, George J. & Olszewski, Wojciech, 2011. "Folk theorems with bounded recall under (almost) perfect monitoring," Games and Economic Behavior, Elsevier, vol. 71(1), pages 174-192, January.
- George Mailath & Wojciech Olszewski, 2008. "Folk theorems with Bounded Recall under(Almost) Perfect Monitoring," Discussion Papers 1462, Northwestern University, Center for Mathematical Studies in Economics and Management Science.
- D. Fudenberg & David K. Levine, 1989.
"Reputation and Equilibrium Selection in Games with a Patient Player,"
Levine's Working Paper Archive
508, David K. Levine.
- Fudenberg, Drew & Levine, David K, 1989. "Reputation and Equilibrium Selection in Games with a Patient Player," Econometrica, Econometric Society, vol. 57(4), pages 759-78, July.
- Drew Fudenberg & David Levine, 1987. "Reputation and Equilibrium Selection in Games With a Patient Player," Working papers 461, Massachusetts Institute of Technology (MIT), Department of Economics.
- Drew Fudenberg & David K. Levine, 1995. "Reputation and Equilibrium Selection in Games with a Patient Player," Levine's Working Paper Archive 103, David K. Levine.
- Bhaskar, V., 1994.
"Informational Constraints and the Overlapping Generations Model: Folk and Anti-Folk Theorems,"
Papers
9485, Tilburg - Center for Economic Research.
- Bhaskar, V, 1998. "Informational Constraints and the Overlapping Generations Model: Folk and Anti-Folk Theorems," Review of Economic Studies, Wiley Blackwell, vol. 65(1), pages 135-49, January.
- Bhaskar, V., 1994. "Informational Constraints and the Overlapping Generations Model : Folk and Anti-Folk Theorems," Discussion Paper 1994-85, Tilburg University, Center for Economic Research.
- Mailath,G.J. & Samuelson,L., 1998.
"Who wants a good reputation?,"
Working papers
19, Wisconsin Madison - Social Systems.
- Mailath, George J & Samuelson, Larry, 2001. "Who Wants a Good Reputation?," Review of Economic Studies, Wiley Blackwell, vol. 68(2), pages 415-41, April.
- George J. Mailath & Larry Samuelson, . "Who Wants a Good Reputation?," Penn CARESS Working Papers a3e3219aee004bd237f8112f9, Penn Economics Department.
- George J. Mailath & Larry Samuelson, . ""Who Wants a Good Reputation?''," CARESS Working Papres 98-12, University of Pennsylvania Center for Analytic Research and Economics in the Social Sciences.
- George J. Mailath & Larry Samuelson, 2000. "Who Wants a Good Reputation?," CARESS Working Papres sell-rep, University of Pennsylvania Center for Analytic Research and Economics in the Social Sciences.
- Abhinay Muthoo & Kenneth Shepsle, 2010. "Information, institutions and constitutional arrangements," Public Choice, Springer, vol. 144(1), pages 1-36, July.
- V. Bhaskar & George J. Mailath & Stephen Morris, 2008.
"Purification in the Infinitely-Repeated Prisoners' Dilemma,"
Review of Economic Dynamics,
Elsevier for the Society for Economic Dynamics, vol. 11(3), pages 515-528, July.
- V. Bhaskar & George J. Mailath & Stephen Morris, 2004. "Purification in the Infinitely Repeated Prisoners' Dilemma," Levine's Bibliography 122247000000000028, UCLA Department of Economics.
- V Bhaskar & George J. Mailath & Stephen Morris, 2006. "Purification in the Infinitely Repeated Prisoner's Dilemma," Levine's Bibliography 321307000000000170, UCLA Department of Economics.
- V. Bhaskar & George J. Mailath & Stephen Morris, 2004. "Purification in the Infinitely-Repeated Prisoners' Dilemma," Cowles Foundation Discussion Papers 1451, Cowles Foundation for Research in Economics, Yale University.
- V. Bhaskar & G. J. Mailath & S. Morris, 2004. "Purification in the Infinitely-Repeated Prisoners' Dilemma," Economics Discussion Papers 576, University of Essex, Department of Economics.
- V. Bhaskar & George J. Mailath & Stephen Morris, 2006. "Purification in the Infinitely-Repeated Prisoners' Dilemma," Cowles Foundation Discussion Papers 1571, Cowles Foundation for Research in Economics, Yale University.
- V. Bhaskar & George J. Mailath & Stephen Morris, 2004. "Purification in the Infinitely-Repeated Prisoners’ Dilemma," PIER Working Paper Archive 04-004, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
- V.V. Bhaskar, 2007. "Purification in the Infinitely-Repeated Prisoners' Dilemma," 2007 Meeting Papers 136, Society for Economic Dynamics.
- Roger Lagunoff & Akihiko Matsui, . ""An 'Anti-Folk Theorem' for a Class of Asynchronously Repeated Games''," CARESS Working Papres 95-15, University of Pennsylvania Center for Analytic Research and Economics in the Social Sciences.
- Mas-Colell, Andreu & Whinston, Michael D. & Green, Jerry R., 1995. "Microeconomic Theory," OUP Catalogue, Oxford University Press, number 9780195102680.
- Maskin, Eric & Tirole, Jean, 1988. "A Theory of Dynamic Oligopoly, II: Price Competition, Kinked Demand Curves, and Edgeworth Cycles," Econometrica, Econometric Society, vol. 56(3), pages 571-99, May.
- Mailath, George J. & Samuelson, Larry, 2006. "Repeated Games and Reputations: Long-Run Relationships," OUP Catalogue, Oxford University Press, number 9780195300796.
- Morris, Stephen & Ui, Takashi, 2004.
"Best response equivalence,"
Games and Economic Behavior,
Elsevier, vol. 49(2), pages 260-287, November.
- Morris, Stephen Morris & Takashi Ui, 2002. "Best Response Equivalence," Cowles Foundation Discussion Papers 1377, Cowles Foundation for Research in Economics, Yale University.
- Jeheil Phillippe, 1995. "Limited Horizon Forecast in Repeated Alternate Games," Journal of Economic Theory, Elsevier, vol. 67(2), pages 497-519, December.
- Livshits, Igor, 2002. "On non-existence of pure strategy Markov perfect equilibrium," Economics Letters, Elsevier, vol. 76(3), pages 393-396, August.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.Cited by:
- Hannu Salonen & Hannu Vartiainen, 2011. "On the Existence of Markov Perfect Equilibria in Perfect Information Games," Discussion Papers 68, Aboa Centre for Economics.
- P. Jean-Jacques Herings & Harold Houba, 2010.
"The Condorcet Paradox Revisited,"
Tinbergen Institute Discussion Papers
10-026/1, Tinbergen Institute.
- Herings P. Jean-Jacques & Houba Harold, 2010. "The Condercet Paradox Revisited," Research Memoranda 009, Maastricht : METEOR, Maastricht Research School of Economics of Technology and Organization.
- Marina Azzimonti, 2009.
"Barriers to investment in polarized societies,"
2009 Meeting Papers
1233, Society for Economic Dynamics.
- Marina Azzimonti, 2011. "Barriers to Investment in Polarized Societies," American Economic Review, American Economic Association, vol. 101(5), pages 2182-2204, August.
- marina, azzimonti, 2009. "Barriers to investment in polarized societies," MPRA Paper 25936, University Library of Munich, Germany.
Lists
This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.Statistics
Access and download statisticsCorrections
When requesting a correction, please mention this item's handle: RePEc:pen:papers:09-029For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Dolly Guarini).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.

