This file is part of IDEAS, which uses RePEc data


[ Papers | Articles | Software | Books | Chapters | Authors | Institutions | JEL Classification | NEP reports | Search | New papers by email | Author registration | Rankings | Volunteers | FAQ | Blog | Help! ]

Stochastic Game Theory: Adjustment to Equilibrium Under Noisy Directional Learning

Author info | Abstract | Publisher info | Download info | Related research | Statistics
Author Info
Simon P. Anderson ()
Jacob K. Goeree ()
Charles A. Holt ()

Additional information is available for the following registered author(s):

Abstract

This paper presents a dynamic model in which agents adjust their decisions in the direction of higher payoffs, subject to random error. This process produces a probability distribution of players' decisions whose evolution over time is determined by the Fokker-Planck equation. The dynamic process is stable for all potential games, a class of payoff structures that includes several widely studied games. In equilibrium, the distributions that determine expected payoffs correspond to the distributions that arise from the logit function applied to those expected payoffs. This "logit equilibrium" forms a stochastic generalization of the Nash equilibrium and provides a possible explanation of anomalous laboratory data.

Download Info
To download:

If you experience problems downloading a file, check if you have the proper application to view it first. Information about this may be contained in the File-Format links below. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://www.virginia.edu/economics/RePEc/vir/virpap/papers/virpap327.pdf
File Format: application/pdf
File Function:
Download Restriction: no

Publisher Info
Paper provided by University of Virginia, Department of Economics in its series Virginia Economics Online Papers with number 327.

Download reference. The following formats are available: HTML (with abstract), plain text (with abstract), BibTeX, RIS (EndNote, RefMan, ProCite), ReDIF
Length: 30 pages
Date of creation: Jul 1999
Date of revision:
Handle: RePEc:vir:virpap:327

Contact details of provider:
Web page: http://www.virginia.edu/economics/home.html

For technical questions regarding this item, or to correct its listing, contact: (Debby Stanford).

Related research
Keywords: bounded rationality; noisy directional learning; Fokker- Planck equation; potential games; logit equilibrium; stochastic potential.;

Other versions of this item:

Find related papers by JEL classification:
C62 - Mathematical and Quantitative Methods - - Mathematical Methods and Programming - - - Existence and Stability Conditions of Equilibrium
C73 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Stochastic and Dynamic Games; Evolutionary Games

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

  1. Slade, Margaret E, 1994. "What Does an Oligopoly Maximize?," Journal of Industrial Economics, Blackwell Publishing, vol. 42(1), pages 45-61, March. [Downloadable!] (restricted)
    Other versions:
  2. Binmore, Ken & Samuelson, Larry, 1997. "Muddling Through: Noisy Equilibrium Selection," Journal of Economic Theory, Elsevier, vol. 74(2), pages 235-265, June. [Downloadable!] (restricted)
  3. Rosenthal, Robert W, 1989. "A Bounded-Rationality Approach to the Study of Noncooperative Games," International Journal of Game Theory, Springer, vol. 18(3), pages 273-91.
  4. Smith, Vernon L & Walker, James M, 1993. "Monetary Rewards and Decision Cost in Experimental Economics," Economic Inquiry, Oxford University Press, vol. 31(2), pages 245-61, April.
  5. Anderson, Simon P. & Goeree, Jacob K. & Holt, Charles A., 1998. "A theoretical analysis of altruism and decision error in public goods games," Journal of Public Economics, Elsevier, vol. 70(2), pages 297-323, November. [Downloadable!] (restricted)
  6. Binmore, Ken & Samuelson, Larry, 1999. "Evolutionary Drift and Equilibrium Selection," Review of Economic Studies, Blackwell Publishing, vol. 66(2), pages 363-93, April. [Downloadable!] (restricted)
  7. Fudenberg, Drew & Harris, Christopher, 1992. "Evolutionary Dynamics with Aggregate Shocks," IDEI Working Papers 13, Institut d'Économie Industrielle (IDEI), Toulouse.
    Other versions:
  8. Erev, Ido & Roth, Alvin E, 1998. "Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria," American Economic Review, American Economic Association, vol. 88(4), pages 848-81, September. [Downloadable!] (restricted)
  9. Binmore, Ken & Larry Samuelson, 1994. "Muddling Through: Noisy Equilibrium Selection," Discussion Paper Serie B 275, University of Bonn, Germany.
    Other versions:
  10. C. Monica Capra & Charles A. Holt, 1999. "Coordination," Southern Economic Journal, Southern Economic Association, vol. 65(3), pages 630-636, January.
  11. McKelvey Richard D. & Palfrey Thomas R., 1995. "Quantal Response Equilibria for Normal Form Games," Games and Economic Behavior, Elsevier, vol. 10(1), pages 6-38, July. [Downloadable!] (restricted)
  12. Binmore Kenneth G. & Samuelson Larry & Vaughan Richard, 1995. "Musical Chairs: Modeling Noisy Evolution," Games and Economic Behavior, Elsevier, vol. 11(1), pages 1-35, October. [Downloadable!] (restricted)
  13. Chen, Hsiao-Chi & Friedman, James W. & Thisse, Jacques-Francois, 1997. "Boundedly Rational Nash Equilibrium: A Probabilistic Choice Approach," Games and Economic Behavior, Elsevier, vol. 18(1), pages 32-54, January. [Downloadable!] (restricted)
  14. repec:att:wimass:199529 is not listed on IDEAS
  15. Simon P. Anderson & Jacob K. Goeree & Charles A. Holt, 1998. "Rent Seeking with Bounded Rationality: An Analysis of the All-Pay Auction," Journal of Political Economy, University of Chicago Press, vol. 106(4), pages 828-853, August. [Downloadable!] (restricted)
  16. Ochs Jack, 1995. "Games with Unique, Mixed Strategy Equilibria: An Experimental Study," Games and Economic Behavior, Elsevier, vol. 10(1), pages 202-217, July. [Downloadable!] (restricted)
  17. Kandori, Michihiro & Mailath, George J & Rob, Rafael, 1993. "Learning, Mutation, and Long Run Equilibria in Games," Econometrica, Econometric Society, vol. 61(1), pages 29-56, January. [Downloadable!] (restricted)
    Other versions:
  18. Fernando Vega-Redondo, 1997. "The Evolution of Walrasian Behavior," Econometrica, Econometric Society, vol. 65(2), pages 375-384, March.
  19. repec:att:wimass:199324 is not listed on IDEAS
  20. C. Monica Capra et al., 1999. "Anomalous Behavior in a Traveler's Dilemma?," American Economic Review, American Economic Association, vol. 89(3), pages 678-690, June. [Downloadable!] (restricted)
  21. Young, H Peyton, 1993. "The Evolution of Conventions," Econometrica, Econometric Society, vol. 61(1), pages 57-84, January. [Downloadable!] (restricted)
  22. Selten, Reinhard & Joachim Buchta, 1994. "Experimental Sealed Bid First Price Auctions with Directly Observed Bid Functions," Discussion Paper Serie B 270, University of Bonn, Germany.
  23. Bryant, John, 1983. "A Simple Rational Expectations Keynes-Type Model," The Quarterly Journal of Economics, MIT Press, vol. 98(3), pages 525-28, August. [Downloadable!] (restricted)
  24. Monderer, Dov & Shapley, Lloyd S., 1996. "Potential Games," Games and Economic Behavior, Elsevier, vol. 14(1), pages 124-143, May. [Downloadable!] (restricted)
  25. Goeree, Jacob K. & Holt, Charles A., 2005. "An experimental study of costly coordination," Games and Economic Behavior, Elsevier, vol. 51(2), pages 349-364, May. [Downloadable!] (restricted)
    Other versions:
Full references

Cited by:
(explanations, Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.)

  1. JIMENEZ Edward, 2002. "Unified Game Theory," Computing in Economics and Finance 2002 25, Society for Computational Economics. [Downloadable!]
  2. Veronika Grimm & Jaromir Kovarik & Giovanni Ponti, 2008. "Fixed price plus rationing: an experiment," Experimental Economics, Springer, vol. 11(4), pages 402-422, December. [Downloadable!] (restricted)
    Other versions:
  3. Basov, S., 2001. "An Evolutionary Model of Reciprocity," Department of Economics - Working Papers Series 812, The University of Melbourne. [Downloadable!]
  4. C. Monica Capra & Susana Cabrera & Rosario Gómez, 2003. "The Effects of Common Advice on One-shot Traveler’s Dilemma Games: Explaining Behavior through an Introspective Model with Errors," Economic Working Papers at Centro de Estudios Andaluces E2003/17, Centro de Estudios Andaluces. [Downloadable!]
  5. Philip A. Haile & Ali Hortacsu & Grigory Kosenok, 2003. "On the Empirical Content of Quantal Response Equilibrium," Cowles Foundation Discussion Papers 1432, Cowles Foundation, Yale University. [Downloadable!]
    Other versions:
  6. Michihiro Kandori, 2002. "The Erosion and Sustainability of Norms and Morale," Levine's Bibliography 506439000000000030, UCLA Department of Economics. [Downloadable!]
  7. Simon P Anderson & Jacob K Goeree & Charles A Holt, 2001. "A Thoeretical Anlysis of Altruism and Decision Error in Public Goods Games," Levine's Working Paper Archive 563824000000000075, David K. Levine. [Downloadable!]
  8. Suren Basov, 2003. "Bounded Rationality:Static Versus Dynamic Approaches," Department of Economics - Working Papers Series 874, The University of Melbourne. [Downloadable!]
  9. repec:att:wimass:192015 is not listed on IDEAS
  10. Suren Basov, 2002. "Bounded Rationality: Static versus Dynamic Approach," Department of Economics - Working Papers Series 864, The University of Melbourne. [Downloadable!]
  11. repec:bep:thetop:v:3:y:2003:i:1:p:1093-1093 is not listed on IDEAS
  12. Michihiro Kandori, 2002. "The Erosion and Sustainability of Norms and Morale," CIRJE F-Series CIRJE-F-169, CIRJE, Faculty of Economics, University of Tokyo. [Downloadable!]
  13. Basov, S., 2001. "A Noisy Model of Individual Behaviour," Department of Economics - Working Papers Series 791, The University of Melbourne. [Downloadable!]
  14. Josef Hofbauer & William H. Sandholm, 2001. "Evolution and Learning in Games with Randomly Disturbed Payoffs," Vienna Economics Papers 0205, University of Vienna, Department of Economics. [Downloadable!]
Statistics
Access and download statistics

Did you know? Over five million full texts a year are downloaded through IDEAS.

This page was last updated on 2009-11-18.


This information is provided to you by IDEAS at the Department of Economics, College of Liberal Arts and Sciences, University of Connecticut using RePEc data on a server sponsored by the Society for Economic Dynamics.