Learning about Learning in Games through Experimental Control of Strategic Interdependence
Abstract
We conduct experiments in which humans repeatedly play one of two games against a computer decision maker that follows either Roth and Erev's reinforcement learning algorithm or Camerer and Ho's EWA algorithm. The human/algorithm interaction provides results that can't be obtained from the analysis of pure human interactions or model simulations. The learning algorithms are more sensitive than humans in calculating exploitable opponent play. Learning algorithms respond to these calculated opportunities systematically; however, the magnitude of these responses are too weak to improve the algorithm's payoffs. Human play against various decision maker types does not significantly vary. These results demonstrate that humans and currently proposed models of their behavior differ in that humans do not adjust payoff assessments by smooth transition functions and that when humans detect exploitable play they are more likely to choose the best response to this belief.Download Info
If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.Bibliographic Info
Paper provided by EconWPA in its series Experimental with number 0310003.Length: 39 pages
Date of creation: 13 Oct 2003
Date of revision:
Handle: RePEc:wpa:wuwpex:0310003
Note: Type of Document - pdf; pages: 39
Contact details of provider:
Web page: http://128.118.178.162
Related research
Keywords:Other versions of this item:
- Shachat, Jason & Swarthout, J. Todd, 2012. "Learning about learning in games through experimental control of strategic interdependence," Journal of Economic Dynamics and Control, Elsevier, vol. 36(3), pages 383-402.
- Jason Shachat & J. Todd Swarthout, 2002. "Learning about Learning in Games through Experimental Control of Strategic Interdependence," Experimental Economics Center Working Paper Series 2006-17, Experimental Economics Center, Andrew Young School of Policy Studies, Georgia State University, revised Aug 2008.
- C7 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory
This paper has been announced in the following NEP Reports:
- NEP-ALL-2003-10-20 (All new papers)
- NEP-EXP-2003-10-20 (Experimental Economics)
References
References listed on IDEASPlease report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Robert W. Rosenthal & Jason Shachat & Mark Walker, 2003.
"Hide and Seek in Arizona,"
Experimental
0312001, EconWPA.
- Robert W. Rosenthal & Jason Shachat & Mark Walker, 2003. "Hide and seek in Arizona," International Journal of Game Theory, Springer, vol. 32(2), pages 273-293, December.
- Morgan, John & Sefton, Martin, 2002. "An Experimental Investigation of Unprofitable Games," Games and Economic Behavior, Elsevier, vol. 40(1), pages 123-146, July.
- McCabe, Kevin & Houser, Daniel & Ryan, Lee & Smith, Vernon & Trouard, Ted, 2001. "A Functional Imaging Study of Cooperation in Two-Person reciprocal Exchange," MPRA Paper 5172, University Library of Munich, Germany.
- Erev, Ido & Roth, Alvin E, 1998. "Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria," American Economic Review, American Economic Association, vol. 88(4), pages 848-81, September.
- Timothy C. Salmon, 2001. "An Evaluation of Econometric Models of Adaptive Learning," Econometrica, Econometric Society, vol. 69(6), pages 1597-1628, November.
- Jordan J. S., 1993. "Three Problems in Learning Mixed-Strategy Nash Equilibria," Games and Economic Behavior, Elsevier, vol. 5(3), pages 368-386, July.
- Fudenberg, Drew & Levine, David K., 1995.
"Consistency and cautious fictitious play,"
Journal of Economic Dynamics and Control,
Elsevier, vol. 19(5-7), pages 1065-1089.
- Fudenberg, Drew & Levine, David, 1995. "Consistency and Cautious Fictitious Play," Scholarly Articles 3198694, Harvard University Department of Economics.
- Drew Fudenberg & David K. Levine, 1996. "Consistency and Cautious Fictitious Play," Levine's Working Paper Archive 470, David K. Levine.
- Eyal Winter & Shmuel Zamir, 2005. "An Experiment With Ultimatum Bargaining In A Changing Environment," The Japanese Economic Review, Japanese Economic Association, vol. 56(3), pages 363-385.
- Roth, Alvin E & Schoumaker, Francoise, 1983. "Expectations and Reputations in Bargaining: An Experimental Study," American Economic Review, American Economic Association, vol. 73(3), pages 362-72, June.
- Shachat, Jason M., 2002. "Mixed Strategy Play and the Minimax Hypothesis," Journal of Economic Theory, Elsevier, vol. 104(1), pages 189-226, May.
- Walker, James M. & Smith, Vernon L. & Cox, James C., 1987. "Bidding behavior in first price sealed bid auctions : Use of computerized Nash competitors," Economics Letters, Elsevier, vol. 23(3), pages 239-244.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.Cited by:
- Dürsch, Peter & Kolb, Albert & Oechssler, Jörg & Schipper, Burkhard C., 2005.
"Rage Against the Machines: How Subjects Learn to Play Against Computers,"
Discussion Paper Series of SFB/TR 15 Governance and the Efficiency of Economic Systems
63, Free University of Berlin, Humboldt University of Berlin, University of Bonn, University of Mannheim, University of Munich.
- Dürsch, Peter & Kolb, Albert & Oechssler, Jörg & Schipper, Burkhard, 2005. "Rage Against the Machines - How Subjects Learn to Play Against Computers," Sonderforschungsbereich 504 Publications 05-36, Sonderforschungsbereich 504, Universität Mannheim & Sonderforschungsbereich 504, University of Mannheim.
- Peter Dürsch & Albert Kolb & Jörg Oechssler & Burkhard C. Schipper, 2005. "Rage Against the Machines: How Subjects Learn to Play Against Computers," Working Papers 0423, University of Heidelberg, Department of Economics, revised Oct 2005.
- Peter Dürsch & Albert Kolb & Jörg Oechssler & Burkhard C. Schipper, 2005. "Rage Against the Machines: How Subjects Learn to Play Against Computers," Bonn Econ Discussion Papers bgse31_2005, University of Bonn, Germany.
- Peter Duersch & Albert Kolb & Joerg Oechssler & Burkhard Schipper, 2005. "Rage Against the Machines: How Subjects Learn to Play Against Computers," Game Theory and Information 0510012, EconWPA.
- Burkhard C. Schipper & Jorg Oechssler & Albert Kolb, 2005. "Rage Against the Machines: How Subjects Learn to Play Against Computers," Working Papers 516, University of California, Davis, Department of Economics.
- Spiliopoulos, Leonidas, 2008. "Humans versus computer algorithms in repeated mixed strategy games," MPRA Paper 6672, University Library of Munich, Germany.
- Peter Duersch & Albert Kolb & Jörg Oechssler & Burkhard Schipper, 2010. "Rage against the machines: how subjects play against learning algorithms," Economic Theory, Springer, vol. 43(3), pages 407-430, June.
Lists
This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.Statistics
Access and download statisticsCorrections
When requesting a correction, please mention this item's handle: RePEc:wpa:wuwpex:0310003For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (EconWPA).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.

