IDEAS home Printed from https://ideas.repec.org/a/eee/jeborg/v191y2021icp798-821.html
   My bibliography  Save this article

Empirical properties and identification of adaptive learning models in behavioral game theory

Author

Listed:
  • Xie, Erhao

Abstract

This paper studies the empirical properties and identification for a broad class of adaptive learning models in games (e.g., experience-weighted attraction (EWA), payoff assessment, and impulse-matching models). I first show that adding a constant c≠0 to the utility function could affect players’ choices during the learning periods. This property is different from standard theories, such as expected utility theory and discrete choice models, where adding c≠0 preserves the same choice. This result has two further implications. First, the constant c added to the utility function could have a structural interpretation, and this paper discusses how to interpret it. Second, the estimation of learning models usually normalizes the utility of one action profile to be zero (i.e., c=0); for instance, the utility of zero dollars is zero, as commonly imposed in experimental economics. This normalization is innocuous in most applications of discrete choice models but could be misspecified in the context of learning. To deal with the above issue, this paper proposes to specify a player’s utility as an unknown function of the action profile, without imposing the above normalization. Equivalently, c is specified as an unknown parameter to be estimated. Under weak conditions, I obtain the joint identification of both utility and learning parameters. Finally, I illustrate the importance of c in the estimation of learning models by conducting a Monte Carlo experiment and revisiting the experimental study by Feri et al. (2010).

Suggested Citation

  • Xie, Erhao, 2021. "Empirical properties and identification of adaptive learning models in behavioral game theory," Journal of Economic Behavior & Organization, Elsevier, vol. 191(C), pages 798-821.
  • Handle: RePEc:eee:jeborg:v:191:y:2021:i:c:p:798-821
    DOI: 10.1016/j.jebo.2021.09.035
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167268121004200
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jebo.2021.09.035?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Sarin, Rajiv & Vahid, Farshid, 2001. "Predicting How People Play Games: A Simple Dynamic Model of Choice," Games and Economic Behavior, Elsevier, vol. 34(1), pages 104-122, January.
    2. Fudenberg, Drew & Levine, David, 1998. "Learning in games," European Economic Review, Elsevier, vol. 42(3-5), pages 631-639, May.
    3. Ulrich Doraszelski & Gregory Lewis & Ariel Pakes, 2018. "Just Starting Out: Learning and Equilibrium in a New Market," American Economic Review, American Economic Association, vol. 108(3), pages 565-615, March.
    4. Mookherjee Dilip & Sopher Barry, 1994. "Learning Behavior in an Experimental Matching Pennies Game," Games and Economic Behavior, Elsevier, vol. 7(1), pages 62-91, July.
    5. Marcet, Albert & Sargent, Thomas J., 1989. "Convergence of least squares learning mechanisms in self-referential linear stochastic models," Journal of Economic Theory, Elsevier, vol. 48(2), pages 337-368, August.
    6. Van Huyck, John B & Battalio, Raymond C & Beil, Richard O, 1990. "Tacit Coordination Games, Strategic Uncertainty, and Coordination Failure," American Economic Review, American Economic Association, vol. 80(1), pages 234-248, March.
    7. Mira Frick & Ryota Iijima & Tomasz Strzalecki, 2019. "Dynamic Random Utility," Econometrica, Econometric Society, vol. 87(6), pages 1941-2002, November.
    8. Frank Heinemann & Rosemarie Nagel & Peter Ockenfels, 2009. "Measuring Strategic Uncertainty in Coordination Games," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(1), pages 181-221.
    9. V. Joseph Hotz & Robert A. Miller, 1993. "Conditional Choice Probabilities and the Estimation of Dynamic Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 60(3), pages 497-529.
    10. Fudenberg, Drew & Levine, David K., 1995. "Consistency and cautious fictitious play," Journal of Economic Dynamics and Control, Elsevier, vol. 19(5-7), pages 1065-1089.
    11. Drew Fudenberg & David K. Levine, 2009. "Learning and Equilibrium," Annual Review of Economics, Annual Reviews, vol. 1(1), pages 385-420, May.
    12. Chmura, Thorsten & Goerg, Sebastian J. & Selten, Reinhard, 2012. "Learning in experimental 2×2 games," Games and Economic Behavior, Elsevier, vol. 76(1), pages 44-73.
    13. McKelvey Richard D. & Palfrey Thomas R., 1995. "Quantal Response Equilibria for Normal Form Games," Games and Economic Behavior, Elsevier, vol. 10(1), pages 6-38, July.
    14. McKelvey, Richard D. & Palfrey, Thomas R. & Weber, Roberto A., 2000. "The effects of payoff magnitude and heterogeneity on behavior in 2 x 2 games with unique mixed strategy equilibria," Journal of Economic Behavior & Organization, Elsevier, vol. 42(4), pages 523-548, August.
    15. Mookherjee, Dilip & Sopher, Barry, 1997. "Learning and Decision Costs in Experimental Constant Sum Games," Games and Economic Behavior, Elsevier, vol. 19(1), pages 97-132, April.
    16. Teck H. Ho & Xin Wang & Colin F. Camerer, 2008. "Individual Differences in EWA Learning with Partial Payoff Information," Economic Journal, Royal Economic Society, vol. 118(525), pages 37-59, January.
    17. Colin Camerer & Teck-Hua Ho, 1999. "Experience-weighted Attraction Learning in Normal Form Games," Econometrica, Econometric Society, vol. 67(4), pages 827-874, July.
    18. Ernst Fehr & Klaus M. Schmidt, 1999. "A Theory of Fairness, Competition, and Cooperation," The Quarterly Journal of Economics, Oxford University Press, vol. 114(3), pages 817-868.
    19. Lee, Robin S. & Pakes, Ariel, 2009. "Multiple equilibria and selection by learning in an applied setting," Economics Letters, Elsevier, vol. 104(1), pages 13-16, July.
    20. Pedro Bordalo & Nicola Gennaioli & Andrei Shleifer, 2020. "Memory, Attention, and Choice," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 135(3), pages 1399-1442.
    21. Daniel McFadden & Kenneth Train, 2000. "Mixed MNL models for discrete response," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(5), pages 447-470.
    22. Steven T. Berry, 1994. "Estimating Discrete-Choice Models of Product Differentiation," RAND Journal of Economics, The RAND Corporation, vol. 25(2), pages 242-262, Summer.
    23. Timothy C. Salmon, 2001. "An Evaluation of Econometric Models of Adaptive Learning," Econometrica, Econometric Society, vol. 69(6), pages 1597-1628, November.
    24. Train,Kenneth E., 2009. "Discrete Choice Methods with Simulation," Cambridge Books, Cambridge University Press, number 9780521766555, January.
    25. Daniel Kahneman & Amos Tversky, 2013. "Prospect Theory: An Analysis of Decision Under Risk," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 6, pages 99-127, World Scientific Publishing Co. Pte. Ltd..
    26. Thomas G. Wollmann, 2018. "Trucks without Bailouts: Equilibrium Product Characteristics for Commercial Vehicles," American Economic Review, American Economic Association, vol. 108(6), pages 1364-1406, June.
    27. George W. Evans, 2001. "Expectations in Macroeconomics. Adaptive versus Eductive Learning," Revue Économique, Programme National Persée, vol. 52(3), pages 573-582.
    28. Cheung, Yin-Wong & Friedman, Daniel, 1997. "Individual Learning in Normal Form Games: Some Laboratory Results," Games and Economic Behavior, Elsevier, vol. 19(1), pages 46-76, April.
    29. Ho, Teck H. & Camerer, Colin F. & Chong, Juin-Kuan, 2007. "Self-tuning experience weighted attraction learning in games," Journal of Economic Theory, Elsevier, vol. 133(1), pages 177-198, March.
    30. Francesco Feri & Bernd Irlenbusch & Matthias Sutter, 2010. "Efficiency Gains from Team-Based Coordination—Large-Scale Experimental Evidence," American Economic Review, American Economic Association, vol. 100(4), pages 1892-1912, September.
    31. Benjamin Enke & Frederik Schwerter & Florian Zimmermann, 2019. "Associative Memory and Belief Formation," CESifo Working Paper Series 7916, CESifo.
    32. Nathaniel T Wilcox, 2006. "Theories of Learning in Games and Heterogeneity Bias," Econometrica, Econometric Society, vol. 74(5), pages 1271-1292, September.
    33. Sarin, Rajiv & Vahid, Farshid, 1999. "Payoff Assessments without Probabilities: A Simple Dynamic Model of Choice," Games and Economic Behavior, Elsevier, vol. 28(2), pages 294-309, August.
    34. TeckH. Ho & Xin Wang & ColinF. Camerer, 2008. "Individual Differences in EWA Learning with Partial Payoff Information," Economic Journal, Royal Economic Society, vol. 118(525), pages 37-59, January.
    35. Pedro Bordalo & Nicola Gennaioli & Andrei Shleifer, 2019. "Memory and Reference Prices: An Application to Rental Choice," AEA Papers and Proceedings, American Economic Association, vol. 109, pages 572-576, May.
    36. Erev, Ido & Roth, Alvin E, 1998. "Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria," American Economic Review, American Economic Association, vol. 88(4), pages 848-881, September.
    37. Cominetti, Roberto & Melo, Emerson & Sorin, Sylvain, 2010. "A payoff-based learning procedure and its application to traffic games," Games and Economic Behavior, Elsevier, vol. 70(1), pages 71-83, September.
    38. Rava Azeredo da Silveira & Michael Woodford, 2019. "Noisy Memory and Over-Reaction to News," AEA Papers and Proceedings, American Economic Association, vol. 109, pages 557-561, May.
    39. Drew Fudenberg & David K. Levine, 1998. "The Theory of Learning in Games," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262061945, December.
    40. Erhao Xie, 2019. "Monetary Payoff and Utility Function in Adaptive Learning Models," Staff Working Papers 19-50, Bank of Canada.
    41. John B. Van Huyck & Raymond C. Battalio & Richard O. Beil, 1991. "Strategic Uncertainty, Equilibrium Selection, and Coordination Failure in Average Opinion Games," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 106(3), pages 885-910.
    42. Antonio Cabrales & Walter Garcia Fontes, 2000. "Estimating learning models from experimental data," Economics Working Papers 501, Department of Economics and Business, Universitat Pompeu Fabra.
    43. Camerer, Colin F. & Ho, Teck-Hua & Chong, Juin-Kuan, 2002. "Sophisticated Experience-Weighted Attraction Learning and Strategic Teaching in Repeated Games," Journal of Economic Theory, Elsevier, vol. 104(1), pages 137-188, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Erhao Xie, 2019. "Monetary Payoff and Utility Function in Adaptive Learning Models," Staff Working Papers 19-50, Bank of Canada.
    2. Nick Feltovich, 2000. "Reinforcement-Based vs. Belief-Based Learning Models in Experimental Asymmetric-Information," Econometrica, Econometric Society, vol. 68(3), pages 605-642, May.
    3. Shachat, Jason & Swarthout, J. Todd, 2012. "Learning about learning in games through experimental control of strategic interdependence," Journal of Economic Dynamics and Control, Elsevier, vol. 36(3), pages 383-402.
    4. Asim Ansari & Ricardo Montoya & Oded Netzer, 2012. "Dynamic learning in behavioral games: A hidden Markov mixture of experts approach," Quantitative Marketing and Economics (QME), Springer, vol. 10(4), pages 475-503, December.
    5. Camerer, Colin F. & Ho, Teck-Hua, 2015. "Behavioral Game Theory Experiments and Modeling," Handbook of Game Theory with Economic Applications,, Elsevier.
    6. repec:wyi:journl:002151 is not listed on IDEAS
    7. Rutström, E. Elisabet & Wilcox, Nathaniel T., 2009. "Stated beliefs versus inferred beliefs: A methodological inquiry and experimental test," Games and Economic Behavior, Elsevier, vol. 67(2), pages 616-632, November.
    8. Victor Aguirregabiria & Jihye Jeon, 2020. "Firms’ Beliefs and Learning: Models, Identification, and Empirical Evidence," Review of Industrial Organization, Springer;The Industrial Organization Society, vol. 56(2), pages 203-235, March.
    9. Jehiel, Philippe & Singh, Juni, 2021. "Multi-state choices with aggregate feedback on unfamiliar alternatives," Games and Economic Behavior, Elsevier, vol. 130(C), pages 1-24.
    10. Ho, Teck H. & Camerer, Colin F. & Chong, Juin-Kuan, 2007. "Self-tuning experience weighted attraction learning in games," Journal of Economic Theory, Elsevier, vol. 133(1), pages 177-198, March.
    11. Nathaniel T Wilcox, 2003. "Heterogeneity and Learning Principles," Levine's Bibliography 666156000000000435, UCLA Department of Economics.
    12. Jaromír Kovářík & Friederike Mengel & José Gabriel Romero, 2018. "Learning in network games," Quantitative Economics, Econometric Society, vol. 9(1), pages 85-139, March.
      • Kovarik, Jaromir & Mengel, Friederike & Romero, José Gabriel, 2012. "Learning in Network Games," IKERLANAK http://www-fae1-eao1-ehu-, Universidad del País Vasco - Departamento de Fundamentos del Análisis Económico I.
    13. Teck H. Ho & Xin Wang & Colin F. Camerer, 2008. "Individual Differences in EWA Learning with Partial Payoff Information," Economic Journal, Royal Economic Society, vol. 118(525), pages 37-59, January.
    14. Teck H Ho & Colin Camerer & Juin-Kuan Chong, 2003. "Functional EWA: A one-parameter theory of learning in games," Levine's Working Paper Archive 506439000000000514, David K. Levine.
    15. Jacob K. Goeree & Charles A. Holt, 2001. "Ten Little Treasures of Game Theory and Ten Intuitive Contradictions," American Economic Review, American Economic Association, vol. 91(5), pages 1402-1422, December.
    16. Wu, Hang & Bayer, Ralph-C, 2015. "Learning from inferred foregone payoffs," Journal of Economic Dynamics and Control, Elsevier, vol. 51(C), pages 445-458.
    17. Rutstrom, E. Elizabet & Wilcox, Nathaniel, 2008. "Stated versus inferred beliefs: A methodological inquiry and experimental test," MPRA Paper 11852, University Library of Munich, Germany.
    18. Chernov, G. & Susin, I., 2019. "Models of learning in games: An overview," Journal of the New Economic Association, New Economic Association, vol. 44(4), pages 77-125.
    19. Naoki Funai, 2013. "An Adaptive Learning Model in Coordination Games," Games, MDPI, vol. 4(4), pages 1-22, November.
    20. Duffy, John, 2006. "Agent-Based Models and Human Subject Experiments," Handbook of Computational Economics, in: Leigh Tesfatsion & Kenneth L. Judd (ed.), Handbook of Computational Economics, edition 1, volume 2, chapter 19, pages 949-1011, Elsevier.
    21. Spiliopoulos, Leonidas, 2012. "Pattern recognition and subjective belief learning in a repeated constant-sum game," Games and Economic Behavior, Elsevier, vol. 75(2), pages 921-935.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jeborg:v:191:y:2021:i:c:p:798-821. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jebo .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.