IDEAS home Printed from https://ideas.repec.org/a/wly/econjl/v118y2008i525p37-59.html
   My bibliography  Save this article

Individual Differences in EWA Learning with Partial Payoff Information

Author

Listed:
  • Teck H. Ho
  • Xin Wang
  • Colin F. Camerer

Abstract

We extend experience‐weighted attraction (EWA) learning to games in which only the set of possible foregone payoffs from unchosen strategies are known, and estimate parameters separately for each player to study heterogeneity. We assume players estimate unknown foregone payoffs from a strategy, by substituting the last payoff actually received from that strategy, by clairvoyantly guessing the actual foregone payoff, or by averaging the set of possible foregone payoffs conditional on the actual outcomes. All three assumptions improve predictive accuracy of EWA. Individual parameter estimates suggest that players cluster into two separate subgroups (which differ from traditional reinforcement and belief learning).

Suggested Citation

  • Teck H. Ho & Xin Wang & Colin F. Camerer, 2008. "Individual Differences in EWA Learning with Partial Payoff Information," Economic Journal, Royal Economic Society, vol. 118(525), pages 37-59, January.
    • Handle: RePEc:wly:econjl:v:118:y:2008:i:525:p:37-59
    DOI: 10.1111/j.1468-0297.2007.02103.x
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/j.1468-0297.2007.02103.x
    Download Restriction: no
    File URL: https://libkey.io/10.1111/j.1468-0297.2007.02103.x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Schlag, Karl H., 1999. "Which one should I imitate?," Journal of Mathematical Economics, Elsevier, vol. 31(4), pages 493-522, May.
    2. Fudenberg, Drew & Levine, David, 1998. "Learning in games," European Economic Review, Elsevier, vol. 42(3-5), pages 631-639, May.
    3. George J. Mailath, 1998. "Corrigenda [Do People Play Nash Equilibrium? Lessons from Evolutionary Game Theory]," Journal of Economic Literature, American Economic Association, vol. 36(4), pages 1941-1941, December.
    4. Mookherjee Dilip & Sopher Barry, 1994. "Learning Behavior in an Experimental Matching Pennies Game," Games and Economic Behavior, Elsevier, vol. 7(1), pages 62-91, July.
    5. Albert Marcet & Juan P. Nicolini, 2003. "Recurrent Hyperinflations and Learning," American Economic Review, American Economic Association, vol. 93(5), pages 1476-1498, December.
    6. McKelvey Richard D. & Palfrey Thomas R., 1995. "Quantal Response Equilibria for Normal Form Games," Games and Economic Behavior, Elsevier, vol. 10(1), pages 6-38, July.
    7. Mookherjee, Dilip & Sopher, Barry, 1997. "Learning and Decision Costs in Experimental Constant Sum Games," Games and Economic Behavior, Elsevier, vol. 19(1), pages 97-132, April.
    8. Selten, Reinhard & Stoecker, Rolf, 1986. "End behavior in sequences of finite Prisoner's Dilemma supergames A learning theory approach," Journal of Economic Behavior & Organization, Elsevier, vol. 7(1), pages 47-70, March.
    9. Roth, Alvin E. & Erev, Ido, 1995. "Learning in extensive-form games: Experimental data and simple dynamic models in the intermediate term," Games and Economic Behavior, Elsevier, vol. 8(1), pages 164-212.
    10. Broseta, Bruno, 2000. "Adaptive Learning and Equilibrium Selection in Experimental Coordination Games: An ARCH(1) Approach," Games and Economic Behavior, Elsevier, vol. 32(1), pages 25-50, July.
    11. Rajiv Sarin & Farshid Vahid, 2004. "Strategy Similarity and Coordination," Economic Journal, Royal Economic Society, vol. 114(497), pages 506-527, July.
    12. Colin Camerer & Teck-Hua Ho, 1999. "Experience-weighted Attraction Learning in Normal Form Games," Econometrica, Econometric Society, vol. 67(4), pages 827-874, July.
    13. Ed Hopkins, 2002. "Two Competing Models of How People Learn in Games," Econometrica, Econometric Society, vol. 70(6), pages 2141-2166, November.
    14. Morgan, John & Sefton, Martin, 2002. "An Experimental Investigation of Unprofitable Games," Games and Economic Behavior, Elsevier, vol. 40(1), pages 123-146, July.
    15. Christopher M. Anderson & Colin F. Camerer, 2000. "Experience-weighted attraction learning in sender-receiver signaling games," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 16(3), pages 689-718.
    16. Timothy C. Salmon, 2001. "An Evaluation of Econometric Models of Adaptive Learning," Econometrica, Econometric Society, vol. 69(6), pages 1597-1628, November.
    17. Teck-Hua Ho & Keith Weigelt, 1996. "Task Complexity, Equilibrium Selection, and Learning: An Experimental Study," Management Science, INFORMS, vol. 42(5), pages 659-679, May.
    18. Chong, Juin-Kuan & Camerer, Colin F. & Ho, Teck H., 2006. "A learning-based model of repeated games with incomplete information," Games and Economic Behavior, Elsevier, vol. 55(2), pages 340-371, May.
    19. Van Huyck, John B. & Cook, Joseph P. & Battalio, Raymond C., 1997. "Adaptive behavior and coordination failure," Journal of Economic Behavior & Organization, Elsevier, vol. 32(4), pages 483-503, April.
    20. Cheung, Yin-Wong & Friedman, Daniel, 1997. "Individual Learning in Normal Form Games: Some Laboratory Results," Games and Economic Behavior, Elsevier, vol. 19(1), pages 46-76, April.
    21. Nathaniel T Wilcox, 2006. "Theories of Learning in Games and Heterogeneity Bias," Econometrica, Econometric Society, vol. 74(5), pages 1271-1292, September.
    22. Rapoport, Amnon & Amaldoss, Wilfred, 2000. "Mixed strategies and iterative elimination of strongly dominated strategies: an experimental investigation of states of knowledge," Journal of Economic Behavior & Organization, Elsevier, vol. 42(4), pages 483-521, August.
    23. Chen, Yan & Khoroshilov, Yuri, 2003. "Learning under limited information," Games and Economic Behavior, Elsevier, vol. 44(1), pages 1-25, July.
    24. Erev, Ido & Roth, Alvin E, 1998. "Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria," American Economic Review, American Economic Association, vol. 88(4), pages 848-881, September.
    25. William Boulding & Ajay Kalra & Richard Staelin, 1999. "The Quality Double Whammy," Marketing Science, INFORMS, vol. 18(4), pages 463-484.
    26. Vriend, Nicolaas J., 1997. "Will reasoning improve learning?," Economics Letters, Elsevier, vol. 55(1), pages 9-18, August.
    27. Drew Fudenberg & David K. Levine, 1998. "The Theory of Learning in Games," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262061945, February.
    28. Stahl, Dale O., 2000. "Rule Learning in Symmetric Normal-Form Games: Theory and Evidence," Games and Economic Behavior, Elsevier, vol. 32(1), pages 105-138, July.
    29. George J. Mailath, 1998. "Do People Play Nash Equilibrium? Lessons from Evolutionary Game Theory," Journal of Economic Literature, American Economic Association, vol. 36(3), pages 1347-1374, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Francesco Fallucchi & Jan Niederreiter & Massimo Riccaboni, 2021. "Learning and dropout in contests: an experimental approach," Theory and Decision, Springer, vol. 90(2), pages 245-278, March.
    2. Akyol, Metin, 2016. "Do educational vouchers reduce inequality and inefficiency in education?," Economics of Education Review, Elsevier, vol. 55(C), pages 149-167.
    3. Camerer, Colin F. & Ho, Teck-Hua, 2015. "Behavioral Game Theory Experiments and Modeling," Handbook of Game Theory with Economic Applications,, Elsevier.
    4. Asim Ansari & Ricardo Montoya & Oded Netzer, 2012. "Dynamic learning in behavioral games: A hidden Markov mixture of experts approach," Quantitative Marketing and Economics (QME), Springer, vol. 10(4), pages 475-503, December.
    5. J. Reiß & Irenaeus Wolff, 2014. "Incentive effects of funding contracts: an experiment," Experimental Economics, Springer;Economic Science Association, vol. 17(4), pages 586-614, December.
    6. Breitmoser, Yves, 2019. "Knowing me, imagining you: Projection and overbidding in auctions," Games and Economic Behavior, Elsevier, vol. 113(C), pages 423-447.
    7. Shachat, Jason & Swarthout, J. Todd, 2012. "Learning about learning in games through experimental control of strategic interdependence," Journal of Economic Dynamics and Control, Elsevier, vol. 36(3), pages 383-402.
    8. Bigoni, Maria & Fort, Margherita, 2013. "Information and learning in oligopoly: An experiment," Games and Economic Behavior, Elsevier, vol. 81(C), pages 192-214.
    9. repec:wyi:journl:002151 is not listed on IDEAS
    10. Chen, Shu-Heng, 2012. "Varieties of agents in agent-based computational economics: A historical and an interdisciplinary perspective," Journal of Economic Dynamics and Control, Elsevier, vol. 36(1), pages 1-25.
    11. Wilfred Amaldoss & Woochoel Shin, 2011. "Competing for Low-End Markets," Marketing Science, INFORMS, vol. 30(5), pages 776-788, September.
    12. Stefano Balietti & Brennan Klein & Christoph Riedl, 2021. "Optimal design of experiments to identify latent behavioral types," Experimental Economics, Springer;Economic Science Association, vol. 24(3), pages 772-799, September.
    13. Wu, Hang & Bayer, Ralph-C, 2015. "Learning from inferred foregone payoffs," Journal of Economic Dynamics and Control, Elsevier, vol. 51(C), pages 445-458.
    14. Russell, Golman, 2011. "Quantal response equilibria with heterogeneous agents," Journal of Economic Theory, Elsevier, vol. 146(5), pages 2013-2028, September.
    15. Francesco Feri & Bernd Irlenbusch & Matthias Sutter, 2010. "Efficiency Gains from Team-Based Coordination—Large-Scale Experimental Evidence," American Economic Review, American Economic Association, vol. 100(4), pages 1892-1912, September.
    16. Kawagoe, Toshiji & Takizawa, Hirokazu, 2012. "Level-k analysis of experimental centipede games," Journal of Economic Behavior & Organization, Elsevier, vol. 82(2), pages 548-566.
    17. Daniel Graydon Stephenson, 2023. "Convergence Rates in Resource Allocation Games," Working Papers 2304, VCU School of Business, Department of Economics.
    18. Michael P. Haselhuhn & Devin G. Pope & Maurice E. Schweitzer & Peter Fishman, 2012. "The Impact of Personal Experience on Behavior: Evidence from Video-Rental Fines," Management Science, INFORMS, vol. 58(1), pages 52-61, January.
    19. Golman, Russell, 2012. "Homogeneity bias in models of discrete choice with bounded rationality," Journal of Economic Behavior & Organization, Elsevier, vol. 82(1), pages 1-11.
    20. Simon Gemkow & Michael Neugart, 2011. "Referral hiring, endogenous social networks, and inequality: an agent-based analysis," Journal of Evolutionary Economics, Springer, vol. 21(4), pages 703-719, October.
    21. Jaromír Kovářík & Friederike Mengel & José Gabriel Romero, 2018. "Learning in network games," Quantitative Economics, Econometric Society, vol. 9(1), pages 85-139, March.
      • Kovarik, Jaromir & Mengel, Friederike & Romero, José Gabriel, 2012. "Learning in Network Games," IKERLANAK http://www-fae1-eao1-ehu-, Universidad del País Vasco - Departamento de Fundamentos del Análisis Económico I.
    22. Xie, Erhao, 2021. "Empirical properties and identification of adaptive learning models in behavioral game theory," Journal of Economic Behavior & Organization, Elsevier, vol. 191(C), pages 798-821.
    23. Breitmoser, Yves, 2017. "Knowing Me, Imagining You:," Rationality and Competition Discussion Paper Series 36, CRC TRR 190 Rationality and Competition.
    24. Wen, Yuanji, 2018. "Voluntary information acquisition in an asymmetric-Information game:comparing learning theories in the laboratory," Journal of Economic Behavior & Organization, Elsevier, vol. 150(C), pages 202-219.
    25. Bin Wu & Wanying Huang & Pengfei Liu, 2017. "Carbon Reduction Strategies Based on an NW Small-World Network with a Progressive Carbon Tax," Sustainability, MDPI, vol. 9(10), pages 1-22, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ho, Teck H. & Camerer, Colin F. & Chong, Juin-Kuan, 2007. "Self-tuning experience weighted attraction learning in games," Journal of Economic Theory, Elsevier, vol. 133(1), pages 177-198, March.
    2. Camerer, Colin F. & Ho, Teck-Hua, 2015. "Behavioral Game Theory Experiments and Modeling," Handbook of Game Theory with Economic Applications,, Elsevier.
    3. Teck H Ho & Colin Camerer & Juin-Kuan Chong, 2003. "Functional EWA: A one-parameter theory of learning in games," Levine's Working Paper Archive 506439000000000514, David K. Levine.
    4. Asim Ansari & Ricardo Montoya & Oded Netzer, 2012. "Dynamic learning in behavioral games: A hidden Markov mixture of experts approach," Quantitative Marketing and Economics (QME), Springer, vol. 10(4), pages 475-503, December.
    5. Camerer, Colin F. & Ho, Teck-Hua & Chong, Juin-Kuan, 2002. "Sophisticated Experience-Weighted Attraction Learning and Strategic Teaching in Repeated Games," Journal of Economic Theory, Elsevier, vol. 104(1), pages 137-188, May.
    6. Xie, Erhao, 2021. "Empirical properties and identification of adaptive learning models in behavioral game theory," Journal of Economic Behavior & Organization, Elsevier, vol. 191(C), pages 798-821.
    7. Duffy, John, 2006. "Agent-Based Models and Human Subject Experiments," Handbook of Computational Economics, in: Leigh Tesfatsion & Kenneth L. Judd (ed.), Handbook of Computational Economics, edition 1, volume 2, chapter 19, pages 949-1011, Elsevier.
    8. Shafran, Aric P., 2012. "Learning in games with risky payoffs," Games and Economic Behavior, Elsevier, vol. 75(1), pages 354-371.
    9. Erhao Xie, 2019. "Monetary Payoff and Utility Function in Adaptive Learning Models," Staff Working Papers 19-50, Bank of Canada.
    10. Spiliopoulos, Leonidas, 2012. "Pattern recognition and subjective belief learning in a repeated constant-sum game," Games and Economic Behavior, Elsevier, vol. 75(2), pages 921-935.
    11. Wolf Ze'ev Ehrblatt & Kyle Hyndman & Erkut Y. ÄOzbay & Andrew Schotter, 2006. "Convergence: An Experimental Study," Levine's Working Paper Archive 122247000000001148, David K. Levine.
    12. Nick Feltovich, 2000. "Reinforcement-Based vs. Belief-Based Learning Models in Experimental Asymmetric-Information," Econometrica, Econometric Society, vol. 68(3), pages 605-642, May.
    13. Battalio,R. & Samuelson,L. & Huyck,J. van, 1998. "Risk dominance, payoff dominance and probabilistic choice learning," Working papers 2, Wisconsin Madison - Social Systems.
    14. Jehiel, Philippe & Singh, Juni, 2021. "Multi-state choices with aggregate feedback on unfamiliar alternatives," Games and Economic Behavior, Elsevier, vol. 130(C), pages 1-24.
    15. Wu, Hang & Bayer, Ralph-C, 2015. "Learning from inferred foregone payoffs," Journal of Economic Dynamics and Control, Elsevier, vol. 51(C), pages 445-458.
    16. Chernov, G. & Susin, I., 2019. "Models of learning in games: An overview," Journal of the New Economic Association, New Economic Association, vol. 44(4), pages 77-125.
    17. Haruvy, Ernan & Stahl, Dale O., 2012. "Between-game rule learning in dissimilar symmetric normal-form games," Games and Economic Behavior, Elsevier, vol. 74(1), pages 208-221.
    18. Jacob K. Goeree & Charles A. Holt, 2001. "Ten Little Treasures of Game Theory and Ten Intuitive Contradictions," American Economic Review, American Economic Association, vol. 91(5), pages 1402-1422, December.
    19. Cason, Timothy N. & Friedman, Daniel & Hopkins, Ed, 2010. "Testing the TASP: An experimental investigation of learning in games with unstable equilibria," Journal of Economic Theory, Elsevier, vol. 145(6), pages 2309-2331, November.
    20. Ed Hopkins, 2002. "Two Competing Models of How People Learn in Games," Econometrica, Econometric Society, vol. 70(6), pages 2141-2166, November.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:econjl:v:118:y:2008:i:525:p:37-59. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://edirc.repec.org/data/resssea.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/resssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.