IDEAS home Printed from https://ideas.repec.org/a/eee/dyncon/v51y2015icp445-458.html
   My bibliography  Save this article

Learning from inferred foregone payoffs

Author

Listed:
  • Wu, Hang
  • Bayer, Ralph-C

Abstract

A player׳s knowledge of her own actions and the corresponding payoffs may enable her to infer or form beliefs about what the payoffs would have been if she had played differently. For quantitative learning models employed in studies of low information environments, players׳ ex-post inferences and beliefs have been largely ignored. For games with large strategy spaces, this omission can seriously weaken the predictive power of a learning model. We propose a novel method of using players׳ ex-post inferences and assessments to impute foregone payoffs for unplayed strategies in low-information environments. We then use the resulting learning model to explain the pricing and learning behavior observed in a Bertrand market experiment. Maximum likelihood estimation shows that the extended model organizes the data remarkably well at both the aggregate and individual levels.

Suggested Citation

  • Wu, Hang & Bayer, Ralph-C, 2015. "Learning from inferred foregone payoffs," Journal of Economic Dynamics and Control, Elsevier, vol. 51(C), pages 445-458.
  • Handle: RePEc:eee:dyncon:v:51:y:2015:i:c:p:445-458
    DOI: 10.1016/j.jedc.2014.11.012
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0165188914003091
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jedc.2014.11.012?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Genius, Margarita & Strazzera, Elisabetta, 2002. "A note about model selection and tests for non-nested contingent valuation models," Economics Letters, Elsevier, vol. 74(3), pages 363-370, February.
    2. Chen, Yan & Khoroshilov, Yuri, 2003. "Learning under limited information," Games and Economic Behavior, Elsevier, vol. 44(1), pages 1-25, July.
    3. Erev, Ido & Roth, Alvin E, 1998. "Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria," American Economic Review, American Economic Association, vol. 88(4), pages 848-881, September.
    4. Vuong, Quang H, 1989. "Likelihood Ratio Tests for Model Selection and Non-nested Hypotheses," Econometrica, Econometric Society, vol. 57(2), pages 307-333, March.
    5. McKelvey Richard D. & Palfrey Thomas R., 1995. "Quantal Response Equilibria for Normal Form Games," Games and Economic Behavior, Elsevier, vol. 10(1), pages 6-38, July.
    6. Teck H. Ho & Xin Wang & Colin F. Camerer, 2008. "Individual Differences in EWA Learning with Partial Payoff Information," Economic Journal, Royal Economic Society, vol. 118(525), pages 37-59, January.
    7. Selten, Reinhard & Stoecker, Rolf, 1986. "End behavior in sequences of finite Prisoner's Dilemma supergames A learning theory approach," Journal of Economic Behavior & Organization, Elsevier, vol. 7(1), pages 47-70, March.
    8. Ralph-C. Bayer & Elke Renner & Rupert Sausgruber, 2013. "Confusion and learning in the voluntary contributions game," Experimental Economics, Springer;Economic Science Association, vol. 16(4), pages 478-496, December.
    9. Rajiv Sarin & Farshid Vahid, 2004. "Strategy Similarity and Coordination," Economic Journal, Royal Economic Society, vol. 114(497), pages 506-527, July.
    10. Reinhard Selten & Klaus Abbink & Ricarda Cox, 2005. "Learning Direction Theory and the Winner’s Curse," Experimental Economics, Springer;Economic Science Association, vol. 8(1), pages 5-20, April.
    11. Colin Camerer & Teck-Hua Ho, 1999. "Experience-weighted Attraction Learning in Normal Form Games," Econometrica, Econometric Society, vol. 67(4), pages 827-874, July.
    12. Vriend, Nicolaas J., 1997. "Will reasoning improve learning?," Economics Letters, Elsevier, vol. 55(1), pages 9-18, August.
    13. Yan Chen & Fang-Fang Tang, 1998. "Learning and Incentive-Compatible Mechanisms for Public Goods Provision: An Experimental Study," Journal of Political Economy, University of Chicago Press, vol. 106(3), pages 633-662, June.
    14. Bruttel, Lisa V., 2009. "Group dynamics in experimental studies--The Bertrand Paradox revisited," Journal of Economic Behavior & Organization, Elsevier, vol. 69(1), pages 51-63, January.
    15. Brit Grosskopf, 2003. "Reinforcement and Directional Learning in the Ultimatum Game with Responder Competition," Experimental Economics, Springer;Economic Science Association, vol. 6(2), pages 141-158, October.
    16. Timothy N. Cason & Daniel Friedman, 1997. "Price Formation in Single Call Markets," Econometrica, Econometric Society, vol. 65(2), pages 311-346, March.
    17. Ralph-C Bayer & Changxia Ke, 2011. "Are "Rockets and Feathers" Caused by Search or Informational Frictions," Working Papers are_rockets_and_feathers_, Max Planck Institute for Tax Law and Public Finance.
    18. Cheung, Yin-Wong & Friedman, Daniel, 1997. "Individual Learning in Normal Form Games: Some Laboratory Results," Games and Economic Behavior, Elsevier, vol. 19(1), pages 46-76, April.
    19. Ho, Teck H. & Camerer, Colin F. & Chong, Juin-Kuan, 2007. "Self-tuning experience weighted attraction learning in games," Journal of Economic Theory, Elsevier, vol. 133(1), pages 177-198, March.
    20. Colin F. Camerer & Teck-Hua Ho & Juin-Kuan Chong, 2004. "A Cognitive Hierarchy Model of Games," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(3), pages 861-898.
    21. Reinhard Selten & Klaus Abbink & Ricarda Cox, 2005. "Learning Direction Theory and the Winner’s Curse," Experimental Economics, Springer;Economic Science Association, vol. 8(1), pages 5-20, April.
    22. Nathaniel T Wilcox, 2006. "Theories of Learning in Games and Heterogeneity Bias," Econometrica, Econometric Society, vol. 74(5), pages 1271-1292, September.
    23. Sarin, Rajiv & Vahid, Farshid, 1999. "Payoff Assessments without Probabilities: A Simple Dynamic Model of Choice," Games and Economic Behavior, Elsevier, vol. 28(2), pages 294-309, August.
    24. TeckH. Ho & Xin Wang & ColinF. Camerer, 2008. "Individual Differences in EWA Learning with Partial Payoff Information," Economic Journal, Royal Economic Society, vol. 118(525), pages 37-59, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bayer, Ralph-C & Ke, Changxia, 2018. "What causes rockets and feathers? An experimental investigation," Journal of Economic Behavior & Organization, Elsevier, vol. 153(C), pages 223-237.
    2. Naoki Funai, 2019. "Convergence results on stochastic adaptive learning," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 68(4), pages 907-934, November.
    3. Funai, Naoki, 2022. "Reinforcement learning with foregone payoff information in normal form games," Journal of Economic Behavior & Organization, Elsevier, vol. 200(C), pages 638-660.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xie, Erhao, 2021. "Empirical properties and identification of adaptive learning models in behavioral game theory," Journal of Economic Behavior & Organization, Elsevier, vol. 191(C), pages 798-821.
    2. Shachat, Jason & Swarthout, J. Todd, 2012. "Learning about learning in games through experimental control of strategic interdependence," Journal of Economic Dynamics and Control, Elsevier, vol. 36(3), pages 383-402.
    3. repec:wyi:journl:002151 is not listed on IDEAS
    4. Teck H. Ho & Xin Wang & Colin F. Camerer, 2008. "Individual Differences in EWA Learning with Partial Payoff Information," Economic Journal, Royal Economic Society, vol. 118(525), pages 37-59, January.
    5. Camerer, Colin F. & Ho, Teck-Hua, 2015. "Behavioral Game Theory Experiments and Modeling," Handbook of Game Theory with Economic Applications,, Elsevier.
    6. Wilfred Amaldoss & Teck-Hua Ho & Aradhna Krishna & Kay-Yut Chen & Preyas Desai & Ganesh Iyer & Sanjay Jain & Noah Lim & John Morgan & Ryan Oprea & Joydeep Srivasatava, 2008. "Experiments on strategic choices and markets," Marketing Letters, Springer, vol. 19(3), pages 417-429, December.
    7. Chernov, G. & Susin, I., 2019. "Models of learning in games: An overview," Journal of the New Economic Association, New Economic Association, vol. 44(4), pages 77-125.
    8. Chmura, Thorsten & Goerg, Sebastian J. & Selten, Reinhard, 2012. "Learning in experimental 2×2 games," Games and Economic Behavior, Elsevier, vol. 76(1), pages 44-73.
    9. Breitmoser, Yves, 2019. "Knowing me, imagining you: Projection and overbidding in auctions," Games and Economic Behavior, Elsevier, vol. 113(C), pages 423-447.
    10. Breitmoser, Yves & Tan, Jonathan H.W. & Zizzo, Daniel John, 2014. "On the beliefs off the path: Equilibrium refinement due to quantal response and level-k," Games and Economic Behavior, Elsevier, vol. 86(C), pages 102-125.
    11. Ho, Teck H. & Camerer, Colin F. & Chong, Juin-Kuan, 2007. "Self-tuning experience weighted attraction learning in games," Journal of Economic Theory, Elsevier, vol. 133(1), pages 177-198, March.
    12. Schuster, Stephan, 2012. "Applications in Agent-Based Computational Economics," MPRA Paper 47201, University Library of Munich, Germany.
    13. Jieyao Ding & Andreas Nicklisch, 2013. "On the Impulse in Impulse Learning," Discussion Paper Series of the Max Planck Institute for Research on Collective Goods 2013_02, Max Planck Institute for Research on Collective Goods.
    14. Sebastian J. Goerg & Tibor Neugebauer & Abdolkarim Sadrieh, 2016. "Impulse Response Dynamics in Weakest Link Games," German Economic Review, Verein für Socialpolitik, vol. 17(3), pages 284-297, August.
    15. Huck, Steffen & Jehiel, Philippe & Rutter, Tom, 2011. "Feedback spillover and analogy-based expectations: A multi-game experiment," Games and Economic Behavior, Elsevier, vol. 71(2), pages 351-365, March.
    16. Erhao Xie, 2019. "Monetary Payoff and Utility Function in Adaptive Learning Models," Staff Working Papers 19-50, Bank of Canada.
    17. Breitmoser, Yves, 2017. "Knowing Me, Imagining You:," Rationality and Competition Discussion Paper Series 36, CRC TRR 190 Rationality and Competition.
    18. Schuster, Stephan, 2010. "Network Formation with Adaptive Agents," MPRA Paper 27388, University Library of Munich, Germany.
    19. Asim Ansari & Ricardo Montoya & Oded Netzer, 2012. "Dynamic learning in behavioral games: A hidden Markov mixture of experts approach," Quantitative Marketing and Economics (QME), Springer, vol. 10(4), pages 475-503, December.
    20. Teck H Ho & Colin Camerer & Juin-Kuan Chong, 2003. "Functional EWA: A one-parameter theory of learning in games," Levine's Working Paper Archive 506439000000000514, David K. Levine.
    21. Edward Cartwright & Anna Stepanova, 2017. "Efficiency in a forced contribution threshold public good game," International Journal of Game Theory, Springer;Game Theory Society, vol. 46(4), pages 1163-1191, November.

    More about this item

    Keywords

    Learning; Inferred foregone payoffs; Partial information; Bertrand experiment;
    All these keywords.

    JEL classification:

    • C73 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Stochastic and Dynamic Games; Evolutionary Games
    • D43 - Microeconomics - - Market Structure, Pricing, and Design - - - Oligopoly and Other Forms of Market Imperfection
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness
    • L13 - Industrial Organization - - Market Structure, Firm Strategy, and Market Performance - - - Oligopoly and Other Imperfect Markets

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:dyncon:v:51:y:2015:i:c:p:445-458. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jedc .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.