IDEAS home Printed from https://ideas.repec.org/p/adl/wpaper/2013-22.html
   My bibliography  Save this paper

Learning from Inferred Foregone Payoffs

Author

Listed:
  • Ralph-C. Bayer

    (School of Economics, University of Adelaide)

  • Hang Wu

    (School of Economics, University of Adelaide)

Abstract

A player's knowledge of her own actions and the corresponding own payoffs may enable her to infer or form belief about what the payoffs would have been if she had played differently. In studies of low-information game settings, however, players' ex-post inferences and beliefs have been largely ignored by quantitative learning models. For games with large strategy spaces, the omission may seriously weaken the predictive power of a learning model. We propose an extended payoff assessment learning model which explicitly incorporates players' ex-post inferences and beliefs about the foregone payoffs for unplayed strategies. We use the model to explain the pricing and learning behavior observed in a Bertrand market experiment. Maximum likelihood estimation shows that the extended model organizes the data remarkably well at both aggregate level and individual level.

Suggested Citation

  • Ralph-C. Bayer & Hang Wu, 2013. "Learning from Inferred Foregone Payoffs," School of Economics and Public Policy Working Papers 2013-22, University of Adelaide, School of Economics and Public Policy.
  • Handle: RePEc:adl:wpaper:2013-22
    as

    Download full text from publisher

    File URL: https://media.adelaide.edu.au/economics/papers/doc/wp2013-22.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Selten, Reinhard & Stoecker, Rolf, 1986. "End behavior in sequences of finite Prisoner's Dilemma supergames A learning theory approach," Journal of Economic Behavior & Organization, Elsevier, vol. 7(1), pages 47-70, March.
    2. Genius, Margarita & Strazzera, Elisabetta, 2002. "A note about model selection and tests for non-nested contingent valuation models," Economics Letters, Elsevier, vol. 74(3), pages 363-370, February.
    3. Rajiv Sarin & Farshid Vahid, 2004. "Strategy Similarity and Coordination," Economic Journal, Royal Economic Society, vol. 114(497), pages 506-527, July.
    4. Colin F. Camerer & Teck-Hua Ho & Juin-Kuan Chong, 2004. "A Cognitive Hierarchy Model of Games," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(3), pages 861-898.
    5. Yan Chen & Fang-Fang Tang, 1998. "Learning and Incentive-Compatible Mechanisms for Public Goods Provision: An Experimental Study," Journal of Political Economy, University of Chicago Press, vol. 106(3), pages 633-662, June.
    6. Nathaniel T Wilcox, 2006. "Theories of Learning in Games and Heterogeneity Bias," Econometrica, Econometric Society, vol. 74(5), pages 1271-1292, September.
    7. Bruttel, Lisa V., 2009. "Group dynamics in experimental studies--The Bertrand Paradox revisited," Journal of Economic Behavior & Organization, Elsevier, vol. 69(1), pages 51-63, January.
    8. Reinhard Selten & Klaus Abbink & Ricarda Cox, 2005. "Learning Direction Theory and the Winner’s Curse," Experimental Economics, Springer;Economic Science Association, vol. 8(1), pages 5-20, April.
    9. Timothy N. Cason & Daniel Friedman, 1997. "Price Formation in Single Call Markets," Econometrica, Econometric Society, vol. 65(2), pages 311-346, March.
    10. Chen, Yan & Khoroshilov, Yuri, 2003. "Learning under limited information," Games and Economic Behavior, Elsevier, vol. 44(1), pages 1-25, July.
    11. Erev, Ido & Roth, Alvin E, 1998. "Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria," American Economic Review, American Economic Association, vol. 88(4), pages 848-881, September.
    12. Ralph-C. Bayer & Elke Renner & Rupert Sausgruber, 2013. "Confusion and learning in the voluntary contributions game," Experimental Economics, Springer;Economic Science Association, vol. 16(4), pages 478-496, December.
    13. Ralph-C Bayer & Changxia Ke, 2011. "Are "Rockets and Feathers" Caused by Search or Informational Frictions," Working Papers are_rockets_and_feathers_, Max Planck Institute for Tax Law and Public Finance.
    14. Vuong, Quang H, 1989. "Likelihood Ratio Tests for Model Selection and Non-nested Hypotheses," Econometrica, Econometric Society, vol. 57(2), pages 307-333, March.
    15. McKelvey Richard D. & Palfrey Thomas R., 1995. "Quantal Response Equilibria for Normal Form Games," Games and Economic Behavior, Elsevier, vol. 10(1), pages 6-38, July.
    16. Cheung, Yin-Wong & Friedman, Daniel, 1997. "Individual Learning in Normal Form Games: Some Laboratory Results," Games and Economic Behavior, Elsevier, vol. 19(1), pages 46-76, April.
    17. Colin Camerer & Teck-Hua Ho, 1999. "Experience-weighted Attraction Learning in Normal Form Games," Econometrica, Econometric Society, vol. 67(4), pages 827-874, July.
    18. Sarin, Rajiv & Vahid, Farshid, 1999. "Payoff Assessments without Probabilities: A Simple Dynamic Model of Choice," Games and Economic Behavior, Elsevier, vol. 28(2), pages 294-309, August.
    19. Vriend, Nicolaas J., 1997. "Will reasoning improve learning?," Economics Letters, Elsevier, vol. 55(1), pages 9-18, August.
    20. Ho, Teck H. & Camerer, Colin F. & Chong, Juin-Kuan, 2007. "Self-tuning experience weighted attraction learning in games," Journal of Economic Theory, Elsevier, vol. 133(1), pages 177-198, March.
    21. TeckH. Ho & Xin Wang & ColinF. Camerer, 2008. "Individual Differences in EWA Learning with Partial Payoff Information," Economic Journal, Royal Economic Society, vol. 118(525), pages 37-59, January.
    22. Brit Grosskopf, 2003. "Reinforcement and Directional Learning in the Ultimatum Game with Responder Competition," Experimental Economics, Springer;Economic Science Association, vol. 6(2), pages 141-158, October.
    23. Teck H. Ho & Xin Wang & Colin F. Camerer, 2008. "Individual Differences in EWA Learning with Partial Payoff Information," Economic Journal, Royal Economic Society, vol. 118(525), pages 37-59, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bayer, Ralph-C & Ke, Changxia, 2018. "What causes rockets and feathers? An experimental investigation," Journal of Economic Behavior & Organization, Elsevier, vol. 153(C), pages 223-237.
    2. Naoki Funai, 2019. "Convergence results on stochastic adaptive learning," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 68(4), pages 907-934, November.
    3. Funai, Naoki, 2022. "Reinforcement learning with foregone payoff information in normal form games," Journal of Economic Behavior & Organization, Elsevier, vol. 200(C), pages 638-660.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Shachat, Jason & Swarthout, J. Todd, 2012. "Learning about learning in games through experimental control of strategic interdependence," Journal of Economic Dynamics and Control, Elsevier, vol. 36(3), pages 383-402.
    2. Xie, Erhao, 2021. "Empirical properties and identification of adaptive learning models in behavioral game theory," Journal of Economic Behavior & Organization, Elsevier, vol. 191(C), pages 798-821.
    3. Teck H. Ho & Xin Wang & Colin F. Camerer, 2008. "Individual Differences in EWA Learning with Partial Payoff Information," Economic Journal, Royal Economic Society, vol. 118(525), pages 37-59, January.
    4. repec:wyi:journl:002151 is not listed on IDEAS
    5. Camerer, Colin F. & Ho, Teck-Hua, 2015. "Behavioral Game Theory Experiments and Modeling," Handbook of Game Theory with Economic Applications,, Elsevier.
    6. Wilfred Amaldoss & Teck-Hua Ho & Aradhna Krishna & Kay-Yut Chen & Preyas Desai & Ganesh Iyer & Sanjay Jain & Noah Lim & John Morgan & Ryan Oprea & Joydeep Srivasatava, 2008. "Experiments on strategic choices and markets," Marketing Letters, Springer, vol. 19(3), pages 417-429, December.
    7. Ho, Teck H. & Camerer, Colin F. & Chong, Juin-Kuan, 2007. "Self-tuning experience weighted attraction learning in games," Journal of Economic Theory, Elsevier, vol. 133(1), pages 177-198, March.
    8. Asim Ansari & Ricardo Montoya & Oded Netzer, 2012. "Dynamic learning in behavioral games: A hidden Markov mixture of experts approach," Quantitative Marketing and Economics (QME), Springer, vol. 10(4), pages 475-503, December.
    9. Erhao Xie, 2019. "Monetary Payoff and Utility Function in Adaptive Learning Models," Staff Working Papers 19-50, Bank of Canada.
    10. Chernov, G. & Susin, I., 2019. "Models of learning in games: An overview," Journal of the New Economic Association, New Economic Association, vol. 44(4), pages 77-125.
    11. Huck, Steffen & Jehiel, Philippe & Rutter, Tom, 2011. "Feedback spillover and analogy-based expectations: A multi-game experiment," Games and Economic Behavior, Elsevier, vol. 71(2), pages 351-365, March.
    12. Chmura, Thorsten & Goerg, Sebastian J. & Selten, Reinhard, 2012. "Learning in experimental 2×2 games," Games and Economic Behavior, Elsevier, vol. 76(1), pages 44-73.
    13. Breitmoser, Yves, 2019. "Knowing me, imagining you: Projection and overbidding in auctions," Games and Economic Behavior, Elsevier, vol. 113(C), pages 423-447.
    14. Schuster, Stephan, 2012. "Applications in Agent-Based Computational Economics," MPRA Paper 47201, University Library of Munich, Germany.
    15. Breitmoser, Yves, 2017. "Knowing Me, Imagining You:," Rationality and Competition Discussion Paper Series 36, CRC TRR 190 Rationality and Competition.
    16. Breitmoser, Yves & Tan, Jonathan H.W. & Zizzo, Daniel John, 2014. "On the beliefs off the path: Equilibrium refinement due to quantal response and level-k," Games and Economic Behavior, Elsevier, vol. 86(C), pages 102-125.
    17. Teck H Ho & Colin Camerer & Juin-Kuan Chong, 2003. "Functional EWA: A one-parameter theory of learning in games," Levine's Working Paper Archive 506439000000000514, David K. Levine.
    18. Schuster, Stephan, 2010. "Network Formation with Adaptive Agents," MPRA Paper 27388, University Library of Munich, Germany.
    19. Francesco Fallucchi & Jan Niederreiter & Massimo Riccaboni, 2021. "Learning and dropout in contests: an experimental approach," Theory and Decision, Springer, vol. 90(2), pages 245-278, March.
    20. Cason, Timothy N. & Friedman, Daniel & Hopkins, Ed, 2010. "Testing the TASP: An experimental investigation of learning in games with unstable equilibria," Journal of Economic Theory, Elsevier, vol. 145(6), pages 2309-2331, November.
    21. Yan Chen & Robert Gazzale, 2004. "When Does Learning in Games Generate Convergence to Nash Equilibria? The Role of Supermodularity in an Experimental Setting," American Economic Review, American Economic Association, vol. 94(5), pages 1505-1535, December.

    More about this item

    Keywords

    Learning; Ex-Post Inference; Partial Information; Bertrand Duopoly;
    All these keywords.

    JEL classification:

    • C73 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Stochastic and Dynamic Games; Evolutionary Games
    • D43 - Microeconomics - - Market Structure, Pricing, and Design - - - Oligopoly and Other Forms of Market Imperfection
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness
    • L13 - Industrial Organization - - Market Structure, Firm Strategy, and Market Performance - - - Oligopoly and Other Imperfect Markets

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:adl:wpaper:2013-22. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Qazi Haque (email available below). General contact details of provider: https://edirc.repec.org/data/decadau.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.