IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0246588.html
   My bibliography  Save this article

Learning, exploitation and bias in games

Author

Listed:
  • John M McNamara
  • Alasdair I Houston
  • Olof Leimar

Abstract

We focus on learning during development in a group of individuals that play a competitive game with each other. The game has two actions and there is negative frequency dependence. We define the distribution of actions by group members to be an equilibrium configuration if no individual can improve its payoff by unilaterally changing its action. We show that at this equilibrium, one action is preferred in the sense that those taking the preferred action have a higher payoff than those taking the other, more prosocial, action. We explore the consequences of a simple ‘unbiased’ reinforcement learning rule during development, showing that groups reach an approximate equilibrium distribution, so that some achieve a higher payoff than others. Because there is learning, an individual’s behaviour can influence the future behaviour of others. We show that, as a consequence, there is the potential for an individual to exploit others by influencing them to be the ones to take the non-preferred action. Using an evolutionary simulation, we show that population members can avoid being exploited by over-valuing rewards obtained from the preferred option during learning, an example of a bias that is ‘rational’.

Suggested Citation

  • John M McNamara & Alasdair I Houston & Olof Leimar, 2021. "Learning, exploitation and bias in games," PLOS ONE, Public Library of Science, vol. 16(2), pages 1-14, February.
  • Handle: RePEc:plo:pone00:0246588
    DOI: 10.1371/journal.pone.0246588
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0246588
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0246588&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0246588?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Heifetz, Aviad & Shannon, Chris & Spiegel, Yossi, 2007. "What to maximize if you must," Journal of Economic Theory, Elsevier, vol. 133(1), pages 31-57, March.
    2. Guth, Werner, 1995. "An Evolutionary Approach to Explaining Cooperative Behavior by Reciprocal Incentives," International Journal of Game Theory, Springer;Game Theory Society, vol. 24(4), pages 323-344.
    3. Samuelson, Larry, 2001. "Introduction to the Evolution of Preferences," Journal of Economic Theory, Elsevier, vol. 97(2), pages 225-230, April.
    4. John M. McNamara & Polly Doodson, 2015. "Reputation can enhance or suppress cooperation through positive feedback," Nature Communications, Nature, vol. 6(1), pages 1-7, May.
    5. John M. McNamara & Catherine E. Gasson & Alasdair I Houston, 1999. "Incorporating rules for responding into evolutionary games," Nature, Nature, vol. 401(6751), pages 368-371, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Burkhard C. Schipper, 2021. "The evolutionary stability of optimism, pessimism, and complete ignorance," Theory and Decision, Springer, vol. 90(3), pages 417-454, May.
    2. Ingela Alger & Laurent Lehmann, 2023. "Evolution of Semi-Kantian Preferences in Two-Player Assortative Interactions with Complete and Incomplete Information and Plasticity," Dynamic Games and Applications, Springer, vol. 13(4), pages 1288-1319, December.
    3. Thomas Norman, 2004. "Dynamically Stable Preferences," Economics Series Working Papers 207, University of Oxford, Department of Economics.
    4. Norman, Thomas W.L., 2012. "Equilibrium selection and the dynamic evolution of preferences," Games and Economic Behavior, Elsevier, vol. 74(1), pages 311-320.
    5. Florian Gauer & Christoph Kuzmics, 2020. "Cognitive Empathy In Conflict Situations," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 61(4), pages 1659-1678, November.
    6. Newton, Jonathan, 2017. "Shared intentions: The evolution of collaboration," Games and Economic Behavior, Elsevier, vol. 104(C), pages 517-534.
    7. Heifetz, Aviad & Shannon, Chris & Spiegel, Yossi, 2007. "What to maximize if you must," Journal of Economic Theory, Elsevier, vol. 133(1), pages 31-57, March.
    8. Guttman, Joel M., 2013. "On the evolution of conditional cooperation," European Journal of Political Economy, Elsevier, vol. 30(C), pages 15-34.
    9. Jonathan Newton, 2018. "Evolutionary Game Theory: A Renaissance," Games, MDPI, vol. 9(2), pages 1-67, May.
    10. Heller, Yuval & Mohlin, Erik, 2019. "Coevolution of deception and preferences: Darwin and Nash meet Machiavelli," Games and Economic Behavior, Elsevier, vol. 113(C), pages 223-247.
    11. Werner Güth & Stefan Napel, 2006. "Inequality Aversion in a Variety of Games - An Indirect Evolutionary Analysis," Economic Journal, Royal Economic Society, vol. 116(514), pages 1037-1056, October.
    12. Aviad Heifetz & Chris Shannon & Yossi Spiegel, 2007. "The Dynamic Evolution of Preferences," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 32(2), pages 251-286, August.
    13. Wu, Jiabin, 2016. "Political Institutions and Preference Evolution," MPRA Paper 69597, University Library of Munich, Germany.
    14. Norman, Thomas W.L., 2008. "Dynamically stable sets in infinite strategy spaces," Games and Economic Behavior, Elsevier, vol. 62(2), pages 610-627, March.
    15. Friedman, Daniel & Singh, Nirvikar, 2009. "Equilibrium vengeance," Games and Economic Behavior, Elsevier, vol. 66(2), pages 813-829, July.
    16. Guilhem Lecouteux, 2013. "Choosing one's preferences," Working Papers hal-00864704, HAL.
    17. Aviad Heifetz & Ella Segev & Eric Talley, "undated". "Market Design with Endogenous Preferences," University of Southern California Legal Working Paper Series usclwps-1001, University of Southern California Law School.
    18. Jiabin Wu, 2020. "Labelling, homophily and preference evolution," International Journal of Game Theory, Springer;Game Theory Society, vol. 49(1), pages 1-22, March.
    19. Astrid Gamba, 2011. "On the Evolution of Preferences," Jena Economics Research Papers 2011-032, Friedrich-Schiller-University Jena.
    20. Król, Michał, 2012. "Product differentiation decisions under ambiguous consumer demand and pessimistic expectations," International Journal of Industrial Organization, Elsevier, vol. 30(6), pages 593-604.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0246588. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.