IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2404.08492.html
   My bibliography  Save this paper

Strategic Interactions between Large Language Models-based Agents in Beauty Contests

Author

Listed:
  • Siting Lu

Abstract

The growing adoption of large language models (LLMs) presents substantial potential for deeper understanding of human behaviours within game theory frameworks through simulations. Leveraging on the diverse pool of LLM types and addressing the gap in research on competitive games, this paper examines the strategic interactions among multiple types of LLM-based agents in a classical game of beauty contest. Drawing parallels to experiments involving human subjects, LLM-based agents are assessed similarly in terms of strategic levels. They demonstrate varying depth of reasoning that falls within a range of level-0 and 1, and show convergence in actions in repeated settings. Furthermore, I also explore how variations in group composition of agent types influence strategic behaviours, where I found higher proportion of fixed-strategy opponents enhances convergence for LLM-based agents, and having a mixed environment with agents of differing relative strategic levels accelerates convergence for all agents. There could also be higher average payoffs for the more intelligent agents, albeit at the expense of the less intelligent agents. These results not only provide insights into outcomes for simulated agents under specified scenarios, it also offer valuable implications for understanding strategic interactions between algorithms.

Suggested Citation

  • Siting Lu, 2024. "Strategic Interactions between Large Language Models-based Agents in Beauty Contests," Papers 2404.08492, arXiv.org.
  • Handle: RePEc:arx:papers:2404.08492
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2404.08492
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Antoni Bosch-Domènech & José G. Montalvo & Rosemarie Nagel & Albert Satorra, 2002. "One, Two, (Three), Infinity, ...: Newspaper and Lab Beauty-Contest Experiments," American Economic Review, American Economic Association, vol. 92(5), pages 1687-1701, December.
    2. Giovanna Devetag & Sibilla Guida & Luca Polonio, 2016. "An eye-tracking study of feature-based choice in one-shot games," Experimental Economics, Springer;Economic Science Association, vol. 19(1), pages 177-201, March.
    3. Zach Y. Brown & Alexander MacKay, 2023. "Competition in Pricing Algorithms," American Economic Journal: Microeconomics, American Economic Association, vol. 15(2), pages 109-156, May.
    4. Miguel A. Costa-Gomes & Georg Weizsäcker, 2008. "Stated Beliefs and Play in Normal-Form Games," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 75(3), pages 729-762.
    5. Giovanna Devetag & Sibilla Guida & Luca Polonio, 2016. "An eye-tracking study of feature-based choice in one-shot games," Experimental Economics, Springer;Economic Science Association, vol. 19(1), pages 177-201, March.
    6. John J. Horton, 2023. "Large Language Models as Simulated Economic Agents: What Can We Learn from Homo Silicus?," NBER Working Papers 31122, National Bureau of Economic Research, Inc.
    7. John J. Horton, 2023. "Large Language Models as Simulated Economic Agents: What Can We Learn from Homo Silicus?," Papers 2301.07543, arXiv.org.
    8. Colin F. Camerer & Teck-Hua Ho & Juin-Kuan Chong, 2004. "A Cognitive Hierarchy Model of Games," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(3), pages 861-898.
    9. Taylor Webb & Keith J. Holyoak & Hongjing Lu, 2023. "Emergent analogical reasoning in large language models," Nature Human Behaviour, Nature, vol. 7(9), pages 1526-1541, September.
    10. Eugenio Proto & Aldo Rustichini & Andis Sofianos, 2022. "Intelligence, Errors, and Cooperation in Repeated Interactions [Reasoning about Others’ Reasoning]," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 89(5), pages 2723-2767.
    11. Nagel, Rosemarie, 1995. "Unraveling in Guessing Games: An Experimental Study," American Economic Review, American Economic Association, vol. 85(5), pages 1313-1326, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Polonio, Luca & Coricelli, Giorgio, 2019. "Testing the level of consistency between choices and beliefs in games using eye-tracking," Games and Economic Behavior, Elsevier, vol. 113(C), pages 566-586.
    2. Joshua Zonca & Giorgio Coricelli & Luca Polonio, 2020. "Gaze patterns disclose the link between cognitive reflection and sophistication in strategic interaction," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 15(2), pages 230-245, March.
    3. Despoina Alempaki & Andrew M. Colman & Felix Kölle & Graham Loomes & Briony D. Pulford, 2022. "Investigating the failure to best respond in experimental games," Experimental Economics, Springer;Economic Science Association, vol. 25(2), pages 656-679, April.
    4. repec:cup:judgdm:v:15:y:2020:i:2:p:230-245 is not listed on IDEAS
    5. Joshua Zonca & Giorgio Coricelli & Luca Polonio, 2019. "Does exposure to alternative decision rules change gaze patterns and behavioral strategies in games?," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 5(1), pages 14-25, August.
    6. Giovanna Devetag & Sibilla Guida & Luca Polonio, 2016. "An eye-tracking study of feature-based choice in one-shot games," Experimental Economics, Springer;Economic Science Association, vol. 19(1), pages 177-201, March.
    7. Anastasia G Peshkovskaya & Tatiana S Babkina & Mikhail G Myagkov & Ivan A Kulikov & Ksenia V Ekshova & Kyle Harriff, 2017. "The socialization effect on decision making in the Prisoner's Dilemma game: An eye-tracking study," PLOS ONE, Public Library of Science, vol. 12(4), pages 1-15, April.
    8. Gill, David & Prowse, Victoria, 2012. "Cognitive ability and learning to play equilibrium: A level-k analysis," MPRA Paper 38317, University Library of Munich, Germany, revised 23 Apr 2012.
    9. J. Hausfeld & K. von Hesler & S. Goldlücke, 2021. "Strategic gaze: an interactive eye-tracking study," Experimental Economics, Springer;Economic Science Association, vol. 24(1), pages 177-205, March.
    10. Teck-Hua Ho & So-Eun Park & Xuanming Su, 2021. "A Bayesian Level- k Model in n -Person Games," Management Science, INFORMS, vol. 67(3), pages 1622-1638, March.
    11. Ye Jin, 2021. "Does level-k behavior imply level-k thinking?," Experimental Economics, Springer;Economic Science Association, vol. 24(1), pages 330-353, March.
    12. García-Pola, Bernardo, 2020. "Do people minimize regret in strategic situations? A level-k comparison," Games and Economic Behavior, Elsevier, vol. 124(C), pages 82-104.
    13. Agranov, Marina & Potamites, Elizabeth & Schotter, Andrew & Tergiman, Chloe, 2012. "Beliefs and endogenous cognitive levels: An experimental study," Games and Economic Behavior, Elsevier, vol. 75(2), pages 449-463.
    14. Bosch-Domènech, Antoni & Vriend, Nicolaas J., 2013. "On the role of non-equilibrium focal points as coordination devices," Journal of Economic Behavior & Organization, Elsevier, vol. 94(C), pages 52-67.
    15. Sergeyev, Dmitriy & Iovino, Luigi, 2018. "Central Bank Balance Sheet Policies Without Rational Expectations," CEPR Discussion Papers 13100, C.E.P.R. Discussion Papers.
    16. Haruvy, Ernan & Stahl, Dale O., 2007. "Equilibrium selection and bounded rationality in symmetric normal-form games," Journal of Economic Behavior & Organization, Elsevier, vol. 62(1), pages 98-119, January.
    17. Marchiori, Davide & Di Guida, Sibilla & Polonio, Luca, 2021. "Plasticity of strategic sophistication in interactive decision-making," Journal of Economic Theory, Elsevier, vol. 196(C).
    18. Choo, Lawrence C.Y & Kaplan, Todd R., 2014. "Explaining Behavior in the "11-20" Game," MPRA Paper 52808, University Library of Munich, Germany.
    19. Kyle Hyndman & Antoine Terracol & Jonathan Vaksmann, 2022. "Beliefs and (in)stability in normal-form games," Experimental Economics, Springer;Economic Science Association, vol. 25(4), pages 1146-1172, September.
    20. Breitmoser, Yves, 2019. "Knowing me, imagining you: Projection and overbidding in auctions," Games and Economic Behavior, Elsevier, vol. 113(C), pages 423-447.
    21. Shapiro, Dmitry & Shi, Xianwen & Zillante, Artie, 2014. "Level-k reasoning in a generalized beauty contest," Games and Economic Behavior, Elsevier, vol. 86(C), pages 308-329.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2404.08492. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.