IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2502.15800.html
   My bibliography  Save this paper

LLM Trading: Analysis of LLM Agent Behavior in Experimental Asset Markets

Author

Listed:
  • Thomas Henning
  • Siddhartha M. Ojha
  • Ross Spoon
  • Jiatong Han
  • Colin F. Camerer

Abstract

This paper explores how Large Language Models (LLMs) behave in a classic experimental finance paradigm widely known for eliciting bubbles and crashes in human participants. We adapt an established trading design, where traders buy and sell a risky asset with a known fundamental value, and introduce several LLM-based agents, both in single-model markets (all traders are instances of the same LLM) and in mixed-model "battle royale" settings (multiple LLMs competing in the same market). Our findings reveal that LLMs generally exhibit a "textbook-rational" approach, pricing the asset near its fundamental value, and show only a muted tendency toward bubble formation. Further analyses indicate that LLM-based agents display less trading strategy variance in contrast to humans. Taken together, these results highlight the risk of relying on LLM-only data to replicate human-driven market phenomena, as key behavioral features, such as large emergent bubbles, were not robustly reproduced. While LLMs clearly possess the capacity for strategic decision-making, their relative consistency and rationality suggest that they do not accurately mimic human market dynamics.

Suggested Citation

  • Thomas Henning & Siddhartha M. Ojha & Ross Spoon & Jiatong Han & Colin F. Camerer, 2025. "LLM Trading: Analysis of LLM Agent Behavior in Experimental Asset Markets," Papers 2502.15800, arXiv.org, revised Apr 2025.
  • Handle: RePEc:arx:papers:2502.15800
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2502.15800
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Philip Brookins & Jason DeBacker, 2024. "Playing games with GPT: What can we learn about a large language model from canonical strategic games?," Economics Bulletin, AccessEcon, vol. 44(1), pages 25-37.
    2. Jonathan Chapman & Erik Snowberg & Stephanie W. Wang & Colin Camerer, 2024. "Dynamically Optimized Sequential Experimentation (DOSE) for Estimating Economic Preference Parameters," NBER Working Papers 33013, National Bureau of Economic Research, Inc.
    3. John J. Horton, 2023. "Large Language Models as Simulated Economic Agents: What Can We Learn from Homo Silicus?," NBER Working Papers 31122, National Bureau of Economic Research, Inc.
    4. Holt, Charles A. & Porzio, Megan & Song, Michelle Yingze, 2017. "Price bubbles, gender, and expectations in experimental asset markets," European Economic Review, Elsevier, vol. 100(C), pages 72-94.
    5. John J. Horton, 2023. "Large Language Models as Simulated Economic Agents: What Can We Learn from Homo Silicus?," Papers 2301.07543, arXiv.org.
    6. AJ A. Bostian & Charles A. Holt, 2009. "Price Bubbles with Discounting: A Web-Based Classroom Experiment," The Journal of Economic Education, Taylor & Francis Journals, vol. 40(1), pages 27-37, January.
    7. Charles A. Holt & Susan K. Laury, 2002. "Risk Aversion and Incentive Effects," American Economic Review, American Economic Association, vol. 92(5), pages 1644-1655, December.
    8. Smith, Vernon L & Suchanek, Gerry L & Williams, Arlington W, 1988. "Bubbles, Crashes, and Endogenous Expectations in Experimental Spot Asset Markets," Econometrica, Econometric Society, vol. 56(5), pages 1119-1151, September.
    9. Sara Fish & Yannai A. Gonczarowski & Ran I. Shorrer, 2024. "Algorithmic Collusion by Large Language Models," Papers 2404.00806, arXiv.org, revised Nov 2024.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. John Duffy & Jean Paul Rabanal & Olga A. Rud, 2022. "Market experiments with multiple assets: A survey," Chapters, in: Sascha Füllbrunn & Ernan Haruvy (ed.), Handbook of Experimental Finance, chapter 18, pages 213-224, Edward Elgar Publishing.
    2. Miklánek, Tomáš & Zajíček, Miroslav, 2020. "Personal traits and trading in an experimental asset market," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 86(C).
    3. Nicolas Eber & Patrick Roger & Tristan Roger, 2024. "Finance and intelligence: An overview of the literature," Journal of Economic Surveys, Wiley Blackwell, vol. 38(2), pages 503-554, April.
    4. Jingru Jia & Zehua Yuan & Junhao Pan & Paul E. McNamara & Deming Chen, 2024. "Decision-Making Behavior Evaluation Framework for LLMs under Uncertain Context," Papers 2406.05972, arXiv.org, revised Oct 2024.
    5. Halim, Edward & Riyanto, Yohanes E., 2020. "Asset markets with insider trading disclosure rule and reselling constraint: An experimental analysis," Journal of Economic Dynamics and Control, Elsevier, vol. 110(C).
    6. Kiss, Hubert J. & Kóczy, László Á. & Pintér, Ágnes & Sziklai, Balázs R., 2022. "Does risk sorting explain overpricing in experimental asset markets?," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 99(C).
    7. Ali Goli & Amandeep Singh, 2024. "Frontiers: Can Large Language Models Capture Human Preferences?," Marketing Science, INFORMS, vol. 43(4), pages 709-722, July.
    8. John Duffy & Janet Hua Jiang & Huan Xie, 2024. "Pricing Indefinitely Lived Assets: Experimental Evidence," Management Science, INFORMS, vol. 70(12), pages 8772-8790, December.
    9. Halim, Edward & Riyanto, Yohanes Eko & Roy, Nilanjan, 2016. "Price Dynamics and Consumption Smoothing in Experimental Asset Markets," MPRA Paper 71631, University Library of Munich, Germany.
    10. Ciril Bosch-Rosa & Thomas Meissner & Antoni Bosch-Domènech, 2018. "Cognitive bubbles," Experimental Economics, Springer;Economic Science Association, vol. 21(1), pages 132-153, March.
    11. Christoph Huber & Christian König-Kersting & Matteo M. Marini, 2022. "Experimenting with Financial Professionals," Working Papers 2022-07, Faculty of Economics and Statistics, Universität Innsbruck, revised Jun 2024.
    12. Nathalie Colombier & Laurent Denant Boemont & Youenn Loheac & David Masclet, 2008. "Risk aversion: an experiment with self-employed workers and salaried workers," Applied Economics Letters, Taylor & Francis Journals, vol. 15(10), pages 791-795.
    13. Simon Cornée & David Masclet & Gervais Thenet, 2012. "Credit Relationships: Evidence from Experiments with Real Bankers," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 44(5), pages 957-980, August.
    14. Kevin Leyton-Brown & Paul Milgrom & Neil Newman & Ilya Segal, 2024. "Artificial Intelligence and Market Design: Lessons Learned from Radio Spectrum Reallocation," NBER Chapters, in: New Directions in Market Design, National Bureau of Economic Research, Inc.
    15. Stephen Cheung & Stefan Palan, 2012. "Two heads are less bubbly than one: team decision-making in an experimental asset market," Experimental Economics, Springer;Economic Science Association, vol. 15(3), pages 373-397, September.
    16. Anja Janischewski & Michael Heinrich Baumann, 2025. "What are Asset Price Bubbles? A Survey on Definitions of Financial Bubbles," Chemnitz Economic Papers 065, Department of Economics, Chemnitz University of Technology.
    17. K.S. Muehlfeld & G.U. Weitzel & A. van Witteloostuijn, 2012. "Fight or freeze? Individual differences in investors’ motivational systems and trading in experimental asset markets," Working Papers 12-18, Utrecht School of Economics.
    18. Shaun P. Hargreaves Heap & Daniel John Zizzo, 2011. "Emotions and Chat in a Financial Markets Experiment," Working Paper Series 10, The Paul Woolley Centre for Capital Market Dysfunctionality, University of Technology, Sydney.
    19. Brice Corgnet & Cary Deck & Mark DeSantis & David Porter, 2022. "Forecasting Skills in Experimental Markets: Illusion or Reality?," Management Science, INFORMS, vol. 68(7), pages 5216-5232, July.
    20. Rocco Caferra & Andrea Morone & Piergiuseppe Morone & Paolo Storelli, 2022. "Professional traders’ individual and social preferences under risk: Does group's wealth matter?," Annals of Public and Cooperative Economics, Wiley Blackwell, vol. 93(4), pages 1063-1082, December.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2502.15800. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.