IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2509.21862.html
   My bibliography  Save this paper

Reimagining Agent-based Modeling with Large Language Model Agents via Shachi

Author

Listed:
  • So Kuroki
  • Yingtao Tian
  • Kou Misaki
  • Takashi Ikegami
  • Takuya Akiba
  • Yujin Tang

Abstract

The study of emergent behaviors in large language model (LLM)-driven multi-agent systems is a critical research challenge, yet progress is limited by a lack of principled methodologies for controlled experimentation. To address this, we introduce Shachi, a formal methodology and modular framework that decomposes an agent's policy into core cognitive components: Configuration for intrinsic traits, Memory for contextual persistence, and Tools for expanded capabilities, all orchestrated by an LLM reasoning engine. This principled architecture moves beyond brittle, ad-hoc agent designs and enables the systematic analysis of how specific architectural choices influence collective behavior. We validate our methodology on a comprehensive 10-task benchmark and demonstrate its power through novel scientific inquiries. Critically, we establish the external validity of our approach by modeling a real-world U.S. tariff shock, showing that agent behaviors align with observed market reactions only when their cognitive architecture is appropriately configured with memory and tools. Our work provides a rigorous, open-source foundation for building and evaluating LLM agents, aimed at fostering more cumulative and scientifically grounded research.

Suggested Citation

  • So Kuroki & Yingtao Tian & Kou Misaki & Takashi Ikegami & Takuya Akiba & Yujin Tang, 2025. "Reimagining Agent-based Modeling with Large Language Model Agents via Shachi," Papers 2509.21862, arXiv.org, revised Oct 2025.
  • Handle: RePEc:arx:papers:2509.21862
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2509.21862
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Benjamin S. Manning & Kehang Zhu & John J. Horton, 2024. "Automated Social Science: Language Models as Scientist and Subjects," Papers 2404.11794, arXiv.org, revised Apr 2024.
    2. Chen Gao & Xiaochong Lan & Nian Li & Yuan Yuan & Jingtao Ding & Zhilun Zhou & Fengli Xu & Yong Li, 2024. "Large language models empowered agent-based modeling and simulation: a survey and perspectives," Humanities and Social Sciences Communications, Palgrave Macmillan, vol. 11(1), pages 1-24, December.
    3. Nigel Gilbert & Pietro Terna, 2000. "How to build and use agent-based models in social science," Mind & Society: Cognitive Studies in Economics and Social Sciences, Springer;Fondazione Rosselli, vol. 1(1), pages 57-72, March.
    4. Paul Davidsson, 2002. "Agent Based Social Simulation: a Computer Science View," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 5(1), pages 1-7.
    5. J. Doyne Farmer & Duncan Foley, 2009. "The economy needs agent-based modelling," Nature, Nature, vol. 460(7256), pages 685-686, August.
    6. Taylor Webb & Keith J. Holyoak & Hongjing Lu, 2023. "Emergent analogical reasoning in large language models," Nature Human Behaviour, Nature, vol. 7(9), pages 1526-1541, September.
    7. Alan Kirman, 1993. "Ants, Rationality, and Recruitment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 108(1), pages 137-156.
    8. Leigh Tesfatsion & Kenneth L. Judd (ed.), 2006. "Handbook of Computational Economics," Handbook of Computational Economics, Elsevier, edition 1, volume 2, number 2.
    9. Benjamin S. Manning & Kehang Zhu & John J. Horton, 2024. "Automated Social Science: Language Models as Scientist and Subjects," NBER Working Papers 32381, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Torsten Trimborn & Philipp Otte & Simon Cramer & Maximilian Beikirch & Emma Pabich & Martin Frank, 2020. "SABCEMM: A Simulator for Agent-Based Computational Economic Market Models," Computational Economics, Springer;Society for Computational Economics, vol. 55(2), pages 707-744, February.
    2. De Grauwe, Paul & Ji, Yuemei, 2017. "Structural Reforms and Monetary Policies in a Behavioural Macroeconomic Model," CEPR Discussion Papers 12336, C.E.P.R. Discussion Papers.
    3. Delli Gatti,Domenico & Fagiolo,Giorgio & Gallegati,Mauro & Richiardi,Matteo & Russo,Alberto (ed.), 2018. "Agent-Based Models in Economics," Cambridge Books, Cambridge University Press, number 9781108400046, November.
    4. Paul De Grauwe & Yuemei Ji, 2019. "Inflation Targets and the Zero Lower Bound in a Behavioural Macroeconomic Model," Economica, London School of Economics and Political Science, vol. 86(342), pages 262-299, April.
    5. Paul De Grauwe & Yuemei Ji, 2017. "Analyzing Structural Reforms Using a Behavioral Macroeconomic Model," CESifo Working Paper Series 6518, CESifo.
    6. Georg Jäger & Laura S. Zilian & Christian Hofer & Manfred Füllsack, 2019. "Crowdworking: working with or against the crowd?," Journal of Economic Interaction and Coordination, Springer;Society for Economic Science with Heterogeneous Interacting Agents, vol. 14(4), pages 761-788, December.
    7. Paul De Grauwe & Yuemei Ji, 2017. "The International Synchronisation of Business Cycles: the Role of Animal Spirits," Open Economies Review, Springer, vol. 28(3), pages 383-412, July.
    8. Kirill S. Glavatskiy & Mikhail Prokopenko & Adrian Carro & Paul Ormerod & Michael Harré, 2021. "Explaining herding and volatility in the cyclical price dynamics of urban housing markets using a large-scale agent-based model," SN Business & Economics, Springer, vol. 1(6), pages 1-21, June.
    9. Jian-Qiao Zhu & Haijiang Yan & Thomas L. Griffiths, 2024. "Language Models Trained to do Arithmetic Predict Human Risky and Intertemporal Choice," Papers 2405.19313, arXiv.org, revised May 2025.
    10. J. Silvestre, & T. Araújo & M. St. Aubyn, 2016. "Economic growth and individual satisfaction in an agent-based economy," Working Papers Department of Economics 2016/19, ISEG - Lisbon School of Economics and Management, Department of Economics, Universidade de Lisboa.
    11. Balint, T. & Lamperti, F. & Mandel, A. & Napoletano, M. & Roventini, A. & Sapio, A., 2017. "Complexity and the Economics of Climate Change: A Survey and a Look Forward," Ecological Economics, Elsevier, vol. 138(C), pages 252-265.
    12. Luca Riccetti & Alberto Russo & Mauro Gallegati, 2015. "An agent based decentralized matching macroeconomic model," Journal of Economic Interaction and Coordination, Springer;Society for Economic Science with Heterogeneous Interacting Agents, vol. 10(2), pages 305-332, October.
    13. Francesco Lamperti & Giovanni Dosi & Mauro Napoletano & Andrea Roventini & Alessandro Sapio, 2018. "And then he wasn't a she : Climate change and green transitions in an agent-based integrated assessment model," Working Papers hal-03443464, HAL.
    14. Frank Westerhoff & Martin Hohnisch, 2010. "Consumer sentiment and countercyclical fiscal policies," International Review of Applied Economics, Taylor & Francis Journals, vol. 24(5), pages 609-618.
    15. Zhang, Hui & Cao, Libin & Zhang, Bing, 2017. "Emissions trading and technology adoption: An adaptive agent-based analysis of thermal power plants in China," Resources, Conservation & Recycling, Elsevier, vol. 121(C), pages 23-32.
    16. Poledna, Sebastian & Thurner, Stefan & Farmer, J. Doyne & Geanakoplos, John, 2014. "Leverage-induced systemic risk under Basle II and other credit risk policies," Journal of Banking & Finance, Elsevier, vol. 42(C), pages 199-212.
    17. V. Alfi & L. Pietronero & A. Zaccaria, 2008. "Minimal Agent Based Model For The Origin And Self-Organization Of Stylized Facts In Financial Markets," Papers 0807.1888, arXiv.org.
    18. Yamamoto, Ryuichi, 2019. "Dynamic Predictor Selection And Order Splitting In A Limit Order Market," Macroeconomic Dynamics, Cambridge University Press, vol. 23(5), pages 1757-1792, July.
    19. Pascal Seppecher & Isabelle Salle & Dany Lang, 2019. "Is the market really a good teacher?," Journal of Evolutionary Economics, Springer, vol. 29(1), pages 299-335, March.
    20. Andrew Hoegh & Frank T. Manen & Mark Haroldson, 2021. "Agent-Based Models for Collective Animal Movement: Proximity-Induced State Switching," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 26(4), pages 560-579, December.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2509.21862. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.