IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2509.21862.html

Reimagining Agent-based Modeling with Large Language Model Agents via Shachi

Author

Listed:
  • So Kuroki
  • Yingtao Tian
  • Kou Misaki
  • Takashi Ikegami
  • Takuya Akiba
  • Yujin Tang

Abstract

The study of emergent behaviors in large language model (LLM)-driven multi-agent systems is a critical research challenge, yet progress is limited by a lack of principled methodologies for controlled experimentation. To address this, we introduce Shachi, a formal methodology and modular framework that decomposes an agent's policy into core cognitive components: Configuration for intrinsic traits, Memory for contextual persistence, and Tools for expanded capabilities, all orchestrated by an LLM reasoning engine. This principled architecture moves beyond brittle, ad-hoc agent designs and enables the systematic analysis of how specific architectural choices influence collective behavior. We validate our methodology on a comprehensive 10-task benchmark and demonstrate its power through novel scientific inquiries. Critically, we establish the external validity of our approach by modeling a real-world U.S. tariff shock, showing that agent behaviors align with observed market reactions only when their cognitive architecture is appropriately configured with memory and tools. Our work provides a rigorous, open-source foundation for building and evaluating LLM agents, aimed at fostering more cumulative and scientifically grounded research.

Suggested Citation

  • So Kuroki & Yingtao Tian & Kou Misaki & Takashi Ikegami & Takuya Akiba & Yujin Tang, 2025. "Reimagining Agent-based Modeling with Large Language Model Agents via Shachi," Papers 2509.21862, arXiv.org, revised Oct 2025.
  • Handle: RePEc:arx:papers:2509.21862
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2509.21862
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Benjamin S. Manning & Kehang Zhu & John J. Horton, 2024. "Automated Social Science: Language Models as Scientist and Subjects," NBER Working Papers 32381, National Bureau of Economic Research, Inc.
    2. Benjamin S. Manning & Kehang Zhu & John J. Horton, 2024. "Automated Social Science: Language Models as Scientist and Subjects," Papers 2404.11794, arXiv.org, revised Apr 2024.
    3. J. Doyne Farmer & Duncan Foley, 2009. "The economy needs agent-based modelling," Nature, Nature, vol. 460(7256), pages 685-686, August.
    4. Alan Kirman, 1993. "Ants, Rationality, and Recruitment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 108(1), pages 137-156.
    5. Taylor Webb & Keith J. Holyoak & Hongjing Lu, 2023. "Emergent analogical reasoning in large language models," Nature Human Behaviour, Nature, vol. 7(9), pages 1526-1541, September.
    6. Chen Gao & Xiaochong Lan & Nian Li & Yuan Yuan & Jingtao Ding & Zhilun Zhou & Fengli Xu & Yong Li, 2024. "Large language models empowered agent-based modeling and simulation: a survey and perspectives," Humanities and Social Sciences Communications, Palgrave Macmillan, vol. 11(1), pages 1-24, December.
    7. Leigh Tesfatsion & Kenneth L. Judd (ed.), 2006. "Handbook of Computational Economics," Handbook of Computational Economics, Elsevier, edition 1, volume 2, number 2.
    8. Nigel Gilbert & Pietro Terna, 2000. "How to build and use agent-based models in social science," Mind & Society: Cognitive Studies in Economics and Social Sciences, Springer;Fondazione Rosselli, vol. 1(1), pages 57-72, March.
    9. Tesfatsion, Leigh, 2006. "Agent-Based Computational Economics: A Constructive Approach to Economic Theory," Handbook of Computational Economics, in: Leigh Tesfatsion & Kenneth L. Judd (ed.), Handbook of Computational Economics, edition 1, volume 2, chapter 16, pages 831-880, Elsevier.
    10. Paul Davidsson, 2002. "Agent Based Social Simulation: a Computer Science View," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 5(1), pages 1-7.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Torsten Trimborn & Philipp Otte & Simon Cramer & Maximilian Beikirch & Emma Pabich & Martin Frank, 2020. "SABCEMM: A Simulator for Agent-Based Computational Economic Market Models," Computational Economics, Springer;Society for Computational Economics, vol. 55(2), pages 707-744, February.
    2. Delli Gatti,Domenico & Fagiolo,Giorgio & Gallegati,Mauro & Richiardi,Matteo & Russo,Alberto (ed.), 2018. "Agent-Based Models in Economics," Cambridge Books, Cambridge University Press, number 9781108400046, November.
    3. Georg Jäger & Laura S. Zilian & Christian Hofer & Manfred Füllsack, 2019. "Crowdworking: working with or against the crowd?," Journal of Economic Interaction and Coordination, Springer;Society for Economic Science with Heterogeneous Interacting Agents, vol. 14(4), pages 761-788, December.
    4. Kirill S. Glavatskiy & Mikhail Prokopenko & Adrian Carro & Paul Ormerod & Michael Harré, 2021. "Explaining herding and volatility in the cyclical price dynamics of urban housing markets using a large-scale agent-based model," SN Business & Economics, Springer, vol. 1(6), pages 1-21, June.
    5. Zhang, Hui & Cao, Libin & Zhang, Bing, 2017. "Emissions trading and technology adoption: An adaptive agent-based analysis of thermal power plants in China," Resources, Conservation & Recycling, Elsevier, vol. 121(C), pages 23-32.
    6. Fenintsoa Andriamasinoro & Raphael Danino-Perraud, 2021. "Use of artificial intelligence to assess mineral substance criticality in the French market: the example of cobalt," Mineral Economics, Springer;Raw Materials Group (RMG);Luleå University of Technology, vol. 34(1), pages 19-37, April.
    7. Paul De Grauwe, 2012. "Booms and busts: New Keynesian and behavioural explanations," Chapters, in: Robert M. Solow & Jean-Philippe Touffut (ed.), What’s Right with Macroeconomics?, chapter 6, pages 149-180, Edward Elgar Publishing.
    8. de Koning, Koen & Filatova, Tatiana & Bin, Okmyung, 2017. "Bridging the Gap Between Revealed and Stated Preferences in Flood-prone Housing Markets," Ecological Economics, Elsevier, vol. 136(C), pages 1-13.
    9. repec:spo:wpmain:info:hdl:2441/53r60a8s3kup1vc9l564k4686 is not listed on IDEAS
    10. Tamás Sebestyén & Dóra Longauer, 2018. "Network structure, equilibrium and dynamics in a monopolistically competitive economy," Netnomics, Springer, vol. 19(3), pages 131-157, December.
    11. Barde, Sylvain, 2016. "Direct comparison of agent-based models of herding in financial markets," Journal of Economic Dynamics and Control, Elsevier, vol. 73(C), pages 329-353.
    12. De Grauwe, Paul & Ji, Yuemei, 2017. "Structural Reforms and Monetary Policies in a Behavioural Macroeconomic Model," CEPR Discussion Papers 12336, C.E.P.R. Discussion Papers.
    13. repec:spo:wpmain:info:hdl:2441/7kr9gv74ut9ngo58gia97t83i7 is not listed on IDEAS
    14. Eveline Leeuwen & Mark Lijesen, 2016. "Agents playing Hotelling’s game: an agent-based approach to a game theoretic model," The Annals of Regional Science, Springer;Western Regional Science Association, vol. 57(2), pages 393-411, November.
    15. Alessio Emanuele Biondo, 2019. "Order book modeling and financial stability," Journal of Economic Interaction and Coordination, Springer;Society for Economic Science with Heterogeneous Interacting Agents, vol. 14(3), pages 469-489, September.
    16. Edgardo Bucciarelli & Marcello Silvestri, 2013. "Hyman P. Minsky's unorthodox approach: recent advances in simulation techniques to develop his theoretical assumptions," Journal of Post Keynesian Economics, Taylor & Francis Journals, vol. 36(2), pages 299-324.
    17. Francesco Lamperti & Giovanni Dosi & Mauro Napoletano & Andrea Roventini & Alessandro Sapio, 2018. "And then he wasn't a she : Climate change and green transitions in an agent-based integrated assessment model," Working Papers hal-03443464, HAL.
    18. Kuhle, Wolfgang, 2021. "Equilibrium with computationally constrained agents," Mathematical Social Sciences, Elsevier, vol. 109(C), pages 77-92.
    19. Chen, Shu-Heng, 2012. "Varieties of agents in agent-based computational economics: A historical and an interdisciplinary perspective," Journal of Economic Dynamics and Control, Elsevier, vol. 36(1), pages 1-25.
    20. Christ of Zöllig & Kay W. Axhausen, 2012. "Assessment of infrastructure investments using agent-based accessibility," Chapters, in: Karst T. Geurs & Kevin J. Krizek & Aura Reggiani (ed.), Accessibility Analysis and Transport Planning, chapter 4, pages 54-70, Edward Elgar Publishing.
    21. Lamperti, F. & Dosi, G. & Napoletano, M. & Roventini, A. & Sapio, A., 2020. "Climate change and green transitions in an agent-based integrated assessment model," Technological Forecasting and Social Change, Elsevier, vol. 153(C).
    22. Ciola, Emanuele & Turco, Enrico & Gurgone, Andrea & Bazzana, Davide & Vergalli, Sergio & Menoncin, Francesco, 2023. "Enter the MATRIX model:a Multi-Agent model for Transition Risks with application to energy shocks," Journal of Economic Dynamics and Control, Elsevier, vol. 146(C).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2509.21862. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.