IDEAS home Printed from https://ideas.repec.org/a/jas/jasssj/2015-7-5.html
   My bibliography  Save this article

"Anarchy" Reigns: A Quantitative Analysis of Agent-Based Modelling Publication Practices in JASSS, 2001-2012

Author

Abstract

Agent Based Modelling (ABM), a promising scientific toolset, has received criticism from some, in part, due to a claimed lack of scientific rigour, especially in the communication of its methods and results. To test the veracity of these claims, we conduct a structured analysis of over 900 scientific objects (figures, tables, or equations) that arose from 128 ABM papers published in the Journal of Artificial Societies and Social Simulation (JASSS), during the period 2001 to 2012 inclusive. Regrettably, we find considerable evidence in support of the detractors of ABM as a scientific enterprise: elementary plotting attributes are left off more often than not; basic information such as the number of replicates or the basis behind a particular statistic are not included; and few, if any, established methodological communication standards are apparent. In short, 'anarchy reigns'. Whilst the study was confined only to ABM papers of JASSS, we conclude that if the ABM community wishes its approach to be accepted further afield, authors, reviewers, and editors should take the results of our work as a wake-up call.

Suggested Citation

  • Simon Angus & Behrooz Hassani-Mahmooei, 2015. ""Anarchy" Reigns: A Quantitative Analysis of Agent-Based Modelling Publication Practices in JASSS, 2001-2012," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 18(4), pages 1-16.
    • Handle: RePEc:jas:jasssj:2015-7-5
    as

    Download full text from publisher

    File URL: https://www.jasss.org/18/4/16/16.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Mark Buchanan, 2009. "Economics: Meltdown modelling," Nature, Nature, vol. 460(7256), pages 680-682, August.
    2. Nigel Gilbert & Pietro Terna, 2000. "How to build and use agent-based models in social science," Mind & Society: Cognitive Studies in Economics and Social Sciences, Springer;Fondazione Rosselli, vol. 1(1), pages 57-72, March.
    3. J. Doyne Farmer & Duncan Foley, 2009. "The economy needs agent-based modelling," Nature, Nature, vol. 460(7256), pages 685-686, August.
    4. Jean-Philippe Bouchaud, 2008. "Economics needs a scientific revolution," Nature, Nature, vol. 455(7217), pages 1181-1181, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hepburn, Cameron & Mealy, Penny, 2017. "Transformational Change: Parallels for addressing climate and development goals," INET Oxford Working Papers 2019-02, Institute for New Economic Thinking at the Oxford Martin School, University of Oxford, revised May 2019.
    2. John C. Stevenson, 2021. "Population and Inequality Dynamics in Simple Economies," Papers 2101.09817, arXiv.org, revised Aug 2021.
    3. Lee, Ju-Sung & Filatova, Tatiana & Ligmann-Zielinska, Arika & Hassani-Mahmooei, Behrooz & Stonedahl, Forrest & Lorscheid, Iris & Voinov, Alexey & Polhill, J. Gareth & Sun, Zhanli & Parker, Dawn C., 2015. "The complexities of agent-based modeling output analysis," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 18(4).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Stein, Julian Alexander Cornelius & Braun, Dieter, 2019. "Stability of a time-homogeneous system of money and antimoney in an agent-based random economy," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 520(C), pages 232-249.
    2. Nguyen, Q. & Nguyen, N.K. K. & Nguyen, L.H. N., 2019. "Dynamic topology and allometric scaling behavior on the Vietnamese stock market," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 514(C), pages 235-243.
    3. Huang, Chuangxia & Deng, Yunke & Yang, Xiaoguang & Cao, Jinde & Yang, Xin, 2021. "A network perspective of comovement and structural change: Evidence from the Chinese stock market," International Review of Financial Analysis, Elsevier, vol. 76(C).
    4. Poledna, Sebastian & Thurner, Stefan & Farmer, J. Doyne & Geanakoplos, John, 2014. "Leverage-induced systemic risk under Basle II and other credit risk policies," Journal of Banking & Finance, Elsevier, vol. 42(C), pages 199-212.
    5. Gianluca Fabiani & Nikolaos Evangelou & Tianqi Cui & Juan M. Bello-Rivas & Cristina P. Martin-Linares & Constantinos Siettos & Ioannis G. Kevrekidis, 2024. "Task-oriented machine learning surrogates for tipping points of agent-based models," Nature Communications, Nature, vol. 15(1), pages 1-13, December.
    6. Andrew Hoegh & Frank T. Manen & Mark Haroldson, 2021. "Agent-Based Models for Collective Animal Movement: Proximity-Induced State Switching," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 26(4), pages 560-579, December.
    7. Gerard Ballot & Antoine Mandel & Annick Vignes, 2015. "Agent-based modeling and economic theory: where do we stand?," Journal of Economic Interaction and Coordination, Springer;Society for Economic Science with Heterogeneous Interacting Agents, vol. 10(2), pages 199-220, October.
    8. Tommaso Ciarli & André Lorentz & Marco Valente & Maria Savona, 2019. "Structural changes and growth regimes," Journal of Evolutionary Economics, Springer, vol. 29(1), pages 119-176, March.
    9. Hazan, Aurélien, 2017. "Volume of the steady-state space of financial flows in a monetary stock-flow-consistent model," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 473(C), pages 589-602.
    10. Anirban Chakraborti & Ioane Muni Toke & Marco Patriarca & Frederic Abergel, 2011. "Econophysics review: I. Empirical facts," Quantitative Finance, Taylor & Francis Journals, vol. 11(7), pages 991-1012.
    11. Torsten Trimborn & Philipp Otte & Simon Cramer & Maximilian Beikirch & Emma Pabich & Martin Frank, 2020. "SABCEMM: A Simulator for Agent-Based Computational Economic Market Models," Computational Economics, Springer;Society for Computational Economics, vol. 55(2), pages 707-744, February.
    12. Vygintas Gontis & Aleksejus Kononovicius, 2014. "Consentaneous Agent-Based and Stochastic Model of the Financial Markets," PLOS ONE, Public Library of Science, vol. 9(7), pages 1-12, July.
    13. Yerali Gandica & Marco Valerio Geraci & Sophie Béreau & Jean-Yves Gnabo, 2018. "Fragmentation, integration and macroprudential surveillance of the US financial industry: Insights from network science," PLOS ONE, Public Library of Science, vol. 13(4), pages 1-23, April.
    14. Sylvain Mignot & Annick Vignes, 2020. "The Many Faces of Agent-Based Computational Economics: Ecology of Agents, Bottom-Up Approaches and Paradigm Shift [Les modèles multi-agents en économie, entre agents hétérogènes, approches bottom-u," Post-Print hal-02956172, HAL.
    15. Ciarli, Tommaso & Valente, Marco, 2016. "The complex interactions between economic growth and market concentration in a model of structural change," Structural Change and Economic Dynamics, Elsevier, vol. 38(C), pages 38-54.
    16. Tommaso Ciarli & Andre' Lorentz & Maria Savona & Marco Valente, 2012. "The role of technology, organisation, and demand in growth and income distribution," LEM Papers Series 2012/06, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
    17. Aur'elien Hazan, 2016. "Volume of the steady-state space of financial flows in a monetary stock-flow-consistent model," Papers 1601.00822, arXiv.org, revised Jan 2017.
    18. Torsten Trimborn & Philipp Otte & Simon Cramer & Max Beikirch & Emma Pabich & Martin Frank, 2018. "SABCEMM-A Simulator for Agent-Based Computational Economic Market Models," Papers 1801.01811, arXiv.org, revised Oct 2018.
    19. Jian Zhou & Gao-Feng Gu & Zhi-Qiang Jiang & Xiong Xiong & Wei Chen & Wei Zhang & Wei-Xing Zhou, 2017. "Computational Experiments Successfully Predict the Emergence of Autocorrelations in Ultra-High-Frequency Stock Returns," Computational Economics, Springer;Society for Computational Economics, vol. 50(4), pages 579-594, December.
    20. J. Farmer & Cameron Hepburn & Penny Mealy & Alexander Teytelboym, 2015. "A Third Wave in the Economics of Climate Change," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 62(2), pages 329-357, October.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jas:jasssj:2015-7-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Francesco Renzini (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.