IDEAS home Printed from https://ideas.repec.org/a/zbw/espost/230635.html
   My bibliography  Save this article

The complexities of agent-based modeling output analysis

Author

Listed:
  • Lee, Ju-Sung
  • Filatova, Tatiana
  • Ligmann-Zielinska, Arika
  • Hassani-Mahmooei, Behrooz
  • Stonedahl, Forrest
  • Lorscheid, Iris
  • Voinov, Alexey
  • Polhill, J. Gareth
  • Sun, Zhanli
  • Parker, Dawn C.

Abstract

The proliferation of agent-based models (ABMs) in recent decades has motivated model practitioners to improve the transparency, replicability, and trust in results derived from ABMs. The complexity of ABMs has risen in stride with advances in computing power and resources, resulting in larger models with complex interactions and learning and whose outputs are often high-dimensional and require sophisticated analytical approaches. Similarly, the increasing use of data and dynamics in ABMs has further enhanced the complexity of their outputs. In this article, we offer an overview of the state-of-the-art approaches in analyzing and reporting ABM outputs highlighting challenges and outstanding issues. In particular, we examine issues surrounding variance stability (in connection with determination of appropriate number of runs and hypothesis testing), sensitivity analysis, spatio-temporal analysis, visualization, and effective communication of all these to non-technical audiences, such as various stakeholders.

Suggested Citation

  • Lee, Ju-Sung & Filatova, Tatiana & Ligmann-Zielinska, Arika & Hassani-Mahmooei, Behrooz & Stonedahl, Forrest & Lorscheid, Iris & Voinov, Alexey & Polhill, J. Gareth & Sun, Zhanli & Parker, Dawn C., 2015. "The complexities of agent-based modeling output analysis," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics.
  • Handle: RePEc:zbw:espost:230635
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/230635/1/Lee_2015_agent_based_modeling.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Wolfgang Radax & Bernhard Rengs, 2010. "Prospects and Pitfalls of Statistical Testing: Insights from Replicating the Demographic Prisoner's Dilemma," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 13(4), pages 1-1.
    2. Fonoberova, Maria & Fonoberov, Vladimir A. & Mezić, Igor, 2013. "Global sensitivity/uncertainty analysis for agent-based models," Reliability Engineering and System Safety, Elsevier, vol. 118(C), pages 8-17.
    3. Matteo Richiardi & Roberto Leombruni & Nicole J. Saam & Michele Sonnessa, 2006. "A Common Protocol for Agent-Based Social Simulation," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 9(1), pages 1-15.
    4. Filatova, Tatiana & Parker, Dawn C. & van der Veen, Anne, 2011. "The Implications of Skewed Risk Perception for a Dutch Coastal Land Market: Insights from an Agent-Based Computational Economics Model," Agricultural and Resource Economics Review, Cambridge University Press, vol. 40(3), pages 405-423, December.
    5. Amineh Ghorbani & Pieter Bots & Virginia Dignum & Gerard Dijkema, 2013. "MAIA: a Framework for Developing Agent-Based Social Simulations," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 16(2), pages 1-9.
    6. Hassani-Mahmooei, Behrooz & Parris, Brett W., 2013. "Resource scarcity, effort allocation and environmental security: An agent-based theoretical approach," Economic Modelling, Elsevier, vol. 30(C), pages 183-192.
    7. Riccardo Boero & Giangiacomo Bravo & Marco Castellani & Flaminio Squazzoni, 2010. "Why Bother with What Others Tell You? An Experimental Data-Driven Agent-Based Model," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 13(3), pages 1-6.
    8. Simon Angus & Behrooz Hassani-Mahmooei, 2015. ""Anarchy" Reigns: A Quantitative Analysis of Agent-Based Modelling Publication Practices in JASSS, 2001-2012," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 18(4), pages 1-16.
    9. Schelling, Thomas C, 1969. "Models of Segregation," American Economic Review, American Economic Association, vol. 59(2), pages 488-493, May.
    10. Filatova, Tatiana & Parker, Dawn Cassandra & van der Veen, Anne, 2011. "The Implications of Skewed Risk Perception for a Dutch Coastal Land Market: Insights from an Agent-Based Computational Economics Model," Agricultural and Resource Economics Review, Northeastern Agricultural and Resource Economics Association, vol. 40(3), pages 1-19, December.
    11. Lulseged Tamene & Quang Le & Paul Vlek, 2014. "A Landscape Planning and Management Tool for Land and Water Resources Management: An Example Application in Northern Ethiopia," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 28(2), pages 407-424, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Niamir, Leila & Filatova, Tatiana & Voinov, Alexey & Bressers, Hans, 2018. "Transition to low-carbon economy: Assessing cumulative impacts of individual behavioral changes," Energy Policy, Elsevier, vol. 118(C), pages 325-345.
    2. Allan Beltrán & David Maddison & Robert J. R. Elliott, 2018. "Assessing the Economic Benefits of Flood Defenses: A Repeat‐Sales Approach," Risk Analysis, John Wiley & Sons, vol. 38(11), pages 2340-2367, November.
    3. Giorgio Fagiolo & Mattia Guerini & Francesco Lamperti & Alessio Moneta & Andrea Roventini, 2017. "Validation of Agent-Based Models in Economics and Finance," LEM Papers Series 2017/23, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
    4. Marcel Ausloos & Herbert Dawid & Ugo Merlone, 2015. "Spatial Interactions in Agent-Based Modeling," Dynamic Modeling and Econometrics in Economics and Finance, in: Pasquale Commendatore & Saime Kayam & Ingrid Kubin (ed.), Complexity and Geographical Economics, edition 127, pages 353-377, Springer.
    5. Flaminio Squazzoni, 2010. "The impact of agent-based models in the social sciences after 15 years of incursions," History of Economic Ideas, Fabrizio Serra Editore, Pisa - Roma, vol. 18(2), pages 197-234.
    6. Jovan Žamac & Daniel Hallberg & Thomas Lindh, 2010. "Low Fertility and Long-Run Growth in an Economy with a Large Public Sector [Fécondité basse et croissance à long terme dans une économie à secteur public très développé]," European Journal of Population, Springer;European Association for Population Studies, vol. 26(2), pages 183-205, May.
    7. G. Fagiolo & C. Birchenhall & P. Windrum, 2007. "Empirical Validation in Agent-based Models: Introduction to the Special Issue," Computational Economics, Springer;Society for Computational Economics, vol. 30(3), pages 189-194, October.
    8. Robert Marks, 2007. "Validating Simulation Models: A General Framework and Four Applied Examples," Computational Economics, Springer;Society for Computational Economics, vol. 30(3), pages 265-290, October.
    9. Matteo G. Richiardi, 2017. "The Future of Agent-Based Modeling," Eastern Economic Journal, Palgrave Macmillan;Eastern Economic Association, vol. 43(2), pages 271-287, March.
    10. Luis R. Izquierdo & Segismundo S. Izquierdo & José Manuel Galán & José Ignacio Santos, 2009. "Techniques to Understand Computer Simulations: Markov Chain Analysis," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 12(1), pages 1-6.
    11. Katrin Erdlenbruch & Bruno Bonté, 2018. "Simulating the dynamics of individual adaptation to floods," Post-Print hal-02175815, HAL.
    12. Davide Secchi & Raffaello Seri, 2017. "Controlling for false negatives in agent-based models: a review of power analysis in organizational research," Computational and Mathematical Organization Theory, Springer, vol. 23(1), pages 94-121, March.
    13. Toon Haer & W. J. Wouter Botzen & Hans de Moel & Jeroen C. J. H. Aerts, 2017. "Integrating Household Risk Mitigation Behavior in Flood Risk Analysis: An Agent‐Based Model Approach," Risk Analysis, John Wiley & Sons, vol. 37(10), pages 1977-1992, October.
    14. Stuart Rossiter & Jason Noble & Keith R.W. Bell, 2010. "Social Simulations: Improving Interdisciplinary Understanding of Scientific Positioning and Validity," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 13(1), pages 1-10.
    15. Ernesto Carrella & Richard M. Bailey & Jens Koed Madsen, 2018. "Indirect inference through prediction," Papers 1807.01579, arXiv.org.
    16. Francesco Andreoli & Eugenio Peluso, 2016. "So close yet so unequal: Reconsidering spatial inequality in U.S. cities," Working Papers 21/2016, University of Verona, Department of Economics.
    17. Jeremy Pais & Scott South & Kyle Crowder, 2009. "White Flight Revisited: A Multiethnic Perspective on Neighborhood Out-Migration," Population Research and Policy Review, Springer;Southern Demographic Association (SDA), vol. 28(3), pages 321-346, June.
    18. Gandica, Yerali & Gargiulo, Floriana & Carletti, Timoteo, 2016. "Can topology reshape segregation patterns?," Chaos, Solitons & Fractals, Elsevier, vol. 90(C), pages 46-54.
    19. Lindbeck, Assar, 1997. "Incentives and Social Norms in Household Behavior," American Economic Review, American Economic Association, vol. 87(2), pages 370-377, May.
    20. Karla Hoff & Arijit Sen, 2005. "Homeownership, Community Interactions, and Segregation," American Economic Review, American Economic Association, vol. 95(4), pages 1167-1189, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:espost:230635. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://edirc.repec.org/data/zbwkide.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/zbwkide.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.