IDEAS home Printed from https://ideas.repec.org/a/jas/jasssj/2007-61-2.html
   My bibliography  Save this article

Alternative Approaches to the Empirical Validation of Agent-Based Models

Author

Abstract

This paper draws on the metaphor of a spectrum of models ranging from the most theory-driven to the most evidence-driven. The issue of concern is the practice and criteria that will be appro- priate to validation of different models. In order to address this concern, two modelling approaches are investigated in some detailed – one from each end of our metaphorical spectrum. Windrum et al. (2007) (http://jasss.soc.surrey.ac.uk/10/2/8.html) claimed strong similarities between agent based social simulation and conventional social science – specifically econometric – approaches to empirical modelling and on that basis considered how econometric validation techniques might be used in empirical social simulations more broadly. An alternative is the approach of the French school of 'companion modelling' associated with Bousquet, Barreteau, Le Page and others which engages stakeholders in the modelling and validation process. The conventional approach is con- strained by prior theory and the French school approach by evidence. In this sense they are at opposite ends of the theory-evidence spectrum. The problems for validation identified by Windrum et al. are shown to be irrelevant to companion modelling which readily incorporate complexity due to realistically descriptive specifications of individual behaviour and social interaction. The result combines the precision of formal approaches with the richness of narrative scenarios. Companion modelling is therefore found to be practicable and to achieve what is claimed for it and this alone is a key difference from conventional social science including agent based computational economics.

Suggested Citation

  • Scott Moss, 2007. "Alternative Approaches to the Empirical Validation of Agent-Based Models," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 11(1), pages 1-5.
  • Handle: RePEc:jas:jasssj:2007-61-2
    as

    Download full text from publisher

    File URL: https://www.jasss.org/11/1/5/5.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Kun Chang Lee & Namho Lee, 2007. "CARDS: Case-Based Reasoning Decision Support Mechanism for Multi-Agent Negotiation in Mobile Commerce," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 10(2), pages 1-4.
    2. Tesfatsion, Leigh & Judd, Kenneth L., 2006. "Handbook of Computational Economics, Vol. 2: Agent-Based Computational Economics," Staff General Research Papers Archive 10368, Iowa State University, Department of Economics.
    3. Mayer, Thomas, 1975. "Selecting Economic Hypotheses by Goodness of Fit," Economic Journal, Royal Economic Society, vol. 85(340), pages 877-883, December.
    4. Wim Westera, 2007. "Peer-Allocated Instant Response (PAIR): Computational Allocation of Peer Tutors in Learning Communities," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 10(2), pages 1-5.
    5. Thorsten Chmura & Thomas Pitz, 2007. "An Extended Reinforcement Algorithm for Estimation of Human Behaviour in Experimental Congestion Games," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 10(2), pages 1-1.
    6. Guillaume Deffuant, 2006. "Comparing Extremism Propagation Patterns in Continuous Opinion Models," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 9(3), pages 1-8.
    7. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    8. J. Gareth Polhill & Edoardo Pignotti & Nicholas M. Gotts & Pete Edwards & Alun Preece, 2007. "A Semantic Grid Service for Experimentation with an Agent-Based Model of Land-Use Change," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 10(2), pages 1-2.
    9. Leigh Tesfatsion & Kenneth L. Judd (ed.), 2006. "Handbook of Computational Economics," Handbook of Computational Economics, Elsevier, edition 1, volume 2, number 2.
    10. Gilbert Peffer & Barbara Llacay, 2007. "Higher-Order Simulations: Strategic Investment Under Model-Induced Price Patterns," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 10(2), pages 1-6.
    11. Rosaria Conte & Bruce Edmonds & Scott Moss & R. Keith Sawyer, 2001. "Sociology and Social Theory in Agent Based Social Simulation: A Symposium," Computational and Mathematical Organization Theory, Springer, vol. 7(3), pages 183-205, October.
    12. Olivier Barreteau & François Bousquet & Jean-Marie Attonaty, 2001. "Role-Playing Games for Opening the Black Box of Multi-Agent Systems: Method and Lessons of Its Application to Senegal River Valley Irrigated Systems," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 4(2), pages 1-5.
    13. Eugene F. Fama, 1963. "Mandelbrot and the Stable Paretian Hypothesis," The Journal of Business, University of Chicago Press, vol. 36, pages 420-420.
    14. Malerba, Franco, et al, 1999. "'History-Friendly' Models of Industry Evolution: The Computer Industry," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 8(1), pages 3-40, March.
    15. Francesco C. Billari & Thomas Fent & Alexia Prskawetz & Jürgen Scheffran (ed.), 2006. "Agent-Based Computational Modelling," Contributions to Economics, Springer, number 978-3-7908-1721-8.
    16. Clements, Michael P & Hendry, David F, 1996. "Intercept Corrections and Structural Change," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 11(5), pages 475-494, Sept.-Oct.
    17. Arvid Oskar Ivar Hoffmann & Wander Jager & J. H. Von Eije, 2007. "Social Simulation of Stock Markets: Taking It to the Next Level," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 10(2), pages 1-7.
    18. Joshua M. Epstein & Robert L. Axtell, 1996. "Growing Artificial Societies: Social Science from the Bottom Up," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262550253, December.
    19. Engle, Robert F, 1982. "Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation," Econometrica, Econometric Society, vol. 50(4), pages 987-1007, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Christophe Le Page & Nicolas Becu & Pierre Bommel & François Bousquet, 2012. "Participatory Agent-Based Simulation for Renewable Resource Management: The Role of the Cormas Simulation Platform to Nurture a Community of Practice," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 15(1), pages 1-10.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Flaminio Squazzoni, 2010. "The impact of agent-based models in the social sciences after 15 years of incursions," History of Economic Ideas, Fabrizio Serra Editore, Pisa - Roma, vol. 18(2), pages 197-234.
    2. Troy Tassier, 2013. "Handbook of Research on Complexity, by J. Barkley Rosser, Jr. and Edward Elgar," Eastern Economic Journal, Palgrave Macmillan;Eastern Economic Association, vol. 39(1), pages 132-133.
    3. Stefano Balbi & Carlo Giupponi, 2009. "Reviewing agent-based modelling of socio-ecosystems: a methodology for the analysis of climate change adaptation and sustainability," Working Papers 2009_15, Department of Economics, University of Venice "Ca' Foscari".
    4. Detlef Seese & Christof Weinhardt & Frank Schlottmann (ed.), 2008. "Handbook on Information Technology in Finance," International Handbooks on Information Systems, Springer, number 978-3-540-49487-4, November.
    5. Antonio Doria, Francisco, 2011. "J.B. Rosser Jr. , Handbook of Research on Complexity, Edward Elgar, Cheltenham, UK--Northampton, MA, USA (2009) 436 + viii pp., index, ISBN 978 1 84542 089 5 (cased)," Journal of Economic Behavior & Organization, Elsevier, vol. 78(1-2), pages 196-204, April.
    6. Giorgio Fagiolo & Mattia Guerini & Francesco Lamperti & Alessio Moneta & Andrea Roventini, 2017. "Validation of Agent-Based Models in Economics and Finance," LEM Papers Series 2017/23, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
    7. He, Xue-Zhong & Li, Youwei, 2015. "Testing of a market fraction model and power-law behaviour in the DAX 30," Journal of Empirical Finance, Elsevier, vol. 31(C), pages 1-17.
    8. Amilon, Henrik, 2008. "Estimation of an adaptive stock market model with heterogeneous agents," Journal of Empirical Finance, Elsevier, vol. 15(2), pages 342-362, March.
    9. Xue-Zhong He & Youwei Li, 2017. "The adaptiveness in stock markets: testing the stylized facts in the DAX 30," Journal of Evolutionary Economics, Springer, vol. 27(5), pages 1071-1094, November.
    10. Carl Chiarella & Roberto Dieci & Xue-Zhong He, 2013. "Time-varying beta: a boundedly rational equilibrium approach," Journal of Evolutionary Economics, Springer, vol. 23(3), pages 609-639, July.
    11. Bauer, Christian & De Grauwe, Paul & Reitz, Stefan, 2009. "Exchange rate dynamics in a target zone--A heterogeneous expectations approach," Journal of Economic Dynamics and Control, Elsevier, vol. 33(2), pages 329-344, February.
    12. Raphaël Douady, 2019. "Managing the Downside of Active and Passive Strategies: Convexity and Fragilities," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) hal-02488589, HAL.
    13. Jovanovic, Franck & Schinckus, Christophe, 2017. "Econophysics and Financial Economics: An Emerging Dialogue," OUP Catalogue, Oxford University Press, number 9780190205034.
    14. Gaunersdorfer, Andrea & Hommes, Cars H. & Wagener, Florian O.O., 2008. "Bifurcation routes to volatility clustering under evolutionary learning," Journal of Economic Behavior & Organization, Elsevier, vol. 67(1), pages 27-47, July.
    15. Delli Gatti,Domenico & Fagiolo,Giorgio & Gallegati,Mauro & Richiardi,Matteo & Russo,Alberto (ed.), 2018. "Agent-Based Models in Economics," Cambridge Books, Cambridge University Press, number 9781108400046.
    16. Ausloos, Marcel & Jovanovic, Franck & Schinckus, Christophe, 2016. "On the “usual” misunderstandings between econophysics and finance: Some clarifications on modelling approaches and efficient market hypothesis," International Review of Financial Analysis, Elsevier, vol. 47(C), pages 7-14.
    17. Filatova, Tatiana & Parker, Dawn Cassandra & van der Veen, Anne, 2011. "The Implications of Skewed Risk Perception for a Dutch Coastal Land Market: Insights from an Agent-Based Computational Economics Model," Agricultural and Resource Economics Review, Northeastern Agricultural and Resource Economics Association, vol. 40(3), pages 1-19, December.
    18. Lucio Biggiero & Enrico Sevi, 2009. "Opportunism by cheating and its effects on industry profitability. The CIOPS model," Computational and Mathematical Organization Theory, Springer, vol. 15(3), pages 191-236, September.
    19. Carl Chiarella & Roberto Dieci & Xue-Zhong He, 2008. "Heterogeneity, Market Mechanisms, and Asset Price Dynamics," Research Paper Series 231, Quantitative Finance Research Centre, University of Technology, Sydney.
    20. Carl Chiarella & Roberto Dieci & Xue-Zhong He & Kai Li, 2013. "An evolutionary CAPM under heterogeneous beliefs," Annals of Finance, Springer, vol. 9(2), pages 185-215, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jas:jasssj:2007-61-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Francesco Renzini (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.