IDEAS home Printed from https://ideas.repec.org/a/jas/jasssj/2006-40-2.html
   My bibliography  Save this article

Empirical Validation of Agent-Based Models: Alternatives and Prospects

Author

Abstract

This paper addresses a set of methodological problems arising in the empirical validation of agent-based (AB) economics models and discusses how these are currently being tackled. These problems are generic for all those engaged in AB modelling, not just economists. The discussion is therefore of direct relevance to JASSS readers. The paper has two objectives. The first objective is the identification of a set of issues that are common to all modellers engaged in empirical validation. This gives rise to a novel taxonomy that captures the relevant dimensions along which AB modellers differ. The second objective is a focused discussion of three alternative methodological approaches being developed in AB economics - indirect calibration, the Werker-Brenner approach, and the history-friendly approach – and a set of (as yet) unresolved issues for empirical validation that require future research.

Suggested Citation

  • Paul Windrum & Giorgio Fagiolo & Alessio Moneta, 2007. "Empirical Validation of Agent-Based Models: Alternatives and Prospects," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 10(2), pages 1-8.
  • Handle: RePEc:jas:jasssj:2006-40-2
    as

    Download full text from publisher

    File URL: http://jasss.soc.surrey.ac.uk/10/2/8/8.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Giorgio Fagiolo & Luigi Marengo & Marco Valente, 2004. "Endogenous Networks In Random Population Games," Mathematical Population Studies, Taylor & Francis Journals, vol. 11(2), pages 121-147.
    2. Werker, C. & Brenner, T., 2004. "Empirical calibration of simulation models," Working Papers 04.13, Eindhoven Center for Innovation Studies.
    3. Fagiolo, Giorgio & Dosi, Giovanni, 2003. "Exploitation, exploration and innovation in a model of endogenous growth with locally interacting agents," Structural Change and Economic Dynamics, Elsevier, vol. 14(3), pages 237-273, September.
    4. Koesrinartoto, D. & Sun, Junjie & Tesfatsion, Leigh, 2005. "An agent-based computational laboratory for testing the economic reliability of wholesale power market designs," ISU General Staff Papers 200501010800001043, Iowa State University, Department of Economics.
    5. G. Fagiolo & G. Dosi & R. Gabriele, 2004. "Matching, Bargaining, And Wage Setting In An Evolutionary Model Of Labor Market And Output Dynamics," Advances in Complex Systems (ACS), World Scientific Publishing Co. Pte. Ltd., vol. 7(02), pages 157-186.
    6. Matteo Richiardi & Roberto Leombruni & Nicole J. Saam & Michele Sonnessa, 2006. "A Common Protocol for Agent-Based Social Simulation," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 9(1), pages 1-15.
    7. Uskali Maki, 2005. "Models are experiments, experiments are models," Journal of Economic Methodology, Taylor & Francis Journals, vol. 12(2), pages 303-315.
    8. Leigh TESFATSION, 1995. "How Economists Can Get Alife," Economic Report 37, Iowa State University Department of Economics.
    9. T. Brenner & P. Murmann, 2003. "The Use of Simulations in Developing," Papers on Economics and Evolution 2003-03, Philipps University Marburg, Department of Geography.
    10. Frank Schorfheide, 2000. "Loss function-based evaluation of DSGE models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(6), pages 645-670.
    11. Liebowitz, S J & Margolis, Stephen E, 1990. "The Fable of the Keys," Journal of Law and Economics, University of Chicago Press, vol. 33(1), pages 1-25, April.
    12. Lane, David A, 1993. "Artificial Worlds and Economics, Part I," Journal of Evolutionary Economics, Springer, vol. 3(2), pages 89-107, May.
    13. Tesfatsion, Leigh, 2002. "Agent-Based Computational Economics: Growing Economies from the Bottom Up," ISU General Staff Papers 200201010800001251, Iowa State University, Department of Economics.
    14. Matteo Richiardi, 2003. "The Promises and Perils of Agent-Based Computational Economics," LABORatorio R. Revelli Working Papers Series 29, LABORatorio R. Revelli, Centre for Employment Studies.
    15. Sawyer, K. R. & Beed, Clive & Sankey, H., 1997. "Underdetermination in Economics. The Duhem-Quine Thesis," Economics and Philosophy, Cambridge University Press, vol. 13(1), pages 1-23, April.
    16. Alessio Moneta, 2005. "Causality in macroeconometrics: some considerations about reductionism and realism," Journal of Economic Methodology, Taylor & Francis Journals, vol. 12(3), pages 433-453.
    17. Giovanni Dosi & Giorgio Fagiolo & Andrea Roventini, 2006. "An Evolutionary Model of Endogenous Business Cycles," Computational Economics, Springer;Society for Computational Economics, vol. 27(1), pages 3-34, February.
    18. Saviotti, Pier Paolo & Pyka, Andreas, 2004. "Economic development, qualitative change and employment creation," Structural Change and Economic Dynamics, Elsevier, vol. 15(3), pages 265-287, September.
    19. Silverberg, Gerald & Dosi, Giovanni & Orsenigo, Luigi, 1988. "Innovation, Diversity and Diffusion: A Self-organisation Model," Economic Journal, Royal Economic Society, vol. 98(393), pages 1032-1054, December.
    20. Dosi, Giovanni, 1988. "Sources, Procedures, and Microeconomic Effects of Innovation," Journal of Economic Literature, American Economic Association, vol. 26(3), pages 1120-1171, September.
    21. Brenner, Thomas, 2006. "Agent Learning Representation: Advice on Modelling Economic Learning," Handbook of Computational Economics, in: Leigh Tesfatsion & Kenneth L. Judd (ed.), Handbook of Computational Economics, edition 1, volume 2, chapter 18, pages 895-947, Elsevier.
    22. Richard R. Nelson, 1995. "Recent Evolutionary Theorizing about Economic Change," Journal of Economic Literature, American Economic Association, vol. 33(1), pages 48-90, March.
    23. Dosi, Giovanni & Nelson, Richard R, 1994. "An Introduction to Evolutionary Theories in Economics," Journal of Evolutionary Economics, Springer, vol. 4(3), pages 153-172, September.
    24. Brock, W A, 1999. "Scaling in Economics: A Reader's Guide," Industrial and Corporate Change, Oxford University Press, vol. 8(3), pages 409-446, September.
    25. Luigi Marengo & Marc Willinger, 1997. "Alternative methodologies for modelling evolutionary dynamics: Introduction," Journal of Evolutionary Economics, Springer, vol. 7(4), pages 331-338.
    26. Windrum, Paul, 1999. "Simulation models of technological innovation: A Review," Research Memorandum 005, Maastricht University, Maastricht Economic Research Institute on Innovation and Technology (MERIT).
    27. Lane, David A, 1993. "Artificial Worlds and Economics, Part II," Journal of Evolutionary Economics, Springer, vol. 3(3), pages 177-197, August.
    28. Gatti, Domenico Delli & Guilmi, Corrado Di & Gaffeo, Edoardo & Giulioni, Gianfranco & Gallegati, Mauro & Palestrini, Antonio, 2005. "A new approach to business fluctuations: heterogeneous interacting agents, scaling laws and financial fragility," Journal of Economic Behavior & Organization, Elsevier, vol. 56(4), pages 489-512, April.
    29. Roberto Leombruni, 2002. "The Methodological Status of Agent-Based Simulations," LABORatorio R. Revelli Working Papers Series 19, LABORatorio R. Revelli, Centre for Employment Studies.
    30. Delli Gatti, Domenico & Gallegati, Mauro & Giulioni, Gianfranco & Palestrini, Antonio, 2003. "Financial fragility, patterns of firms' entry and exit and aggregate dynamics," Journal of Economic Behavior & Organization, Elsevier, vol. 51(1), pages 79-97, May.
    31. Malerba, Franco, et al, 1999. "'History-Friendly' Models of Industry Evolution: The Computer Industry," Industrial and Corporate Change, Oxford University Press, vol. 8(1), pages 3-40, March.
    32. G. Silverberg & B. Verspagen, 1995. "Evolutionary Theorizing on Economic Growth," Working Papers wp95078, International Institute for Applied Systems Analysis.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Giorgio Fagiolo & Paul Windrum & Alessio Moneta, 2006. "Empirical Validation of Agent Based Models: A Critical Survey," LEM Papers Series 2006/14, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
    2. Giorgio Fagiolo & Alessio Moneta & Paul Windrum, 2007. "A Critical Guide to Empirical Validation of Agent-Based Models in Economics: Methodologies, Procedures, and Open Problems," Computational Economics, Springer;Society for Computational Economics, vol. 30(3), pages 195-226, October.
    3. Dosi, Giovanni & Fagiolo, Giorgio & Roventini, Andrea, 2010. "Schumpeter meeting Keynes: A policy-friendly model of endogenous growth and business cycles," Journal of Economic Dynamics and Control, Elsevier, vol. 34(9), pages 1748-1767, September.
    4. Garavaglia, Christian, 2010. "Modelling industrial dynamics with "History-friendly" simulations," Structural Change and Economic Dynamics, Elsevier, vol. 21(4), pages 258-275, November.
    5. Flaminio Squazzoni, 2010. "The impact of agent-based models in the social sciences after 15 years of incursions," History of Economic Ideas, Fabrizio Serra Editore, Pisa - Roma, vol. 18(2), pages 197-234.
    6. Delli Gatti,Domenico & Fagiolo,Giorgio & Gallegati,Mauro & Richiardi,Matteo & Russo,Alberto (ed.), 2018. "Agent-Based Models in Economics," Cambridge Books, Cambridge University Press, number 9781108400046, May.
    7. Giorgio Fagiolo & Mattia Guerini & Francesco Lamperti & Alessio Moneta & Andrea Roventini, 2017. "Validation of Agent-Based Models in Economics and Finance," LEM Papers Series 2017/23, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
    8. Fagiolo G. & Roventini A., 2004. "Animal Spirits, Lumpy Investment, and the Business Cycle," Computing in Economics and Finance 2004 109, Society for Computational Economics.
    9. Karolina Safarzyńska & Jeroen Bergh, 2010. "Evolutionary models in economics: a survey of methods and building blocks," Journal of Evolutionary Economics, Springer, vol. 20(3), pages 329-373, June.
    10. Giovanni Dosi & Giorgio Fagiolo & Andrea Roventini, 2005. "Animal Spirits, Lumpy Investment, and Endogenous Business Cycles," LEM Papers Series 2005/04, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
    11. G. Fagiolo & A. Roventini., 2009. "On the Scientific Status of Economic Policy: A Tale of Alternative Paradigms," VOPROSY ECONOMIKI, N.P. Redaktsiya zhurnala "Voprosy Economiki", vol. 6.
    12. Giorgio Fagiolo & Andrea Roventini, 2017. "Macroeconomic Policy in DSGE and Agent-Based Models Redux: New Developments and Challenges Ahead," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 20(1), pages 1-1.
    13. Silverberg, Gerald, 1997. "Evolutionary modeling in economics : recent history and immediate prospects," Research Memorandum 008, Maastricht University, Maastricht Economic Research Institute on Innovation and Technology (MERIT).
    14. P. Windrum, 2007. "Neo-Schumpeterian Simulation Models," Chapters, in: Horst Hanusch & Andreas Pyka (ed.), Elgar Companion to Neo-Schumpeterian Economics, chapter 26, Edward Elgar Publishing.
    15. Dosi, Giovanni & Nelson, Richard R., 2010. "Technical Change and Industrial Dynamics as Evolutionary Processes," Handbook of the Economics of Innovation, in: Bronwyn H. Hall & Nathan Rosenberg (ed.), Handbook of the Economics of Innovation, edition 1, volume 1, chapter 0, pages 51-127, Elsevier.
    16. Giovanni Dosi & Giorgio Fagiolo & Mauro Napoletano & Andrea Roventini, 2012. "Economic policies with endogenous innovation and Keynesian demand management," Chapters, in: Robert M. Solow & Jean-Philippe Touffut (ed.), What’s Right with Macroeconomics?, chapter 5, pages 110-148, Edward Elgar Publishing.
    17. Murat YILDIZOGLU, 2009. "Evolutionary approaches of economic dynamics (In French)," Cahiers du GREThA (2007-2019) 2009-16, Groupe de Recherche en Economie Théorique et Appliquée (GREThA).
    18. A. Pyka & G. Fagiolo, 2007. "Agent-based Modelling: A Methodology for Neo-Schumpetarian Economics," Chapters, in: Horst Hanusch & Andreas Pyka (ed.), Elgar Companion to Neo-Schumpeterian Economics, chapter 29, Edward Elgar Publishing.
    19. Pier-Paolo Saviotti & Andreas Pyka¤ & Bogang Jun, 0. "Diversification, structural change, and economic development," Journal of Evolutionary Economics, Springer, vol. 0, pages 1-35.
    20. Tesfatsion, Leigh, 1998. "Teaching Agent-Based Computational Economics To Graduate Students," Economic Reports 18193, Iowa State University, Department of Economics.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jas:jasssj:2006-40-2. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Flaminio Squazzoni (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.