IDEAS home Printed from https://ideas.repec.org/a/pal/easeco/v38y2012i4p525-547.html
   My bibliography  Save this article

The Empirical Validation of an Agent-based Model

Author

Listed:
  • Pasquale Cirillo

    (Institute of Mathematical Statistics and Actuarial Sciences, University of Bern, Sidlerstrasse 5, CH-3012, Bern, Switzerland.)

  • Mauro Gallegati

    (Department of Economics, Università Politecnica delle Marche, Piazzale Martelli 8, IT-60121, Ancona, Italy.)

Abstract

The aim of this paper is to empirically validate the agent-based macroeconomic model of Gaffeo et al. [2008]. We show that the microsimulated version of the model is able to replicate actual data with a satisfactory degree of precision. From a theoretical point of view, our validation approach is made up of three different steps: a calibrated microsimulation of the model with actual data, an ex-post descriptive validation of the results, and a simple calibration exercise to ameliorate the goodness-of-fit of the model. The validation procedure of this paper has been performed using Italian data.

Suggested Citation

  • Pasquale Cirillo & Mauro Gallegati, 2012. "The Empirical Validation of an Agent-based Model," Eastern Economic Journal, Palgrave Macmillan;Eastern Economic Association, vol. 38(4), pages 525-547.
  • Handle: RePEc:pal:easeco:v:38:y:2012:i:4:p:525-547
    as

    Download full text from publisher

    File URL: http://www.palgrave-journals.com/eej/journal/v38/n4/pdf/eej201134a.pdf
    File Function: Link to full text PDF
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: http://www.palgrave-journals.com/eej/journal/v38/n4/full/eej201134a.html
    File Function: Link to full text HTML
    Download Restriction: Access to full text is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. S. Alfarano & T. Lux & F. Wagner, 2007. "Empirical validation of stochastic models of interacting agents," The European Physical Journal B: Condensed Matter and Complex Systems, Springer;EDP Sciences, vol. 55(2), pages 183-187, January.
    2. Edoardo Gaffeo & Domenico Delli Gatti & Saul Desiderio & Mauro Gallegati, 2008. "Adaptive Microfoundations for Emergent Macroeconomics," Eastern Economic Journal, Palgrave Macmillan;Eastern Economic Association, vol. 34(4), pages 441-463.
    3. Fujiwara, Yoshi, 2004. "Zipf law in firms bankruptcy," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 337(1), pages 219-230.
    4. Stiglitz, Joseph E, 1989. "Financial Markets and Development," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 5(4), pages 55-68, Winter.
    5. James B. McDonald, 2008. "Some Generalized Functions for the Size Distribution of Income," Economic Studies in Inequality, Social Exclusion, and Well-Being, in: Duangkamon Chotikapanich (ed.), Modeling Income Distributions and Lorenz Curves, chapter 3, pages 37-55, Springer.
    6. Ramsden, J.J. & Kiss-Haypál, Gy., 2000. "Company size distribution in different countries," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 277(1), pages 220-227.
    7. Cirillo, Pasquale & Hüsler, Jürg, 2009. "On the upper tail of Italian firms’ size distribution," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 388(8), pages 1546-1554.
    8. Russo, Alberto & Catalano, Michele & Gaffeo, Edoardo & Gallegati, Mauro & Napoletano, Mauro, 2007. "Industrial dynamics, fiscal policy and R&D: Evidence from a computational experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 64(3-4), pages 426-447.
    9. Anders Klevmarken, 2022. "Statistical Inference in Micro-simulation Models: Incorporating External Information," International Journal of Microsimulation, International Microsimulation Association, vol. 15(1), pages 111-120.
    10. Dawid Herbert & Gemkow Simon & Harting Philipp & Kabus Kordian & Wersching Klaus & Neugart Michael, 2008. "Skills, Innovation, and Growth: An Agent-Based Policy Analysis," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 228(2-3), pages 251-275, April.
    11. Domenico Gatti & Edoardo Gaffeo & Mauro Gallegati, 2010. "Complex agent-based macroeconomics: a manifesto for a new paradigm," Journal of Economic Interaction and Coordination, Springer;Society for Economic Science with Heterogeneous Interacting Agents, vol. 5(2), pages 111-135, December.
    12. Giulio Bottazzi & Angelo Secchi, 2006. "Explaining the distribution of firm growth rates," RAND Journal of Economics, RAND Corporation, vol. 37(2), pages 235-256, June.
    13. Joseph E. Stiglitz, 1989. "Markets and Development," NBER Working Papers 2961, National Bureau of Economic Research, Inc.
    14. Gaffeo, E. & Catalano, M. & Clementi, F. & Delli Gatti, D. & Gallegati, M. & Russo, A., 2007. "Reflections on modern macroeconomics: Can we travel along a safer road?," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 382(1), pages 89-97.
    15. Okuyama, K & Takayasu, M & Takayasu, H, 1999. "Zipf's law in income distribution of companies," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 269(1), pages 125-131.
    16. Cincotti, Silvano & Raberto, Marco & Teglio, Andrea, 2010. "Credit money and macroeconomic instability in the agent-based model and simulator Eurace," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 4, pages 1-32.
    17. Gilli, M. & Winker, P., 2003. "A global optimization heuristic for estimating agent based models," Computational Statistics & Data Analysis, Elsevier, vol. 42(3), pages 299-312, March.
    18. repec:ebl:ecbull:v:15:y:2003:i:6:p:1-7 is not listed on IDEAS
    19. Hall, Bronwyn H, 1987. "The Relationship between Firm Size and Firm Growth in the U.S. Manufacturing Sector," Journal of Industrial Economics, Wiley Blackwell, vol. 35(4), pages 583-606, June.
    20. Bianchi, Carlo & Cirillo, Pasquale & Gallegati, Mauro & Vagliasindi, Pietro A., 2008. "Validation in agent-based models: An investigation on the CATS model," Journal of Economic Behavior & Organization, Elsevier, vol. 67(3-4), pages 947-964, September.
    21. Carlo Bianchi & Pasquale Cirillo & Mauro Gallegati & Pietro Vagliasindi, 2007. "Validating and Calibrating Agent-Based Models: A Case Study," Computational Economics, Springer;Society for Computational Economics, vol. 30(3), pages 245-264, October.
    22. Haber Gottfried, 2008. "Monetary and Fiscal Policy Analysis With an Agent-Based Macroeconomic Model," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 228(2-3), pages 276-295, April.
    23. Robert Axtell & Robert Axelrod & Joshua M. Epstein & Michael D. Cohen, 1995. "Aligning Simulation Models: A Case Study and Results," Working Papers 95-07-065, Santa Fe Institute.
    24. Gatti, Domenico Delli & Guilmi, Corrado Di & Gaffeo, Edoardo & Giulioni, Gianfranco & Gallegati, Mauro & Palestrini, Antonio, 2005. "A new approach to business fluctuations: heterogeneous interacting agents, scaling laws and financial fragility," Journal of Economic Behavior & Organization, Elsevier, vol. 56(4), pages 489-512, April.
    25. Cirillo, Pasquale, 2010. "An analysis of the size distribution of Italian firms by age," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 389(3), pages 459-466.
    26. Giorgio Fagiolo & Alessio Moneta & Paul Windrum, 2007. "A Critical Guide to Empirical Validation of Agent-Based Models in Economics: Methodologies, Procedures, and Open Problems," Computational Economics, Springer;Society for Computational Economics, vol. 30(3), pages 195-226, October.
    27. Corrado Di Guilmi & Mauro Gallegati & Edoardo Gaffeo, 2003. "Power Law Scaling in the World Income Distribution," Economics Bulletin, AccessEcon, vol. 15(6), pages 1-7.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Recchioni, Maria Cristina & Tedeschi, Gabriele & Gallegati, Mauro, 2015. "A calibration procedure for analyzing stock price dynamics in an agent-based framework," Journal of Economic Dynamics and Control, Elsevier, vol. 60(C), pages 1-25.
    2. Anna Klabunde, 2014. "Computational Economic Modeling of Migration," Ruhr Economic Papers 0471, Rheinisch-Westfälisches Institut für Wirtschaftsforschung, Ruhr-Universität Bochum, Universität Dortmund, Universität Duisburg-Essen.
    3. Francesco Lamperti, 2015. "An Information Theoretic Criterion for Empirical Validation of Time Series Models," LEM Papers Series 2015/02, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
    4. Petrović, Marko & Ozel, Bulent & Teglio, Andrea & Raberto, Marco & Cincotti, Silvano, 2020. "Should I stay or should I go? An agent-based setup for a trading and monetary union," Journal of Economic Dynamics and Control, Elsevier, vol. 113(C).
    5. Teglio, Andrea & Mazzocchetti, Andrea & Ponta, Linda & Raberto, Marco & Cincotti, Silvano, 2019. "Budgetary rigour with stimulus in lean times: Policy advices from an agent-based model," Journal of Economic Behavior & Organization, Elsevier, vol. 157(C), pages 59-83.
    6. Jakob Grazzini & Matteo G. Richiardi, 2013. "Consistent Estimation of Agent-Based Models by Simulated Minimum Distance," LABORatorio R. Revelli Working Papers Series 130, LABORatorio R. Revelli, Centre for Employment Studies.
    7. Annalisa Fabretti, 2013. "On the problem of calibrating an agent based model for financial markets," Journal of Economic Interaction and Coordination, Springer;Society for Economic Science with Heterogeneous Interacting Agents, vol. 8(2), pages 277-293, October.
    8. Grazzini, Jakob & Richiardi, Matteo, 2015. "Estimation of ergodic agent-based models by simulated minimum distance," Journal of Economic Dynamics and Control, Elsevier, vol. 51(C), pages 148-165.
    9. Klabunde, Anna, 2014. "Computational Economic Modeling of Migration," Ruhr Economic Papers 471, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    10. Anna Klabunde & Frans Willekens, 2016. "Decision-Making in Agent-Based Models of Migration: State of the Art and Challenges," European Journal of Population, Springer;European Association for Population Studies, vol. 32(1), pages 73-97, February.
    11. repec:zbw:rwirep:0471 is not listed on IDEAS

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Carlo Bianchi & Pasquale Cirillo & Mauro Gallegati & Pietro Vagliasindi, 2007. "Validating and Calibrating Agent-Based Models: A Case Study," Computational Economics, Springer;Society for Computational Economics, vol. 30(3), pages 245-264, October.
    2. Bianchi, Carlo & Cirillo, Pasquale & Gallegati, Mauro & Vagliasindi, Pietro A., 2008. "Validation in agent-based models: An investigation on the CATS model," Journal of Economic Behavior & Organization, Elsevier, vol. 67(3-4), pages 947-964, September.
    3. Neveu, Andre R., 2013. "Fiscal policy and business cycle characteristics in a heterogeneous agent macro model," Journal of Economic Behavior & Organization, Elsevier, vol. 92(C), pages 224-240.
    4. Özge Dilaver & Robert Calvert Jump & Paul Levine, 2018. "Agent‐Based Macroeconomics And Dynamic Stochastic General Equilibrium Models: Where Do We Go From Here?," Journal of Economic Surveys, Wiley Blackwell, vol. 32(4), pages 1134-1159, September.
    5. Lengnick, Matthias, 2013. "Agent-based macroeconomics: A baseline model," Journal of Economic Behavior & Organization, Elsevier, vol. 86(C), pages 102-120.
    6. Wei Zhao & Yi Lu & Genfu Feng, 2019. "How Many Agents are Rational in China’s Economy? Evidence from a Heterogeneous Agent-Based New Keynesian Model," Computational Economics, Springer;Society for Computational Economics, vol. 54(2), pages 575-611, August.
    7. Luca Riccetti & Alberto Russo & Mauro Gallegati, 2015. "An agent based decentralized matching macroeconomic model," Journal of Economic Interaction and Coordination, Springer;Society for Economic Science with Heterogeneous Interacting Agents, vol. 10(2), pages 305-332, October.
    8. Dosi, Giovanni & Fagiolo, Giorgio & Napoletano, Mauro & Roventini, Andrea, 2013. "Income distribution, credit and fiscal policies in an agent-based Keynesian model," Journal of Economic Dynamics and Control, Elsevier, vol. 37(8), pages 1598-1625.
    9. Einar Erlingsson & Simone Alfarano & Marco Raberto & Hlynur Stefánsson, 2013. "On the distributional properties of size, profit and growth of Icelandic firms," Journal of Economic Interaction and Coordination, Springer;Society for Economic Science with Heterogeneous Interacting Agents, vol. 8(1), pages 57-74, April.
    10. Giorgio Fagiolo & Andrea Roventini, 2017. "Macroeconomic Policy in DSGE and Agent-Based Models Redux: New Developments and Challenges Ahead," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 20(1), pages 1-1.
    11. repec:spo:wpecon:info:hdl:2441/eu4vqp9ompqllr09j0h130d0n is not listed on IDEAS
    12. repec:hal:spmain:info:hdl:2441/dcditnq6282sbu1u151qe5p7f is not listed on IDEAS
    13. Guerini, Mattia & Moneta, Alessio, 2017. "A method for agent-based models validation," Journal of Economic Dynamics and Control, Elsevier, vol. 82(C), pages 125-141.
    14. Delli Gatti,Domenico & Fagiolo,Giorgio & Gallegati,Mauro & Richiardi,Matteo & Russo,Alberto (ed.), 2018. "Agent-Based Models in Economics," Cambridge Books, Cambridge University Press, number 9781108400046.
    15. Giorgio Fagiolo & Andrea Roventini, 2012. "Macroeconomic Policy in DSGE and Agent-Based Models," Revue de l'OFCE, Presses de Sciences-Po, vol. 0(5), pages 67-116.
    16. repec:hal:wpspec:info:hdl:2441/eu4vqp9ompqllr09j0h130d0n is not listed on IDEAS
    17. Iori, G. & Porter, J., 2012. "Agent-Based Modelling for Financial Markets," Working Papers 12/08, Department of Economics, City University London.
    18. repec:hal:spmain:info:hdl:2441/eu4vqp9ompqllr09j0h130d0n is not listed on IDEAS
    19. Giovanni Dosi & Andrea Roventini, 2017. "Agent-Based Macroeconomics and Classical Political Economy: Some Italian Roots," Italian Economic Journal: A Continuation of Rivista Italiana degli Economisti and Giornale degli Economisti, Springer;Società Italiana degli Economisti (Italian Economic Association), vol. 3(3), pages 261-283, November.
    20. Michael Neugart & Matteo G. Richiardi, 2012. "Agent-based models of the labor market," LABORatorio R. Revelli Working Papers Series 125, LABORatorio R. Revelli, Centre for Employment Studies.
    21. Ricetti, Luca & Russo, Alberto & Gallegati, Mauro, 2013. "Unemployment benefits and financial leverage in an agent based macroeconomic model," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 7, pages 1-44.
    22. Grazzini, Jakob & Richiardi, Matteo, 2015. "Estimation of ergodic agent-based models by simulated minimum distance," Journal of Economic Dynamics and Control, Elsevier, vol. 51(C), pages 148-165.
    23. Francesco Lamperti, 2015. "An Information Theoretic Criterion for Empirical Validation of Time Series Models," LEM Papers Series 2015/02, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
    24. Annalisa Fabretti, 2013. "On the problem of calibrating an agent based model for financial markets," Journal of Economic Interaction and Coordination, Springer;Society for Economic Science with Heterogeneous Interacting Agents, vol. 8(2), pages 277-293, October.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pal:easeco:v:38:y:2012:i:4:p:525-547. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.palgrave-journals.com/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.