IDEAS home Printed from https://ideas.repec.org/a/jas/jasssj/2022-17-3.html
   My bibliography  Save this article

Equation-Based Versus Agent-Based Models: Why Not Embrace Both for an Efficient Parameter Calibration?

Author

Listed:

Abstract

In this work, we propose 2LevelCalibration, a multi-stage approach for the calibration of unknown parameters of agent-based models. First, we detail the aspects of agent-based models that make this task so cumbersome. Then, we conduct extensive research on common methods applied for this purpose in other domains, highlighting the strong points of each approach that could be explored to efficiently calibrate the parameters of agent-based models. Finally, we present a multi-stage method for this task, 2LevelCalibration, which benefits from the simplicity of equation-based models, used to faster explore a large set of possible combinations of parameters and to quickly select the more promising ones. These values are then analysed more carefully in the second step of our method, which performs the calibration of the agent-based model parameters' near the region of the search space that potentially contains the best set of parameters, previously identified in our method. This strategy outperformed traditional techniques when tested to calibrate the parameters of an agent-based model to replicate real-world observations of the housing market. With this testbed, we show that our method has highly desirable characteristics such as lightweight implementation and consistency, which are ideal for agent-based models' development process.

Suggested Citation

  • Priscilla Avegliano & Jaime Simão Sichman, 2023. "Equation-Based Versus Agent-Based Models: Why Not Embrace Both for an Efficient Parameter Calibration?," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 26(4), pages 1-3.
  • Handle: RePEc:jas:jasssj:2022-17-3
    as

    Download full text from publisher

    File URL: https://www.jasss.org/26/4/3/3.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Lamperti, Francesco & Roventini, Andrea & Sani, Amir, 2018. "Agent-based model calibration using machine learning surrogates," Journal of Economic Dynamics and Control, Elsevier, vol. 90(C), pages 366-389.
    2. Sander Hoog, 2019. "Surrogate Modelling in (and of) Agent-Based Models: A Prospectus," Computational Economics, Springer;Society for Computational Economics, vol. 53(3), pages 1245-1263, March.
    3. Fonoberova, Maria & Fonoberov, Vladimir A. & Mezić, Igor, 2013. "Global sensitivity/uncertainty analysis for agent-based models," Reliability Engineering and System Safety, Elsevier, vol. 118(C), pages 8-17.
    4. Benoit Mandelbrot & Howard M. Taylor, 1967. "On the Distribution of Stock Price Differences," Operations Research, INFORMS, vol. 15(6), pages 1057-1062, December.
    5. Ajay Jasra & Kody Law & Carina Suciu, 2020. "Advanced Multilevel Monte Carlo Methods," International Statistical Review, International Statistical Institute, vol. 88(3), pages 548-579, December.
    6. S. Conti & J. P. Gosling & J. E. Oakley & A. O'Hagan, 2009. "Gaussian process emulation of dynamic computer codes," Biometrika, Biometrika Trust, vol. 96(3), pages 663-676.
    7. Giorgio Fagiolo & Mattia Guerini & Francesco Lamperti & Alessio Moneta & Andrea Roventini, 2017. "Validation of Agent-Based Models in Economics and Finance," LEM Papers Series 2017/23, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
    8. Grazzini, Jakob & Richiardi, Matteo G. & Tsionas, Mike, 2017. "Bayesian estimation of agent-based models," Journal of Economic Dynamics and Control, Elsevier, vol. 77(C), pages 26-47.
    9. Kinal, Terrence & Lahiri, Kajal, 1983. "Specification Error Analysis with Stochastic Regressors," Econometrica, Econometric Society, vol. 51(4), pages 1209-1219, July.
    10. Shields, Michael D. & Teferra, Kirubel & Hapij, Adam & Daddazio, Raymond P., 2015. "Refined Stratified Sampling for efficient Monte Carlo based uncertainty quantification," Reliability Engineering and System Safety, Elsevier, vol. 142(C), pages 310-325.
    11. Igor Fedotenkov, 2020. "A Review of More than One Hundred Pareto-Tail Index Estimators," Statistica, Department of Statistics, University of Bologna, vol. 80(3), pages 245-299.
    12. repec:hal:spmain:info:hdl:2441/13thfd12aa8rmplfudlgvgahff is not listed on IDEAS
    13. J. Doyne Farmer & Duncan Foley, 2009. "The economy needs agent-based modelling," Nature, Nature, vol. 460(7256), pages 685-686, August.
    14. Lux, Thomas, 2018. "Estimation of agent-based models using sequential Monte Carlo methods," Journal of Economic Dynamics and Control, Elsevier, vol. 91(C), pages 391-408.
    15. Elizabeth Hunter & Brian Mac Namee & John D. Kelleher, 2017. "A Taxonomy for Agent-Based Models in Human Infectious Disease Epidemiology," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 20(3), pages 1-2.
    16. Nicolas Mauhe & Luis R. Izquierdo & Segismundo S. Izquierdo, 2023. "Social Simulation Models as Refuting Machines," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 26(2), pages 1-8.
    17. Florian Kotthoff & Thomas Hamacher, 2022. "Calibrating Agent-Based Models of Innovation Diffusion with Gradients," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 25(3), pages 1-4.
    18. Lamboni, M. & Iooss, B. & Popelin, A.-L. & Gamboa, F., 2013. "Derivative-based global sensitivity measures: General links with Sobol’ indices and numerical tests," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 87(C), pages 45-54.
    19. Jeremy E. Oakley & Anthony O'Hagan, 2004. "Probabilistic sensitivity analysis of complex models: a Bayesian approach," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 66(3), pages 751-769, August.
    20. Josie McCulloch & Jiaqi Ge & Jonathan A. Ward & Alison Heppenstall & J. Gareth Polhill & Nick Malleson, 2022. "Calibrating Agent-Based Models Using Uncertainty Quantification Methods," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 25(2), pages 1-1.
    21. Philip Vermeulen, 2018. "How Fat is the Top Tail of the Wealth Distribution?," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 64(2), pages 357-387, June.
    22. Saltelli, Andrea & Bolado, Ricardo, 1998. "An alternative way to compute Fourier amplitude sensitivity test (FAST)," Computational Statistics & Data Analysis, Elsevier, vol. 26(4), pages 445-460, February.
    23. Jan C. Thiele & Winfried Kurth & Volker Grimm, 2014. "Facilitating Parameter Estimation and Sensitivity Analysis of Agent-Based Models: A Cookbook Using NetLogo and 'R'," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 17(3), pages 1-11.
    24. Ozge Dilaver & Nigel Gilbert, 2023. "Unpacking a Black Box: A Conceptual Anatomy Framework for Agent-Based Social Simulation Models," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 26(1), pages 1-4.
    25. Jeremy Oakley, 2002. "Bayesian inference for the uncertainty distribution of computer model outputs," Biometrika, Biometrika Trust, vol. 89(4), pages 769-784, December.
    26. S Robinson, 2008. "Conceptual modelling for simulation Part II: a framework for conceptual modelling," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 59(3), pages 291-304, March.
    27. Ernesto Carrella, 2021. "No Free Lunch when Estimating Simulation Parameters," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 24(2), pages 1-7.
    28. Marc C. Kennedy & Anthony O'Hagan, 2001. "Bayesian calibration of computer models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 63(3), pages 425-464.
    29. S Robinson, 2008. "Conceptual modelling for simulation Part I: definition and requirements," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 59(3), pages 278-290, March.
    30. David L. Banks & Mevin B. Hooten, 2021. "Statistical Challenges in Agent-Based Modeling," The American Statistician, Taylor & Francis Journals, vol. 75(3), pages 235-242, July.
    31. Oliver Reinhardt & Jason Hilton & Tom Warnke & Jakub Bijak & Adelinde M. Uhrmacher, 2018. "Streamlining Simulation Experiments with Agent-Based Models in Demography," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 21(3), pages 1-9.
    32. Iris Lorscheid & Bernd-Oliver Heine & Matthias Meyer, 2012. "Opening the ‘black box’ of simulations: increased transparency and effective communication through the systematic design of experiments," Computational and Mathematical Organization Theory, Springer, vol. 18(1), pages 22-62, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Vandin, Andrea & Giachini, Daniele & Lamperti, Francesco & Chiaromonte, Francesca, 2022. "Automated and distributed statistical analysis of economic agent-based models," Journal of Economic Dynamics and Control, Elsevier, vol. 143(C).
    2. Donovan Platt, 2022. "Bayesian Estimation of Economic Simulation Models Using Neural Networks," Computational Economics, Springer;Society for Computational Economics, vol. 59(2), pages 599-650, February.
    3. Platt, Donovan, 2020. "A comparison of economic agent-based model calibration methods," Journal of Economic Dynamics and Control, Elsevier, vol. 113(C).
    4. Barde, Sylvain, 2020. "Macroeconomic simulation comparison with a multivariate extension of the Markov information criterion," Journal of Economic Dynamics and Control, Elsevier, vol. 111(C).
    5. Giorgio Fagiolo & Mattia Guerini & Francesco Lamperti & Alessio Moneta & Andrea Roventini, 2017. "Validation of Agent-Based Models in Economics and Finance," LEM Papers Series 2017/23, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
    6. Zila, Eric & Kukacka, Jiri, 2023. "Moment set selection for the SMM using simple machine learning," Journal of Economic Behavior & Organization, Elsevier, vol. 212(C), pages 366-391.
    7. Donovan Platt, 2019. "A Comparison of Economic Agent-Based Model Calibration Methods," Papers 1902.05938, arXiv.org.
    8. Andrea Vandin & Daniele Giachini & Francesco Lamperti & Francesca Chiaromonte, 2021. "Automated and Distributed Statistical Analysis of Economic Agent-Based Models," Papers 2102.05405, arXiv.org, revised Nov 2023.
    9. Kukacka, Jiri & Kristoufek, Ladislav, 2021. "Does parameterization affect the complexity of agent-based models?," Journal of Economic Behavior & Organization, Elsevier, vol. 192(C), pages 324-356.
    10. Andrea Vandin & Daniele Giachini & Francesco Lamperti & Francesca Chiaromonte, 2020. "Automated and Distributed Statistical Analysis of Economic Agent-Based Models," LEM Papers Series 2020/31, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
    11. Kukacka, Jiri & Sacht, Stephen, 2023. "Estimation of heuristic switching in behavioral macroeconomic models," Journal of Economic Dynamics and Control, Elsevier, vol. 146(C).
    12. Mario Martinoli & Alessio Moneta & Gianluca Pallante, 2022. "Calibration and Validation of Macroeconomic Simulation Models by Statistical Causal Search," LEM Papers Series 2022/33, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
    13. Lamperti, Francesco & Roventini, Andrea & Sani, Amir, 2018. "Agent-based model calibration using machine learning surrogates," Journal of Economic Dynamics and Control, Elsevier, vol. 90(C), pages 366-389.
    14. Petropoulos, G. & Wooster, M.J. & Carlson, T.N. & Kennedy, M.C. & Scholze, M., 2009. "A global Bayesian sensitivity analysis of the 1d SimSphere soil–vegetation–atmospheric transfer (SVAT) model using Gaussian model emulation," Ecological Modelling, Elsevier, vol. 220(19), pages 2427-2440.
    15. Platt, Donovan & Gebbie, Tim, 2018. "Can agent-based models probe market microstructure?," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 503(C), pages 1092-1106.
    16. Dosi, Giovanni & Roventini, Andrea & Russo, Emanuele, 2019. "Endogenous growth and global divergence in a multi-country agent-based model," Journal of Economic Dynamics and Control, Elsevier, vol. 101(C), pages 101-129.
    17. repec:hal:spmain:info:hdl:2441/20hflp7eqn97boh50no50tv67n is not listed on IDEAS
    18. Delli Gatti, Domenico & Grazzini, Jakob, 2020. "Rising to the challenge: Bayesian estimation and forecasting techniques for macroeconomic Agent Based Models," Journal of Economic Behavior & Organization, Elsevier, vol. 178(C), pages 875-902.
    19. Lamperti, F. & Dosi, G. & Napoletano, M. & Roventini, A. & Sapio, A., 2018. "Faraway, So Close: Coupled Climate and Economic Dynamics in an Agent-based Integrated Assessment Model," Ecological Economics, Elsevier, vol. 150(C), pages 315-339.
    20. Zhang, Jinyu & Zhang, Qiaosen & Li, Yong & Wang, Qianchao, 2023. "Sequential Bayesian inference for agent-based models with application to the Chinese business cycle," Economic Modelling, Elsevier, vol. 126(C).
    21. Lamperti, Francesco & Roventini, Andrea & Sani, Amir, 2018. "Agent-based model calibration using machine learning surrogates," Journal of Economic Dynamics and Control, Elsevier, vol. 90(C), pages 366-389.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jas:jasssj:2022-17-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Francesco Renzini (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.