IDEAS home Printed from https://ideas.repec.org/a/jas/jasssj/2014-43-2.html

A New Method to Evaluate Simulation Models: The Calibration Profile (CP) Algorithm

Author

Listed:

Abstract

Models of social systems generally contain free parameters that cannot be evaluated directly from data. A calibration phase is therefore necessary to assess the capacity of the model to produce the expected dynamics. However, despite the high computational cost of this calibration it doesn't produce a global picture of the relationship between the parameter space and the behaviour space of the model. The Calibration Profile (CP) algorithm is an innovative method extending the concept of automated calibration processes. It computes a profile that depicts the effect of each single parameter on the model behaviour, independently from the others. A 2-dimensional graph is thus produced exposing the impact of the parameter under study on the capacity of the model to produce expected dynamics. The first part of this paper is devoted to the formal description of the CP algorithm. In the second part,we apply it to an agent based geographical model (SimpopLocal). The analysis of the results brings to light novel insights on the model.

Suggested Citation

  • Romain Reuillon & Clara Schmitt & Ricardo De Aldama & Jean-Baptiste Mouret, 2015. "A New Method to Evaluate Simulation Models: The Calibration Profile (CP) Algorithm," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 18(1), pages 1-12.
    • Handle: RePEc:jas:jasssj:2014-43-2
    as

    Download full text from publisher

    File URL: https://www.jasss.org/18/1/12/12.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Brian J. L. Berry, 1964. "Cities As Systems Within Systems Of Cities," Papers in Regional Science, Wiley Blackwell, vol. 13(1), pages 147-163, January.
    2. A G Wilson, 1971. "A Family of Spatial Interaction Models, and Associated Developments," Environment and Planning A, , vol. 3(1), pages 1-32, March.
    3. Anne Bretagnolle & Denise Pumain, 2010. "Simulating Urban Networks through Multiscalar Space-Time Dynamics: Europe and the United States, 17th-20th Centuries," Urban Studies, Urban Studies Journal Limited, vol. 47(13), pages 2819-2839, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Antoine Peris & Evert Meijers & Maarten Ham, 2018. "The Evolution of the Systems of Cities Literature Since 1995: Schools of Thought and their Interaction," Networks and Spatial Economics, Springer, vol. 18(3), pages 533-554, September.
    2. Peter J Taylor, 2009. "Urban Economics in Thrall to Christaller: A Misguided Search for City Hierarchies in External Urban Relations," Environment and Planning A, , vol. 41(11), pages 2550-2555, November.
    3. Brian J. L. Berry, 1995. "Whither Regional Science?," International Regional Science Review, , vol. 17(3), pages 297-305, July.
    4. M. Alonso & M. Beamonte & P. Gargallo & M. Salvador, 2014. "Labour and residential accessibility: a Bayesian analysis based on Poisson gravity models with spatial effects," Journal of Geographical Systems, Springer, vol. 16(4), pages 409-439, October.
    5. Shen, Yao, 2019. "Segregation through space: A scope of the flow-based spatial interaction model," Journal of Transport Geography, Elsevier, vol. 76(C), pages 10-23.
    6. Roy Treadway, 1972. "Gradients of metropolitan dominance in turkey: Alternative models," Demography, Springer;Population Association of America (PAA), vol. 9(1), pages 13-33, February.
    7. Daniel A. Griffith & Manfred M. Fischer, 2016. "Constrained Variants of the Gravity Model and Spatial Dependence: Model Specification and Estimation Issues," Advances in Spatial Science, in: Roberto Patuelli & Giuseppe Arbia (ed.), Spatial Econometric Interaction Modelling, chapter 0, pages 37-66, Springer.
    8. Denise Pumain, 2006. "Villes et systèmes de villes dans l’économie," Revue d'Économie Financière, Programme National Persée, vol. 86(5), pages 29-46.
    9. Mikhail Rogov & Céline Rozenblat, 2018. "Urban Resilience Discourse Analysis: Towards a Multi-Level Approach to Cities," Sustainability, MDPI, vol. 10(12), pages 1-21, November.
    10. Franco Ruzzenenti, 2018. "The Prism of Elasticity in Rebound Effect Modelling: An Insight from the Freight Transport Sector," Sustainability, MDPI, vol. 10(8), pages 1-13, August.
    11. M. Centorrino & F. Ofria & D. Farinella, 2010. "Convergence and divergence processes between the Mezzogiorno and the Centre- North ten years after the adoption of the EMU," Rivista economica del Mezzogiorno, Società editrice il Mulino, issue 3, pages 453-486.
    12. Horn, Richard James, 1975. "Population, land use, and income in a central place region," ISU General Staff Papers 197501010800006421, Iowa State University, Department of Economics.
    13. Peter Wissoker & Desiree Fields & Rachel Weber & Elvin Wyly, 2014. "Rethinking Real Estate Finance in the Wake of a Boom: A Celebration of the Twentieth Anniversary of the Publication of the Double Issue on Property and Finance in Environment and Planning A," Environment and Planning A, , vol. 46(12), pages 2787-2794, December.
    14. Roy Treadway, 1969. "Social components of metropolitan population densities," Demography, Springer;Population Association of America (PAA), vol. 6(1), pages 55-74, February.
    15. John B. Parr & Keisuke Suzuki, 1973. "Settlement Populations and the Lognormal Distribution," Urban Studies, Urban Studies Journal Limited, vol. 10(3), pages 335-352, October.
    16. Marcel Ausloos & Herbert Dawid & Ugo Merlone, 2015. "Spatial Interactions in Agent-Based Modeling," Dynamic Modeling and Econometrics in Economics and Finance, in: Pasquale Commendatore & Saime Kayam & Ingrid Kubin (ed.), Complexity and Geographical Economics, edition 127, pages 353-377, Springer.
    17. Ferrari, C. & Parola, F. & Gattorna, E., 2011. "Measuring the quality of port hinterland accessibility: The Ligurian case," Transport Policy, Elsevier, vol. 18(2), pages 382-391, March.
    18. Kyoung-Ho Shin & Michael Timberlake, 2000. "World Cities in Asia: Cliques, Centrality and Connectedness," Urban Studies, Urban Studies Journal Limited, vol. 37(12), pages 2257-2285, November.
    19. Marián Halás & Pavel Klapka & Vladimír Bačík & Michal Klobučník, 2017. "The spatial equity principle in the administrative division of the Central European countries," PLOS ONE, Public Library of Science, vol. 12(11), pages 1-18, November.
    20. Xingjian Liu & Ben Derudder & Frank Witlox & Michael Hoyler, 2014. "Cities As Networks within Networks of Cities: The Evolution of the City/Firm-Duality in the World City Network, 2000–2010," Tijdschrift voor Economische en Sociale Geografie, Royal Dutch Geographical Society KNAG, vol. 105(4), pages 465-482, September.

    More about this item

    Keywords

    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jas:jasssj:2014-43-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Francesco Renzini (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.