IDEAS home Printed from https://ideas.repec.org/a/jas/jasssj/2009-70-1.html
   My bibliography  Save this article

An Objective-Based Perspective on Assessment of Model-Supported Policy Processes

Author

Listed:

Abstract

Simulation models, being in use for a long time in natural sciences and engineering domains, are diffusing to a wider context including policy analysis studies. The differences between the nature of the domain of application, as well as the increased variety of usage partially induced by this difference naturally imply new challenges to be overcome. One of these challenges is related to the assessment of the simulation-based outcomes in terms of their reliability and relevance in the policy context being studied. The importance of this assessment is twofold. First of all, it is all about conducting a high quality policy study with effective results. However, the quality of the study does not necessarily imply acceptance of the results by the clients and/or colleagues. This problem of policy analysts increases the importance of such an assessment; an effective assessment may induce the acceptance of the conclusions drawn from the study by the clients and/or colleagues. The main objective of this paper is to introduce an objective-based assessment perspective for simulation model-supported policy studies. As a first step towards such a goal, an objective-based classification of models is introduced. Based on that, we will discuss the importance of different aspects of the assessment for each type. In doing so, we aim to provide a structured discussion that may serve as a sort of methodological guideline to be used by policy analysts, and also by clients.

Suggested Citation

  • Gönenç Yücel & Els van Daalen, 2009. "An Objective-Based Perspective on Assessment of Model-Supported Policy Processes," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 12(4), pages 1-3.
  • Handle: RePEc:jas:jasssj:2009-70-1
    as

    Download full text from publisher

    File URL: https://www.jasss.org/12/4/3/3.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Petra Ahrweiler & Nigel Gilbert, 2005. "Caffè Nero: The Evaluation of Social Simulation," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 8(4), pages 1-14.
    2. Riccardo Boero & Flaminio Squazzoni, 2005. "Does Empirical Embeddedness Matter? Methodological Issues on Agent-Based Models for Analytical Social Science," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 8(4), pages 1-6.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Nicola Lettieri, 2016. "Computational Social Science, the Evolution of Policy Design and Rule Making in Smart Societies," Future Internet, MDPI, vol. 8(2), pages 1-17, May.
    2. Yücel, Gönenç & van Daalen, Cornelia, 2012. "A simulation-based analysis of transition pathways for the Dutch electricity system," Energy Policy, Elsevier, vol. 42(C), pages 557-568.
    3. Hofbauer, Leonhard & McDowall, Will & Pye, Steve, 2022. "Challenges and opportunities for energy system modelling to foster multi-level governance of energy transitions," Renewable and Sustainable Energy Reviews, Elsevier, vol. 161(C).
    4. Li, Francis G.N. & Trutnevyte, Evelina & Strachan, Neil, 2015. "A review of socio-technical energy transition (STET) models," Technological Forecasting and Social Change, Elsevier, vol. 100(C), pages 290-305.
    5. Thomas Brenner & Claudia Werker, 2009. "Policy Advice Derived from Simulation Models," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 12(4), pages 1-2.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhai, Xueting & Zhong, Dixi & Luo, Qiuju, 2019. "Turn it around in crisis communication: An ABM approach," Annals of Tourism Research, Elsevier, vol. 79(C).
    2. Ahmed Laatabi & Nicolas Marilleau & Tri Nguyen-Huu & Hassan Hbid & Mohamed Ait Babram, 2018. "ODD+2D: An ODD Based Protocol for Mapping Data to Empirical ABMs," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 21(2), pages 1-9.
    3. Tom A. B. Snijders & Christian E. G. Steglich, 2015. "Representing Micro–Macro Linkages by Actor-based Dynamic Network Models," Sociological Methods & Research, , vol. 44(2), pages 222-271, May.
    4. Flaminio Squazzoni, 2010. "The impact of agent-based models in the social sciences after 15 years of incursions," History of Economic Ideas, Fabrizio Serra Editore, Pisa - Roma, vol. 18(2), pages 197-234.
    5. J. Gareth Polhill & Dawn C. Parker & Daniel Brown & Volker Grimm, 2008. "Using the ODD Protocol for Describing Three Agent-Based Social Simulation Models of Land-Use Change," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 11(2), pages 1-3.
    6. Sarah Wolf & Steffen Fürst & Antoine Mandel & Wiebke Lass & Daniel Lincke & Federico Pablo-Marti & Carlo Jaeger, 2013. "A multi-agent model of several economic regions," PSE - Labex "OSE-Ouvrir la Science Economique" halshs-00825217, HAL.
    7. Dehua Gao & Flaminio Squazzoni & Xiuquan Deng, 2018. "The role of cognitive artifacts in organizational routine dynamics: an agent-based model," Computational and Mathematical Organization Theory, Springer, vol. 24(4), pages 473-499, December.
    8. Margherita Vestoso, 2018. "The GDPR beyond Privacy: Data-Driven Challenges for Social Scientists, Legislators and Policy-Makers," Future Internet, MDPI, vol. 10(7), pages 1-11, July.
    9. Jannis Beese & M. Kazem Haki & Stephan Aier & Robert Winter, 2019. "Simulation-Based Research in Information Systems," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 61(4), pages 503-521, August.
    10. Garavaglia, Christian, 2010. "Modelling industrial dynamics with "History-friendly" simulations," Structural Change and Economic Dynamics, Elsevier, vol. 21(4), pages 258-275, November.
    11. Kostadinov, Fabian & Holm, Stefan & Steubing, Bernhard & Thees, Oliver & Lemm, Renato, 2014. "Simulation of a Swiss wood fuel and roundwood market: An explorative study in agent-based modeling," Forest Policy and Economics, Elsevier, vol. 38(C), pages 105-118.
    12. Diego Ferraro & Daniela Blanco & Sebasti'an Pessah & Rodrigo Castro, 2021. "Land use change in agricultural systems: an integrated ecological-social simulation model of farmer decisions and cropping system performance based on a cellular automata approach," Papers 2109.01031, arXiv.org, revised Sep 2021.
    13. Kathrin Eismann, 2021. "Diffusion and persistence of false rumors in social media networks: implications of searchability on rumor self-correction on Twitter," Journal of Business Economics, Springer, vol. 91(9), pages 1299-1329, November.
    14. Mehdizadeh, Milad & Nordfjaern, Trond & Klöckner, Christian A., 2022. "A systematic review of the agent-based modelling/simulation paradigm in mobility transition," Technological Forecasting and Social Change, Elsevier, vol. 184(C).
    15. Jasper Muis, 2010. "Simulating Political Stability and Change in the Netherlands (1998-2002): an Agent-Based Model of Party Competition with Media Effects Empirically Tested," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 13(2), pages 1-4.
    16. Li, Jinjing & O'Donoghue, Cathal, 2012. "A methodological survey of dynamic microsimulation models," MERIT Working Papers 2012-002, United Nations University - Maastricht Economic and Social Research Institute on Innovation and Technology (MERIT).
    17. Dehua Gao & Flaminio Squazzoni & Xiuquan Deng, 2018. "The Intertwining Impact of Intraorganizational and Routine Networks on Routine Replication Dynamics: An Agent-Based Model," Complexity, Hindawi, vol. 2018, pages 1-23, November.
    18. Javier Arroyo & Samer Hassan & Celia Gutiérrez & Juan Pavón, 2010. "Re-thinking simulation: a methodological approach for the application of data mining in agent-based modelling," Computational and Mathematical Organization Theory, Springer, vol. 16(4), pages 416-435, December.
    19. Ponsiglione, C. & Cannavacciuolo, L. & Primario, S. & Quinto, I. & Zollo, G., 2021. "The ambiguity of natural language as resource for organizational design: A computational analysis," Journal of Business Research, Elsevier, vol. 129(C), pages 654-665.
    20. Michele Sonnessa & Elena Tànfani & Angela Testi, 2017. "An agent-based simulation model to evaluate alternative co-payment scenarios for contributing to health systems financing," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(5), pages 591-604, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jas:jasssj:2009-70-1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Carlo Debernardi (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.