IDEAS home Printed from https://ideas.repec.org/p/osf/socarx/hpma8.html

The usefulness of algorithmic models in policy making

Author

Listed:
  • Kolkman, Daan

Abstract

Governments increasingly use algorithmic models to inform their policy making process. Many suggest that employing such quantifications will lead to more efficient, more effective or otherwise better quality policy making. Yet, it remains unclear to what extent these benefits materialize and if so, how they are brought about. This paper draws on the sociology and policy science literature to study how algorithmic models, a particular type of quantification, are used in policy analysis. It presents the outcomes of 38 unstructured interviews with data scientists, policy analysts, and policy makers that work with algorithmic models in government. Based on an in-depth analysis of these interviews, I conclude that the usefulness of algorithmic models in policy analysis is best understood in terms of the commensurability of these quantifications. However, these broad communicative and organizational benefits can only be brought about if algorithmic models are handled with care. Otherwise, they may propagate bias, exclude particular social groups, and will entrench existing worldviews.

Suggested Citation

  • Kolkman, Daan, 2020. "The usefulness of algorithmic models in policy making," SocArXiv hpma8, Center for Open Science.
    • Handle: RePEc:osf:socarx:hpma8
    DOI: 10.31219/osf.io/hpma8
    as

    Download full text from publisher

    File URL: https://osf.io/download/5ec2d85cc7d4ab002621c638/
    Download Restriction: no
    File URL: https://libkey.io/10.31219/osf.io/hpma8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. den Butter, Frank A. G. & Morgan, Mary S., 1998. "What makes the models-policy interaction successful?," Economic Modelling, Elsevier, vol. 15(3), pages 443-475, July.
    2. José Manuel Galán & Luis R. Izquierdo & Segismundo S. Izquierdo & José Ignacio Santos & Ricardo del Olmo & Adolfo López-Paredes & Bruce Edmonds, 2009. "Errors and Artefacts in Agent-Based Modelling," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 12(1), pages 1-1.
    3. Elinor Ostrom, 2010. "Analyzing collective action," Agricultural Economics, International Association of Agricultural Economists, vol. 41(s1), pages 155-166, November.
    4. Franses, Ph.H.B.F. & Kranendonk, H.C. & Lanser, D., 2007. "On the optimality of expert-adjusted forecasts," Econometric Institute Research Papers EI 2007-38, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    5. Bert Enserink & Joop F. M. Koppenjan & Igor S. Mayer, 2013. "A Policy Sciences View on Policy Analysis," International Series in Operations Research & Management Science, in: Wil A. H. Thissen & Warren E. Walker (ed.), Public Policy Analysis, edition 127, chapter 0, pages 11-40, Springer.
    6. Beunza, Daniel & Stark, David, 2012. "From dissonance to resonance: cognitive interdependence in quantitative finance," LSE Research Online Documents on Economics 45604, London School of Economics and Political Science, LSE Library.
    7. Boulanger, Paul-Marie & Brechet, Thierry, 2005. "Models for policy-making in sustainable development: The state of the art and perspectives for research," Ecological Economics, Elsevier, vol. 55(3), pages 337-350, November.
    8. Todd, Peter M., 2007. "How much information do we need?," European Journal of Operational Research, Elsevier, vol. 177(3), pages 1317-1332, March.
    9. Daniel Antony Kolkman & Paolo Campo & Tina Balke-Visser & Nigel Gilbert, 2016. "How to build models for government: criteria driving model acceptance in policymaking," Policy Sciences, Springer;Society of Policy Sciences, vol. 49(4), pages 489-504, December.
    10. Millo, Yuval & MacKenzie, Donald, 2009. "The usefulness of inaccurate models: Towards an understanding of the emergence of financial risk management," Accounting, Organizations and Society, Elsevier, vol. 34(5), pages 638-653, July.
    11. Laurence E. Lynn, 1999. "A place at the table: Policy analysis, its postpositive critics, and future of practice," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 18(3), pages 411-425.
    12. Franses, Ph.H.B.F. & Kranendonk, H.C. & Lanser, D., 2007. "On the optimality of expert-adjusted forecasts," Econometric Institute Research Papers EI 2007-38, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    13. Mackenzie, Donald, 2006. "Is Economics Performative? Option Theory and the Construction of Derivatives Markets," Journal of the History of Economic Thought, Cambridge University Press, vol. 28(1), pages 29-55, March.
    14. Wander Jager & Bruce Edmonds, 2015. "Policy Making and Modelling in a Complex World," Public Administration and Information Technology, in: Marijn Janssen & Maria A. Wimmer & Ameneh Deljoo (ed.), Policy Practice and Digital Science, edition 127, chapter 4, pages 57-73, Springer.
    15. Laurie A. Schintler & Rajendra Kulkarni, 2014. "Big Data for Policy Analysis: The Good, The Bad, and The Ugly," Review of Policy Research, Policy Studies Organization, vol. 31(4), pages 343-348, July.
    16. Veale, Michael & Van Kleek, Max & Binns, Reuben, 2018. "Fairness and Accountability Design Needs for Algorithmic Support in High-Stakes Public Sector Decision-Making," SocArXiv 8kvf4, Center for Open Science.
    17. Måns Nilsson & Andrew Jordan & John Turnpenny & Julia Hertin & Björn Nykvist & Duncan Russel, 2008. "The use and non-use of policy appraisal tools in public policy making: an analysis of three European countries and the European Union," Policy Sciences, Springer;Society of Policy Sciences, vol. 41(4), pages 335-355, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Catalin VRABIE, 2024. "Guvernarea electronică 3.0: Un model AI de soluționare automatizată a petițiilor," Smart Cities International Conference (SCIC) Proceedings, Smart-EDU Hub, Faculty of Public Administration, National University of Political Studies & Public Administration, vol. 12, pages 9-28, september.
    2. König, Pascal D. & Wenzelburger, Georg, 2021. "The legitimacy gap of algorithmic decision-making in the public sector: Why it arises and how to address it," Technology in Society, Elsevier, vol. 67(C).
    3. Catalin Vrabie, 2023. "E-Government 3.0: An AI Model to Use for Enhanced Local Democracies," Sustainability, MDPI, vol. 15(12), pages 1-19, June.
    4. Wilson, Christopher & van der Velden, Maja, 2022. "Sustainable AI: An integrated model to guide public sector decision-making," Technology in Society, Elsevier, vol. 68(C).
    5. Sivanandham, S. & Srivatsa Srinivas, S., 2025. "Enhancing food security at the last-mile: A light-weight and scalable decision support system for the public distribution system in India," Socio-Economic Planning Sciences, Elsevier, vol. 98(C).
    6. Catalin Vrabie, 2025. "From Presence to Performance: Mapping the Digital Maturity of Romanian Municipalities," Administrative Sciences, MDPI, vol. 15(4), pages 1-23, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. repec:osf:socarx:hpma8_v1 is not listed on IDEAS
    2. Thomas Wainwright, 2011. "Elite Knowledges: Framing Risk and the Geographies of Credit," Environment and Planning A, , vol. 43(3), pages 650-665, March.
    3. Reto Cueni & Bruno S. Frey, 2014. "Forecasts and Reactivity," CREMA Working Paper Series 2014-10, Center for Research in Economics, Management and the Arts (CREMA).
    4. Mitoko, Jeremiah, 2021. "Economics of Microcredit-From current crisis to new possibilities," MPRA Paper 108392, University Library of Munich, Germany.
    5. Daniel Antony Kolkman & Paolo Campo & Tina Balke-Visser & Nigel Gilbert, 2016. "How to build models for government: criteria driving model acceptance in policymaking," Policy Sciences, Springer;Society of Policy Sciences, vol. 49(4), pages 489-504, December.
    6. Mirjat, Nayyar Hussain & Uqaili, Mohammad Aslam & Harijan, Khanji & Valasai, Gordhan Das & Shaikh, Faheemullah & Waris, M., 2017. "A review of energy and power planning and policies of Pakistan," Renewable and Sustainable Energy Reviews, Elsevier, vol. 79(C), pages 110-127.
    7. Christian Berndt & Marc Boeckler, 2011. "Performative Regional (dis)Integration: Transnational Markets, Mobile Commodities, and Bordered North–South Differences," Environment and Planning A, , vol. 43(5), pages 1057-1078, May.
    8. Stine Grodal & Jaekyung Ha & Elizabeth Hood & Micah Rajunov, 2024. "Between Humans and Machines : The social construction of the generative AI category," Post-Print hal-04731673, HAL.
    9. Adewale Alola, Andrew & Ozturk, Ilhan & Bekun, Festus Victor, 2021. "Is clean energy prosperity and technological innovation rapidly mitigating sustainable energy-development deficit in selected sub-Saharan Africa? A myth or reality," Energy Policy, Elsevier, vol. 158(C).
    10. Jinhua Xie & Gangqiao Yang & Ge Wang & Shuoyan He, 2024. "How does social capital affect farmers’ environment-friendly technology adoption behavior? A case study in Hubei Province, China," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 26(7), pages 18361-18384, July.
    11. Aryanpur, Vahid & Atabaki, Mohammad Saeid & Marzband, Mousa & Siano, Pierluigi & Ghayoumi, Kiarash, 2019. "An overview of energy planning in Iran and transition pathways towards sustainable electricity supply sector," Renewable and Sustainable Energy Reviews, Elsevier, vol. 112(C), pages 58-74.
    12. Steffen S. Bettin, 2020. "Electricity infrastructure and innovation in the next phase of energy transition—amendments to the technology innovation system framework," Review of Evolutionary Political Economy, Springer, vol. 1(3), pages 371-395, November.
    13. Robert Roßner & Dimitrios Zikos, 2018. "The Role of Homogeneity and Heterogeneity Among Resource Users on Water Governance: Lessons Learnt from an Economic Field Experiment on Irrigation in Uzbekistan," Water Economics and Policy (WEP), World Scientific Publishing Co. Pte. Ltd., vol. 4(03), pages 1-30, July.
    14. Christensen, Toke Haunstrup & Friis, Freja & Bettin, Steffen & Throndsen, William & Ornetzeder, Michael & Skjølsvold, Tomas Moe & Ryghaug, Marianne, 2020. "The role of competences, engagement, and devices in configuring the impact of prices in energy demand response: Findings from three smart energy pilots with households," Energy Policy, Elsevier, vol. 137(C).
    15. Fernanda Sobrino & Adolfo De Unánue T. & Edgar Hernández & Patricia Villa & Elena Villalobos & David Aké & Stephany Cisneros & Cristian Paul Camacho Osnay & Armando García Neri & Israel Hernández, 2026. "Designing AI for Prosecutorial Governance: Case Prioritization and Statutory Oversight in Mexico," Working Paper Series of the School of Government and Public Transformation 24, School of Government and Public Transformation, Tecnológico de Monterrey.
    16. Rojas, Cristian & Cinner, Joshua, 2020. "Do market and trust contexts spillover into public goods contributions? Evidence from experimental games in Papua New Guinea," Ecological Economics, Elsevier, vol. 174(C).
    17. Morgan Bazilian & Patrick Nussbaumer & Hans-Holger Rogner & Abeeku Brew-Hammond & Vivien Foster & Shonali Pachauri & Eric Williams & Mark Howells & Philippe Niyongabo & Lawrence Musaba & Brian Ó Galla, 2011. "Energy Access Scenarios to 2030 for the Power Sector in Sub-Saharan Africa," Working Papers 2011.68, Fondazione Eni Enrico Mattei.
    18. Guiette, Alain & Vandenbempt, Koen, 2017. "Change managerialism and micro-processes of sensemaking during change implementation," Scandinavian Journal of Management, Elsevier, vol. 33(2), pages 65-81.
    19. Giacomo Caterini, 2018. "Classifying Firms with Text Mining," DEM Working Papers 2018/09, Department of Economics and Management.
    20. Ulbricht, Lena, 2020. "Algorithmen und Politisierung [Algorithms and politicization]," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 0, pages 255-278.
    21. Hall, Matthew, 2010. "Accounting information and managerial work," LSE Research Online Documents on Economics 28539, London School of Economics and Political Science, LSE Library.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:socarx:hpma8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://arabixiv.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.