IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1607.07398.html
   My bibliography  Save this paper

The fallacy of evidence based policy

Author

Listed:
  • Andrea Saltelli
  • Mario Giampietro

Abstract

The use of science for policy is at the core of a perfect storm generated by the insurgence of several concurrent crises: of science, of trust, of sustainability. The modern positivistic model of science for policy, known as evidence based policy, is based on dramatic simplifications and compressions of available perceptions of the state of affairs and possible explanations (hypocognition). This model can result in flawed prescriptions. The flaws become more evident when dealing with complex issues characterized by concomitant uncertainties in the normative, descriptive and ethical domains. In this situation evidence-based policy may concur to the fragility of the social system. Science plays an important role in reducing the feeling of vulnerability of humans by projecting a promise of protection against uncertainties. In many applications quantitative science is used to remove uncertainty by transforming it into probability, so that mathematical modelling can play the ritual role of haruspices. This epistemic governance arrangement is today in crisis. The primacy of science to adjudicate political issues must pass through an assessment of the level of maturity and effectiveness of the various disciplines deployed. The solution implies abandoning dreams of prediction, control and optimization obtained by relying on a limited set of simplified narratives to define the problem and moving instead to an open exploration of a broader set of plausible and relevant stories. Evidence based policy has to be replaced by robust policy, where robustness is tested with respect to feasibility (compatibility with processes outside human control); viability (compatibility with processes under human control, in relation to both the economic and technical dimensions), and desirability domain (compatibility with a plurality of normative considerations relevant to a plurality of actors).

Suggested Citation

  • Andrea Saltelli & Mario Giampietro, 2015. "The fallacy of evidence based policy," Papers 1607.07398, arXiv.org.
  • Handle: RePEc:arx:papers:1607.07398
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/1607.07398
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Helga Nowotny, 2003. "Democratising expertise and socially robust knowledge," Science and Public Policy, Oxford University Press, vol. 30(3), pages 151-156, June.
    2. Marion Fourcade & Etienne Ollion & Yann Algan, 2015. "The Superiority of Economists," Journal of Economic Perspectives, American Economic Association, vol. 29(1), pages 89-114, Winter.
    3. Warren Pearce & Sujatha Raman, 2014. "The new randomised controlled trials (RCT) movement in public policy: challenges of epistemic governance," Policy Sciences, Springer;Society of Policy Sciences, vol. 47(4), pages 387-402, December.
    4. Joseph E. Stiglitz, 2011. "Rethinking Macroeconomics: What Failed, And How To Repair It," Journal of the European Economic Association, European Economic Association, vol. 9(4), pages 591-645, August.
    5. Ian Boyd, 2013. "Research: A standard for policy-relevant science," Nature, Nature, vol. 501(7466), pages 159-160, September.
    6. C. Glenn Begley, 2013. "Six red flags for suspect work," Nature, Nature, vol. 497(7450), pages 433-434, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Starominski-Uehara, Marvin, 2020. "Governance in Crisis: Institutionalizing Reflective Report to Guide Decision Making Under Uncertainty," SocArXiv y3nsa, Center for Open Science.
    2. Stephan Price & Clare Saunders & Stephen Hinchliffe & Robbie A McDonald, 2017. "From contradiction to contrast in a countryside conflict: Using Q Methodology to reveal a diplomatic space for doing TB differently," Environment and Planning A, , vol. 49(11), pages 2578-2594, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Donovan, Kevin P., 2018. "The rise of the randomistas: on the experimental turn in international aid," SocArXiv xygzb, Center for Open Science.
    2. Emiliano Brancaccio & Mauro Gallegati & Raffaele Giammetti, 2022. "Neoclassical influences in agent‐based literature: A systematic review," Journal of Economic Surveys, Wiley Blackwell, vol. 36(2), pages 350-385, April.
    3. Chiasson, Guy & Angelstam, Per & Axelsson, Robert & Doyon, Frederik, 2019. "Towards collaborative forest planning in Canadian and Swedish hinterlands: Different institutional trajectories?," Land Use Policy, Elsevier, vol. 83(C), pages 334-345.
    4. Andrew Mearman & Sebastian Berger & Danielle Guizzo, 2016. "Curriculum reform in UK economics: a critique," Working Papers 20161611, Department of Accounting, Economics and Finance, Bristol Business School, University of the West of England, Bristol.
    5. Ricardo Salas & Pablo Sanabria-Pulido & Catalina Rodríguez & Pilar Torres, 2022. "Mérito, representatividad, y asimetrías en nombramientos de altos funcionarios públicos en Colombia 1991-2021," Documentos de trabajo 20768, Escuela de Gobierno - Universidad de los Andes.
    6. Goddard, Jessica J. & Kallis, Giorgos & Norgaard, Richard B., 2019. "Keeping multiple antennae up: Coevolutionary foundations for methodological pluralism," Ecological Economics, Elsevier, vol. 165(C), pages 1-1.
    7. Chen, Shu-Heng & Chang, Chia-Ling & Wen, Ming-Chang, 2014. "Social networks and macroeconomic stability," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 8, pages 1-40.
    8. Thoma, Johanna, 2018. "Book review: economics rules," LSE Research Online Documents on Economics 84173, London School of Economics and Political Science, LSE Library.
    9. Karl Beyer & Stephan Puehringer, 2019. "Divided we stand? Professional consensus and political conflict in academic economics," ICAE Working Papers 94, Johannes Kepler University, Institute for Comprehensive Analysis of the Economy.
    10. Born, Benjamin & Enders, Zeno & Müller, Gernot J., 2023. "On FIRE, news, and expectations," Working Papers 42, German Research Foundation's Priority Programme 1859 "Experience and Expectation. Historical Foundations of Economic Behaviour", Humboldt University Berlin.
    11. Jun, Bogang & Kim, Tai-Yoo, 2015. "A neo-Schumpeterian perspective on the analytical macroeconomic framework: The expanded reproduction system," Hohenheim Discussion Papers in Business, Economics and Social Sciences 11-2015, University of Hohenheim, Faculty of Business, Economics and Social Sciences.
    12. Wang, Yi-Ran & Ma, Chao-Qun & Ren, Yi-Shuai, 2022. "A model for CBDC audits based on blockchain technology: Learning from the DCEP," Research in International Business and Finance, Elsevier, vol. 63(C).
    13. Dirk Helbing, 2013. "Economics 2.0: The Natural Step towards A Self-Regulating, Participatory Market Society," Papers 1305.4078, arXiv.org, revised Jun 2013.
    14. Benchimol, Jonathan & Bounader, Lahcen, 2023. "Optimal monetary policy under bounded rationality," Journal of Financial Stability, Elsevier, vol. 67(C).
    15. Gunn, Callum J. & Bertelsen, Neil & Regeer, Barbara J. & Schuitmaker-Warnaar, Tjerk Jan, 2021. "Valuing patient engagement: Reflexive learning in evidence generation practices for health technology assessment," Social Science & Medicine, Elsevier, vol. 280(C).
    16. Jaakko Kuorikoski & Aki Lehtinen, 2018. "Model selection in macroeconomics: DSGE and ad hocness," Journal of Economic Methodology, Taylor & Francis Journals, vol. 25(3), pages 252-264, July.
    17. Jishnu Das & Quy-Toan Do, 2020. "US and them - The geography of academic research," Vox eBook Chapters, in: Sebastian Galliani & Ugo Panizza (ed.), Publishing and Measuring Success in Economics, edition 1, volume 1, chapter 1, pages 111-114, Centre for Economic Policy Research.
    18. Markus Dressel, 2022. "Models of science and society: transcending the antagonism," Palgrave Communications, Palgrave Macmillan, vol. 9(1), pages 1-15, December.
    19. Joshua Aizenman & Kenneth Kletzer, 2020. "Networking, citations of academic research, and premature death," Vox eBook Chapters, in: Sebastian Galliani & Ugo Panizza (ed.), Publishing and Measuring Success in Economics, edition 1, volume 1, chapter 1, pages 51-55, Centre for Economic Policy Research.
    20. Michael E. Rose, 2022. "Small world: Narrow, wide, and long replication of Goyal, van der Leij and Moraga‐Gonzélez (JPE 2006) and a comparison of EconLit and Scopus," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(4), pages 820-828, June.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1607.07398. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.