IDEAS home Printed from https://ideas.repec.org/a/zbw/espost/323980.html
   My bibliography  Save this article

The E-word – On the public acceptance of experiments

Author

Listed:
  • Fischer, Mira
  • Grewenig, Elisabeth
  • Lergetporer, Philipp
  • Werner, Katharina
  • Zeidler, Helen

Abstract

Randomized experiments are often viewed as the “gold standard” of scientific evidence, but people's skepticism towards experiments has compromised their viability in the past. We study preferences for experimental policy evaluations in a representative survey in Germany (N > 1,900). We find that a majority of 75 % supports the idea of small-scale evaluations of policies before enacting them at a large scale. Experimentally varying whether the evaluations are explicitly described as “experiments” has a precisely estimated overall zero effect on public support. Our results indicate political leeway for experimental policy evaluation, a practice that is still uncommon in Germany.

Suggested Citation

  • Fischer, Mira & Grewenig, Elisabeth & Lergetporer, Philipp & Werner, Katharina & Zeidler, Helen, 2024. "The E-word – On the public acceptance of experiments," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 235, pages 1-3.
  • Handle: RePEc:zbw:espost:323980
    DOI: 10.1016/j.econlet.2024.111558
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/323980/1/Full-text-article-Fischer-et-al-The-e-word.pdf
    Download Restriction: no

    File URL: https://libkey.io/10.1016/j.econlet.2024.111558?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. repec:feb:artefa:0106 is not listed on IDEAS
    2. James J. Heckman & Jeffrey A. Smith, 1995. "Assessing the Case for Social Experiments," Journal of Economic Perspectives, American Economic Association, vol. 9(2), pages 85-110, Spring.
    3. Freundl Vera & Grewenig Elisabeth & Kugler Franziska & Lergetporer Philipp & Schüler Ruth & Wedel Katharina & Werner Katharina & Wirth Olivia & Woessmann Ludger, 2023. "The ifo Education Survey 2014–2021: A New Dataset on Public Preferences for Education Policy in Germany," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 243(6), pages 699-710, December.
    4. Regina T. Riphahn & Ludger Wößmann, 2016. "Mehr Transparenz in der Bildungspolitik [More Transparency in Education Policy]," Wirtschaftsdienst, Springer;ZBW - Leibniz Information Centre for Economics, vol. 96(7), pages 474-478, July.
    5. Felix Chopra & Ingar Haaland & Christopher Roth & Andreas Stegmann, 2024. "The Null Result Penalty," The Economic Journal, Royal Economic Society, vol. 134(657), pages 193-219.
    6. Angrist, Josh & Lavy, Victor, 2002. "The Effect of High School Matriculation Awards: Evidence from Randomized Trials," CEPR Discussion Papers 3827, C.E.P.R. Discussion Papers.
    7. Sebastian Blesse & Philipp Lergetporer & Justus Nover & Katharina Werner, 2023. "Transparency and Policy Competition: Experimental Evidence from German Citizens and Politicians," Rationality and Competition Discussion Paper Series 387, CRC TRR 190 Rationality and Competition.
    8. Dave Huitema & Andrew Jordan & Stefania Munaretto & Mikael Hildén, 2018. "Policy experimentation: core concepts, political dynamics, governance and impacts," Policy Sciences, Springer;Society of Policy Sciences, vol. 51(2), pages 143-159, June.
    9. Sally Sadoff, 2014. "The role of experimentation in education policy," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 30(4), pages 597-620.
    10. John List, 2008. "Informed consent in social science," Artefactual Field Experiments 00086, The Field Experiments Website.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Robert Dur & Arjan Non & Paul Prottung & Benedetta Ricci, 2025. "Who's Afraid of Policy Experiments?," The Economic Journal, Royal Economic Society, vol. 135(666), pages 538-555.
    2. Chlond, Bettina & Goeschl, Timo & Lohse, Johannes, 2025. "Revealed preferences for policy experiments," Working Papers 0763, University of Heidelberg, Department of Economics.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Levitt, Steven D. & List, John A., 2009. "Field experiments in economics: The past, the present, and the future," European Economic Review, Elsevier, vol. 53(1), pages 1-18, January.
    2. Bernard Fortin, 1997. "Dépendance à l’égard de l’aide sociale et réforme de la sécurité du revenu," L'Actualité Economique, Société Canadienne de Science Economique, vol. 73(4), pages 557-573.
    3. Jason M. Lindo & Nicholas J. Sanders & Philip Oreopoulos, 2010. "Ability, Gender, and Performance Standards: Evidence from Academic Probation," American Economic Journal: Applied Economics, American Economic Association, vol. 2(2), pages 95-117, April.
    4. Sylvain Chassang & Erik Snowberg & Ben Seymour & Cayley Bowles, 2015. "Accounting for Behavior in Treatment Effects: New Applications for Blind Trials," PLOS ONE, Public Library of Science, vol. 10(6), pages 1-13, June.
    5. James J. Heckman, 1991. "Randomization and Social Policy Evaluation Revisited," NBER Technical Working Papers 0107, National Bureau of Economic Research, Inc.
    6. Riddell, Chris & Riddell, W. Craig, 2016. "When Can Experimental Evidence Mislead? A Re-Assessment of Canada's Self Sufficiency Project," IZA Discussion Papers 9939, Institute of Labor Economics (IZA).
    7. Büttner, Thomas, 2008. "Ankündigungseffekt oder Maßnahmewirkung? Eine Evaluation von Trainingsmaßnahmen zur Überprüfung der Verfügbarkeit (Notification or participation : which treatment actually activates job-seekers? An ev," Zeitschrift für ArbeitsmarktForschung - Journal for Labour Market Research, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany], vol. 41(1), pages 25-40.
    8. Matilde Machado, 2005. "Substance abuse treatment, what do we know?," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 6(1), pages 53-64, March.
    9. Alan B. Krueger, 2002. "Inequality, Too Much of a Good Thing," Working Papers 845, Princeton University, Department of Economics, Industrial Relations Section..
    10. Christopher J. Ruhm, 2019. "Shackling the Identification Police?," Southern Economic Journal, John Wiley & Sons, vol. 85(4), pages 1016-1026, April.
    11. Omar Al-Ubaydli & John A. List, 2019. "How natural field experiments have enhanced our understanding of unemployment," Nature Human Behaviour, Nature, vol. 3(1), pages 33-39, January.
    12. Victor Iajya & Nicola Lacetera & Mario Macis & Robert Slonim, 2012. "The Effects of Information, Social and Economic Incentives on Voluntary Undirected Blood Donations: Evidence from a Randomized Controlled Trial in Argentina," NBER Working Papers 18630, National Bureau of Economic Research, Inc.
    13. Heckman, James, 2001. "Accounting for Heterogeneity, Diversity and General Equilibrium in Evaluating Social Programmes," Economic Journal, Royal Economic Society, vol. 111(475), pages 654-699, November.
    14. Charles Bellemare & Bruce Shearer, 2011. "On The Relevance And Composition Of Gifts Within The Firm: Evidence From Field Experiments," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 52(3), pages 855-882, August.
    15. Jere R. Behrman & John Hoddinott & John A. Maluccio, & Erica Soler-Hampejsek & Emily L. Behrman & Reynaldo Martorell & Manuel Ramirez-Zea & Aryeh D. Stein, 2006. "What Determines Adult Cognitive Skills? Impacts of Pre-Schooling, Schooling and Post-Schooling Experiences in Guatemala," PIER Working Paper Archive 06-027, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    16. Victor R. Fuchs & Alan B. Krueger & James M. Poterba, 1997. "Why do Economists Disagree About Policy?," NBER Working Papers 6151, National Bureau of Economic Research, Inc.
    17. Edwin Leuven & Hessel Oosterbeek & Bas van der Klaauw, 2010. "The Effect of Financial Rewards on Students' Achievement: Evidence from a Randomized Experiment," Journal of the European Economic Association, MIT Press, vol. 8(6), pages 1243-1265, December.
    18. Bruno Ferman & Lucas Finamor, 2025. "There must be an error here! Experimental evidence on coding errors' biases," Papers 2508.20069, arXiv.org, revised Sep 2025.
    19. Deb, Partha & Trivedi, Pravin K., 2002. "The structure of demand for health care: latent class versus two-part models," Journal of Health Economics, Elsevier, vol. 21(4), pages 601-625, July.
    20. Victor Lavy & Analia Schlosser, 2005. "Targeted Remedial Education for Underperforming Teenagers: Costs and Benefits," Journal of Labor Economics, University of Chicago Press, vol. 23(4), pages 839-874, October.

    More about this item

    JEL classification:

    • I28 - Health, Education, and Welfare - - Education - - - Government Policy
    • H40 - Public Economics - - Publicly Provided Goods - - - General
    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:espost:323980. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/zbwkide.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.