IDEAS home Printed from https://ideas.repec.org/p/tin/wpaper/20230027.html
   My bibliography  Save this paper

Who’s Afraid of Policy Experiments?

Author

Listed:
  • Robert Dur

    (Erasmus University Rotterdam)

  • Arjan Non

    (Erasmus University Rotterdam)

  • Paul Prottung
  • Benedetta Ricci

Abstract

In many public policy areas, randomized policy experiments can greatly contribute to our knowledge of the effects of policies and can thus help to improve public policy. However, policy experiments are not very common. This paper studies whether a lack of appreciation of policy experiments among voters may be the reason for this. Using unique survey data representative of the Dutch electorate, we find clear evidence contradicting this view. Voters strongly support policy experimentation and, in line with theory, particularly so when they do not hold a strong opinion about the policy. In a subsequent survey experiment among Dutch politicians, we find that politicians conform their expressed opinion about policy experiments to what we tell them the actual opinion of voters is. We conclude that voters are not afraid of policy experiments and neither are politicians when we tell them that voters are not.

Suggested Citation

  • Robert Dur & Arjan Non & Paul Prottung & Benedetta Ricci, 2023. "Who’s Afraid of Policy Experiments?," Tinbergen Institute Discussion Papers 23-027/V, Tinbergen Institute.
  • Handle: RePEc:tin:wpaper:20230027
    as

    Download full text from publisher

    File URL: https://papers.tinbergen.nl/23027.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Jonas Hjort & Diana Moreira & Gautam Rao & Juan Francisco Santini, 2021. "How Research Affects Policy: Experimental Evidence from 2,150 Brazilian Municipalities," American Economic Review, American Economic Association, vol. 111(5), pages 1442-1480, May.
    2. Shaoda Wang & David Y. Yang, 2021. "Policy Experimentation in China: the Political Economy of Policy Learning," NBER Working Papers 29402, National Bureau of Economic Research, Inc.
    3. Stefano DellaVigna & Woojin Kim & Elizabeth Linos, 2022. "Bottlenecks for Evidence Adoption," NBER Working Papers 30144, National Bureau of Economic Research, Inc.
    4. repec:feb:artefa:0106 is not listed on IDEAS
    5. Rachel Glennerster & Kudzai Takavarasha, 2013. "Running Randomized Evaluations: A Practical Guide," Economics Books, Princeton University Press, edition 1, number 10085.
    6. Millner, Antony & Ollivier, Hélène & Simon, Leo, 2014. "Policy experimentation, political competition, and heterogeneous beliefs," Journal of Public Economics, Elsevier, vol. 120(C), pages 84-96.
    7. Dur, Robert A J, 2001. "Why Do Policy Makers Stick to Inefficient Decisions?," Public Choice, Springer, vol. 107(3-4), pages 221-234, June.
    8. Andreas Bernecker & Pierre C. Boyer & Christina Gathmann, 2021. "The Role of Electoral Incentives for Policy Innovation: Evidence from the US Welfare Reform," American Economic Journal: Economic Policy, American Economic Association, vol. 13(2), pages 26-57, May.
    9. Steven Callander & Patrick Hummel, 2014. "Preemptive Policy Experimentation," Econometrica, Econometric Society, vol. 82(4), pages 1509-1528, July.
    10. Bruno Strulovici, 2010. "Learning While Voting: Determinants of Collective Experimentation," Econometrica, Econometric Society, vol. 78(3), pages 933-971, May.
    11. Kalla, Joshua L. & Porter, Ethan, 2021. "Correcting Bias in Perceptions of Public Opinion Among American Elected Officials: Results from Two Field Experiments," British Journal of Political Science, Cambridge University Press, vol. 51(4), pages 1792-1800, October.
    12. Gary Charness & Anya Samek & Jeroen Ven, 2022. "What is considered deception in experimental economics?," Experimental Economics, Springer;Economic Science Association, vol. 25(2), pages 385-412, April.
    13. Steven Callande & Bård Harstad, 2015. "Experimentation in Federal Systems," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 130(2), pages 951-1002.
    14. John List, 2008. "Informed consent in social science," Artefactual Field Experiments 00086, The Field Experiments Website.
    15. Naurin, Elin & Öhberg, Patrik, 2021. "Ethics in Elite Experiments: A Perspective of Officials and Voters," British Journal of Political Science, Cambridge University Press, vol. 51(2), pages 890-898, April.
    16. Broockman, David E. & Skovron, Christopher, 2018. "Bias in Perceptions of Public Opinion among Political Elites," American Political Science Review, Cambridge University Press, vol. 112(3), pages 542-563, August.
    17. Robert Mislavsky & Berkeley Dietvorst & Uri Simonsohn, 2020. "Critical Condition: People Don’t Dislike a Corporate Experiment More Than They Dislike Its Worst Condition," Marketing Science, INFORMS, vol. 39(6), pages 1092-1104, November.
    18. Yokoo, Hide-Fumi & 横尾, 英史, 2020. "Ethics of randomized field experiments: Evidence from a randomized survey experiment," Discussion Papers 2020-07, Graduate School of Economics, Hitotsubashi University.
    19. Karolin Soontjens & Julie Sevenans, 2022. "Electoral incentives make politicians respond to voter preferences: Evidence from a survey experiment with members of Parliament in Belgium," Social Science Quarterly, Southwestern Social Science Association, vol. 103(5), pages 1125-1139, September.
    20. Butler, Daniel M. & Nickerson, David W., 2011. "Can Learning Constituency Opinion Affect How Legislators Vote? Results from a Field Experiment," Quarterly Journal of Political Science, now publishers, vol. 6(1), pages 55-83, August.
    21. Corduneanu-Huci, Cristina & Dorsch, Michael T. & Maarek, Paul, 2021. "The politics of experimentation: Political competition and randomized controlled trials," Journal of Comparative Economics, Elsevier, vol. 49(1), pages 1-21.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xie, Yinxi & Xie, Yang, 2017. "Machiavellian experimentation," Journal of Comparative Economics, Elsevier, vol. 45(4), pages 685-711.
    2. Antony Millner & Hélène Ollivier, 2016. "Beliefs, Politics, and Environmental Policy," Review of Environmental Economics and Policy, Association of Environmental and Resource Economists, vol. 10(2), pages 226-244.
    3. Grosch, Kerstin & Haeckl, Simone & Rau, Holger & Preuss, Paul, 2023. "A Guide to Conducting School Experiments: Expert Insights and Best Practices for Effective Implementation," UiS Working Papers in Economics and Finance 2023/2, University of Stavanger.
    4. Bowen, Renee & Hwang, Ilwoo & Krasa, Stefan, 2022. "Personal power dynamics in bargaining," Journal of Economic Theory, Elsevier, vol. 205(C).
    5. Alonso, Ricardo & Câmara, Odilon, 2016. "Political disagreement and information in elections," Games and Economic Behavior, Elsevier, vol. 100(C), pages 390-412.
    6. Doruk Cetemen & Can Urgun & Leeat Yariv, 2023. "Collective Progress: Dynamics of Exit Waves," Journal of Political Economy, University of Chicago Press, vol. 131(9), pages 2402-2450.
    7. Sandro Ambuehl & Sebastian Blesse & Philipp Doerrenberg & Christoph Feldhaus & Axel Ockenfels, 2023. "Politicians' Social Welfare Criteria: An Experiment with German Legislators," CESifo Working Paper Series 10329, CESifo.
    8. Sebastian Blesse & Philipp Lergetporer & Justus Nover & Katharina Werner, 2023. "Transparency and Policy Competition: Experimental Evidence from German Citizens and Politicians," Rationality and Competition Discussion Paper Series 387, CRC TRR 190 Rationality and Competition.
    9. Andreas Bernecker & Pierre C. Boyer & Christina Gathmann, 2021. "The Role of Electoral Incentives for Policy Innovation: Evidence from the US Welfare Reform," American Economic Journal: Economic Policy, American Economic Association, vol. 13(2), pages 26-57, May.
    10. Bowen, T. Renee & Krasa, Stefan & Hwang, Ilwoo, 2020. "Agenda-Setter Power Dynamics: Learning in Multi-Issue Bargaining," CEPR Discussion Papers 15406, C.E.P.R. Discussion Papers.
    11. T. Renee Bowen & George Georgiadis & Nicolas S. Lambert, 2019. "Collective Choice in Dynamic Public Good Provision," American Economic Journal: Microeconomics, American Economic Association, vol. 11(1), pages 243-298, February.
    12. Binswanger, Johannes & Oechslin, Manuel, 2020. "Better statistics, better economic policies?," European Economic Review, Elsevier, vol. 130(C).
    13. Bowen, T. Renee & Georgiadis, George & Lambert, Nicolas S., 2015. "Collective Choice in Dynamic Public Good Provision: Real versus Formal Authority," Research Papers 3346, Stanford University, Graduate School of Business.
    14. Vincent Anesi & Mikhail Safronov, 2021. "Cloturing Deliberation," DEM Discussion Paper Series 21-03, Department of Economics at the University of Luxembourg.
    15. Freer, Mikhail & Martinelli, César & Wang, Siyu, 2020. "Collective experimentation: A laboratory study," Journal of Economic Behavior & Organization, Elsevier, vol. 175(C), pages 365-379.
    16. Ginzburg, Boris, 2022. "Collective Learning and Distributive Uncertainty," MPRA Paper 112780, University Library of Munich, Germany.
    17. Thomas, Caroline, 2019. "Experimentation with reputation concerns – Dynamic signalling with changing types," Journal of Economic Theory, Elsevier, vol. 179(C), pages 366-415.
    18. Cheng, Chen & Xing, Yiqing, 2023. "A screening perspective on experimental zones," China Economic Review, Elsevier, vol. 77(C).
    19. Ambuehl, Sandro & Blesse, Sebastian & Doerrenberg, Philipp & Feldhaus, Christoph & Ockenfels, Axel, 2023. "Politicians' social welfare criteria - An experiment with German legislators," ZEW Discussion Papers 23-013, ZEW - Leibniz Centre for European Economic Research.
    20. Obie Porteous, 2022. "Research Deserts and Oases: Evidence from 27 Thousand Economics Journal Articles on Africa," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 84(6), pages 1235-1258, December.

    More about this item

    Keywords

    policy experiments; randomized controlled trials; voters; politicians; public policy; survey experiment; conformism.;
    All these keywords.

    JEL classification:

    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • D72 - Microeconomics - - Analysis of Collective Decision-Making - - - Political Processes: Rent-seeking, Lobbying, Elections, Legislatures, and Voting Behavior
    • D78 - Microeconomics - - Analysis of Collective Decision-Making - - - Positive Analysis of Policy Formulation and Implementation

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tin:wpaper:20230027. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Tinbergen Office +31 (0)10-4088900 (email available below). General contact details of provider: https://edirc.repec.org/data/tinbenl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.