IDEAS home Printed from https://ideas.repec.org/p/zbw/rwirep/906.html
   My bibliography  Save this paper

Who nudges whom? Field experiments with public partners

Author

Listed:
  • Fels, Katja M.

Abstract

Field experiments which test the application of behavioural insights to policy design have become popular to inform policy decisions. This study is the first to empirically examine who and what drives these experiments with public partners. Through a mixed-methods approach, based on a novel dataset of insights from academic researchers, behavioural insight team members, and public servants, I derive three main results: Firstly, public servants have a considerable influence on study setup and sample design. Secondly, behavioural insight team members report concerns regarding scientific rigor and limitations imposed by risk-aversion of their public partners significantly more often than academic researchers. Thirdly, transparency and quality control in collaborative research are low with respect to pre-analysis plans, the publication of results, and medium or long term effects. To remedy the current weaknesses, the study sketches out several promising ways forward, such as setting up a matchmaking platform for researchers and public bodies to facilitate cooperation, and using time-embargoed pre-analysis plans.

Suggested Citation

  • Fels, Katja M., 2021. "Who nudges whom? Field experiments with public partners," Ruhr Economic Papers 906, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    • Handle: RePEc:zbw:rwirep:906
    DOI: 10.4419/96973049
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/233882/1/1757179925.pdf
    Download Restriction: no
    File URL: https://libkey.io/10.4419/96973049?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Benedikt Fecher & Mathis Fräßdorf & Gert G. Wagner, 2016. "Perceptions and Practices of Replication by Social and Behavioral Scientists: Making Replications a Mandatory Element of Curricula Would Be Useful," Discussion Papers of DIW Berlin 1572, DIW Berlin, German Institute for Economic Research.
    2. John P A Ioannidis, 2005. "Why Most Published Research Findings Are False," PLOS Medicine, Public Library of Science, vol. 2(8), pages 1-1, August.
    3. Cartwright,Nancy, 2007. "Hunting Causes and Using Them," Cambridge Books, Cambridge University Press, number 9780521860819.
    4. Garret Christensen & Edward Miguel, 2018. "Transparency, Reproducibility, and the Credibility of Economics Research," Journal of Economic Literature, American Economic Association, vol. 56(3), pages 920-980, September.
    5. Stefano DellaVigna & Elizabeth Linos, 2022. "RCTs to Scale: Comprehensive Evidence From Two Nudge Units," Econometrica, Econometric Society, vol. 90(1), pages 81-116, January.
    6. Stefano DellaVigna, 2009. "Psychology and Economics: Evidence from the Field," Journal of Economic Literature, American Economic Association, vol. 47(2), pages 315-372, June.
    7. Michael Hallsworth, 2014. "The use of field experiments to increase tax compliance," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 30(4), pages 658-679.
    8. Brigitte C. Madrian, 2014. "Applying Insights from Behavioral Economics to Policy Design," Annual Review of Economics, Annual Reviews, vol. 6(1), pages 663-688, August.
    9. Delaney, Liam, 2018. "Behavioural Insights Team: ethical, professional and historical considerations," Behavioural Public Policy, Cambridge University Press, vol. 2(2), pages 183-189, November.
    10. Donna Bobek & Amy Hageman & Charles Kelliher, 2013. "Analyzing the Role of Social Norms in Tax Compliance Behavior," Journal of Business Ethics, Springer, vol. 115(3), pages 451-468, July.
    11. Brigitte C. Madrian & Dennis F. Shea, 2001. "The Power of Suggestion: Inertia in 401(k) Participation and Savings Behavior," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 116(4), pages 1149-1187.
    12. Bruno S. Frey & Stephan Meier, 2004. "Social Comparisons and Pro-social Behavior: Testing "Conditional Cooperation" in a Field Experiment," American Economic Review, American Economic Association, vol. 94(5), pages 1717-1722, December.
    13. Dina Pomeranz & José Vila-Belda, 2019. "Taking State-Capacity Research to the Field: Insights from Collaborations with Tax Authorities," Annual Review of Economics, Annual Reviews, vol. 11(1), pages 755-781, August.
    14. Levitt, Steven D. & List, John A., 2009. "Field experiments in economics: The past, the present, and the future," European Economic Review, Elsevier, vol. 53(1), pages 1-18, January.
    15. Stefano DellaVigna & Devin Pope, 2018. "What Motivates Effort? Evidence and Expert Forecasts," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 85(2), pages 1029-1069.
    16. Eszter Czibor & David Jimenez‐Gomez & John A. List, 2019. "The Dozen Things Experimental Economists Should Do (More of)," Southern Economic Journal, John Wiley & Sons, vol. 86(2), pages 371-432, October.
    17. Deaton, Angus & Cartwright, Nancy, 2018. "Understanding and misunderstanding randomized controlled trials," Social Science & Medicine, Elsevier, vol. 210(C), pages 2-21.
    18. Jachimowicz, Jon M. & Duncan, Shannon & Weber, Elke U. & Johnson, Eric J., 2019. "When and why defaults influence decisions: a meta-analysis of default effects," Behavioural Public Policy, Cambridge University Press, vol. 3(2), pages 159-186, November.
    19. Schmidt Christoph M., 2014. "Wirkungstreffer erzielen – Die Rolle der evidenzbasierten Politikberatung in einer aufgeklärten Gesellschaft," Perspektiven der Wirtschaftspolitik, De Gruyter, vol. 15(3), pages 219-233, October.
    20. Glenn W. Harrison, 2014. "Cautionary notes on the use of field experiments to address policy issues," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 30(4), pages 753-763.
    21. Sanders, Michael & Snijders, Veerle & Hallsworth, Michael, 2018. "Behavioural science and policy: where are we now and where are we going?," Behavioural Public Policy, Cambridge University Press, vol. 2(2), pages 144-167, November.
    22. Gillitzer, Christian & Sinning, Mathias, 2020. "Nudging businesses to pay their taxes: Does timing matter?," Journal of Economic Behavior & Organization, Elsevier, vol. 169(C), pages 284-300.
    23. Dina Pomeranz, 2015. "No Taxation without Information: Deterrence and Self-Enforcement in the Value Added Tax," American Economic Review, American Economic Association, vol. 105(8), pages 2539-2569, August.
    24. Allcott, Hunt, 2011. "Social norms and energy conservation," Journal of Public Economics, Elsevier, vol. 95(9-10), pages 1082-1095, October.
    25. repec:cup:judgdm:v:11:y:2016:i:4:p:310-325 is not listed on IDEAS
    26. Hallsworth, Michael & List, John A. & Metcalfe, Robert D. & Vlaev, Ivo, 2017. "The behavioralist as tax collector: Using natural field experiments to enhance tax compliance," Journal of Public Economics, Elsevier, vol. 148(C), pages 14-31.
    27. Nicky J. Welton & Howard H. Z. Thom, 2015. "Value of Information," Medical Decision Making, , vol. 35(5), pages 564-566, July.
    28. Pritchett Lant & Sandefur Justin, 2014. "Context Matters for Size: Why External Validity Claims and Development Practice do not Mix," Journal of Globalization and Development, De Gruyter, vol. 4(2), pages 161-197, March.
    29. Lodewijk Smets, 2020. "Supporting Policy Reform from the Outside," The World Bank Research Observer, World Bank, vol. 35(1), pages 19-43.
    30. Cartwright,Nancy, 2007. "Hunting Causes and Using Them," Cambridge Books, Cambridge University Press, number 9780521677981.
    31. repec:feb:artefa:0087 is not listed on IDEAS
    32. Allcott, Hunt, 2011. "Social norms and energy conservation," Journal of Public Economics, Elsevier, vol. 95(9), pages 1082-1095.
    33. Andor, Mark A. & Fels, Katja M., 2018. "Behavioral Economics and Energy Conservation – A Systematic Review of Non-price Interventions and Their Causal Effects," Ecological Economics, Elsevier, vol. 148(C), pages 178-210.
    34. Dina Pomeranz, 2017. "Impact Evaluation Methods in Public Economics," Public Finance Review, , vol. 45(1), pages 10-43, January.
    35. Paul J. Ferraro & Juan Jose Miranda & Michael K. Price, 2011. "The Persistence of Treatment Effects with Norm-Based Policy Instruments: Evidence from a Randomized Environmental Policy Experiment," American Economic Review, American Economic Association, vol. 101(3), pages 318-322, May.
    36. Bruno Frey & Stephan Meier, 2004. "In a field experiment," Natural Field Experiments 00243, The Field Experiments Website.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andor, Mark A. & Gerster, Andreas & Peters, Jörg & Schmidt, Christoph M., 2020. "Social Norms and Energy Conservation Beyond the US," Journal of Environmental Economics and Management, Elsevier, vol. 103(C).
    2. C. Yiwei Zhang & Jeffrey Hemmeter & Judd B. Kessler & Robert D. Metcalfe & Robert Weathers, 2023. "Nudging Timely Wage Reporting: Field Experimental Evidence from the U.S. Supplemental Security Income Program," Management Science, INFORMS, vol. 69(3), pages 1341-1353, March.
    3. Biddle, Nicholas & Fels, Katja M. & Sinning, Mathias, 2018. "Behavioral insights on business taxation: Evidence from two natural field experiments," Journal of Behavioral and Experimental Finance, Elsevier, vol. 18(C), pages 30-49.
    4. Biddle, Nicholas & Fels, Katja & Sinning, Mathias, 2017. "Behavioral insights and business taxation: Evidence from two randomized controlled trials," Ruhr Economic Papers 698, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    5. Hallsworth, Michael & List, John A. & Metcalfe, Robert D. & Vlaev, Ivo, 2017. "The behavioralist as tax collector: Using natural field experiments to enhance tax compliance," Journal of Public Economics, Elsevier, vol. 148(C), pages 14-31.
    6. Sinning, Mathias & Zhang, Yinjunjie, 2023. "Social norms or enforcement? A natural field experiment to improve traffic and parking fine compliance," Journal of Economic Behavior & Organization, Elsevier, vol. 210(C), pages 43-60.
    7. Philipp Doerrenberg & Andreas Peichl, 2022. "Tax Morale and the Role of Social Norms and Reciprocity - Evidence from a Randomized Survey Experiment," FinanzArchiv: Public Finance Analysis, Mohr Siebeck, Tübingen, vol. 78(1-2), pages 44-86.
    8. James R. Meldrum & Hannah Brenkert-Smith & Patricia A. Champ & Jamie Gomez & Hilary Byerly & Lilia Falk & Christopher M. Barth, 2021. "Would you like to know more? The effect of personalized wildfire risk information and social comparisons on information-seeking behavior in the wildland–urban interface," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 106(3), pages 2139-2161, April.
    9. Beshears, John & Kosowsky, Harry, 2020. "Nudging: Progress to date and future directions," Organizational Behavior and Human Decision Processes, Elsevier, vol. 161(S), pages 3-19.
    10. Brülisauer, Marcel & Goette, Lorenz & Jiang, Zhengyi & Schmitz, Jan & Schubert, Renate, 2020. "Appliance-specific feedback and social comparisons: Evidence from a field experiment on energy conservation," Energy Policy, Elsevier, vol. 145(C).
    11. Gillitzer, Christian & Sinning, Mathias, 2020. "Nudging businesses to pay their taxes: Does timing matter?," Journal of Economic Behavior & Organization, Elsevier, vol. 169(C), pages 284-300.
    12. Kölle, Felix & Quercia, Simone, 2021. "The influence of empirical and normative expectations on cooperation," Journal of Economic Behavior & Organization, Elsevier, vol. 190(C), pages 691-703.
    13. Brade, Raphael & Himmler, Oliver & Jäckle, Robert, 2022. "Relative performance feedback and the effects of being above average — field experiment and replication," Economics of Education Review, Elsevier, vol. 89(C).
    14. James Alm & Lilith Burgstaller & Arrita Domi & Amanda März & Matthias Kasper, 2023. "Nudges, Boosts, and Sludge: Using New Behavioral Approaches to Improve Tax Compliance," Economies, MDPI, vol. 11(9), pages 1-22, September.
    15. Antinyan, Armenak & Asatryan, Zareh, 2019. "Nudging for tax compliance: A meta-analysis," ZEW Discussion Papers 19-055, ZEW - Leibniz Centre for European Economic Research.
    16. Cristina Bicchieri & Eugen Dimant, 2022. "Nudging with care: the risks and benefits of social information," Public Choice, Springer, vol. 191(3), pages 443-464, June.
    17. Leonhard K. Lades & Ewa Zawojska & Robert J. Johnston & Nick Hanley & Liam Delaney & Mikołaj Czajkowski, 2022. "Anomalies or Expected Behaviors? Understanding Stated Preferences and Welfare Implications in Light of Contemporary Behavioral Theory," Working Papers 2022-20, Faculty of Economic Sciences, University of Warsaw.
    18. Mette T. Damgaard, 2020. "A decade of nudging: What have we learned?," Economics Working Papers 2020-07, Department of Economics and Business Economics, Aarhus University.
    19. Bonan, Jacopo & Cattaneo, Cristina & d’Adda, Giovanna & Tavoni, Massimo, 2021. "Can social information programs be more effective? The role of environmental identity for energy conservation," Journal of Environmental Economics and Management, Elsevier, vol. 108(C).
    20. Allcott, Hunt & Rogers, Todd T, 2012. "How Long Do Treatment Effects Last? Persistence and Durability of a Descriptive Norms Intervention's Effect on Energy Conservation," Scholarly Articles 9804492, Harvard Kennedy School of Government.

    More about this item

    Keywords

    Behavioural public policy; field experiments; Behavioural Insights Team (BIT); research transparency; expert interviews;
    All these keywords.

    JEL classification:

    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • D04 - Microeconomics - - General - - - Microeconomic Policy: Formulation; Implementation; Evaluation
    • D90 - Microeconomics - - Micro-Based Behavioral Economics - - - General
    • H11 - Public Economics - - Structure and Scope of Government - - - Structure and Scope of Government

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:rwirep:906. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/rwiesde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.