IDEAS home Printed from https://ideas.repec.org/p/cpr/ceprdp/14280.html
   My bibliography  Save this paper

How Research Affects Policy: Experimental Evidence from 2,150 Brazilian Municipalities

Author

Listed:
  • Hjort, Jonas
  • Rao, Gautam
  • Moreira, Diana
  • Santini, Juan Francisco

Abstract

This paper investigates if research findings change political leaders' beliefs and cause policy change. Collaborating with the National Confederation of Municipalities in Brazil, we work with 2,150 municipalities and the mayors who control their policies. We use experiments to measure mayors' demand for research information and their response to learning research findings. In one experiment, we find that mayors and other municipal officials are willing to pay to learn the results of impact evaluations, and update their beliefs when informed of the findings. They value larger-sample studies more, while not distinguishing on average between studies conducted in rich and poor countries. In a second experiment, we find that informing mayors about research on a simple and effective policy (reminder letters for taxpayers) increases the probability that their municipality implements the policy by 10 percentage points. In sum, we provide direct evidence that providing research information to political leaders can lead to policy change. Information frictions may thus help explain failures to adopt effective policies.

Suggested Citation

  • Hjort, Jonas & Rao, Gautam & Moreira, Diana & Santini, Juan Francisco, 2020. "How Research Affects Policy: Experimental Evidence from 2,150 Brazilian Municipalities," CEPR Discussion Papers 14280, C.E.P.R. Discussion Papers.
  • Handle: RePEc:cpr:ceprdp:14280
    as

    Download full text from publisher

    File URL: https://cepr.org/publications/DP14280
    Download Restriction: CEPR Discussion Papers are free to download for our researchers, subscribers and members. If you fall into one of these categories but have trouble downloading our papers, please contact us at subscribers@cepr.org
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. repec:mpr:mprres:7375 is not listed on IDEAS
    2. Stefano DellaVigna & Devin Pope, 2018. "Predicting Experimental Results: Who Knows What?," Journal of Political Economy, University of Chicago Press, vol. 126(6), pages 2410-2456.
    3. Monica Martinez-Bravo, 2014. "The Role of Local Officials in New Democracies: Evidence from Indonesia," American Economic Review, American Economic Association, vol. 104(4), pages 1244-1287, April.
    4. Daniel J. Benjamin, 2018. "Errors in Probabilistic Reasoning and Judgment Biases," NBER Working Papers 25200, National Bureau of Economic Research, Inc.
    5. Nicholas Bloom & Benn Eifert & Aprajit Mahajan & David McKenzie & John Roberts, 2013. "Does Management Matter? Evidence from India," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 128(1), pages 1-51.
    6. Ulrike Malmendier & Stefan Nagel & Zhen Yan, 2017. "The Making of Hawks and Doves: Inflation Experiences on the FOMC," NBER Working Papers 23228, National Bureau of Economic Research, Inc.
    7. Grigorieff, Alexis & Roth, Christopher & Ubfal, Diego, 2016. "Does Information Change Attitudes Towards Immigrants? Representative Evidence from Survey Experiments," IZA Discussion Papers 10419, Institute of Labor Economics (IZA).
    8. Gerlinde Fellner & Rupert Sausgruber & Christian Traxler, 2009. "Testing Enforcement Strategies in the Field: Legal Threat, Moral Appeal and Social Information," Working Papers 2009-23, Faculty of Economics and Statistics, Universität Innsbruck.
    9. Imran Rasul & Daniel Rogger, 2018. "Management of Bureaucrats and Public Service Delivery: Evidence from the Nigerian Civil Service," Economic Journal, Royal Economic Society, vol. 128(608), pages 413-446, February.
    10. Esther Duflo & Michael Greenstone & Nicholas Ryan, 2013. "Truth-telling by Third-party Auditors and the Response of Polluting Firms: Experimental Evidence from India," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 128(4), pages 1499-1545.
    11. Jeffrey R. Kling & Sendhil Mullainathan & Eldar Shafir & Lee C. Vermeulen & Marian V. Wrobel, 2012. "Comparison Friction: Experimental Evidence from Medicare Drug Plans," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 127(1), pages 199-235.
    12. Guo Xu, 2018. "The Costs of Patronage: Evidence from the British Empire," American Economic Review, American Economic Association, vol. 108(11), pages 3170-3198, November.
    13. Coleman, Stephen, 1996. "The Minnesota income tax compliance experiment: State tax results," MPRA Paper 4827, University Library of Munich, Germany.
    14. List, John A., 2009. "An introduction to field experiments in economics," Journal of Economic Behavior & Organization, Elsevier, vol. 70(3), pages 439-442, June.
    15. Torsten Persson & Guido Tabellini, 2002. "Political Economics: Explaining Economic Policy," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262661314, December.
    16. Rebecca Dizon-Ross, 2018. "Parents' Beliefs About Their Children's Academic Ability: Implications for Educational Investments," NBER Working Papers 24610, National Bureau of Economic Research, Inc.
    17. Adnan Q. Khan & Asim I. Khwaja & Benjamin A. Olken, 2016. "Tax Farming Redux: Experimental Evidence on Performance Pay for Tax Collectors," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(1), pages 219-271.
    18. Raghabendra Chattopadhyay & Esther Duflo, 2004. "Women as Policy Makers: Evidence from a Randomized Policy Experiment in India," Econometrica, Econometric Society, vol. 72(5), pages 1409-1443, September.
    19. Hallsworth, Michael & List, John A. & Metcalfe, Robert D. & Vlaev, Ivo, 2017. "The behavioralist as tax collector: Using natural field experiments to enhance tax compliance," Journal of Public Economics, Elsevier, vol. 148(C), pages 14-31.
    20. Sheheryar Banuri & Stefan Dercon & Varun Gauri, 2019. "Biased Policy Professionals," The World Bank Economic Review, World Bank, vol. 33(2), pages 310-327.
    21. Benjamin F. Jones & Benjamin A. Olken, 2005. "Do Leaders Matter? National Leadership and Growth Since World War II," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 120(3), pages 835-864.
    22. Imran Rasul & Daniel Rogger, 2018. "Management of Bureaucrats and Public Service Delivery: Evidence from the Nigerian Civil Service," Economic Journal, Royal Economic Society, vol. 128(608), pages 413-446, February.
    23. Orazio P. Attanasio & Camila Fernández & Emla O. A. Fitzsimons & Sally M. Grantham-McGregor & Costas Meghir & Marta Rubio-Codina, "undated". "Using the Infrastructure of a Conditional Cash Transfer Program to Deliver a Scalable Integrated Early Child Development Program in Colombia: Cluster Randomized Controlled Trial," Mathematica Policy Research Reports 62cf429ea5b74678a945aa87b, Mathematica Policy Research.
    24. Adnan Q. Khan & Asim Ijaz Khwaja & Benjamin A. Olken, 2019. "Making Moves Matter: Experimental Evidence on Incentivizing Bureaucrats through Performance-Based Postings," American Economic Review, American Economic Association, vol. 109(1), pages 237-270, January.
    25. Michael Carlos Best & Jonas Hjort & David Szakonyi, 2023. "Individuals and Organizations as Sources of State Effectiveness," American Economic Review, American Economic Association, vol. 113(8), pages 2121-2167, August.
    26. repec:feb:artefa:0089 is not listed on IDEAS
    27. Chen, Daniel L. & Moskowitz, Tobias J. & Shue, Kelly, 2016. "Decision-Making Under the Gambler’s Fallacy: Evidence From Asylum Courts, Loan Officers, and Baseball Umpires," IAST Working Papers 16-43, Institute for Advanced Study in Toulouse (IAST).
    28. Monica Martinez-Bravo, 2017. "The Local Political Economy Effects of School Construction in Indonesia," American Economic Journal: Applied Economics, American Economic Association, vol. 9(2), pages 256-289, April.
    29. Castro, Lucio & Scartascini, Carlos, 2015. "Tax compliance and enforcement in the pampas evidence from a field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 116(C), pages 65-82.
    30. Grigorieff, Alexis & Roth, Christopher & Ubfal, Diego, 2016. "Does Information Change Attitudes Towards Immigrants? Representative Evidence from Survey Experiments," IZA Discussion Papers 10419, Institute of Labor Economics (IZA).
    31. Raj Chetty & Emmanuel Saez, 2013. "Teaching the Tax Code: Earnings Responses to an Experiment with EITC Recipients," American Economic Journal: Applied Economics, American Economic Association, vol. 5(1), pages 1-31, January.
    32. Esther Duflo & Michael Greenstone & Rohini Pande & Nicholas Ryan, 2018. "The Value of Regulatory Discretion: Estimates From Environmental Inspections in India," Econometrica, Econometric Society, vol. 86(6), pages 2123-2160, November.
    33. Haaland, Ingar & Roth, Christopher, 2020. "Labor market concerns and support for immigration," Journal of Public Economics, Elsevier, vol. 191(C).
    34. Timothy Besley & Jose G. Montalvo & Marta Reynal‐Querol, 2011. "Do Educated Leaders Matter?," Economic Journal, Royal Economic Society, vol. 121(554), pages 205-205, August.
    35. Mitra Akhtari & Diana Moreira & Laura Trucco, 2022. "Political Turnover, Bureaucratic Turnover, and the Quality of Public Services," American Economic Review, American Economic Association, vol. 112(2), pages 442-493, February.
    36. John Hasseldine & Peggy Hite & Simon James & Marika Toumi, 2007. "Persuasive Communications: Tax Compliance Enforcement Strategies for Sole Proprietors," Contemporary Accounting Research, John Wiley & Sons, vol. 24(1), pages 171-194, March.
    37. Yang Yao & Muyang Zhang, 2015. "Subnational leaders and economic growth: evidence from Chinese cities," Journal of Economic Growth, Springer, vol. 20(4), pages 405-436, December.
    38. Gerlinde Fellner & Rupert Sausgruber & Christian Traxler, 2013. "Testing Enforcement Strategies In The Field: Threat, Moral Appeal And Social Information," Journal of the European Economic Association, European Economic Association, vol. 11(3), pages 634-660, June.
    39. Daniel L. Chen & Tobias J. Moskowitz & Kelly Shue, 2016. "Decision Making Under the Gambler’s Fallacy: Evidence from Asylum Judges, Loan Officers, and Baseball Umpires," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(3), pages 1181-1242.
    40. Robert Jensen, 2010. "The (Perceived) Returns to Education and the Demand for Schooling," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(2), pages 515-548.
    41. Thomas Fujiwara & Leonard Wantchekon, 2013. "Can Informed Public Deliberation Overcome Clientelism? Experimental Evidence from Benin," American Economic Journal: Applied Economics, American Economic Association, vol. 5(4), pages 241-255, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hallsworth, Michael & List, John A. & Metcalfe, Robert D. & Vlaev, Ivo, 2017. "The behavioralist as tax collector: Using natural field experiments to enhance tax compliance," Journal of Public Economics, Elsevier, vol. 148(C), pages 14-31.
    2. Dina Pomeranz & José Vila-Belda, 2019. "Taking State-Capacity Research to the Field: Insights from Collaborations with Tax Authorities," Annual Review of Economics, Annual Reviews, vol. 11(1), pages 755-781, August.
    3. Janne Tukiainen & Sebastian Blesse & Albrecht Bohne & Leonardo M. Giuffrida & Jan Jäässkeläinen & Ari Luukinen & Antti Sieppi, 2021. "What Are the Priorities of Bureaucrats? Evidence from Conjoint Experiments with Procurement Officials," EconPol Working Paper 63, ifo Institute - Leibniz Institute for Economic Research at the University of Munich.
    4. Paul Pelzl & Steven Poelhekke, 2023. "Democratization, leader education and growth: firm-level evidence from Indonesia," Journal of Economic Growth, Springer, vol. 28(4), pages 571-600, December.
    5. Andrew Dustan & Stanislao Maldonado & Juan Manuel Hernandez-Agramonte, 2018. "Motivating bureaucrats with non-monetary incentives when state capacity is weak: Evidence from large-scale field experiments in Peru," Working Papers 136, Peruvian Economic Association.
    6. Peters, Jörg & Langbein, Jörg & Roberts, Gareth, 2016. "Policy evaluation, randomized controlled trials, and external validity—A systematic review," Economics Letters, Elsevier, vol. 147(C), pages 51-54.
    7. Biddle, Nicholas & Fels, Katja M. & Sinning, Mathias, 2018. "Behavioral insights on business taxation: Evidence from two natural field experiments," Journal of Behavioral and Experimental Finance, Elsevier, vol. 18(C), pages 30-49.
    8. Biddle, Nicholas & Fels, Katja & Sinning, Mathias, 2017. "Behavioral insights and business taxation: Evidence from two randomized controlled trials," Ruhr Economic Papers 698, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    9. Dina Pomeranz, 2017. "Impact Evaluation Methods in Public Economics," Public Finance Review, , vol. 45(1), pages 10-43, January.
    10. Blesse, Sebastian, 2023. "Do your tax problems make tax evasion seem more justifiable? Evidence from a survey experiment," European Journal of Political Economy, Elsevier, vol. 78(C).
    11. Matthew Collin & Vincenzo Di Maro & David K. Evans & Fredrick Manang, 2022. "Property Tax Compliance in Tanzania: Can Nudges Help?," Working Papers 621, Center for Global Development.
    12. Andrew Dustan & Juan Manuel Hernandez-Agramonte & Stanislao Maldonado, 2018. "Motivating bureaucrats with non-monetary incentives when state capacity is weak: Evidence from large-scale," Natural Field Experiments 00664, The Field Experiments Website.
    13. Blesse, Sebastian, 2021. "Are your tax problems an opportunity not to pay taxes? Evidence from a randomized survey experiment," ZEW Discussion Papers 21-040, ZEW - Leibniz Centre for European Economic Research.
    14. Antinyan, Armenak & Asatryan, Zareh, 2019. "Nudging for tax compliance: A meta-analysis," ZEW Discussion Papers 19-055, ZEW - Leibniz Centre for European Economic Research.
    15. Dustan, Andrew & Hernandez-Agramonte, Juan Manuel & Maldonado, Stanislao, 2023. "Motivating bureaucrats with behavioral insights when state capacity is weak: Evidence from large-scale field experiments in Peru," Journal of Development Economics, Elsevier, vol. 160(C).
    16. Monica Martinez-Bravo, 2017. "The Local Political Economy Effects of School Construction in Indonesia," American Economic Journal: Applied Economics, American Economic Association, vol. 9(2), pages 256-289, April.
    17. repec:idq:ictduk:13726 is not listed on IDEAS
    18. Jonas Hjort & Golvine de Rochambeau & Vinayak Iyer & Fei Ao, 2020. "Informational Barriers to Market Access: Experimental Evidence from Liberian Firms," NBER Working Papers 27662, National Bureau of Economic Research, Inc.
    19. Altmann, Steffen & Falk, Armin & Jäger, Simon & Zimmermann, Florian, 2018. "Learning about job search: A field experiment with job seekers in Germany," Journal of Public Economics, Elsevier, vol. 164(C), pages 33-49.
    20. Philipp Barteska & Jay Euijung Lee, 2024. "Bureaucrats and the Korean export miracle," Discussion Papers 2024-11, Nottingham Interdisciplinary Centre for Economic and Political Research (NICEP).
    21. Castro, Lucio & Scartascini, Carlos, 2015. "Tax compliance and enforcement in the pampas evidence from a field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 116(C), pages 65-82.

    More about this item

    JEL classification:

    • D72 - Microeconomics - - Analysis of Collective Decision-Making - - - Political Processes: Rent-seeking, Lobbying, Elections, Legislatures, and Voting Behavior
    • D78 - Microeconomics - - Analysis of Collective Decision-Making - - - Positive Analysis of Policy Formulation and Implementation
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness
    • O17 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Formal and Informal Sectors; Shadow Economy; Institutional Arrangements
    • O18 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Urban, Rural, Regional, and Transportation Analysis; Housing; Infrastructure

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cpr:ceprdp:14280. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://www.cepr.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.