IDEAS home Printed from https://ideas.repec.org/a/aea/aecrev/v111y2021i5p1442-80.html
   My bibliography  Save this article

How Research Affects Policy: Experimental Evidence from 2,150 Brazilian Municipalities

Author

Listed:
  • Jonas Hjort
  • Diana Moreira
  • Gautam Rao
  • Juan Francisco Santini

Abstract

Can research findings change political leaders' beliefs and policies? We use experiments with 2,150 Brazilian municipalities to measure mayors' demand for and response to research information. In one experiment, we find that mayors are willing to pay to learn the results of evaluation studies, and update their beliefs when informed of the findings. They value larger-sample studies more, while not distinguishing between studies in rich and poor countries. In a second experiment, we find that informing mayors about research on a simple and effective policy, taxpayer reminder letters, increases the probability the policy is implemented by 10 percentage points.

Suggested Citation

  • Jonas Hjort & Diana Moreira & Gautam Rao & Juan Francisco Santini, 2021. "How Research Affects Policy: Experimental Evidence from 2,150 Brazilian Municipalities," American Economic Review, American Economic Association, vol. 111(5), pages 1442-1480, May.
  • Handle: RePEc:aea:aecrev:v:111:y:2021:i:5:p:1442-80
    DOI: 10.1257/aer.20190830
    as

    Download full text from publisher

    File URL: https://www.aeaweb.org/doi/10.1257/aer.20190830
    Download Restriction: no

    File URL: https://doi.org/10.3886/E122661V1
    Download Restriction: no

    File URL: https://www.aeaweb.org/doi/10.1257/aer.20190830.appx
    Download Restriction: no

    File URL: https://www.aeaweb.org/doi/10.1257/aer.20190830.ds
    Download Restriction: Access to full text is restricted to AEA members and institutional subscribers.

    File URL: https://libkey.io/10.1257/aer.20190830?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Mitra Akhtari & Diana Moreira & Laura Trucco, 2022. "Political Turnover, Bureaucratic Turnover, and the Quality of Public Services," American Economic Review, American Economic Association, vol. 112(2), pages 442-493, February.
    2. repec:mpr:mprres:7375 is not listed on IDEAS
    3. Grigorieff, Alexis & Roth, Christopher & Ubfal, Diego, 2016. "Does Information Change Attitudes Towards Immigrants? Representative Evidence from Survey Experiments," IZA Discussion Papers 10419, Institute of Labor Economics (IZA).
    4. Raj Chetty & Emmanuel Saez, 2013. "Teaching the Tax Code: Earnings Responses to an Experiment with EITC Recipients," American Economic Journal: Applied Economics, American Economic Association, vol. 5(1), pages 1-31, January.
    5. List, John A., 2009. "An introduction to field experiments in economics," Journal of Economic Behavior & Organization, Elsevier, vol. 70(3), pages 439-442, June.
    6. Stefano DellaVigna & Devin Pope, 2018. "Predicting Experimental Results: Who Knows What?," Journal of Political Economy, University of Chicago Press, vol. 126(6), pages 2410-2456.
    7. Yang Yao & Muyang Zhang, 2015. "Subnational leaders and economic growth: evidence from Chinese cities," Journal of Economic Growth, Springer, vol. 20(4), pages 405-436, December.
    8. Monica Martinez-Bravo, 2014. "The Role of Local Officials in New Democracies: Evidence from Indonesia," American Economic Review, American Economic Association, vol. 104(4), pages 1244-1287, April.
    9. Daniel J. Benjamin, 2018. "Errors in Probabilistic Reasoning and Judgment Biases," NBER Working Papers 25200, National Bureau of Economic Research, Inc.
    10. Sheheryar Banuri & Stefan Dercon & Varun Gauri, 2019. "Biased Policy Professionals," The World Bank Economic Review, World Bank, vol. 33(2), pages 310-327.
    11. Torsten Persson & Guido Tabellini, 2002. "Political Economics: Explaining Economic Policy," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262661314, December.
    12. Rebecca Dizon-Ross, 2018. "Parents' Beliefs About Their Children's Academic Ability: Implications for Educational Investments," NBER Working Papers 24610, National Bureau of Economic Research, Inc.
    13. Haaland, Ingar & Roth, Christopher, 2020. "Labor market concerns and support for immigration," Journal of Public Economics, Elsevier, vol. 191(C).
    14. Gerlinde Fellner & Rupert Sausgruber & Christian Traxler, 2013. "Testing Enforcement Strategies In The Field: Threat, Moral Appeal And Social Information," Journal of the European Economic Association, European Economic Association, vol. 11(3), pages 634-660, June.
    15. Esther Duflo & Michael Greenstone & Rohini Pande & Nicholas Ryan, 2018. "The Value of Regulatory Discretion: Estimates From Environmental Inspections in India," Econometrica, Econometric Society, vol. 86(6), pages 2123-2160, November.
    16. Imran Rasul & Daniel Rogger, 2018. "Management of Bureaucrats and Public Service Delivery: Evidence from the Nigerian Civil Service," Economic Journal, Royal Economic Society, vol. 128(608), pages 413-446, February.
    17. Nicholas Bloom & Benn Eifert & Aprajit Mahajan & David McKenzie & John Roberts, 2013. "Does Management Matter? Evidence from India," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 128(1), pages 1-51.
    18. Monica Martinez-Bravo, 2017. "The Local Political Economy Effects of School Construction in Indonesia," American Economic Journal: Applied Economics, American Economic Association, vol. 9(2), pages 256-289, April.
    19. Ulrike Malmendier & Stefan Nagel & Zhen Yan, 2017. "The Making of Hawks and Doves: Inflation Experiences on the FOMC," NBER Working Papers 23228, National Bureau of Economic Research, Inc.
    20. Adnan Q. Khan & Asim I. Khwaja & Benjamin A. Olken, 2016. "Tax Farming Redux: Experimental Evidence on Performance Pay for Tax Collectors," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(1), pages 219-271.
    21. Timothy Besley & Jose G. Montalvo & Marta Reynal‐Querol, 2011. "Do Educated Leaders Matter?," Economic Journal, Royal Economic Society, vol. 121(554), pages 205-205, August.
    22. Raghabendra Chattopadhyay & Esther Duflo, 2004. "Women as Policy Makers: Evidence from a Randomized Policy Experiment in India," Econometrica, Econometric Society, vol. 72(5), pages 1409-1443, September.
    23. Hallsworth, Michael & List, John A. & Metcalfe, Robert D. & Vlaev, Ivo, 2017. "The behavioralist as tax collector: Using natural field experiments to enhance tax compliance," Journal of Public Economics, Elsevier, vol. 148(C), pages 14-31.
    24. Michael Carlos Best & Jonas Hjort & David Szakonyi, 2023. "Individuals and Organizations as Sources of State Effectiveness," American Economic Review, American Economic Association, vol. 113(8), pages 2121-2167, August.
    25. Castro, Lucio & Scartascini, Carlos, 2015. "Tax compliance and enforcement in the pampas evidence from a field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 116(C), pages 65-82.
    26. Daniel L. Chen & Tobias J. Moskowitz & Kelly Shue, 2016. "Decision Making Under the Gambler’s Fallacy: Evidence from Asylum Judges, Loan Officers, and Baseball Umpires," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(3), pages 1181-1242.
    27. Esther Duflo & Michael Greenstone & Nicholas Ryan, 2013. "Truth-telling by Third-party Auditors and the Response of Polluting Firms: Experimental Evidence from India," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 128(4), pages 1499-1545.
    28. Benjamin F. Jones & Benjamin A. Olken, 2005. "Do Leaders Matter? National Leadership and Growth Since World War II," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 120(3), pages 835-864.
    29. Jeffrey R. Kling & Sendhil Mullainathan & Eldar Shafir & Lee C. Vermeulen & Marian V. Wrobel, 2012. "Comparison Friction: Experimental Evidence from Medicare Drug Plans," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 127(1), pages 199-235.
    30. Guo Xu, 2018. "The Costs of Patronage: Evidence from the British Empire," American Economic Review, American Economic Association, vol. 108(11), pages 3170-3198, November.
    31. Imran Rasul & Daniel Rogger, 2018. "Management of Bureaucrats and Public Service Delivery: Evidence from the Nigerian Civil Service," Economic Journal, Royal Economic Society, vol. 128(608), pages 413-446, February.
    32. John Hasseldine & Peggy Hite & Simon James & Marika Toumi, 2007. "Persuasive Communications: Tax Compliance Enforcement Strategies for Sole Proprietors," Contemporary Accounting Research, John Wiley & Sons, vol. 24(1), pages 171-194, March.
    33. Orazio P. Attanasio & Camila Fernández & Emla O. A. Fitzsimons & Sally M. Grantham-McGregor & Costas Meghir & Marta Rubio-Codina, "undated". "Using the Infrastructure of a Conditional Cash Transfer Program to Deliver a Scalable Integrated Early Child Development Program in Colombia: Cluster Randomized Controlled Trial," Mathematica Policy Research Reports 62cf429ea5b74678a945aa87b, Mathematica Policy Research.
    34. Adnan Q. Khan & Asim Ijaz Khwaja & Benjamin A. Olken, 2019. "Making Moves Matter: Experimental Evidence on Incentivizing Bureaucrats through Performance-Based Postings," American Economic Review, American Economic Association, vol. 109(1), pages 237-270, January.
    35. repec:feb:artefa:0089 is not listed on IDEAS
    36. Robert Jensen, 2010. "The (Perceived) Returns to Education and the Demand for Schooling," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(2), pages 515-548.
    37. Coleman, Stephen, 1996. "The Minnesota income tax compliance experiment: State tax results," MPRA Paper 4827, University Library of Munich, Germany.
    38. Chen, Daniel L. & Moskowitz, Tobias J. & Shue, Kelly, 2016. "Decision-Making Under the Gambler’s Fallacy: Evidence From Asylum Courts, Loan Officers, and Baseball Umpires," IAST Working Papers 16-43, Institute for Advanced Study in Toulouse (IAST).
    39. Thomas Fujiwara & Leonard Wantchekon, 2013. "Can Informed Public Deliberation Overcome Clientelism? Experimental Evidence from Benin," American Economic Journal: Applied Economics, American Economic Association, vol. 5(4), pages 241-255, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Janne Tukiainen & Sebastian Blesse & Albrecht Bohne & Leonardo M. Giuffrida & Jan Jäässkeläinen & Ari Luukinen & Antti Sieppi, 2021. "What Are the Priorities of Bureaucrats? Evidence from Conjoint Experiments with Procurement Officials," EconPol Working Paper 63, ifo Institute - Leibniz Institute for Economic Research at the University of Munich.
    2. Hallsworth, Michael & List, John A. & Metcalfe, Robert D. & Vlaev, Ivo, 2017. "The behavioralist as tax collector: Using natural field experiments to enhance tax compliance," Journal of Public Economics, Elsevier, vol. 148(C), pages 14-31.
    3. Paul Pelzl & Steven Poelhekke, 2023. "Democratization, leader education and growth: firm-level evidence from Indonesia," Journal of Economic Growth, Springer, vol. 28(4), pages 571-600, December.
    4. Dina Pomeranz & José Vila-Belda, 2019. "Taking State-Capacity Research to the Field: Insights from Collaborations with Tax Authorities," Annual Review of Economics, Annual Reviews, vol. 11(1), pages 755-781, August.
    5. Andrew Dustan & Stanislao Maldonado & Juan Manuel Hernandez-Agramonte, 2018. "Motivating bureaucrats with non-monetary incentives when state capacity is weak: Evidence from large-scale field experiments in Peru," Working Papers 136, Peruvian Economic Association.
    6. Peters, Jörg & Langbein, Jörg & Roberts, Gareth, 2016. "Policy evaluation, randomized controlled trials, and external validity—A systematic review," Economics Letters, Elsevier, vol. 147(C), pages 51-54.
    7. Andrew Dustan & Juan Manuel Hernandez-Agramonte & Stanislao Maldonado, 2018. "Motivating bureaucrats with non-monetary incentives when state capacity is weak: Evidence from large-scale," Natural Field Experiments 00664, The Field Experiments Website.
    8. Dustan, Andrew & Hernandez-Agramonte, Juan Manuel & Maldonado, Stanislao, 2023. "Motivating bureaucrats with behavioral insights when state capacity is weak: Evidence from large-scale field experiments in Peru," Journal of Development Economics, Elsevier, vol. 160(C).
    9. Monica Martinez-Bravo, 2017. "The Local Political Economy Effects of School Construction in Indonesia," American Economic Journal: Applied Economics, American Economic Association, vol. 9(2), pages 256-289, April.
    10. Jonas Hjort & Vinayak Iyer & Golvine De Rochambeau, 2020. "Informational Barriers to Market Access: Experimental Evidence from Liberian Firms," Sciences Po publications 2020-09, Sciences Po.
    11. Biddle, Nicholas & Fels, Katja M. & Sinning, Mathias, 2018. "Behavioral insights on business taxation: Evidence from two natural field experiments," Journal of Behavioral and Experimental Finance, Elsevier, vol. 18(C), pages 30-49.
    12. Biddle, Nicholas & Fels, Katja & Sinning, Mathias, 2017. "Behavioral insights and business taxation: Evidence from two randomized controlled trials," Ruhr Economic Papers 698, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    13. Karthik Muralidharan & Paul Niehaus, 2017. "Experimentation at Scale," Journal of Economic Perspectives, American Economic Association, vol. 31(4), pages 103-124, Fall.
    14. Dina Pomeranz, 2017. "Impact Evaluation Methods in Public Economics," Public Finance Review, , vol. 45(1), pages 10-43, January.
    15. Blesse, Sebastian, 2023. "Do your tax problems make tax evasion seem more justifiable? Evidence from a survey experiment," European Journal of Political Economy, Elsevier, vol. 78(C).
    16. Matthew Collin & Vincenzo Di Maro & David K. Evans & Fredrick Manang, 2022. "Property Tax Compliance in Tanzania: Can Nudges Help?," Working Papers 621, Center for Global Development.
    17. Blesse, Sebastian, 2021. "Are your tax problems an opportunity not to pay taxes? Evidence from a randomized survey experiment," ZEW Discussion Papers 21-040, ZEW - Leibniz Centre for European Economic Research.
    18. Antinyan, Armenak & Asatryan, Zareh, 2019. "Nudging for tax compliance: A meta-analysis," ZEW Discussion Papers 19-055, ZEW - Leibniz Centre for European Economic Research.
    19. repec:hal:wpspec:info:hdl:2441/6jahov5tde8vt9aplqrgg3trl4 is not listed on IDEAS
    20. Guojun He & Shaoda Wang, 2017. "Do College Graduates Serving as Village Officials Help Rural China?," American Economic Journal: Applied Economics, American Economic Association, vol. 9(4), pages 186-215, October.
    21. repec:hal:spmain:info:hdl:2441/6jahov5tde8vt9aplqrgg3trl4 is not listed on IDEAS
    22. Giulia Mascagni, 2018. "From The Lab To The Field: A Review Of Tax Experiments," Journal of Economic Surveys, Wiley Blackwell, vol. 32(2), pages 273-301, April.

    More about this item

    JEL classification:

    • D72 - Microeconomics - - Analysis of Collective Decision-Making - - - Political Processes: Rent-seeking, Lobbying, Elections, Legislatures, and Voting Behavior
    • D78 - Microeconomics - - Analysis of Collective Decision-Making - - - Positive Analysis of Policy Formulation and Implementation
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness
    • O17 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Formal and Informal Sectors; Shadow Economy; Institutional Arrangements
    • O18 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Urban, Rural, Regional, and Transportation Analysis; Housing; Infrastructure

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:aea:aecrev:v:111:y:2021:i:5:p:1442-80. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Michael P. Albert (email available below). General contact details of provider: https://edirc.repec.org/data/aeaaaea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.