IDEAS home Printed from https://ideas.repec.org/p/diw/diwwpp/dp1503.html
   My bibliography  Save this paper

Regression Discontinuity Designs Based on Population Thresholds: Pitfalls and Solutions

Author

Listed:
  • Andrew C. Eggers
  • Ronny Freier
  • Veronica Grembi
  • Tommaso Nannicini

Abstract

In many countries, important features of municipal government (such as the electoral system, mayors' salaries, and the number of councillors) depend on whether the municipality is above or below arbitrary population thresholds. Several papers have used a regression discontinuity design (RDD) to measure the effects of these threshold-based policies on political and economic outcomes. Using evidence from France, Germany, and Italy, we highlight two common pitfalls that arise in exploiting population-based policies (confounded treatment and sorting) and we provide guidance for detecting and addressing these pitfalls. Even when these problems are present, population-threshold RDD may be the best available research design for studying the effects of certain policies and political institutions.

Suggested Citation

  • Andrew C. Eggers & Ronny Freier & Veronica Grembi & Tommaso Nannicini, 2015. "Regression Discontinuity Designs Based on Population Thresholds: Pitfalls and Solutions," Discussion Papers of DIW Berlin 1503, DIW Berlin, German Institute for Economic Research.
    • Handle: RePEc:diw:diwwpp:dp1503
    as

    Download full text from publisher

    File URL: https://www.diw.de/documents/publikationen/73/diw_01.c.513460.de/dp1503.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Veronica Grembi & Tommaso Nannicini & Ugo Troiano, 2011. "Policy Responses to Fiscal Restraints: A Difference-in-Discontinuities Design," Working Papers 397, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    2. Baskaran, Thushyanthan & Lopes da Fonseca, Mariana, 2016. "Electoral competition and endogenous political institutions: Quasi-experimental evidence from Germany," Journal of Economic Behavior & Organization, Elsevier, vol. 122(C), pages 43-61.
    3. Davezies, Laurent & Le Barbanchon, Thomas, 2017. "Regression discontinuity design with continuous measurement error in the running variable," Journal of Econometrics, Elsevier, vol. 200(2), pages 260-281.
    4. Litschig, Stephan, 2012. "Are rules-based government programs shielded from special-interest politics? Evidence from revenue-sharing transfers in Brazil," Journal of Public Economics, Elsevier, vol. 96(11), pages 1047-1060.
    5. Alan I. Barreca & Melanie Guldi & Jason M. Lindo & Glen R. Waddell, 2011. "Saving Babies? Revisiting the effect of very low birth weight classification," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(4), pages 2117-2123.
    6. Ferraz, Claudio & Finan, Frederico S., 2008. "Motivating Politicians: The Impacts of Monetary Incentives on Quality and Performance," IZA Discussion Papers 3411, Institute of Labor Economics (IZA).
    7. Sebastian Calonico & Matias D. Cattaneo & Rocio Titiunik, 2014. "Robust Nonparametric Confidence Intervals for Regression‐Discontinuity Designs," Econometrica, Econometric Society, vol. 82, pages 2295-2326, November.
    8. Pellicer, Miquel & Wegner, Eva, 2013. "Electoral Rules and Clientelistic Parties: A Regression Discontinuity Approach," Quarterly Journal of Political Science, now publishers, vol. 8(4), pages 339-371, October.
    9. Peter Egger & Marko Koethenbuerger, 2010. "Government Spending and Legislative Organization: Quasi-experimental Evidence from Germany," American Economic Journal: Applied Economics, American Economic Association, vol. 2(4), pages 200-212, October.
    10. Stephan Litschig & Kevin Morrison, 2010. "Government spending and re-election: Quasi-experimental evidence from Brazilian municipalities," Economics Working Papers 1233, Department of Economics and Business, Universitat Pompeu Fabra, revised Jun 2012.
    11. McCrary, Justin, 2008. "Manipulation of the running variable in the regression discontinuity design: A density test," Journal of Econometrics, Elsevier, vol. 142(2), pages 698-714, February.
    12. Kristof De Witte & Benny Geys, 2015. "Strategic Housing Policy, Migration and Sorting around Population Thresholds," CESifo Working Paper Series 5639, CESifo.
    13. Pettersson-Lidbom, Per, 2012. "Does the size of the legislature affect the size of government? Evidence from two natural experiments," Journal of Public Economics, Elsevier, vol. 96(3), pages 269-278.
    14. Taisuke Otsu & Ke-Li Xu & Yukitoshi Matsushita, 2013. "Estimation and Inference of Discontinuity in Density," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 31(4), pages 507-524, October.
    15. Andrew C. Eggers & Anthony Fowler & Jens Hainmueller & Andrew B. Hall & James M. Snyder, 2015. "On the Validity of the Regression Discontinuity Design for Estimating Electoral Effects: New Evidence from Over 40,000 Close Races," American Journal of Political Science, John Wiley & Sons, vol. 59(1), pages 259-274, January.
    16. Caughey, Devin & Sekhon, Jasjeet S., 2011. "Elections and the Regression Discontinuity Design: Lessons from Close U.S. House Races, 1942–2008," Political Analysis, Cambridge University Press, vol. 19(4), pages 385-408.
    17. Lyytikäinen, Teemu & Tukiainen, Janne, 2019. "Are voters rational?," European Journal of Political Economy, Elsevier, vol. 59(C), pages 230-242.
    18. Barone, Guglielmo & de Blasio, Guido, 2013. "Electoral rules and voter turnout," International Review of Law and Economics, Elsevier, vol. 36(C), pages 25-35.
    19. Asatryan, Zareh & Baskaran, Thushyanthan & Heinemann, Friedrich, 2017. "The effect of direct democracy on the level and structure of local taxes," Regional Science and Urban Economics, Elsevier, vol. 65(C), pages 38-55.
    20. De Benedetto, Marco Alberto & De Paola, Maria, 2014. "Candidates' Quality and Electoral Participation: Evidence from Italian Municipal Elections," IZA Discussion Papers 8102, Institute of Labor Economics (IZA).
    21. Zareh Asatryan & Thushyanthan Baskaran & Theocharis Grigoriadis & Friedrich Heinemann, 2017. "Direct Democracy and Local Public Finances under Cooperative Federalism," Scandinavian Journal of Economics, Wiley Blackwell, vol. 119(3), pages 801-820, July.
    22. Daan van der Linde & Swantje Falcke & Ian Koetsier & Brigitte Unger, 2014. "Do Wages Affect Politicians' Performance? A regression discontinuity approach for Dutch municipalities," Working Papers 14-15, Utrecht School of Economics.
    23. Pablo Casas-Arce & Albert Saiz, 2015. "Women and Power: Unpopular, Unwilling, or Held Back?," Journal of Political Economy, University of Chicago Press, vol. 123(3), pages 641-669.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Britto, Diogo G.C. & Fiorin, Stefano, 2020. "Corruption and legislature size: Evidence from Brazil," European Journal of Political Economy, Elsevier, vol. 65(C).
    2. Anna Harvey, 2020. "Applying regression discontinuity designs to American political development," Public Choice, Springer, vol. 185(3), pages 377-399, December.
    3. Felix Arnold & Ronny Freier, 2015. "Signature requirements and citizen initiatives: Quasi-experimental evidence from Germany," Public Choice, Springer, vol. 162(1), pages 43-56, January.
    4. Sanz, Carlos, 2020. "Direct democracy and government size: evidence from Spain," Political Science Research and Methods, Cambridge University Press, vol. 8(4), pages 630-645, October.
    5. Sanz, Carlos, 2017. "The Effect of Electoral Systems on Voter Turnout: Evidence from a Natural Experiment," Political Science Research and Methods, Cambridge University Press, vol. 5(4), pages 689-710, October.
    6. Kristof De Witte & Benny Geys, 2015. "Strategic Housing Policy, Migration and Sorting around Population Thresholds," CESifo Working Paper Series 5639, CESifo.
    7. Felix Arnold & Ronny Freier, 2013. "Signature Requirements and Citizen Initiatives: Quasi-Experimental Evidence from Germany," Discussion Papers of DIW Berlin 1311, DIW Berlin, German Institute for Economic Research.
    8. Köppl–Turyna, Monika & Pitlik, Hans, 2018. "Do equalization payments affect subnational borrowing? Evidence from regression discontinuity," European Journal of Political Economy, Elsevier, vol. 53(C), pages 84-108.
    9. Thushyanthan Baskaran & Zohal Hessami, 2017. "Political alignment and intergovernmental transfers in parliamentary systems: evidence from Germany," Public Choice, Springer, vol. 171(1), pages 75-98, April.
    10. Federico Boffa & Vincenzo Mollisi & Giacomo A. M. Ponzetto, 2023. "Do incompetent politicians breed populist voters? Evidence from Italian municipalities," Economics Working Papers 1861, Department of Economics and Business, Universitat Pompeu Fabra.
    11. Matakos, Konstantinos & Savolainen, Riikka & Troumpounis, Orestis & Tukiainen, Janne & Xefteris, Dimitrios, 2018. "Electoral Institutions and Intraparty Cohesion," Working Papers 109, VATT Institute for Economic Research.
    12. Geschwind, Stephan & Roesel, Felix, 2022. "Taxation under direct democracy," Journal of Economic Behavior & Organization, Elsevier, vol. 200(C), pages 536-554.
    13. Mauricio Villamizar‐Villegas & Freddy A. Pinzon‐Puerto & Maria Alejandra Ruiz‐Sanchez, 2022. "A comprehensive history of regression discontinuity designs: An empirical survey of the last 60 years," Journal of Economic Surveys, Wiley Blackwell, vol. 36(4), pages 1130-1178, September.
    14. Baskaran, Thushyanthan & Lopes da Fonseca, Mariana, 2016. "Electoral competition and endogenous political institutions: Quasi-experimental evidence from Germany," Journal of Economic Behavior & Organization, Elsevier, vol. 122(C), pages 43-61.
    15. Florian Ade & Ronny Freier, 2011. "When Can We Trust Population Thresholds in Regression Discontinuity Designs?," Discussion Papers of DIW Berlin 1136, DIW Berlin, German Institute for Economic Research.
    16. Lyytikäinen, Teemu & Tukiainen, Janne, 2019. "Are voters rational?," European Journal of Political Economy, Elsevier, vol. 59(C), pages 230-242.
    17. Kantorowicz, Jarosław, 2017. "Electoral systems and fiscal policy outcomes: Evidence from Poland," European Journal of Political Economy, Elsevier, vol. 47(C), pages 36-60.
    18. Thushyanthan Baskaran & Sonia Bhalotra & Brian Min & Yogesh Uppal, 2018. "Women legislators and economic performance," WIDER Working Paper Series wp-2018-47, World Institute for Development Economic Research (UNU-WIDER).
    19. Adam C. Sales & Ben B. Hansen, 2020. "Limitless Regression Discontinuity," Journal of Educational and Behavioral Statistics, , vol. 45(2), pages 143-174, April.
    20. Gouvêa, Raphael & Girardi, Daniele, 2021. "Partisanship and local fiscal policy: Evidence from Brazilian cities," Journal of Development Economics, Elsevier, vol. 150(C).

    More about this item

    Keywords

    regression discontinuity design; causal inference; sorting; population thresholds; institutional design;
    All these keywords.

    JEL classification:

    • H10 - Public Economics - - Structure and Scope of Government - - - General
    • H19 - Public Economics - - Structure and Scope of Government - - - Other
    • H70 - Public Economics - - State and Local Government; Intergovernmental Relations - - - General
    • H77 - Public Economics - - State and Local Government; Intergovernmental Relations - - - Intergovernmental Relations; Federalism

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:diw:diwwpp:dp1503. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Bibliothek (email available below). General contact details of provider: https://edirc.repec.org/data/diwbede.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.