IDEAS home Printed from https://ideas.repec.org/a/zbw/jcreco/337525.html

Why High-Order Polynomials Should Not Be Used in Regression Discontinuity Designs. A Comment on Gelman and Imbens (Journal of Business & Economic Statistics, 2019)

Author

Listed:
  • Albada, Melle R.

Abstract

Gelman and Imbens (2019) argue against using global high-order polynomial models in regression discontinuity designs, recommending local linear or quadratic models instead. This comment revisits two of their arguments, showing they are contingent on specific contexts and interpretations. First, global high-order polynomial models assign extreme weights when the running variable's distribution has regions with few observations. Because so few observations receive these weights, their contribution to the treatment estimate is usually small. Second, I establish that local models can also yield excessive false positive findings, even when using best-practice modeling methods, and that this problem worsens as the sample size grows. These results improve our understanding of the limitations of global high-order polynomial models and suggest that researchers should routinely investigate false positive rates in their study.

Suggested Citation

  • Albada, Melle R., 2025. "Why High-Order Polynomials Should Not Be Used in Regression Discontinuity Designs. A Comment on Gelman and Imbens (Journal of Business & Economic Statistics, 2019)," Journal of Comments and Replications in Economics (JCRE), ZBW - Leibniz Information Centre for Economics, vol. 4, pages 1-16.
  • Handle: RePEc:zbw:jcreco:337525
    DOI: 10.18718/81781.50
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/337525/1/JCRE-2025-11.pdf
    Download Restriction: no

    File URL: https://libkey.io/10.18718/81781.50?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Zhuan Pei & David S. Lee & David Card & Andrea Weber, 2022. "Local Polynomial Order in Regression Discontinuity Designs," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(3), pages 1259-1267, June.
    2. Sebastian Calonico & Matias D. Cattaneo & Rocio Titiunik, 2014. "Robust Nonparametric Confidence Intervals for Regression‐Discontinuity Designs," Econometrica, Econometric Society, vol. 82, pages 2295-2326, November.
    3. Sebastian Calonico & Matias D Cattaneo & Max H Farrell, 2020. "Optimal bandwidth choice for robust bias-corrected inference in regression discontinuity designs," The Econometrics Journal, Royal Economic Society, vol. 23(2), pages 192-210.
    4. Gerber, Alan S. & Green, Donald P. & Larimer, Christopher W., 2008. "Social Pressure and Voter Turnout: Evidence from a Large-Scale Field Experiment," American Political Science Review, Cambridge University Press, vol. 102(1), pages 33-48, February.
    5. Sebastian Calonico & Matias D. Cattaneo & Rocío Titiunik, 2015. "Optimal Data-Driven Regression Discontinuity Plots," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(512), pages 1753-1769, December.
    6. Hahn, Jinyong & Todd, Petra & Van der Klaauw, Wilbert, 2001. "Identification and Estimation of Treatment Effects with a Regression-Discontinuity Design," Econometrica, Econometric Society, vol. 69(1), pages 201-209, January.
    7. Emanuele Colonnelli & Mounu Prem & Edoardo Teso, 2020. "Patronage and Selection in Public Sector Organizations," American Economic Review, American Economic Association, vol. 110(10), pages 3071-3099, October.
    8. Brian A. Jacob & Lars Lefgren, 2004. "Remedial Education and Student Achievement: A Regression-Discontinuity Analysis," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 226-244, February.
    9. Green, Donald P. & Leong, Terence Y. & Kern, Holger L. & Gerber, Alan S. & Larimer, Christopher W., 2009. "Testing the Accuracy of Regression Discontinuity Analysis Using Experimental Benchmarks," Political Analysis, Cambridge University Press, vol. 17(4), pages 400-417.
    10. Matias D. Cattaneo & Nicolas Idrobo & Rocio Titiunik, 2019. "A Practical Introduction to Regression Discontinuity Designs: Foundations," Papers 1911.09511, arXiv.org.
    11. Guido Imbens & Karthik Kalyanaraman, 2012. "Optimal Bandwidth Choice for the Regression Discontinuity Estimator," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 79(3), pages 933-959.
    12. Yoichi Arai & Hidehiko Ichimura, 2018. "Simultaneous selection of optimal bandwidths for the sharp regression discontinuity estimator," Quantitative Economics, Econometric Society, vol. 9(1), pages 441-482, March.
    13. Andrew Gelman & Guido Imbens, 2019. "Why High-Order Polynomials Should Not Be Used in Regression Discontinuity Designs," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(3), pages 447-456, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ari Hyytinen & Jaakko Meriläinen & Tuukka Saarimaa & Otto Toivanen & Janne Tukiainen, 2018. "When does regression discontinuity design work? Evidence from random election outcomes," Quantitative Economics, Econometric Society, vol. 9(2), pages 1019-1051, July.
    2. Mauricio Villamizar‐Villegas & Freddy A. Pinzon‐Puerto & Maria Alejandra Ruiz‐Sanchez, 2022. "A comprehensive history of regression discontinuity designs: An empirical survey of the last 60 years," Journal of Economic Surveys, Wiley Blackwell, vol. 36(4), pages 1130-1178, September.
    3. Cappelletti, Giuseppe & Ponte Marques, Aurea & Salleo, Carmelo & Martín, Diego Vila, 2020. "How do banking groups react to macroprudential policies? Cross-border spillover effects of higher capital buffers on lending, risk-taking and internal markets," Working Paper Series 2497, European Central Bank.
    4. 'Agoston Reguly, 2021. "Discovering Heterogeneous Treatment Effects in Regression Discontinuity Designs," Papers 2106.11640, arXiv.org, revised Aug 2025.
    5. Kettlewell, Nathan & Siminski, Peter, 2020. "Optimal Model Selection in RDD and Related Settings Using Placebo Zones," IZA Discussion Papers 13639, IZA Network @ LISER.
    6. Quaresima Federico & Santolini Raffaella & Fiorillo Fabio, 2020. "Political affiliation in post-parliamentary careers in Italian public enterprises," German Economic Review, De Gruyter, vol. 21(1), pages 35-64, April.
    7. Yuta Okamoto & Yuuki Ozaki, 2024. "On Extrapolation of Treatment Effects in Multiple-Cutoff Regression Discontinuity Designs," Papers 2412.04265, arXiv.org, revised Sep 2025.
    8. Yoici Arai & Taisuke Otsu & Myung Hwan Seo, 2019. "Causal inference on regression discontinuity designs by high-dimensional methods," STICERD - Econometrics Paper Series 601, Suntory and Toyota International Centres for Economics and Related Disciplines, LSE.
    9. Naven, Matthew & Whalen, Daniel, 2022. "The signaling value of university rankings: Evidence from top 14 law schools," Economics of Education Review, Elsevier, vol. 89(C).
    10. Likai Chen & Georg Keilbar & Liangjun Su & Weining Wang, 2023. "Inference on many jumps in nonparametric panel regression models," Papers 2312.01162, arXiv.org, revised Jan 2025.
    11. Blaise Melly & Rafael Lalive, 2020. "Estimation, Inference, and Interpretation in the Regression Discontinuity Design," Diskussionsschriften dp2016, Universitaet Bern, Departement Volkswirtschaft.
    12. Vanessa Cirulli & Giuliano Resce & Marco Ventura, 2024. "Co-payment exemption and healthcare consumption: quasi-experimental evidence from Italy," Empirical Economics, Springer, vol. 67(1), pages 355-380, July.
    13. Pastore, Chiara & Jones, Andrew M., 2023. "Human capital consequences of missing out on a grammar school education," Economic Modelling, Elsevier, vol. 126(C).
    14. Fusejima, Koki & Ishihara, Takuya & Sawada, Masayuki, 2025. "A unified test for regression discontinuity designs," Journal of Econometrics, Elsevier, vol. 251(C).
    15. Jin-young Choi & Myoung-jae Lee, 2017. "Regression discontinuity: review with extensions," Statistical Papers, Springer, vol. 58(4), pages 1217-1246, December.
    16. Cappelletti, Giuseppe & Ponte Marques, Aurea & Varraso, Paolo, 2024. "Impact of higher capital buffers on banks’ lending and risk-taking in the short- and medium-term: Evidence from the euro area experiments," Journal of Financial Stability, Elsevier, vol. 72(C).
    17. Mario Carillo & Gemma Dipoppa & Shanker Satyanath, 2023. "Fascist Ideology and Migrant Labor Exploitation," Working Papers 1395, Barcelona School of Economics.
    18. Ponte Marques, Aurea & Vila Martín, Diego & Salleo, Carmelo & Cappelletti, Giuseppe, 2025. "Macroprudential policy spillovers in international banking groups. Beggar-thy-neighbour and the role of internal capital markets," Journal of Banking & Finance, Elsevier, vol. 171(C).
    19. Mohamed Ebeid & Umut Oguzoglu, 2023. "Short‐term effect of retirement on health: Evidence from nonparametric fuzzy regression discontinuity design," Health Economics, John Wiley & Sons, Ltd., vol. 32(6), pages 1323-1343, June.
    20. de Gendre, Alexandra & Lynch, John & Meunier, Aurélie & Pilkington, Rhiannon & Schurer, Stefanie, 2021. "Child Health and Parental Responses to an Unconditional Cash Transfer at Birth," IZA Discussion Papers 14693, IZA Network @ LISER.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General
    • C18 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Methodolical Issues: General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:jcreco:337525. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/zbwkide.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.