IDEAS home Printed from https://ideas.repec.org/p/cwl/cwldpp/2044r2.html
   My bibliography  Save this paper

Simple and Honest Confidence Intervals in Nonparametric Regression

Author

Listed:

Abstract

We consider the problem of constructing honest confidence intervals (CIs) for a scalar parameter of interest, such as the regression discontinuity parameter, in nonparametric regression based on kernel or local polynomial estimators. To ensure that our CIs are honest, we derive and tabulate novel critical values that take into account the possible bias of the estimator upon which the CIs are based. We show that this approach leads to CIs that are more efficient than conventional CIs that achieve coverage by undersmoothing or subtracting an estimate of the bias. We give sharp efficiency bounds of using different kernels, and derive the optimal bandwidth for constructing honest CIs. We show that using the bandwidth that minimizes the maximum mean-squared error results in CIs that are nearly efficient and that in this case, the critical value depends only on the rate of convergence. For the common case in which the rate of convergence is n^{-2/5}, the appropriate critical value for 95% CIs is 2.18, rather than the usual 1.96 critical value. We illustrate our results in a Monte Carlo analysis and an empirical application.

Suggested Citation

  • Timothy B. Armstrong & Michal Koles�r, 2016. "Simple and Honest Confidence Intervals in Nonparametric Regression," Cowles Foundation Discussion Papers 2044R2, Cowles Foundation for Research in Economics, Yale University, revised Mar 2018.
  • Handle: RePEc:cwl:cwldpp:2044r2
    Note: Includes Supplemental Material
    as

    Download full text from publisher

    File URL: https://cowles.yale.edu/sites/default/files/files/pub/d20/d2044-r2a.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Sebastian Calonico & Matias D. Cattaneo & Rocio Titiunik, 2014. "Robust Nonparametric Confidence Intervals for Regression‐Discontinuity Designs," Econometrica, Econometric Society, vol. 82, pages 2295-2326, November.
    2. Jens Ludwig & Douglas L. Miller, 2007. "Does Head Start Improve Children's Life Chances? Evidence from a Regression Discontinuity Design," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(1), pages 159-208.
    3. Jianqing Fan & Theo Gasser & Irène Gijbels & Michael Brockmann & Joachim Engel, 1997. "Local Polynomial Regression: Optimal Kernels and Asymptotic Minimax Efficiency," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 49(1), pages 79-99, March.
    4. Hahn, Jinyong & Todd, Petra & Van der Klaauw, Wilbert, 2001. "Identification and Estimation of Treatment Effects with a Regression-Discontinuity Design," Econometrica, Econometric Society, vol. 69(1), pages 201-209, January.
    5. Guido Imbens & Karthik Kalyanaraman, 2012. "Optimal Bandwidth Choice for the Regression Discontinuity Estimator," Review of Economic Studies, Oxford University Press, vol. 79(3), pages 933-959.
    6. Alberto Abadie & Guido W. Imbens & Fanyin Zheng, 2014. "Inference for Misspecified Models With Fixed Regressors," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(508), pages 1601-1614, December.
    7. Alberto Abadie & Guido W. Imbens, 2006. "Large Sample Properties of Matching Estimators for Average Treatment Effects," Econometrica, Econometric Society, vol. 74(1), pages 235-267, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Matias D. Cattaneo & Rocío Titiunik, 2022. "Regression Discontinuity Designs," Annual Review of Economics, Annual Reviews, vol. 14(1), pages 821-851, August.
    2. Mueller, Clemens, 2023. "Reacting to Early Failure in University: Evidence from a Regression Discontinuity Design," VfS Annual Conference 2023 (Regensburg): Growth and the "sociale Frage" 277620, Verein für Socialpolitik / German Economic Association.
    3. Bugni, Federico A. & Canay, Ivan A., 2021. "Testing continuity of a density via g-order statistics in the regression discontinuity design," Journal of Econometrics, Elsevier, vol. 221(1), pages 138-159.
    4. Pesola, Hanna Onerva & Sarvimäki, Matti, 2022. "Intergenerational Spillovers of Integration Policies: Evidence from Finland’s Integration Plans," IZA Discussion Papers 15310, Institute of Labor Economics (IZA).
    5. Yang He & Otávio Bartalotti, 2020. "Wild bootstrap for fuzzy regression discontinuity designs: obtaining robust bias-corrected confidence intervals [Using Maimonides’ rule to estimate the effect of class size on scholastic achievemen," The Econometrics Journal, Royal Economic Society, vol. 23(2), pages 211-231.
    6. Patrizia Ordine & Giuseppe Rose, 2019. "Early entry, age-at-test, and schooling attainment: evidence from Italian primary schools," Economia Politica: Journal of Analytical and Institutional Economics, Springer;Fondazione Edison, vol. 36(3), pages 761-784, October.
    7. Ma, Jun & Marmer, Vadim & Shneyerov, Artyom, 2019. "Inference for first-price auctions with Guerre, Perrigne, and Vuong’s estimator," Journal of Econometrics, Elsevier, vol. 211(2), pages 507-538.
    8. David N. Figlio & Krzysztof Karbownik & Umut Özek, 2023. "Sibling Spillovers May Enhance the Efficacy of Targeted School Policies," NBER Working Papers 31406, National Bureau of Economic Research, Inc.
    9. Stéphane Bonhomme & Martin Weidner, 2020. "Minimizing Sensitivity to Model Misspecification," CeMMAP working papers CWP37/20, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    10. Stéphane Bonhomme & Martin Weidner, 2022. "Minimizing sensitivity to model misspecification," Quantitative Economics, Econometric Society, vol. 13(3), pages 907-954, July.
    11. Freyberger, Joachim & Rai, Yoshiyasu, 2018. "Uniform confidence bands: Characterization and optimality," Journal of Econometrics, Elsevier, vol. 204(1), pages 119-130.
    12. Ying-Ying Lee, 2018. "Partial Mean Processes with Generated Regressors: Continuous Treatment Effects and Nonseparable Models," Papers 1811.00157, arXiv.org.
    13. Matti Sarvimäki & Hanna Pesola, 2022. "Intergenerational Spillovers of Integration Policies: Evidence from Finland’s Integration Plans," RF Berlin - CReAM Discussion Paper Series 2212, Rockwool Foundation Berlin (RF Berlin) - Centre for Research and Analysis of Migration (CReAM).
    14. Kato, Kengo & Sasaki, Yuya, 2018. "Uniform confidence bands in deconvolution with unknown error distribution," Journal of Econometrics, Elsevier, vol. 207(1), pages 129-161.
    15. Guastavino, Carlos & Miranda, Alvaro & Montero, Rodrigo, 2021. "Rank effect in bureaucrat recruitment," European Journal of Political Economy, Elsevier, vol. 68(C).
    16. Kengo Kato & Yuya Sasaki & Takuya Ura, 2021. "Robust inference in deconvolution," Quantitative Economics, Econometric Society, vol. 12(1), pages 109-142, January.
    17. Tomasz Olma, 2021. "Nonparametric Estimation of Truncated Conditional Expectation Functions," Papers 2109.06150, arXiv.org.
    18. Samantha E. Clark & Ruth Etzioni & Jerry Radich & Zachary Marcum & Anirban Basu, 2023. "The price elasticity of Gleevec in patients with Chronic Myeloid Leukemia enrolled in Medicare Part D: Evidence from a regression discontinuity design," Papers 2305.06076, arXiv.org.
    19. Blaise Melly & Rafael Lalive, 2020. "Estimation, Inference, and Interpretation in the Regression Discontinuity Design," Diskussionsschriften dp2016, Universitaet Bern, Departement Volkswirtschaft.
    20. Dean Eckles & Nikolaos Ignatiadis & Stefan Wager & Han Wu, 2020. "Noise-Induced Randomization in Regression Discontinuity Designs," Papers 2004.09458, arXiv.org, revised Nov 2023.
    21. Federico Crippa, 2024. "Manipulation Test for Multidimensional RDD," Papers 2402.10836, arXiv.org.
    22. Yingying Dong & Michal Kolesár, 2023. "When can we ignore measurement error in the running variable?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(5), pages 735-750, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hansen, Benjamin & Miller, Keaton & Weber, Caroline, 2020. "Federalism, partial prohibition, and cross-border sales: Evidence from recreational marijuana," Journal of Public Economics, Elsevier, vol. 187(C).
    2. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    3. Yang He & Otávio Bartalotti, 2020. "Wild bootstrap for fuzzy regression discontinuity designs: obtaining robust bias-corrected confidence intervals [Using Maimonides’ rule to estimate the effect of class size on scholastic achievemen," The Econometrics Journal, Royal Economic Society, vol. 23(2), pages 211-231.
    4. Mauricio Villamizar‐Villegas & Freddy A. Pinzon‐Puerto & Maria Alejandra Ruiz‐Sanchez, 2022. "A comprehensive history of regression discontinuity designs: An empirical survey of the last 60 years," Journal of Economic Surveys, Wiley Blackwell, vol. 36(4), pages 1130-1178, September.
    5. Jin-young Choi & Myoung-jae Lee, 2017. "Regression discontinuity: review with extensions," Statistical Papers, Springer, vol. 58(4), pages 1217-1246, December.
    6. Xiao Huang & Zhaoguo Zhan, 2022. "Local Composite Quantile Regression for Regression Discontinuity," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(4), pages 1863-1875, October.
    7. Yoichi Arai & Taisuke Otsu & Myung Hwan Seo, 2021. "Regression Discontinuity Design with Potentially Many Covariates," Papers 2109.08351, arXiv.org, revised Feb 2024.
    8. Bartalotti Otávio, 2019. "Regression Discontinuity and Heteroskedasticity Robust Standard Errors: Evidence from a Fixed-Bandwidth Approximation," Journal of Econometric Methods, De Gruyter, vol. 8(1), pages 1-26, January.
    9. Louise Grogan & Fraser Summerfield, 2019. "Government Transfers, Work, and Wellbeing: Evidence from the Russian Old-Age Pension," Journal of Population Economics, Springer;European Society for Population Economics, vol. 32(4), pages 1247-1292, October.
    10. Marinho Bertanha & Guido W. Imbens, 2020. "External Validity in Fuzzy Regression Discontinuity Designs," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 38(3), pages 593-612, July.
    11. Zhuan Pei & David S. Lee & David Card & Andrea Weber, 2022. "Local Polynomial Order in Regression Discontinuity Designs," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(3), pages 1259-1267, June.
    12. Anderson, Kathryn & Gong, Xue & Hong, Kai & Zhang, Xi, 2016. "Do selective high schools improve student achievement? Effects of exam schools in China," China Economic Review, Elsevier, vol. 40(C), pages 121-134.
    13. Guido Imbens & Stefan Wager, 2019. "Optimized Regression Discontinuity Designs," The Review of Economics and Statistics, MIT Press, vol. 101(2), pages 264-278, May.
    14. Nicholas Barton & Tessa Bold & Justin Sandefur, 2017. "Measuring Rents from Public Employment: Regression Discontinuity Evidence from Kenya - Working Paper 457," Working Papers 457, Center for Global Development.
    15. Bold, Tessa & Barton, Nicholas & Sandefur, Justin, 2017. "Measuring Rents from Public Employment: Regression discontinuity evidence from Kenya," CEPR Discussion Papers 12105, C.E.P.R. Discussion Papers.
    16. 'Agoston Reguly, 2021. "Heterogeneous Treatment Effects in Regression Discontinuity Designs," Papers 2106.11640, arXiv.org, revised Oct 2021.
    17. Deng, Taotao & Hu, Yukun & Ma, Mulan, 2019. "Regional policy and tourism: A quasi-natural experiment," Annals of Tourism Research, Elsevier, vol. 74(C), pages 1-16.
    18. Tatiana Komarova & Denis Nekipelov, 2020. "Identification and Formal Privacy Guarantees," Papers 2006.14732, arXiv.org, revised May 2021.
    19. Harrison H. Li & Art B. Owen, 2022. "A general characterization of optimal tie-breaker designs," Papers 2202.12511, arXiv.org, revised Oct 2022.
    20. Wu, Jia & Wei, Xiangdong & Zhang, Hongliang & Zhou, Xiang, 2019. "Elite schools, magnet classes, and academic performances: Regression-discontinuity evidence from China," China Economic Review, Elsevier, vol. 55(C), pages 143-167.

    More about this item

    Keywords

    Nonparametric inference; relative efficiency;

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cwl:cwldpp:2044r2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Brittany Ladd (email available below). General contact details of provider: https://edirc.repec.org/data/cowleus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.