IDEAS home Printed from https://ideas.repec.org/p/kyo/wpaper/910.html
   My bibliography  Save this paper

The Effect of Measurement Error in the Sharp Regression Discontinuity Design

Author

Listed:
  • Takahide Yanagi

    (Graduate School of Economics Kyoto University, Research Fellow of Japan Society for the Promotion of Science)

Abstract

This paper develops a nonparametric analysis for the sharp regression discontinuity (RD) design in which the continuous forcing variable may contain measurement error. We show that if the observable forcing variable contains measurement error, this error causes severe identification bias for the average treatment effect given the “true†forcing variable at the discontinuity point. The bias is critical in the sense that even if there is a significant causal effect, researchers are misled to the incorrect conclusion of no causal effect. Furthermore, the measurement error leads the conditional probability of the treatment to be continuous at the threshold. To investigate the average treatment effect using the mismeasured forcing variable, we propose an approximation using the small error variance approximation (SEVA) originally developed by Chesher (1991). Based on the SEVA, the average treatment effect is approximated up to the order of the variance of the measurement error using an identified parameter when the variance is small. We also develop an estimation procedure for the parameter that approximates the average treatment effect based on local polynomial regressions and the kernel density estimation. Monte Carlo simulations reveal the severity of the identification bias caused by the measurement error and demonstrate that our approximate analysis is successful.

Suggested Citation

  • Takahide Yanagi, 2014. "The Effect of Measurement Error in the Sharp Regression Discontinuity Design," KIER Working Papers 910, Kyoto University, Institute of Economic Research.
  • Handle: RePEc:kyo:wpaper:910
    as

    Download full text from publisher

    File URL: http://www.kier.kyoto-u.ac.jp/DP/DP910.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Erich Battistin & Agar Brugiavini & Enrico Rettore & Guglielmo Weber, 2009. "The Retirement Consumption Puzzle: Evidence from a Regression Discontinuity Approach," American Economic Review, American Economic Association, vol. 99(5), pages 2209-2226, December.
    2. Yoichi Arai & Hidehiko Ichimura, 2018. "Simultaneous selection of optimal bandwidths for the sharp regression discontinuity estimator," Quantitative Economics, Econometric Society, vol. 9(1), pages 441-482, March.
    3. Andrew Chesher & Christian Schluter, 2002. "Welfare Measurement and Measurement Error," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 69(2), pages 357-378.
    4. Sebastian Calonico & Matias D. Cattaneo & Rocio Titiunik, 2014. "Robust Nonparametric Confidence Intervals for Regression‐Discontinuity Designs," Econometrica, Econometric Society, vol. 82, pages 2295-2326, November.
    5. David Card & Lara D. Shore-Sheppard, 2004. "Using Discontinuous Eligibility Rules to Identify the Effects of the Federal Medicaid Expansions on Low-Income Children," The Review of Economics and Statistics, MIT Press, vol. 86(3), pages 752-766, August.
    6. Susanne M. Schennach, 2012. "Measurement error in nonlinear models - a review," CeMMAP working papers CWP41/12, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    7. Imbens, Guido W. & Lemieux, Thomas, 2008. "Regression discontinuity designs: A guide to practice," Journal of Econometrics, Elsevier, vol. 142(2), pages 615-635, February.
    8. Lee, David S. & Card, David, 2008. "Regression discontinuity inference with specification error," Journal of Econometrics, Elsevier, vol. 142(2), pages 655-674, February.
    9. Patrick Hullegie & Tobias J. Klein, 2010. "The effect of private health insurance on medical care utilization and self‐assessed health in Germany," Health Economics, John Wiley & Sons, Ltd., vol. 19(9), pages 1048-1062, September.
    10. Jinyong Hahn & Petra Todd & Wilbert Van der Klaauw, 1999. "Evaluating the Effect of an Antidiscrimination Law Using a Regression-Discontinuity Design," NBER Working Papers 7131, National Bureau of Economic Research, Inc.
    11. Guido Imbens & Karthik Kalyanaraman, 2012. "Optimal Bandwidth Choice for the Regression Discontinuity Estimator," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 79(3), pages 933-959.
    12. Diane Whitmore Schanzenbach, 2009. "Do School Lunches Contribute to Childhood Obesity?," Journal of Human Resources, University of Wisconsin Press, vol. 44(3).
    13. David S. Lee & Thomas Lemieux, 2010. "Regression Discontinuity Designs in Economics," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 281-355, June.
    14. Koch, Thomas G., 2013. "Using RD design to understand heterogeneity in health insurance crowd-out," Journal of Health Economics, Elsevier, vol. 32(3), pages 599-611.
    15. Bound, John & Brown, Charles & Mathiowetz, Nancy, 2001. "Measurement error in survey data," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 5, chapter 59, pages 3705-3843, Elsevier.
    16. David Card & Carlos Dobkin & Nicole Maestas, 2008. "The Impact of Nearly Universal Insurance Coverage on Health Care Utilization: Evidence from Medicare," American Economic Review, American Economic Association, vol. 98(5), pages 2242-2258, December.
    17. Yingying Dong, 2012. "Regression Discontinuity Applications with Rounding Errors in the Running Variable," Working Papers 111206, University of California-Irvine, Department of Economics.
    18. Lee, David S., 2008. "Randomized experiments from non-random selection in U.S. House elections," Journal of Econometrics, Elsevier, vol. 142(2), pages 675-697, February.
    19. McCrary, Justin, 2008. "Manipulation of the running variable in the regression discontinuity design: A density test," Journal of Econometrics, Elsevier, vol. 142(2), pages 698-714, February.
    20. Qi Li & Jeffrey Scott Racine, 2006. "Nonparametric Econometrics: Theory and Practice," Economics Books, Princeton University Press, edition 1, volume 1, number 8355.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mauricio Villamizar‐Villegas & Freddy A. Pinzon‐Puerto & Maria Alejandra Ruiz‐Sanchez, 2022. "A comprehensive history of regression discontinuity designs: An empirical survey of the last 60 years," Journal of Economic Surveys, Wiley Blackwell, vol. 36(4), pages 1130-1178, September.
    2. YANAGI, Takahide & 柳, 貴英, 2015. "Regression Discontinuity Designs with Nonclassical Measurement Error," Discussion Papers 2015-09, Graduate School of Economics, Hitotsubashi University.
    3. Zhuan Pei & Yi Shen, 2017. "The Devil is in the Tails: Regression Discontinuity Design with Measurement Error in the Assignment Variable," Advances in Econometrics, in: Regression Discontinuity Designs, volume 38, pages 455-502, Emerald Group Publishing Limited.
    4. Jin-young Choi & Myoung-jae Lee, 2017. "Regression discontinuity: review with extensions," Statistical Papers, Springer, vol. 58(4), pages 1217-1246, December.
    5. Dean Eckles & Nikolaos Ignatiadis & Stefan Wager & Han Wu, 2020. "Noise-Induced Randomization in Regression Discontinuity Designs," Papers 2004.09458, arXiv.org, revised Nov 2023.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. YANAGI, Takahide & 柳, 貴英, 2015. "Regression Discontinuity Designs with Nonclassical Measurement Error," Discussion Papers 2015-09, Graduate School of Economics, Hitotsubashi University.
    2. Davezies, Laurent & Le Barbanchon, Thomas, 2017. "Regression discontinuity design with continuous measurement error in the running variable," Journal of Econometrics, Elsevier, vol. 200(2), pages 260-281.
    3. Mauricio Villamizar‐Villegas & Freddy A. Pinzon‐Puerto & Maria Alejandra Ruiz‐Sanchez, 2022. "A comprehensive history of regression discontinuity designs: An empirical survey of the last 60 years," Journal of Economic Surveys, Wiley Blackwell, vol. 36(4), pages 1130-1178, September.
    4. Jin-young Choi & Myoung-jae Lee, 2017. "Regression discontinuity: review with extensions," Statistical Papers, Springer, vol. 58(4), pages 1217-1246, December.
    5. Otávio Bartalotti, 2013. "Theory and Practice of Inference in Regression Discontinuity: A Fixed-Bandwidth Asymptotics Approach," Working Papers 1302, Tulane University, Department of Economics, revised Nov 2013.
    6. David S. Lee & Thomas Lemieux, 2010. "Regression Discontinuity Designs in Economics," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 281-355, June.
    7. Blaise Melly & Rafael Lalive, 2020. "Estimation, Inference, and Interpretation in the Regression Discontinuity Design," Diskussionsschriften dp2016, Universitaet Bern, Departement Volkswirtschaft.
    8. Bartalotti Otávio, 2019. "Regression Discontinuity and Heteroskedasticity Robust Standard Errors: Evidence from a Fixed-Bandwidth Approximation," Journal of Econometric Methods, De Gruyter, vol. 8(1), pages 1-26, January.
    9. Dong, Yingying, 2010. "Jumpy or Kinky? Regression Discontinuity without the Discontinuity," MPRA Paper 25461, University Library of Munich, Germany.
    10. Ivan A Canay & Vishal Kamat, 2018. "Approximate Permutation Tests and Induced Order Statistics in the Regression Discontinuity Design," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 85(3), pages 1577-1608.
    11. Christelis, Dimitris & Georgarakos, Dimitris & Sanz-de-Galdeano, Anna, 2020. "The impact of health insurance on stockholding: A regression discontinuity approach," Journal of Health Economics, Elsevier, vol. 69(C).
    12. Christina Korting & Carl Lieberman & Jordan Matsudaira & Zhuan Pei & Yi Shen, 2023. "Visual Inference and Graphical Representation in Regression Discontinuity Designs," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 138(3), pages 1977-2019.
    13. Joaquín Artés & Ignacio Jurado, 2018. "Government fragmentation and fiscal deficits: a regression discontinuity approach," Public Choice, Springer, vol. 175(3), pages 367-391, June.
    14. Lee Myoung-Jae, 2017. "Regression Discontinuity with Errors in the Running Variable: Effect on Truthful Margin," Journal of Econometric Methods, De Gruyter, vol. 6(1), pages 1-8, January.
    15. Montoya, Ana Maria & Noton, Carlos & Solis, Alex, 2018. "The Returns to College Choice: Loans, Scholarships and Labor Outcomes," Working Paper Series 2018:12, Uppsala University, Department of Economics.
    16. Ivan A. Canay & Vishal Kamat, 2015. "Approximate permutation tests and induced order statistics in the regression discontinuity design," CeMMAP working papers 27/15, Institute for Fiscal Studies.
    17. Zhuan Pei & Yi Shen, 2017. "The Devil is in the Tails: Regression Discontinuity Design with Measurement Error in the Assignment Variable," Advances in Econometrics, in: Regression Discontinuity Designs, volume 38, pages 455-502, Emerald Group Publishing Limited.
    18. Yiqi Liu & Yuan Qi, 2023. "Using Forests in Multivariate Regression Discontinuity Designs," Papers 2303.11721, arXiv.org.
    19. Xu, Ke-Li, 2017. "Regression discontinuity with categorical outcomes," Journal of Econometrics, Elsevier, vol. 201(1), pages 1-18.
    20. Yingying Dong, 2012. "Regression Discontinuity Applications with Rounding Errors in the Running Variable," Working Papers 111206, University of California-Irvine, Department of Economics.

    More about this item

    Keywords

    Panel data; Regression discontinuity designs; classical measurement error; approximation; nonparametric methods; local polynomial regressions;
    All these keywords.

    JEL classification:

    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kyo:wpaper:910. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Makoto Watanabe (email available below). General contact details of provider: https://edirc.repec.org/data/iekyojp.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.