IDEAS home Printed from https://ideas.repec.org/p/mpr/mprres/61fb6c057561451a8a607450814f6f06.html
   My bibliography  Save this paper

Technical Methods Report: Statistical Power for Regression Discontinuity Designs in Education Evaluations

Author

Listed:
  • Peter Z. Schochet

Abstract

This paper examines theoretical and empirical issues related to the statistical power of impact estimates under clustered regression discontinuity (RD) designs.

Suggested Citation

  • Peter Z. Schochet, "undated". "Technical Methods Report: Statistical Power for Regression Discontinuity Designs in Education Evaluations," Mathematica Policy Research Reports 61fb6c057561451a8a6074508, Mathematica Policy Research.
    • Handle: RePEc:mpr:mprres:61fb6c057561451a8a607450814f6f06
    as

    Download full text from publisher

    File URL: https://www.mathematica.org/-/media/publications/pdfs/education/statisticalpower.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. repec:mpr:mprres:5699 is not listed on IDEAS
    2. James J. Heckman & Edward Vytlacil, 2005. "Structural Equations, Treatment Effects, and Econometric Policy Evaluation," Econometrica, Econometric Society, vol. 73(3), pages 669-738, May.
    3. Brian A. Jacob & Lars Lefgren, 2004. "Remedial Education and Student Achievement: A Regression-Discontinuity Analysis," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 226-244, February.
    4. Peter Z. Schochet, "undated". "Statistical Power for Random Assignment Evaluations of Education Programs (Journal Article)," Mathematica Policy Research Reports a110ff428db043f4a6f55d349, Mathematica Policy Research.
    5. Yang L. & Tsiatis A. A., 2001. "Efficiency Study of Estimators for a Treatment Effect in a Pretest-Posttest Trial," The American Statistician, American Statistical Association, vol. 55, pages 314-321, November.
    6. Jens Ludwig & Douglas L. Miller, 2007. "Does Head Start Improve Children's Life Chances? Evidence from a Regression Discontinuity Design," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(1), pages 159-208.
    7. repec:mpr:mprres:5863 is not listed on IDEAS
    8. Wilbert van der Klaauw, 2002. "Estimating the Effect of Financial Aid Offers on College Enrollment: A Regression-Discontinuity Approach," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 43(4), pages 1249-1287, November.
    9. Imbens, Guido W. & Lemieux, Thomas, 2008. "Regression discontinuity designs: A guide to practice," Journal of Econometrics, Elsevier, vol. 142(2), pages 615-635, February.
    10. Peter Z. Schochet, "undated". "Is Regression Adjustment Supported by the Neyman Model for Causal Inference? (Presentation)," Mathematica Policy Research Reports abfc39d59c714499b2fe42f68, Mathematica Policy Research.
    11. Peter Z. Schochet, "undated". "Is Regression Adjustment Supported By the Neyman Model for Causal Inference?," Mathematica Policy Research Reports 782da2242fba458eb61752f96, Mathematica Policy Research.
    12. Hahn, Jinyong & Todd, Petra & Van der Klaauw, Wilbert, 2001. "Identification and Estimation of Treatment Effects with a Regression-Discontinuity Design," Econometrica, Econometric Society, vol. 69(1), pages 201-209, January.
    13. Peter Z. Schochet, "undated". "Statistical Power for Random Assignment Evaluations of Education Programs," Mathematica Policy Research Reports 6749d31ad72d4acf988f7dce5, Mathematica Policy Research.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. John Deke, 2016. "Design and Analysis Considerations for Cluster Randomized Controlled Trials That Have a Small Number of Clusters," Evaluation Review, , vol. 40(5), pages 444-486, October.
    2. Olivier Bargain & Delphine Boutin, 2021. "Minimum Age Regulation and Child Labor: New Evidence from Brazil," The World Bank Economic Review, World Bank, vol. 35(1), pages 234-260.
    3. John Deke & Thomas Wei & Tim Kautz, "undated". "Asymdystopia: The Threat of Small Biases in Evaluations of Education Interventions that Need to be Powered to Detect Small Impacts," Mathematica Policy Research Reports f0ff8f86e3c34dc8baaf22b56, Mathematica Policy Research.
    4. Philip Gleason & Alexandra Resch & Jillian Berk, 2018. "RD or Not RD: Using Experimental Studies to Assess the Performance of the Regression Discontinuity Approach," Evaluation Review, , vol. 42(1), pages 3-33, February.
    5. repec:mpr:mprres:7486 is not listed on IDEAS
    6. repec:mpr:mprres:7461 is not listed on IDEAS
    7. John Deke & Lisa Dragoset, "undated". "Statistical Power for Regression Discontinuity Designs in Education: Empirical Estimates of Design Effects Relative to Randomized Controlled Trials," Mathematica Policy Research Reports a4f1d03eb7bf427a8983d4736, Mathematica Policy Research.
    8. Jeffrey Smith & Arthur Sweetman, 2016. "Viewpoint: Estimating the causal effects of policies and programs," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 49(3), pages 871-905, August.
    9. Nicholas A. Bowman & Nayoung Jang, 2022. "What is the Purpose of Academic Probation? Its Substantial Negative Effects on Four-Year Graduation," Research in Higher Education, Springer;Association for Institutional Research, vol. 63(8), pages 1285-1311, December.
    10. Dolores De La Mata, 2012. "The Effect Of Medicaid Eligibility On Coverage, Utilization, And Children'S Health," Health Economics, John Wiley & Sons, Ltd., vol. 21(9), pages 1061-1079, September.
    11. Philip M. Gleason & Alexandra M. Resch & Jillian A. Berk, "undated". "Replicating Experimental Impact Estimates Using a Regression Discontinuity Approach," Mathematica Policy Research Reports c7ecf8b35c8d402491d09b2d0, Mathematica Policy Research.
    12. Hugh Sharma Waddington & Paul Fenton Villar & Jeffrey C. Valentine, 2023. "Can Non-Randomised Studies of Interventions Provide Unbiased Effect Estimates? A Systematic Review of Internal Replication Studies," Evaluation Review, , vol. 47(3), pages 563-593, June.
    13. Sarah Dolfin & Nan Maxwell & Ankita Patnaik, "undated". "WHD Compliance Strategies: Directions for Future Research," Mathematica Policy Research Reports b7a5ca876e0b448f9b9c0850e, Mathematica Policy Research.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. repec:mpr:mprres:6372 is not listed on IDEAS
    2. David S. Lee & Thomas Lemieux, 2010. "Regression Discontinuity Designs in Economics," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 281-355, June.
    3. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    4. Mauricio Villamizar‐Villegas & Freddy A. Pinzon‐Puerto & Maria Alejandra Ruiz‐Sanchez, 2022. "A comprehensive history of regression discontinuity designs: An empirical survey of the last 60 years," Journal of Economic Surveys, Wiley Blackwell, vol. 36(4), pages 1130-1178, September.
    5. Jin-young Choi & Myoung-jae Lee, 2017. "Regression discontinuity: review with extensions," Statistical Papers, Springer, vol. 58(4), pages 1217-1246, December.
    6. Peter Z. Schochet, "undated". "The Late Pretest Problem in Randomized Control Trials of Education Interventions," Mathematica Policy Research Reports fb514df5dbb84a5dbea79865c, Mathematica Policy Research.
    7. Marinho Bertanha & Guido W. Imbens, 2020. "External Validity in Fuzzy Regression Discontinuity Designs," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 38(3), pages 593-612, July.
    8. Peter Z. Schochet, "undated". "Statistical Theory for the RCT-YES Software: Design-Based Causal Inference for RCTs," Mathematica Policy Research Reports a0c005c003c242308a92c02dc, Mathematica Policy Research.
    9. Dong, Yingying, 2010. "Jumpy or Kinky? Regression Discontinuity without the Discontinuity," MPRA Paper 25461, University Library of Munich, Germany.
    10. Frandsen, Brigham R. & Frölich, Markus & Melly, Blaise, 2012. "Quantile treatment effects in the regression discontinuity design," Journal of Econometrics, Elsevier, vol. 168(2), pages 382-395.
    11. Juan Carlos Calcagno & Bridget Terry Long, 2008. "The Impact of Postsecondary Remediation Using a Regression Discontinuity Approach: Addressing Endogenous Sorting and Noncompliance," NBER Working Papers 14194, National Bureau of Economic Research, Inc.
    12. Kenneth Fortson & Natalya Verbitsky-Savitz & Emma Kopa & Philip Gleason, 2012. "Using an Experimental Evaluation of Charter Schools to Test Whether Nonexperimental Comparison Group Methods Can Replicate Experimental Impact Estimates," Mathematica Policy Research Reports 27f871b5b7b94f3a80278a593, Mathematica Policy Research.
    13. Pedro Carneiro & Rita Ginja, 2014. "Long-Term Impacts of Compensatory Preschool on Health and Behavior: Evidence from Head Start," American Economic Journal: Economic Policy, American Economic Association, vol. 6(4), pages 135-173, November.
    14. Gong, Jie & Lu, Yi & Xie, Huihua, 2020. "The average and distributional effects of teenage adversity on long-term health," Journal of Health Economics, Elsevier, vol. 71(C).
    15. repec:mpr:mprres:6094 is not listed on IDEAS
    16. Imbens, Guido W. & Lemieux, Thomas, 2008. "Regression discontinuity designs: A guide to practice," Journal of Econometrics, Elsevier, vol. 142(2), pages 615-635, February.
    17. Timothy B Armstrong & Michal Kolesár, 2018. "A Simple Adjustment for Bandwidth Snooping," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 85(2), pages 732-765.
    18. Blaise Melly & Rafael Lalive, 2020. "Estimation, Inference, and Interpretation in the Regression Discontinuity Design," Diskussionsschriften dp2016, Universitaet Bern, Departement Volkswirtschaft.
    19. Del Bono, Emilia & Francesconi, Marco & G. Best, Nicky, 2011. "Health information and health outcomes: an application of the regression discontinuity design to the 1995 UK contraceptive pill scare case," ISER Working Paper Series 2011-16, Institute for Social and Economic Research.
    20. Peter Z. Schochet & Hanley Chiang, "undated". "Technical Methods Report: Estimation and Identification of the Complier Average Causal Effect Parameter in Education RCTs," Mathematica Policy Research Reports 947d1823e3ff42208532a763d, Mathematica Policy Research.
    21. Aidan G. O'Keeffe & Gianluca Baio, 2016. "Approaches to the Estimation of the Local Average Treatment Effect in a Regression Discontinuity Design," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 43(4), pages 978-995, December.
    22. Peter Z. Schochet, 2020. "Analyzing Grouped Administrative Data for RCTs Using Design-Based Methods," Journal of Educational and Behavioral Statistics, , vol. 45(1), pages 32-57, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:mpr:mprres:61fb6c057561451a8a607450814f6f06. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Joanne Pfleiderer or Cindy George (email available below). General contact details of provider: https://edirc.repec.org/data/mathius.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.