IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/21509.html
   My bibliography  Save this paper

The Effects of Test-based Retention on Student Outcomes over Time: Regression Discontinuity Evidence from Florida

Author

Listed:
  • Guido Schwerdt
  • Martin R. West
  • Marcus A. Winters

Abstract

Many American states require that students lacking basic reading proficiency after third grade be retained and remediated. We exploit a discontinuity in retention probabilities under Florida's test-based promotion policy to study its effects on student outcomes through high school. We find large positive effects on achievement that fade out entirely when retained students are compared to their same-age peers, but remain substantial through grade 10 when compared to students in the same grade. Being retained in third grade due to missing the promotion standard increases students' grade point averages and leads them to take fewer remedial courses in high school but has no effect on their probability of graduating.

Suggested Citation

  • Guido Schwerdt & Martin R. West & Marcus A. Winters, 2015. "The Effects of Test-based Retention on Student Outcomes over Time: Regression Discontinuity Evidence from Florida," NBER Working Papers 21509, National Bureau of Economic Research, Inc.
    • Handle: RePEc:nbr:nberwo:21509
    Note: ED
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w21509.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Elizabeth U. Cascio & Douglas O. Staiger, 2012. "Knowledge, Tests, and Fadeout in Educational Interventions," NBER Working Papers 18038, National Bureau of Economic Research, Inc.
    2. Schwerdt, Guido & West, Martin R. & Winters, Marcus A., 2017. "The effects of test-based retention on student outcomes over time: Regression discontinuity evidence from Florida," Journal of Public Economics, Elsevier, vol. 152(C), pages 154-169.
    3. Raj Chetty & John N. Friedman & Nathaniel Hilger & Emmanuel Saez & Diane Whitmore Schanzenbach & Danny Yagan, 2011. "How Does Your Kindergarten Classroom Affect Your Earnings? Evidence from Project Star," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(4), pages 1593-1660.
    4. Miguel Urquiola & Eric Verhoogen, 2009. "Class-Size Caps, Sorting, and the Regression-Discontinuity Design," American Economic Review, American Economic Association, vol. 99(1), pages 179-215, March.
    5. Brian A. Jacob & Lars Lefgren, 2004. "Remedial Education and Student Achievement: A Regression-Discontinuity Analysis," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 226-244, February.
    6. Marcus A. Winters & Jay P. Greene, 2012. "The Medium-Run Effects of Florida’s Test-Based Promotion Policy," Education Finance and Policy, MIT Press, vol. 7(3), pages 305-330, July.
    7. Brian A. Jacob & Lars Lefgren, 2009. "The Effect of Grade Retention on High School Completion," American Economic Journal: Applied Economics, American Economic Association, vol. 1(3), pages 33-58, July.
    8. Marco Manacorda, 2012. "The Cost of Grade Retention," The Review of Economics and Statistics, MIT Press, vol. 94(2), pages 596-606, May.
    9. Eide, Eric R. & Showalter, Mark H., 2001. "The effect of grade retention on educational and labor market outcomes," Economics of Education Review, Elsevier, vol. 20(6), pages 563-576, December.
    10. Joshua D. Angrist & Jörn-Steffen Pischke, 2009. "Mostly Harmless Econometrics: An Empiricist's Companion," Economics Books, Princeton University Press, edition 1, number 8769.
    11. John P. Papay & Richard J. Murnane & John B. Willett, 2011. "How Performance Information Affects Human-Capital Investment Decisions: The Impact of Test-Score Labels on Educational Outcomes," NBER Working Papers 17120, National Bureau of Economic Research, Inc.
    12. Umut Ozek, 2015. "Hold Back To Move Forward? Early Grade Retention And Student Misbehavior," Education Finance and Policy, MIT Press, vol. 10(3), pages 350-377, July.
    13. Schwerdt, Guido & West, Martin R., 2013. "The impact of alternative grade configurations on student outcomes through middle and high school," Journal of Public Economics, Elsevier, vol. 97(C), pages 308-326.
    14. Lee, David S. & Card, David, 2008. "Regression discontinuity inference with specification error," Journal of Econometrics, Elsevier, vol. 142(2), pages 655-674, February.
    15. Matthew M. Chingos & Martin R. West, 2012. "Do More Effective Teachers Earn More Outside the Classroom?," Education Finance and Policy, MIT Press, vol. 7(1), pages 8-43, January.
    16. Guido Imbens & Karthik Kalyanaraman, 2012. "Optimal Bandwidth Choice for the Regression Discontinuity Estimator," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 79(3), pages 933-959.
    17. Philip Babcock & Kelly Bedard, 2011. "The Wages of Failure: New Evidence on School Retention and Long-Run Outcomes," Education Finance and Policy, MIT Press, vol. 6(3), pages 293-322, July.
    18. Almond, Douglas & Currie, Janet, 2011. "Human Capital Development before Age Five," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 15, pages 1315-1486, Elsevier.
    19. David S. Lee & Thomas Lemieux, 2010. "Regression Discontinuity Designs in Economics," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 281-355, June.
    20. Kevin Lang, 2010. "Measurement Matters: Perspectives on Education Policy from an Economist and School Board Member," Journal of Economic Perspectives, American Economic Association, vol. 24(3), pages 167-182, Summer.
    21. Eric A. Hanushek & Steven G. Rivkin, 2010. "Generalizations about Using Value-Added Measures of Teacher Quality," American Economic Review, American Economic Association, vol. 100(2), pages 267-271, May.
    22. Austin Nichols, 2007. "Causal inference with observational data," Stata Journal, StataCorp LP, vol. 7(4), pages 507-541, December.
    23. Jay P. Greene & Marcus A. Winters, 2007. "Revisiting Grade Retention: An Evaluation of Florida's Test-Based Promotion Policy," Education Finance and Policy, MIT Press, vol. 2(4), pages 319-340, September.
    24. Matsudaira, Jordan D., 2008. "Mandatory summer school and student achievement," Journal of Econometrics, Elsevier, vol. 142(2), pages 829-850, February.
    25. John P. Papay & Richard J. Murnane & John B. Willett, 2016. "The Impact of Test Score Labels on Human-Capital Investment Decisions," Journal of Human Resources, University of Wisconsin Press, vol. 51(2), pages 357-388.
    Full references (including those not matched with items on IDEAS)

    Citations

    Blog mentions

    As found by EconAcademics.org, the blog aggregator for Economics research:
    1. Mississippi improves — by failing students?
      by Joanne in Linking and Thinking on Education by Joanne Jacobs on 2019-12-10 18:45:12
    2. Parents: My child may need to repeat a grade
      by Joanne in Linking and Thinking on Education by Joanne Jacobs on 2021-05-25 16:45:51

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ron Diris, 2017. "Don't Hold Back? The Effect of Grade Retention on Student Achievement," Education Finance and Policy, MIT Press, vol. 12(3), pages 312-341, Summer.
    2. Javier Valbuena & Mauro Mediavilla & Álvaro Choi & María Gil, 2021. "Effects Of Grade Retention Policies: A Literature Review Of Empirical Studies Applying Causal Inference," Journal of Economic Surveys, Wiley Blackwell, vol. 35(2), pages 408-451, April.
    3. Victoria Nevin Locke & P. Johnelle Sparks, 2019. "Who Gets Held Back? An Analysis of Grade Retention Using Stratified Frailty Models," Population Research and Policy Review, Springer;Southern Demographic Association (SDA), vol. 38(5), pages 695-731, October.
    4. Cockx, Bart, 2013. "Youth Unemployment in Belgium: Diagnosis and Key Remedies," IZA Policy Papers 66, Institute of Labor Economics (IZA).
    5. Hugo Reis & Emilio Borghesan, 2022. "Learning Through Repetition? A Dynamic Evaluation of Grade Retention in Portugal," Working Papers w202220, Banco de Portugal, Economics and Research Department.
    6. Ozkan Eren & Michael F. Lovenheim & H. Naci Mocan, 2022. "The Effect of Grade Retention on Adult Crime: Evidence from a Test-Based Promotion Policy," Journal of Labor Economics, University of Chicago Press, vol. 40(2), pages 361-395.
    7. Leighton, Margaret & Souza, Priscila & Straub, Stéphane, 2016. "Social Promotion in Primary School: Immediate and Cumulated Effects on Attainment," TSE Working Papers 16-649, Toulouse School of Economics (TSE).
    8. Patrizia Ordine & Giuseppe Rose, 2019. "Early entry, age-at-test, and schooling attainment: evidence from Italian primary schools," Economia Politica: Journal of Analytical and Institutional Economics, Springer;Fondazione Edison, vol. 36(3), pages 761-784, October.
    9. Figlio, David N. & Karbownik, Krzysztof & Özek, Umut, 2023. "Sibling Spillovers May Enhance the Efficacy of Targeted School Policies," IZA Discussion Papers 16250, Institute of Labor Economics (IZA).
    10. Luke C. Miller & Daphna Bassok, 2019. "The Effects of Universal Preschool on Grade Retention," Education Finance and Policy, MIT Press, vol. 14(2), pages 149-177, Spring.
    11. Figlio, David & Özek, Umut, 2020. "An extra year to learn English? Early grade retention and the human capital development of English learners," Journal of Public Economics, Elsevier, vol. 186(C).
    12. Eren, Ozkan & Depew, Briggs & Barnes, Stephen, 2017. "Test-based promotion policies, dropping out, and juvenile crime," Journal of Public Economics, Elsevier, vol. 153(C), pages 9-31.
    13. Bach, Maximilian, 2019. "Strategic grade retention," ZEW Discussion Papers 19-059, ZEW - Leibniz Centre for European Economic Research.
    14. Schwerdt, Guido & West, Martin R. & Winters, Marcus A., 2017. "The effects of test-based retention on student outcomes over time: Regression discontinuity evidence from Florida," Journal of Public Economics, Elsevier, vol. 152(C), pages 154-169.
    15. Zhang, Shiying & Huang, Ao, 2022. "The long-term effects of automatic grade promotion on child development," China Economic Review, Elsevier, vol. 74(C).
    16. Kugler Franziska & Schwerdt Guido & Wößmann Ludger, 2014. "Ökonometrische Methoden zur Evaluierung kausaler Effekte der Wirtschaftspolitik," Perspektiven der Wirtschaftspolitik, De Gruyter, vol. 15(2), pages 105-132, June.
    17. Gerry Redmond & Irene García-Moya & Carmen Moreno & Anna Mooney & Fiona Brooks, 2022. "Gender Differences in the Relationship between Pressure from Schoolwork and Health Complaints: a Three Country Study," Child Indicators Research, Springer;The International Society of Child Indicators (ISCI), vol. 15(3), pages 763-780, June.
    18. Katharina Rathmann & Katharina Loter & Theres Vockert, 2020. "Critical Events throughout the Educational Career: The Effect of Grade Retention and Repetition on School-Aged Children’s Well-Being," IJERPH, MDPI, vol. 17(11), pages 1-30, June.
    19. Tafreschi, Darjusch & Thiemann, Petra, 2016. "Doing it twice, getting it right? The effects of grade retention and course repetition in higher education," Economics of Education Review, Elsevier, vol. 55(C), pages 198-219.
    20. Servaas van der Berg & Gabrielle Wills & Rebecca Selkirk & Charles Adams & Chris van Wyk, 2019. "The cost of repetition in South Africa," Working Papers 13/2019, Stellenbosch University, Department of Economics.
    21. Amy Ellen Schwartz & Douglas Almond & Ajin Lee, 2016. "Retention Heterogeneity in New York City Schools," Center for Policy Research Working Papers 198, Center for Policy Research, Maxwell School, Syracuse University.
    22. Solis, Alex, 2017. "The Effects of Grade Retention on Human Capital Accumulation," Working Paper Series 2017:15, Uppsala University, Department of Economics, revised 07 Dec 2017.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Eren, Ozkan & Depew, Briggs & Barnes, Stephen, 2017. "Test-based promotion policies, dropping out, and juvenile crime," Journal of Public Economics, Elsevier, vol. 153(C), pages 9-31.
    2. Javier Valbuena & Mauro Mediavilla & Álvaro Choi & María Gil, 2021. "Effects Of Grade Retention Policies: A Literature Review Of Empirical Studies Applying Causal Inference," Journal of Economic Surveys, Wiley Blackwell, vol. 35(2), pages 408-451, April.
    3. Ron Diris, 2017. "Don't Hold Back? The Effect of Grade Retention on Student Achievement," Education Finance and Policy, MIT Press, vol. 12(3), pages 312-341, Summer.
    4. Figlio, D. & Karbownik, K. & Salvanes, K.G., 2016. "Education Research and Administrative Data," Handbook of the Economics of Education,, Elsevier.
    5. Lochmann, Alexia & Rapoport, Hillel & Speciale, Biagio, 2019. "The effect of language training on immigrants’ economic integration: Empirical evidence from France," European Economic Review, Elsevier, vol. 113(C), pages 265-296.
    6. Tafreschi, Darjusch & Thiemann, Petra, 2016. "Doing it twice, getting it right? The effects of grade retention and course repetition in higher education," Economics of Education Review, Elsevier, vol. 55(C), pages 198-219.
    7. Zhang, Shiying & Huang, Ao, 2022. "The long-term effects of automatic grade promotion on child development," China Economic Review, Elsevier, vol. 74(C).
    8. Jin-young Choi & Myoung-jae Lee, 2017. "Regression discontinuity: review with extensions," Statistical Papers, Springer, vol. 58(4), pages 1217-1246, December.
    9. Solis, Alex, 2017. "The Effects of Grade Retention on Human Capital Accumulation," Working Paper Series 2017:15, Uppsala University, Department of Economics, revised 07 Dec 2017.
    10. Emilio Borghesan & Hugo Reis & Petra E. Todd, 2022. "Learning Through Repetition? A Dynamic Evaluation of Grade Retention in Portugal," PIER Working Paper Archive 22-030, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    11. Christina LiCalsi & Umut Ozek & David Figlio, 2019. "The Uneven Implementation of Universal School Policies: Maternal Education and Florida's Mandatory Grade Retention Policy," Education Finance and Policy, MIT Press, vol. 14(3), pages 383-413, Summer.
    12. Luke C. Miller & Daphna Bassok, 2019. "The Effects of Universal Preschool on Grade Retention," Education Finance and Policy, MIT Press, vol. 14(2), pages 149-177, Spring.
    13. Umut Ozek, 2015. "Hold Back To Move Forward? Early Grade Retention And Student Misbehavior," Education Finance and Policy, MIT Press, vol. 10(3), pages 350-377, July.
    14. Mauricio Villamizar‐Villegas & Freddy A. Pinzon‐Puerto & Maria Alejandra Ruiz‐Sanchez, 2022. "A comprehensive history of regression discontinuity designs: An empirical survey of the last 60 years," Journal of Economic Surveys, Wiley Blackwell, vol. 36(4), pages 1130-1178, September.
    15. David S. Lee & Thomas Lemieux, 2010. "Regression Discontinuity Designs in Economics," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 281-355, June.
    16. Peter Fredriksson & Björn Öckert & Hessel Oosterbeek, 2013. "Long-Term Effects of Class Size," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 128(1), pages 249-285.
    17. Ozkan Eren & Michael F. Lovenheim & H. Naci Mocan, 2022. "The Effect of Grade Retention on Adult Crime: Evidence from a Test-Based Promotion Policy," Journal of Labor Economics, University of Chicago Press, vol. 40(2), pages 361-395.
    18. Jane Cooley Fruehwirth & Salvador Navarro & Yuya Takahashi, 2016. "How the Timing of Grade Retention Affects Outcomes: Identification and Estimation of Time-Varying Treatment Effects," Journal of Labor Economics, University of Chicago Press, vol. 34(4), pages 979-1021.
    19. Bach, Maximilian, 2019. "Strategic grade retention," ZEW Discussion Papers 19-059, ZEW - Leibniz Centre for European Economic Research.
    20. Figlio, David N. & Karbownik, Krzysztof & Özek, Umut, 2023. "Sibling Spillovers May Enhance the Efficacy of Targeted School Policies," IZA Discussion Papers 16250, Institute of Labor Economics (IZA).

    More about this item

    JEL classification:

    • H52 - Public Economics - - National Government Expenditures and Related Policies - - - Government Expenditures and Education
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • I28 - Health, Education, and Welfare - - Education - - - Government Policy

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:21509. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.