IDEAS home Printed from https://ideas.repec.org/p/ptu/wpaper/w202220.html
   My bibliography  Save this paper

Learning Through Repetition? A Dynamic Evaluation of Grade Retention in Portugal

Author

Listed:
  • Hugo Reis
  • Emilio Borghesan

Abstract

High grade retention rates are a matter of much worldwide debate. Although some students learn more with extended school time, others get discouraged and drop out. This paper develops and implements a dynamic modeling approach for estimating retention effects in Portuguese high schools where over 40% of students were retained. The estimated model is used to simulate academic achievement under existing and alternative retention policies. Results show that the current policy’s average impact on 12th grade math and Portuguese test scores is positive (0.2-0.5 s.d.), but it substantially increases dropout. We solve for the optimal policy to maximize lifetime earnings.

Suggested Citation

  • Hugo Reis & Emilio Borghesan, 2022. "Learning Through Repetition? A Dynamic Evaluation of Grade Retention in Portugal," Working Papers w202220, Banco de Portugal, Economics and Research Department.
    • Handle: RePEc:ptu:wpaper:w202220
    as

    Download full text from publisher

    File URL: https://www.bportugal.pt/sites/default/files/anexos/papers/wp202220.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Robert J. Gary‐Bobo & Marion Goussé & Jean‐Marc Robin, 2016. "Grade retention and unobserved heterogeneity," Quantitative Economics, Econometric Society, vol. 7(3), pages 781-820, November.
    2. James J. Heckman & Vytlacil, Edward J., 2007. "Econometric Evaluation of Social Programs, Part II: Using the Marginal Treatment Effect to Organize Alternative Econometric Estimators to Evaluate Social Programs, and to Forecast their Effects in New," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 71, Elsevier.
    3. Ferreira Sequeda, Maria & Golsteyn, Bart & Parra Cely, Sergio, 2018. "The effect of grade retention on secondary school performance: Evidence from a natural experiment," ROA Research Memorandum 003, Maastricht University, Research Centre for Education and the Labour Market (ROA).
    4. Pedro Carneiro & Karsten T. Hansen & James J. Heckman, 2003. "Estimating Distributions of Treatment Effects with an Application to the Returns to Schooling and Measurement of the Effects of Uncertainty on College," NBER Working Papers 9546, National Bureau of Economic Research, Inc.
    5. James J. Heckman & Edward Vytlacil, 2005. "Structural Equations, Treatment Effects, and Econometric Policy Evaluation," Econometrica, Econometric Society, vol. 73(3), pages 669-738, May.
    6. Schwerdt, Guido & West, Martin R. & Winters, Marcus A., 2017. "The effects of test-based retention on student outcomes over time: Regression discontinuity evidence from Florida," Journal of Public Economics, Elsevier, vol. 152(C), pages 154-169.
    7. Dougherty, Christopher, 2003. "Numeracy, literacy and earnings: evidence from the National Longitudinal Survey of Youth," Economics of Education Review, Elsevier, vol. 22(5), pages 511-521, October.
    8. Jane Cooley Fruehwirth & Salvador Navarro & Yuya Takahashi, 2016. "How the Timing of Grade Retention Affects Outcomes: Identification and Estimation of Time-Varying Treatment Effects," Journal of Labor Economics, University of Chicago Press, vol. 34(4), pages 979-1021.
    9. Raj Chetty & John N. Friedman & Nathaniel Hilger & Emmanuel Saez & Diane Whitmore Schanzenbach & Danny Yagan, 2011. "How Does Your Kindergarten Classroom Affect Your Earnings? Evidence from Project Star," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(4), pages 1593-1660.
    10. Heckman, James J. & Navarro, Salvador, 2007. "Dynamic discrete choice and dynamic treatment effects," Journal of Econometrics, Elsevier, vol. 136(2), pages 341-396, February.
    11. Eren, Ozkan & Depew, Briggs & Barnes, Stephen, 2017. "Test-based promotion policies, dropping out, and juvenile crime," Journal of Public Economics, Elsevier, vol. 153(C), pages 9-31.
    12. Petra E. Todd & Kenneth I. Wolpin, 2007. "The Production of Cognitive Achievement in Children: Home, School, and Racial Test Score Gaps," Journal of Human Capital, University of Chicago Press, vol. 1(1), pages 91-136.
    13. Carneiro, Pedro & Hansen, Karsten T. & Heckman, James J., 2003. "Estimating Distributions of Treatment Effects with an Application to the Returns to Schooling and Measurement of the Effects of Uncertainty on College Choice," IZA Discussion Papers 767, Institute of Labor Economics (IZA).
    14. Brian A. Jacob & Lars Lefgren, 2004. "Remedial Education and Student Achievement: A Regression-Discontinuity Analysis," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 226-244, February.
    15. Baert, Stijn & Picchio, Matteo, 2021. "A signal of (Train)ability? Grade repetition and hiring chances," Journal of Economic Behavior & Organization, Elsevier, vol. 188(C), pages 867-878.
    16. Bart Cockx & Matteo Picchio & Stijn Baert, 2019. "Modeling the effects of grade retention in high school," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 34(3), pages 403-424, April.
    17. Peter Arcidiacono & Holger Sieg & Frank Sloan, 2007. "Living Rationally Under The Volcano? An Empirical Analysis Of Heavy Drinking And Smoking," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 48(1), pages 37-65, February.
    18. Brian A. Jacob & Lars Lefgren, 2009. "The Effect of Grade Retention on High School Completion," American Economic Journal: Applied Economics, American Economic Association, vol. 1(3), pages 33-58, July.
    19. Pedro Carneiro & Karsten T. Hansen & James J. Heckman, 2003. "2001 Lawrence R. Klein Lecture Estimating Distributions of Treatment Effects with an Application to the Returns to Schooling and Measurement of the Effects of Uncertainty on College Choice," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 44(2), pages 361-422, May.
    20. Marco Manacorda, 2012. "The Cost of Grade Retention," The Review of Economics and Statistics, MIT Press, vol. 94(2), pages 596-606, May.
    21. Flavio Cunha & James J. Heckman & Susanne M. Schennach, 2010. "Estimating the Technology of Cognitive and Noncognitive Skill Formation," Econometrica, Econometric Society, vol. 78(3), pages 883-931, May.
    22. Eide, Eric R. & Showalter, Mark H., 2001. "The effect of grade retention on educational and labor market outcomes," Economics of Education Review, Elsevier, vol. 20(6), pages 563-576, December.
    23. Erich Battistin & Antonio Schizzerotto, 2019. "Threat of grade retention, remedial education and student achievement: evidence from upper secondary schools in Italy," Empirical Economics, Springer, vol. 56(2), pages 651-678, February.
    24. Magne Mogstad & Andres Santos & Alexander Torgovitsky, 2018. "Using Instrumental Variables for Inference About Policy Relevant Treatment Parameters," Econometrica, Econometric Society, vol. 86(5), pages 1589-1619, September.
    25. Edward Vytlacil & James J. Heckman, 2001. "Policy-Relevant Treatment Effects," American Economic Review, American Economic Association, vol. 91(2), pages 107-111, May.
    26. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    27. Petra E. Todd & Kenneth I. Wolpin, 2003. "On The Specification and Estimation of The Production Function for Cognitive Achievement," Economic Journal, Royal Economic Society, vol. 113(485), pages 3-33, February.
    28. Petra Todd & Kenneth I. Wolpin, 2018. "Accounting for Mathematics Performance of High School Students in Mexico: Estimating a Coordination Game in the Classroom," Journal of Political Economy, University of Chicago Press, vol. 126(6), pages 2608-2650.
    29. Robert J. Gary‐Bobo & Marion Goussé & Jean‐Marc Robin, 2016. "Grade retention and unobserved heterogeneity," Quantitative Economics, Econometric Society, vol. 7(3), pages 781-820, November.
    30. Cawley, John & Heckman, James & Vytlacil, Edward, 2001. "Three observations on wages and measured cognitive ability," Labour Economics, Elsevier, vol. 8(4), pages 419-442, September.
    31. Robert Gary-Bobo & Jean-Marc Robin & Marion Goussé, 2016. "Grade Retention and Unobserved Heterogeneity," Post-Print hal-03572141, HAL.
    32. Keane, Michael P & Wolpin, Kenneth I, 1997. "The Career Decisions of Young Men," Journal of Political Economy, University of Chicago Press, vol. 105(3), pages 473-522, June.
    33. Cunha, Flavio & Heckman, James J. & Lochner, Lance, 2006. "Interpreting the Evidence on Life Cycle Skill Formation," Handbook of the Economics of Education, in: Erik Hanushek & F. Welch (ed.), Handbook of the Economics of Education, edition 1, volume 1, chapter 12, pages 697-812, Elsevier.
    34. Daniel Ackerberg, 2009. "A new use of importance sampling to reduce computational burden in simulation estimation," Quantitative Marketing and Economics (QME), Springer, vol. 7(4), pages 343-376, December.
    35. Hugo Reis & Manuel Coutinho Pereira, 2014. "Grade retention during basic education in Portugal: determinants and impact on student achievement," Economic Bulletin and Financial Stability Report Articles and Banco de Portugal Economic Studies, Banco de Portugal, Economics and Research Department.
    36. Hugo Reis & Maria Manuel Campos, 2017. "Revisiting the returns to schooling in the Portuguese economy," Economic Bulletin and Financial Stability Report Articles and Banco de Portugal Economic Studies, Banco de Portugal, Economics and Research Department.
    37. Richard J. Murnane & John B. Willett & Yves Duhaldeborde & John H. Tyler, 2000. "How important are the cognitive skills of teenagers in predicting subsequent earnings?," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 19(4), pages 547-568.
    38. repec:hal:spmain:info:hdl:2441/4po7er2pp49baoh37bjdkluouu is not listed on IDEAS
    39. Francesco Agostinelli & Matthew Wiswall, 2016. "Estimating the Technology of Children's Skill Formation," NBER Working Papers 22442, National Bureau of Economic Research, Inc.
    40. Zvi Eckstein & Kenneth I. Wolpin, 1999. "Why Youths Drop Out of High School: The Impact of Preferences, Opportunities, and Abilities," Econometrica, Econometric Society, vol. 67(6), pages 1295-1340, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Javier Valbuena & Mauro Mediavilla & Álvaro Choi & María Gil, 2021. "Effects Of Grade Retention Policies: A Literature Review Of Empirical Studies Applying Causal Inference," Journal of Economic Surveys, Wiley Blackwell, vol. 35(2), pages 408-451, April.
    2. Zhang, Shiying & Huang, Ao, 2022. "The long-term effects of automatic grade promotion on child development," China Economic Review, Elsevier, vol. 74(C).
    3. Oliver Cassagneau-Francis, 2022. "Revisiting the Returns to Higher Education: Heterogeneity by Cognitive and Non-Cognitive Abilities," Working Papers hal-04067399, HAL.
    4. Oliver Cassagneau-Francis, 2022. "Revisiting the Returns to Higher Education: Heterogeneity by Cognitive and Non-Cognitive Abilities," SciencePo Working papers Main hal-04067399, HAL.
    5. Jorge Rodríguez & Fernando Saltiel & Sergio Urzúa, 2022. "Dynamic treatment effects of job training," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(2), pages 242-269, March.
    6. Jane Cooley Fruehwirth & Salvador Navarro & Yuya Takahashi, 2016. "How the Timing of Grade Retention Affects Outcomes: Identification and Estimation of Time-Varying Treatment Effects," Journal of Labor Economics, University of Chicago Press, vol. 34(4), pages 979-1021.
    7. Sebastian Galiani & Juan Pantano, 2021. "Structural Models: Inception and Frontier," NBER Working Papers 28698, National Bureau of Economic Research, Inc.
    8. Ron Diris, 2017. "Don't Hold Back? The Effect of Grade Retention on Student Achievement," Education Finance and Policy, MIT Press, vol. 12(3), pages 312-341, Summer.
    9. Robert J. Gary‐Bobo & Marion Goussé & Jean‐Marc Robin, 2016. "Grade retention and unobserved heterogeneity," Quantitative Economics, Econometric Society, vol. 7(3), pages 781-820, November.
    10. Elizabeth M. Caucutt & Lance Lochner, 2020. "Early and Late Human Capital Investments, Borrowing Constraints, and the Family," Journal of Political Economy, University of Chicago Press, vol. 128(3), pages 1065-1147.
    11. Flavio Cunha & James J. Heckman & Susanne M. Schennach, 2010. "Estimating the Technology of Cognitive and Noncognitive Skill Formation," Econometrica, Econometric Society, vol. 78(3), pages 883-931, May.
    12. Heckman, James J. & Humphries, John Eric & Veramendi, Gregory, 2016. "Dynamic treatment effects," Journal of Econometrics, Elsevier, vol. 191(2), pages 276-292.
    13. repec:hal:spmain:info:hdl:2441/4po7er2pp49baoh37bjdkluouu is not listed on IDEAS
    14. Bach, Maximilian, 2019. "Strategic grade retention," ZEW Discussion Papers 19-059, ZEW - Leibniz Centre for European Economic Research.
    15. Heckman, James J. & Urzúa, Sergio, 2010. "Comparing IV with structural models: What simple IV can and cannot identify," Journal of Econometrics, Elsevier, vol. 156(1), pages 27-37, May.
    16. Christian Belzil, 2008. "Testing the Specification of the Mincer Wage Equation," Annals of Economics and Statistics, GENES, issue 91-92, pages 427-451.
    17. Philipp Eisenhauer & James J. Heckman & Stefano Mosso, 2015. "Estimation Of Dynamic Discrete Choice Models By Maximum Likelihood And The Simulated Method Of Moments," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 56(2), pages 331-357, May.
    18. Bernal, Pedro & Mittag, Nikolas & Qureshi, Javaeria A., 2016. "Estimating effects of school quality using multiple proxies," Labour Economics, Elsevier, vol. 39(C), pages 1-10.
    19. James J. Heckman, 2008. "The Principles Underlying Evaluation Estimators with an Application to Matching," Annals of Economics and Statistics, GENES, issue 91-92, pages 9-73.
    20. Fernando Saltiel, 2019. "What's Math Got to Do With It? Multidimensional Ability and the Gender Gap in STEM," 2019 Meeting Papers 1201, Society for Economic Dynamics.
    21. Veramendi, Gregory & Urzúa, Sergio, 2011. "The Impact of Out-of-Home Childcare Centers on Early Childhood Development," IDB Publications (Working Papers) 3065, Inter-American Development Bank.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ptu:wpaper:w202220. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: DEE-NTD (email available below). General contact details of provider: https://edirc.repec.org/data/bdpgvpt.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.