IDEAS home Printed from https://ideas.repec.org/a/taf/edecon/v19y2011i3p229-252.html
   My bibliography  Save this article

Experimental estimates of the impacts of class size on test scores: robustness and heterogeneity

Author

Listed:
  • Weili Ding
  • Steven Lehrer

Abstract

Proponents of class size reductions (CSRs) draw heavily on the results from Project Student/Teacher Achievement Ratio to support their initiatives. Adding to the political appeal of these initiative are reports that minority and economically disadvantaged students received the largest benefits from smaller classes. We extend this research in two directions. First, to address correlated outcomes from the same class size treatment, we account for the over-rejection of the Null hypotheses by using multiple inference procedures. Second, we conduct a more detailed examination of the heterogeneous impacts of CSRs on measures of cognitive and non-cognitive achievement using more flexible models. We find that students with higher test scores received greater benefits from CSRs. Furthermore, we present evidence that the main effects of the small class treatment are robust to corrections for the multiple hypotheses being tested. However, these same corrections lead the differential impacts of smaller classes by race and free-lunch status to become statistically insignificant.

Suggested Citation

  • Weili Ding & Steven Lehrer, 2011. "Experimental estimates of the impacts of class size on test scores: robustness and heterogeneity," Education Economics, Taylor & Francis Journals, vol. 19(3), pages 229-252.
  • Handle: RePEc:taf:edecon:v:19:y:2011:i:3:p:229-252
    DOI: 10.1080/09645292.2011.589142
    as

    Download full text from publisher

    File URL: http://www.tandfonline.com/10.1080/09645292.2011.589142
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1080/09645292.2011.589142?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Yoav Benjamini & Abba M. Krieger & Daniel Yekutieli, 2006. "Adaptive linear step-up procedures that control the false discovery rate," Biometrika, Biometrika Trust, vol. 93(3), pages 491-507, September.
    2. Anderson, Michael L, 2008. "Multiple Inference and Gender Differences in the Effects of Early Intervention: A Reevaluation of the Abecedarian, Perry Preschool, and Early Training Projects," Department of Agricultural & Resource Economics, UC Berkeley, Working Paper Series qt15n8j26f, Department of Agricultural & Resource Economics, UC Berkeley.
    3. Weili Ding & Steven F. Lehrer, 2010. "Estimating Treatment Effects from Contaminated Multiperiod Education Experiments: The Dynamic Impacts of Class Size Reductions," The Review of Economics and Statistics, MIT Press, vol. 92(1), pages 31-42, February.
    4. Flavio Cunha & James J. Heckman & Susanne M. Schennach, 2010. "Estimating the Technology of Cognitive and Noncognitive Skill Formation," Econometrica, Econometric Society, vol. 78(3), pages 883-931, May.
    5. James J. Heckman & Jora Stixrud & Sergio Urzua, 2006. "The Effects of Cognitive and Noncognitive Abilities on Labor Market Outcomes and Social Behavior," Journal of Labor Economics, University of Chicago Press, vol. 24(3), pages 411-482, July.
    6. Lex Borghans & Bas ter Weel & Bruce A. Weinberg, 2008. "Interpersonal Styles and Labor Market Outcomes," Journal of Human Resources, University of Wisconsin Press, vol. 43(4).
    7. Anderson, Michael L., 2008. "Multiple Inference and Gender Differences in the Effects of Early Intervention: A Reevaluation of the Abecedarian, Perry Preschool, and Early Training Projects," Journal of the American Statistical Association, American Statistical Association, vol. 103(484), pages 1481-1495.
    8. Thomas S. Dee, 2004. "Teachers, Race, and Student Achievement in a Randomized Experiment," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 195-210, February.
    9. Jesse Rothstein, 2010. "Teacher Quality in Educational Production: Tracking, Decay, and Student Achievement," The Quarterly Journal of Economics, Oxford University Press, vol. 125(1), pages 175-214.
    10. Oriana Bandiera & Valentino Larcinese & Imran Rasul, 2010. "Heterogeneous Class Size Effects: New Evidence from a Panel of University Students," Economic Journal, Royal Economic Society, vol. 120(549), pages 1365-1398, December.
    11. Steven Lehrer, 2005. "Class Size And Student Achievement: Experimental Estimates Of Who Benefits And Who Loses From Reductions," Working Paper 1046, Economics Department, Queen's University.
    12. Alan B. Krueger, 1999. "Experimental Estimates of Education Production Functions," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(2), pages 497-532.
    13. Sergio Firpo & Nicole M. Fortin & Thomas Lemieux, 2009. "Unconditional Quantile Regressions," Econometrica, Econometric Society, vol. 77(3), pages 953-973, May.
    14. James Marshall & Michael Peters (ed.), 1999. "Education Policy," Books, Edward Elgar Publishing, number 1657.
    15. Manning, Willard G. & Mullahy, John, 2001. "Estimating log models: to transform or not to transform?," Journal of Health Economics, Elsevier, vol. 20(4), pages 461-494, July.
    16. Yona Rubinstein & James J. Heckman, 2001. "The Importance of Noncognitive Skills: Lessons from the GED Testing Program," American Economic Review, American Economic Association, vol. 91(2), pages 145-149, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Simone Balestra & Uschi Backes-Gellner, 2014. "Heterogeneous effects of pupil-to-teacher ratio policies - A look at class size reduction and teacher aide," Economics of Education Working Paper Series 0102, University of Zurich, Department of Business Administration (IBW), revised Apr 2017.
    2. Jan Kluge & Michael Weber, 2015. "Decomposing the German East-West wage gap," ifo Working Paper Series 205, ifo Institute - Leibniz Institute for Economic Research at the University of Munich.
    3. Mueller, Steffen, 2013. "Teacher experience and the class size effect — Experimental evidence," Journal of Public Economics, Elsevier, vol. 98(C), pages 44-52.
    4. Michael J. Kottelenberg & Steven F. Lehrer, 2017. "Targeted or Universal Coverage? Assessing Heterogeneity in the Effects of Universal Child Care," Journal of Labor Economics, University of Chicago Press, vol. 35(3), pages 609-653.
    5. Pål Schøne & Kristine von Simson & Marte Strøm, 2020. "Peer gender and educational choices," Empirical Economics, Springer, vol. 59(4), pages 1763-1797, October.
    6. Ding, Weili & Lehrer, Steven F., 2014. "Understanding the role of time-varying unobserved ability heterogeneity in education production," Economics of Education Review, Elsevier, vol. 40(C), pages 55-75.
    7. Jeffrey Penney, 2023. "Cautions when normalizing the dependent variable in a regression as a z‐score," Economic Inquiry, Western Economic Association International, vol. 61(2), pages 402-412, April.
    8. Weili Ding, 2020. "Laboratory experiments can pre-design to address power and selection issues," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 6(2), pages 125-138, December.
    9. Jeffrey Penney, 2017. "Racial Interaction Effects and Student Achievement," Education Finance and Policy, MIT Press, vol. 12(4), pages 447-467, Fall.
    10. Middleditch, Paul & Moindrot, Will & Rudkin, Simon, 2022. "Teaching with Twitter: An extension to the traditional learning environment," International Review of Economics Education, Elsevier, vol. 41(C).
    11. Graham McKee & Katharine Sims & Steven Rivkin, 2015. "Disruption, learning, and the heterogeneous benefits of smaller classes," Empirical Economics, Springer, vol. 48(3), pages 1267-1286, May.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Islam, Asad & Lee, Wang-Sheng & Nicholas, Aaron, 2021. "The Effects of Chess Instruction on Academic and Non-cognitive Outcomes: Field Experimental Evidence from a Developing Country," Journal of Development Economics, Elsevier, vol. 150(C).
    2. Philip J. Cook & Kenneth Dodge & George Farkas & Roland G. Fryer, Jr & Jonathan Guryan & Jens Ludwig & Susan Mayer & Harold Pollack & Laurence Steinberg, 2014. "The (Surprising) Efficacy of Academic and Behavioral Intervention with Disadvantaged Youth: Results from a Randomized Experiment in Chicago," NBER Working Papers 19862, National Bureau of Economic Research, Inc.
    3. Raj Chetty & John N. Friedman & Nathaniel Hilger & Emmanuel Saez & Diane Whitmore Schanzenbach & Danny Yagan, 2011. "How Does Your Kindergarten Classroom Affect Your Earnings? Evidence from Project Star," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(4), pages 1593-1660.
    4. C. Kirabo Jackson, 2012. "Non-Cognitive Ability, Test Scores, and Teacher Quality: Evidence from 9th Grade Teachers in North Carolina," NBER Working Papers 18624, National Bureau of Economic Research, Inc.
    5. Dinarte Diaz,Lelys Ileana & Egana-delSol,Pablo & Martinez A.,Claudia, 2022. "Socioemotional Skills Development in Highly Violent Contexts : Measurements and Impacts," Policy Research Working Paper Series 9957, The World Bank.
    6. Del Bono, Emilia & Etheridge, Ben & Garcia, Paul, 2024. "The economic value of childhood socio-emotional skills," ISER Working Paper Series 2024-01, Institute for Social and Economic Research.
    7. Hervé, Justine & Mani, Subha & Behrman, Jere R. & Nandi, Arindam & Sankhil Lamkang, Anjana & Laxminarayan, Ramanan, 2021. "Gender Gaps in Cognitive and Noncognitive Skills: Roles of SES and Gender Attitudes," IZA Discussion Papers 14132, Institute of Labor Economics (IZA).
    8. Sara Heller & Harold A. Pollack & Roseanna Ander & Jens Ludwig, 2013. "Preventing Youth Violence and Dropout: A Randomized Field Experiment," NBER Working Papers 19014, National Bureau of Economic Research, Inc.
    9. Dahmann, Sarah C., 2017. "How does education improve cognitive skills? Instructional time versus timing of instruction," Labour Economics, Elsevier, vol. 47(C), pages 35-47.
    10. Sonia Bhalotra & Martin Karlsson & Therese Nilsson & Nina Schwarz, 2022. "Infant Health, Cognitive Performance, and Earnings: Evidence from Inception of the Welfare State in Sweden," The Review of Economics and Statistics, MIT Press, vol. 104(6), pages 1138-1156, November.
    11. Heinrich, Carolyn J. & Knowles, Matthew T., 2020. "A fine predicament: Conditioning, compliance and consequences in a labeled cash transfer program," World Development, Elsevier, vol. 129(C).
    12. Christopher Blattman & Julian C. Jamison & Margaret Sheridan, 2015. "Reducing crime and violence: Experimental evidence from cognitive behavioral therapy in Liberia," NBER Working Papers 21204, National Bureau of Economic Research, Inc.
    13. Eliana Carranza & Robert Garlick & Kate Orkin & Neil Rankin, 2020. "Job Search and Hiring with Two-sided Limited Information about Workseekers’ Skills," CSAE Working Paper Series 2020-10, Centre for the Study of African Economies, University of Oxford.
    14. Shoji, Masahiro, 2020. "Early-Life Circumstances and Adult Locus of Control: Evidence from 46 Developing Countries," MPRA Paper 99987, University Library of Munich, Germany.
    15. Ernesto Dal Bó & Frederico Finan & Martín A. Rossi, 2013. "Strengthening State Capabilities: The Role of Financial Incentives in the Call to Public Service," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 128(3), pages 1169-1218.
    16. Thiel, Hendrik & Thomsen, Stephan L., 2013. "Noncognitive skills in economics: Models, measurement, and empirical evidence," Research in Economics, Elsevier, vol. 67(2), pages 189-214.
    17. Sarah Baird & Joan Hamory Hicks & Michael Kremer & Edward Miguel, 2016. "Worms at Work: Long-run Impacts of a Child Health Investment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(4), pages 1637-1680.
    18. Sevim, Dilek & Baranov, Victoria & Bhalotra, Sonia R. & Maselko, Joanna & Biroli, Pietro, 2023. "Socioemotional Skills in Early Childhood: Evidence from a Maternal Psychosocial Intervention," IZA Discussion Papers 15925, Institute of Labor Economics (IZA).
    19. Mari, Gabriele & Keizer, Renske, 2020. "Families of Austerity: Welfare Cuts and Family Stress in Britain," SocArXiv vdej8, Center for Open Science.
    20. Marigee Bacolod & Bernardo S. Blum & William C. Strange, 2010. "Elements Of Skill: Traits, Intelligences, Education, And Agglomeration," Journal of Regional Science, Wiley Blackwell, vol. 50(1), pages 245-280, February.

    More about this item

    JEL classification:

    • I20 - Health, Education, and Welfare - - Education - - - General
    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • I24 - Health, Education, and Welfare - - Education - - - Education and Inequality

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:taf:edecon:v:19:y:2011:i:3:p:229-252. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Longhurst (email available below). General contact details of provider: http://www.tandfonline.com/CEDE20 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.