IDEAS home Printed from https://ideas.repec.org/p/zbw/esprep/270952.html
   My bibliography  Save this paper

Publication Bias and Model Uncertainty in Measuring the Effect of Class Size on Achievement

Author

Listed:
  • Opatrny, Matej
  • Havranek, Tomas
  • Irsova, Zuzana
  • Scasny, Milan

Abstract

Class size reduction mandates are frequent and invariably justified by studies reporting positive effects on student achievement. Yet other studies report no effects, and the literature as a whole awaits correction for potential publication bias. Moreover, if identification drives results systematically, the relevance of individual studies will vary. We build a sample of 1,767 estimates collected from 62 studies and for each estimate codify 42 factors reflecting estimation context. We employ recently developed nonlinear techniques for publication bias correction and Bayesian model averaging techniques that address model uncertainty. The results suggest publication bias among studies featured in top five economics journals, but not elsewhere. The implied class size effect is zero for all identification approaches except Tennessee's Student/Teacher Achievement Ratio project. The effect remains zero for disadvantaged students and across subjects, school types, and countries.

Suggested Citation

  • Opatrny, Matej & Havranek, Tomas & Irsova, Zuzana & Scasny, Milan, 2023. "Publication Bias and Model Uncertainty in Measuring the Effect of Class Size on Achievement," EconStor Preprints 270952, ZBW - Leibniz Information Centre for Economics.
  • Handle: RePEc:zbw:esprep:270952
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/270952/1/class.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Steven G. Rivkin & Eric A. Hanushek & John F. Kain, 2005. "Teachers, Schools, and Academic Achievement," Econometrica, Econometric Society, vol. 73(2), pages 417-458, March.
    2. Argaw, Bethlehem A. & Puhani, Patrick A., 2018. "Does class size matter for school tracking outcomes after elementary school? Quasi-experimental evidence using administrative panel data from Germany," Economics of Education Review, Elsevier, vol. 65(C), pages 48-57.
    3. Iwasaki, Ichiro, 2022. "The finance-growth nexus in Latin America and the Caribbean: A meta-analytic perspective," World Development, Elsevier, vol. 149(C).
    4. Wo[ss]mann, Ludger & West, Martin, 2006. "Class-size effects in school systems around the world: Evidence from between-grade variation in TIMSS," European Economic Review, Elsevier, vol. 50(3), pages 695-736, April.
    5. Gregory Cox & Xiaoxia Shi, 2023. "Simple Adaptive Size-Exact Testing for Full-Vector and Subvector Inference in Moment Inequality Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 90(1), pages 201-228.
    6. Miguel Urquiola & Eric Verhoogen, 2009. "Class-Size Caps, Sorting, and the Regression-Discontinuity Design," American Economic Review, American Economic Association, vol. 99(1), pages 179-215, March.
    7. Christopher Jepsen, 2015. "Class size: Does it matter for student achievement?," IZA World of Labor, Institute of Labor Economics (IZA), pages 190-190, September.
    8. Kedagni, Desire & Krishna, Kala & Megalokonomou, Rigissa & Zhao, Yingyan, 2021. "Does class size matter? How, and at what cost?," European Economic Review, Elsevier, vol. 133(C).
    9. Ryan Bosworth, 2014. "Class size, class composition, and the distribution of student achievement," Education Economics, Taylor & Francis Journals, vol. 22(2), pages 141-165, April.
    10. David Card & Jochen Kluve & Andrea Weber, 2018. "What Works? A Meta Analysis of Recent Active Labor Market Program Evaluations," Journal of the European Economic Association, European Economic Association, vol. 16(3), pages 894-931.
    11. Jon Marius Vaag Iversen & Hans Bonesr�nning, 2013. "Disadvantaged students in the early grades: will smaller classes help them?," Education Economics, Taylor & Francis Journals, vol. 21(4), pages 305-324, September.
    12. Theo S. Eicher & Chris Papageorgiou & Adrian E. Raftery, 2011. "Default priors and predictive performance in Bayesian model averaging, with application to growth determinants," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 26(1), pages 30-55, January/F.
    13. Yongyun Shin & Stephen W. Raudenbush, 2011. "The Causal Effect of Class Size on Academic Achievement," Journal of Educational and Behavioral Statistics, , vol. 36(2), pages 154-185, April.
    14. Anne Brink Nandrup, 2016. "Do class size effects differ across grades?," Education Economics, Taylor & Francis Journals, vol. 24(1), pages 83-95, February.
    15. Sims, David P., 2009. "Crowding Peter to educate Paul: Lessons from a class size reduction externality," Economics of Education Review, Elsevier, vol. 28(4), pages 465-473, August.
    16. Babcock, Philip & Betts, Julian R., 2009. "Reduced-class distinctions: Effort, ability, and the education production function," Journal of Urban Economics, Elsevier, vol. 65(3), pages 314-322, May.
    17. Melvin Borland & Roy Howsen & Michelle Trawick, 2005. "An investigation of the effect of class size on student academic achievement," Education Economics, Taylor & Francis Journals, vol. 13(1), pages 73-83.
    18. Trine Filges & Christoffer Scavenius Sonne‐Schmidt & Bjørn Christian Viinholt Nielsen, 2018. "Small class sizes for improving student achievement in primary and secondary schools: a systematic review," Campbell Systematic Reviews, John Wiley & Sons, vol. 14(1), pages 1-107.
    19. Oriana Bandiera & Valentino Larcinese & Imran Rasul, 2010. "Heterogeneous Class Size Effects: New Evidence from a Panel of University Students," Economic Journal, Royal Economic Society, vol. 120(549), pages 1365-1398, December.
    20. Joshua D. Angrist & Erich Battistin & Daniela Vuri, 2017. "In a Small Moment: Class Size and Moral Hazard in the Italian Mezzogiorno," American Economic Journal: Applied Economics, American Economic Association, vol. 9(4), pages 216-249, October.
    21. Hans Bonesrønning, 2003. "Class Size Effects on Student Achievement in Norway: Patterns and Explanations," Southern Economic Journal, John Wiley & Sons, vol. 69(4), pages 952-965, April.
    22. Kara, Elif & Tonin, Mirco & Vlassopoulos, Michael, 2021. "Class size effects in higher education: Differences across STEM and non-STEM fields," Economics of Education Review, Elsevier, vol. 82(C).
    23. Simone Dobbelsteen & Jesse Levin & Hessel Oosterbeek, 2002. "The causal effect of class size on scholastic achievement: distinguishing the pure class size effect from the effect of changes in class composition," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 64(1), pages 17-38, February.
    24. Ugur, Mehmet & Churchill, Sefa Awaworyi & Luong, Hoang M., 2020. "What do we know about R&D spillovers and productivity? Meta-analysis evidence on heterogeneity and statistical power," Research Policy, Elsevier, vol. 49(1).
    25. Daniel Suryadarma & Asep Suryahadi & Sudarno Sumarto & F. Halsey Rogers, 2006. "Improving Student Performance in Public Primary Schools in Developing Countries: Evidence from Indonesia," Education Economics, Taylor & Francis Journals, vol. 14(4), pages 401-429.
    26. Akerhielm, Karen, 1995. "Does class size matter?," Economics of Education Review, Elsevier, vol. 14(3), pages 229-241, September.
    27. Joshua D. Angrist & Victor Lavy, 1999. "Using Maimonides' Rule to Estimate the Effect of Class Size on Scholastic Achievement," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(2), pages 533-575.
    28. Cho, Hyunkuk & Glewwe, Paul & Whitler, Melissa, 2012. "Do reductions in class size raise students’ test scores? Evidence from population variation in Minnesota's elementary schools," Economics of Education Review, Elsevier, vol. 31(3), pages 77-95.
    29. Kennedy, Peter E. & Siegfried, John J., 1997. "Class size and achievement in introductory economics: Evidence from the TUCE III data," Economics of Education Review, Elsevier, vol. 16(4), pages 385-394, October.
    30. Eskil Heinesen, 2010. "Estimating Class-size Effects using Within-school Variation in Subject-specific Classes," Economic Journal, Royal Economic Society, vol. 120(545), pages 737-760, June.
    31. Miguel Urquiola, 2006. "Identifying Class Size Effects in Developing Countries: Evidence from Rural Bolivia," The Review of Economics and Statistics, MIT Press, vol. 88(1), pages 171-177, February.
    32. Becker, William E. & Powers, John R., 2001. "Student performance, attrition, and class size given missing student data," Economics of Education Review, Elsevier, vol. 20(4), pages 377-388, August.
    33. Christopher Jepsen & Steven Rivkin, 2009. "Class Size Reduction and Student Achievement: The Potential Tradeoff between Teacher Quality and Class Size," Journal of Human Resources, University of Wisconsin Press, vol. 44(1).
    34. Ryan Bosworth, 2014. "Class size, class composition, and the distribution of student achievement," Education Economics, Taylor & Francis Journals, vol. 22(2), pages 141-165, April.
    35. Hojo, Masakazu & Senoh, Wataru, 2019. "Do the disadvantaged benefit more from small classes? Evidence from a large-scale survey in Japan," Japan and the World Economy, Elsevier, vol. 52(C).
    36. Deirdre Nansen McCloskey & Stephen T. Ziliak, 2019. "What quantitative methods should we teach to graduate students? A comment on Swann’s “Is precise econometrics an illusion?”," The Journal of Economic Education, Taylor & Francis Journals, vol. 50(4), pages 356-361, October.
    37. Hojo, Masakazu, 2013. "Class-size effects in Japanese schools: A spline regression approach," Economics Letters, Elsevier, vol. 120(3), pages 583-587.
    38. J J Arias & Douglas M. Walker, 2004. "Additional Evidence on the Relationship between Class Size and Student Performance," The Journal of Economic Education, Taylor & Francis Journals, vol. 35(4), pages 311-329, October.
    39. Bruce E. Hansen, 2007. "Least Squares Model Averaging," Econometrica, Econometric Society, vol. 75(4), pages 1175-1189, July.
    40. Masakazu Hojo & Takashi Oshio, 2012. "What Factors Determine Student Performance in East Asia? New Evidence from the 2007 Trends in International Mathematics and Science Study," Asian Economic Journal, East Asian Economic Association, vol. 26(4), pages 333-357, December.
    41. Chris Doucouliagos & T.D. Stanley, 2013. "Are All Economic Facts Greatly Exaggerated? Theory Competition And Selectivity," Journal of Economic Surveys, Wiley Blackwell, vol. 27(2), pages 316-339, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Irsova, Zuzana & Doucouliagos, Hristos & Havranek, Tomas & Stanley, T. D., 2023. "Meta-Analysis of Social Science Research: A Practitioner’s Guide," EconStor Preprints 273719, ZBW - Leibniz Information Centre for Economics.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Christopher Jepsen, 2015. "Class size: Does it matter for student achievement?," IZA World of Labor, Institute of Labor Economics (IZA), pages 190-190, September.
    2. Maximilian Bach & Stephan Sievert, 2019. "Birth Cohort Size Variation and the Estimation of Class Size Effects," Discussion Papers of DIW Berlin 1817, DIW Berlin, German Institute for Economic Research.
    3. Cohen-Zada, Danny & Gradstein, Mark & Reuven, Ehud, 2013. "Allocation of students in public schools: Theory and new evidence," Economics of Education Review, Elsevier, vol. 34(C), pages 96-106.
    4. Kedagni, Desire & Krishna, Kala & Megalokonomou, Rigissa & Zhao, Yingyan, 2021. "Does class size matter? How, and at what cost?," European Economic Review, Elsevier, vol. 133(C).
    5. Masakazu Hojo, 2011. "Education Production Function and Class-Size Effects in Japanese Public Schools," Global COE Hi-Stat Discussion Paper Series gd11-194, Institute of Economic Research, Hitotsubashi University.
    6. Graham McKee & Katharine Sims & Steven Rivkin, 2015. "Disruption, learning, and the heterogeneous benefits of smaller classes," Empirical Economics, Springer, vol. 48(3), pages 1267-1286, May.
    7. Chingos, Matthew M., 2012. "The impact of a universal class-size reduction policy: Evidence from Florida's statewide mandate," Economics of Education Review, Elsevier, vol. 31(5), pages 543-562.
    8. Matthew M. Chingos & Kenneth A. Couch, 2013. "Class Size and Student Outcomes: Research and Policy Implications," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 32(2), pages 411-438, March.
    9. Marie Connolly & Catherine Haeck, 2018. "Le lien entre la taille des classes et les compétences cognitives et non cognitives," CIRANO Project Reports 2018rp-18, CIRANO.
    10. Dominika Ehrenbergerova & Josef Bajzik & Tomas Havranek, 2023. "When Does Monetary Policy Sway House Prices? A Meta-Analysis," IMF Economic Review, Palgrave Macmillan;International Monetary Fund, vol. 71(2), pages 538-573, June.
    11. Torberg Falch & Astrid Marie Jorde Sandsør & Bjarne Strøm, 2017. "Do Smaller Classes Always Improve Students’ Long-run Outcomes?," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 79(5), pages 654-688, October.
    12. Stephen Gibbons & Sandra McNally, 2013. "The Effects of Resources Across School Phases: A Summary of Recent Evidence," CEP Discussion Papers dp1226, Centre for Economic Performance, LSE.
    13. Michael Gilraine & Hugh Macartney & Robert McMillan, 2018. "Estimating the Direct and Indirect Effects of Major Education Reforms," NBER Working Papers 24191, National Bureau of Economic Research, Inc.
    14. Tomas Havranek & Zuzana Irsova & Lubica Laslopova & Olesia Zeynalova, 2020. "Skilled and Unskilled Labor Are Less Substitutable than Commonly Thought," Working Papers IES 2020/29, Charles University Prague, Faculty of Social Sciences, Institute of Economic Studies, revised Sep 2020.
    15. Cala, Petr & Havranek, Tomas & Irsova, Zuzana & Matousek, Jindrich & Novak, Jiri, 2022. "Financial Incentives and Performance: A Meta-Analysis of Economics Evidence," EconStor Preprints 265535, ZBW - Leibniz Information Centre for Economics.
    16. West, Martin R. & Woessmann, Ludger, 2006. "Which school systems sort weaker students into smaller classes? International evidence," European Journal of Political Economy, Elsevier, vol. 22(4), pages 944-968, December.
    17. Gary-Bobo, Robert J. & Mahjoub, Mohamed Badrane, 2006. "Estimation of Class-Size Effects, Using 'Maimonides' Rule': The Case of French Junior High Schools," CEPR Discussion Papers 5754, C.E.P.R. Discussion Papers.
    18. Sims, David P., 2011. "Suing for your supper? Resource allocation, teacher compensation and finance lawsuits," Economics of Education Review, Elsevier, vol. 30(5), pages 1034-1044, October.
    19. Han, Joseph & Ryu, Keunkwan, 2017. "Effects of class size reduction in upper grades: Evidence from Seoul, Korea," Economics of Education Review, Elsevier, vol. 60(C), pages 68-85.
    20. Evan Riehl & Meredith Welch, 2023. "Accountability, Test Prep Incentives, and the Design of Math and English Exams," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 42(1), pages 60-96, January.

    More about this item

    Keywords

    Class size; student learning; meta-analysis; publication bias; Bayesian model averaging;
    All these keywords.

    JEL classification:

    • C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods
    • H52 - Public Economics - - National Government Expenditures and Related Policies - - - Government Expenditures and Education
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:esprep:270952. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/zbwkide.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.