IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp16111.html
   My bibliography  Save this paper

School Quality beyond Test Scores: The Role of Schools in Shaping Educational Outcomes

Author

Listed:
  • Loviglio, Annalisa

    (University of Bologna)

Abstract

I study how schools impact student performance and educational attainment throughout secondary education, and show that school quality cannot be easily captured by any type of rankings because students with differing characteristics and abilities benefit from different school inputs. To do so, I estimate a dynamic structural model of cognitive skills accumulation and schooling decision using rich administrative data from middle schools in Barcelona. I then simulate the outcomes that each student would have achieved in every school in the sample. Notably, the school environment has a crucial impact on the educational attainment of students from less advantaged family background and low-ability students who are at greater risk of leaving school. Moreover, the schools that would yield the highest final test scores for these students – provided they do not drop out – are not the ones that would maximize their likelihood of graduating and enrolling in further education. The results suggest that evaluating and comparing schools using only standardized assessments is insufficient for serving the needs of disadvantaged students, who require schools that enhance educational attainment rather than just test scores.

Suggested Citation

  • Loviglio, Annalisa, 2023. "School Quality beyond Test Scores: The Role of Schools in Shaping Educational Outcomes," IZA Discussion Papers 16111, Institute of Labor Economics (IZA).
  • Handle: RePEc:iza:izadps:dp16111
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp16111.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Justine S. Hastings & Christopher A. Neilson & Seth D. Zimmerman, 2013. "Are Some Degrees Worth More than Others? Evidence from college admission cutoffs in Chile," NBER Working Papers 19241, National Bureau of Economic Research, Inc.
    2. Andreas Ammermueller & Jörn-Steffen Pischke, 2009. "Peer Effects in European Primary Schools: Evidence from the Progress in International Reading Literacy Study," Journal of Labor Economics, University of Chicago Press, vol. 27(3), pages 315-348, July.
    3. Rust, John, 1987. "Optimal Replacement of GMC Bus Engines: An Empirical Model of Harold Zurcher," Econometrica, Econometric Society, vol. 55(5), pages 999-1033, September.
    4. Joshua D. Angrist & Parag A. Pathak & Christopher R. Walters, 2013. "Explaining Charter School Effectiveness," American Economic Journal: Applied Economics, American Economic Association, vol. 5(4), pages 1-27, October.
    5. Lorraine Dearden & John Micklewright & Anna Vignoles, 2011. "The Effectiveness of English Secondary Schools for Pupils of Different Ability Levels," Fiscal Studies, Institute for Fiscal Studies, vol. 32(2), pages 225-244, June.
    6. Thomas J. Kane & Douglas O. Staiger, 2002. "The Promise and Pitfalls of Using Imprecise School Accountability Measures," Journal of Economic Perspectives, American Economic Association, vol. 16(4), pages 91-114, Fall.
    7. Joshua D. Angrist & Sarah R. Cohodes & Susan M. Dynarski & Parag A. Pathak & Christopher R. Walters, 2016. "Stand and Deliver: Effects of Boston's Charter High Schools on College Preparation, Entry, and Choice," Journal of Labor Economics, University of Chicago Press, vol. 34(2), pages 275-318.
    8. Bart Cockx & Matteo Picchio & Stijn Baert, 2019. "Modeling the effects of grade retention in high school," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 34(3), pages 403-424, April.
    9. Jonathan James, 2011. "Ability matching and occupational choice," Working Papers (Old Series) 1125, Federal Reserve Bank of Cleveland.
    10. Will Dobbie & Roland G. Fryer Jr., 2013. "Getting beneath the Veil of Effective Schools: Evidence from New York City," American Economic Journal: Applied Economics, American Economic Association, vol. 5(4), pages 28-60, October.
    11. Brian A. Jacob & Lars Lefgren, 2009. "The Effect of Grade Retention on High School Completion," American Economic Journal: Applied Economics, American Economic Association, vol. 1(3), pages 33-58, July.
    12. Caroline Hoxby & Christopher Avery, 2013. "The Missing "One-Offs": The Hidden Supply of High-Achieving, Low-Income Students," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 44(1 (Spring), pages 1-65.
    13. Arcidiacono, Peter, 2004. "Ability sorting and the returns to college major," Journal of Econometrics, Elsevier, vol. 121(1-2), pages 343-375.
    14. David J. Deming & Justine S. Hastings & Thomas J. Kane & Douglas O. Staiger, 2014. "School Choice, School Quality, and Postsecondary Attainment," American Economic Review, American Economic Association, vol. 104(3), pages 991-1013, March.
    15. Pamela Giustinelli & Nicola Pavoni, 2017. "The Evolution of Awareness and Belief Ambiguity in the Process of High School Track Choice," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 25, pages 93-120, April.
    16. Cunha, Flavio & Heckman, James J. & Lochner, Lance, 2006. "Interpreting the Evidence on Life Cycle Skill Formation," Handbook of the Economics of Education, in: Erik Hanushek & F. Welch (ed.), Handbook of the Economics of Education, edition 1, volume 1, chapter 12, pages 697-812, Elsevier.
    17. Josh Kinsler & Ronni Pavan, 2015. "The Specificity of General Human Capital: Evidence from College Major Choice," Journal of Labor Economics, University of Chicago Press, vol. 33(4), pages 933-972.
    18. Bordon, Paola & Fu, Chao, 2015. "College-Major Choice to College-Then-Major Choice," MPRA Paper 79643, University Library of Munich, Germany.
    19. Matthew Wiswall & Basit Zafar, 2015. "How Do College Students Respond to Public Information about Earnings?," Journal of Human Capital, University of Chicago Press, vol. 9(2), pages 117-169.
    20. Paola Bordon & Chao Fu, 2015. "College-Major Choice to College-Then-Major Choice," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 82(4), pages 1247-1288.
    21. Joshua D. Angrist & Peter D. Hull & Parag A. Pathak & Christopher R. Walters, 2017. "Leveraging Lotteries for School Value-Added: Testing and Estimation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 132(2), pages 871-919.
    22. Christopher Avery & Caroline Hoxby & Clement Jackson & Kaitlin Burek & Glenn Pope & Mridula Raman, 2006. "Cost Should Be No Barrier: An Evaluation of the First Year of Harvard's Financial Aid Initiative," NBER Working Papers 12029, National Bureau of Economic Research, Inc.
    23. Atila Abdulkadiroğlu & Joshua D. Angrist & Susan M. Dynarski & Thomas J. Kane & Parag A. Pathak, 2011. "Accountability and Flexibility in Public Schools: Evidence from Boston's Charters And Pilots," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(2), pages 699-748.
    24. C. Kirabo Jackson & Shanette C. Porter & John Q. Easton & Alyssa Blanchard & Sebastián Kiguel, 2020. "School Effects on Socioemotional Development, School-Based Arrests, and Educational Attainment," American Economic Review: Insights, American Economic Association, vol. 2(4), pages 491-508, December.
    25. Jane Cooley Fruehwirth & Salvador Navarro & Yuya Takahashi, 2016. "How the Timing of Grade Retention Affects Outcomes: Identification and Estimation of Time-Varying Treatment Effects," Journal of Labor Economics, University of Chicago Press, vol. 34(4), pages 979-1021.
    26. Allen, Rebecca & Burgess, Simon, 2013. "Evaluating the provision of school performance information for school choice," Economics of Education Review, Elsevier, vol. 34(C), pages 175-190.
    27. Joshua Angrist & Peter Hull & Christopher R. Walters, 2022. "Methods for Measuring School Effectiveness," NBER Working Papers 30803, National Bureau of Economic Research, Inc.
    28. Flavio Cunha & James J. Heckman, 2008. "Formulating, Identifying and Estimating the Technology of Cognitive and Noncognitive Skill Formation," Journal of Human Resources, University of Wisconsin Press, vol. 43(4).
    29. C. Kirabo Jackson, 2018. "What Do Test Scores Miss? The Importance of Teacher Effects on Non–Test Score Outcomes," Journal of Political Economy, University of Chicago Press, vol. 126(5), pages 2072-2107.
    30. Will Dobbie & Roland G. Fryer, 2011. "Are High-Quality Schools Enough to Increase Achievement among the Poor? Evidence from the Harlem Children's Zone," American Economic Journal: Applied Economics, American Economic Association, vol. 3(3), pages 158-187, July.
    31. Basit Zafar, 2013. "College Major Choice and the Gender Gap," Journal of Human Resources, University of Wisconsin Press, vol. 48(3), pages 545-595.
    32. Cristian Pop-Eleches & Miguel Urquiola, 2013. "Going to a Better School: Effects and Behavioral Responses," American Economic Review, American Economic Association, vol. 103(4), pages 1289-1324, June.
    33. Joseph G. Altonji & Peter Arcidiacono & Arnaud Maurel, 2015. "The Analysis of Field Choice in College and Graduate School: Determinants and Wage Effects," NBER Working Papers 21655, National Bureau of Economic Research, Inc.
    34. Chris Belfield & Teodora Boneva & Christopher Rauh & Jonathan Shaw, 2020. "What Drives Enrolment Gaps in Further Education? The Role of Beliefs in Sequential Schooling Decisions," Economica, London School of Economics and Political Science, vol. 87(346), pages 490-529, April.
    35. Yona Rubinstein & James J. Heckman, 2001. "The Importance of Noncognitive Skills: Lessons from the GED Testing Program," American Economic Review, American Economic Association, vol. 91(2), pages 145-149, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Annalisa Loviglio, 2023. "School Quality Beyond Test Scores: the Role of Schools in Shaping Educational Outcomes," Working Papers wp1184, Dipartimento Scienze Economiche, Universita' di Bologna.
    2. Naven, Matthew, 2019. "Human-Capital Formation During Childhood and Adolescence: Evidence from School Quality and Postsecondary Success in California," MPRA Paper 97716, University Library of Munich, Germany.
    3. Song, Yang, 2019. "Sorting, school performance and quality: Evidence from China," Journal of Comparative Economics, Elsevier, vol. 47(1), pages 238-261.
    4. Figlio, D. & Karbownik, K. & Salvanes, K.G., 2016. "Education Research and Administrative Data," Handbook of the Economics of Education,, Elsevier.
    5. McEachin, Andrew & Lauen, Douglas Lee & Fuller, Sarah Crittenden & Perera, Rachel M., 2020. "Social returns to private choice? Effects of charter schools on behavioral outcomes, arrests, and civic participation," Economics of Education Review, Elsevier, vol. 76(C).
    6. Joshua D. Angrist & Sarah R. Cohodes & Susan M. Dynarski & Parag A. Pathak & Christopher R. Walters, 2016. "Stand and Deliver: Effects of Boston's Charter High Schools on College Preparation, Entry, and Choice," Journal of Labor Economics, University of Chicago Press, vol. 34(2), pages 275-318.
    7. Yanqing Ding & Wei Li & Xin Li & Yinduo Wu & Jin Yang & Xiaoyang Ye, 2021. "Heterogeneous Major Preferences for Extrinsic Incentives: The Effects of Wage Information on the Gender Gap in STEM Major Choice," Research in Higher Education, Springer;Association for Institutional Research, vol. 62(8), pages 1113-1145, December.
    8. Atila Abdulkadiroğlu & Joshua D. Angrist & Yusuke Narita & Parag A. Pathak, 2017. "Research Design Meets Market Design: Using Centralized Assignment for Impact Evaluation," Econometrica, Econometric Society, vol. 85, pages 1373-1432, September.
    9. Arpita Patnaik & Matthew J. Wiswall & Basit Zafar, 2020. "College Majors," NBER Working Papers 27645, National Bureau of Economic Research, Inc.
    10. Atila Abdulkadiroğlu & Weiwei Hu & Parag A. Pathak, 2013. "Small High Schools and Student Achievement: Lottery-Based Evidence from New York City," NBER Working Papers 19576, National Bureau of Economic Research, Inc.
    11. Jean-William Laliberté, "undated". "Long-term Contextual Effects in Education: Schools and Neighborhoods," Working Papers 2019-01, Department of Economics, University of Calgary.
    12. Masi, Barbara, 2018. "A ticket to ride: The unintended consequences of school transport subsidies," Economics of Education Review, Elsevier, vol. 63(C), pages 100-115.
    13. Matthew Davis & Blake Heller, 2019. "No Excuses Charter Schools and College Enrollment: New Evidence from a High School Network in Chicago," Education Finance and Policy, MIT Press, vol. 14(3), pages 414-440, Summer.
    14. Fouarge, Didier & Heß, Pascal, 2023. "Preference-choice mismatch and university dropout," Labour Economics, Elsevier, vol. 83(C).
    15. Joe Regan-Stansfield, 2016. "Do good primary schools perform even better as academies?," Working Papers 141167564, Lancaster University Management School, Economics Department.
    16. Justine S. Hastings & Christopher A. Neilson & Seth D. Zimmerman, 2013. "Are Some Degrees Worth More than Others? Evidence from college admission cutoffs in Chile," NBER Working Papers 19241, National Bureau of Economic Research, Inc.
    17. Atila Abdulkadiroğlu & Joshua Angrist & Parag Pathak, 2014. "The Elite Illusion: Achievement Effects at Boston and New York Exam Schools," Econometrica, Econometric Society, vol. 82(1), pages 137-196, January.
    18. Lorenzo Neri & Elisabetta Pasini, 2020. "Heterogeneous Effects of School Autonomy in England," Discussion Paper Series, School of Economics and Finance 202010, School of Economics and Finance, University of St Andrews.
    19. Sarah R. Cohodes, 2016. "Teaching to the Student: Charter School Effectiveness in Spite of Perverse Incentives," Education Finance and Policy, MIT Press, vol. 11(1), pages 1-42, Winter.
    20. Eyles, Andrew & Machin, Stephen & McNally, Sandra, 2017. "Unexpected school reform: Academisation of primary schools in England," Journal of Public Economics, Elsevier, vol. 155(C), pages 108-121.

    More about this item

    Keywords

    school value-added; educational choices; educational attainment; retention;
    All these keywords.

    JEL classification:

    • I20 - Health, Education, and Welfare - - Education - - - General
    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity
    • C35 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Discrete Regression and Qualitative Choice Models; Discrete Regressors; Proportions

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp16111. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.