IDEAS home Printed from https://ideas.repec.org/a/sae/jedbes/v44y2019i5p507-542.html
   My bibliography  Save this article

School Differences in Social–Emotional Learning Gains: Findings From the First Large-Scale Panel Survey of Students

Author

Listed:
  • Susanna Loeb

    (Brown University)

  • Michael S. Christian

    (Education Analytics)

  • Heather Hough

    (Policy Analysis for California Education)

  • Robert H. Meyer
  • Andrew B. Rice

    (Education Analytics)

  • Martin R. West

    (Harvard University)

Abstract

Measures of school-level growth in student outcomes are common tools for assessing the impacts of schools. The vast majority of these measures use standardized tests as the outcome of interest, even though emerging evidence demonstrates the importance of social–emotional learning (SEL). In this article, we present results from using the first large-scale panel surveys of students on SEL to produce school-level value-added measures by grade for growth mind-set, self-efficacy, self-management, and social awareness. We found substantive differences across schools in SEL growth, with magnitudes of differences similar to those for growth in academic achievement. In contrast, we found that the goodness of fit of the value-added model was considerably lower when the outcome variables were measures of SEL constructs rather than of academic achievement. In addition, the across-school variance in the average level of the SEL measures was proportionally much smaller than that for academic measures. These findings recommend caution in interpreting measures as the causal impacts of schools on SEL, though they also do not rule out important school effects.

Suggested Citation

  • Susanna Loeb & Michael S. Christian & Heather Hough & Robert H. Meyer & Andrew B. Rice & Martin R. West, 2019. "School Differences in Social–Emotional Learning Gains: Findings From the First Large-Scale Panel Survey of Students," Journal of Educational and Behavioral Statistics, , vol. 44(5), pages 507-542, October.
    • Handle: RePEc:sae:jedbes:v:44:y:2019:i:5:p:507-542
    DOI: 10.3102/1076998619845162
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.3102/1076998619845162
    Download Restriction: no
    File URL: https://libkey.io/10.3102/1076998619845162?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Steven G. Rivkin & Eric A. Hanushek & John F. Kain, 2005. "Teachers, Schools, and Academic Achievement," Econometrica, Econometric Society, vol. 73(2), pages 417-458, March.
    2. David Blazar, 2018. "Validating Teacher Effects on Students’ Attitudes and Behaviors: Evidence from Random Assignment of Teachers to Students," Education Finance and Policy, MIT Press, vol. 13(3), pages 281-309, Summer.
    3. Joshua Angrist & Peter Hull & Parag Pathak & Christopher Walters, 2016. "Interpreting Tests of School VAM Validity," American Economic Review, American Economic Association, vol. 106(5), pages 388-392, May.
    4. Geoff Masters, 1982. "A rasch model for partial credit scoring," Psychometrika, Springer;The Psychometric Society, vol. 47(2), pages 149-174, June.
    5. Seth Gershenson & Diane Whitmore Schanzenbach, 2016. "Linking Teacher Quality, Student Attendance, and Student Achievement," Education Finance and Policy, MIT Press, vol. 11(2), pages 125-149, Spring.
    6. Tim Kautz & James J. Heckman & Ron Diris & Bas ter Weel & Lex Borghans, 2014. "Fostering and Measuring Skills: Improving Cognitive and Non-cognitive Skills to Promote Lifetime Success," OECD Education Working Papers 110, OECD Publishing.
    7. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2014. "Measuring the Impacts of Teachers II: Teacher Value-Added and Student Outcomes in Adulthood," American Economic Review, American Economic Association, vol. 104(9), pages 2633-2679, September.
    8. Cory Koedel & Julian Betts, 2010. "Value Added to What? How a Ceiling in the Testing Instrument Influences Value-Added Estimation," Education Finance and Policy, MIT Press, vol. 5(1), pages 54-81, January.
    9. David J. Deming, 2014. "Using School Choice Lotteries to Test Measures of School Effectiveness," American Economic Review, American Economic Association, vol. 104(5), pages 406-411, May.
    10. Joshua D. Angrist & Peter D. Hull & Parag A. Pathak & Christopher R. Walters, 2017. "Leveraging Lotteries for School Value-Added: Testing and Estimation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 132(2), pages 871-919.
    11. Ladd, Helen F. & Walsh, Randall P., 2002. "Implementing value-added measures of school effectiveness: getting the incentives right," Economics of Education Review, Elsevier, vol. 21(1), pages 1-17, February.
    12. Meyer, Robert H., 1997. "Value-added indicators of school performance: A primer," Economics of Education Review, Elsevier, vol. 16(3), pages 283-301, June.
    13. Hanley Chiang & Stephen Lipscomb & Brian Gill, 2016. "Is School Value Added Indicative of Principal Quality?," Education Finance and Policy, MIT Press, vol. 11(3), pages 283-309, Summer.
    14. David Blazar & Matthew A. Kraft, 2015. "Teacher and Teaching Effects on Students' Academic Behaviors and Mindsets," Mathematica Policy Research Reports c1c4216bd08f408fb6bdf16a3, Mathematica Policy Research.
    15. Helen F. Ladd & Lucy C. Sorensen, 2017. "Returns to Teacher Experience: Student Achievement and Motivation in Middle School," Education Finance and Policy, MIT Press, vol. 12(2), pages 241-279, Spring.
    16. C. Kirabo Jackson, 2018. "What Do Test Scores Miss? The Importance of Teacher Effects on Non–Test Score Outcomes," Journal of Political Economy, University of Chicago Press, vol. 126(5), pages 2072-2107.
    17. Nicky J. Welton & Howard H. Z. Thom, 2015. "Value of Information," Medical Decision Making, , vol. 35(5), pages 564-566, July.
    18. Cory Koedel & Mark Ehlert & Eric Parsons & Michael Podgursky, 2012. "Selecting Growth Measures for School and Teacher Evaluations," Working Papers 1210, Department of Economics, University of Missouri.
    19. Derek C. Briggs & Jonathan P. Weeks, 2011. "The Persistence of School-Level Value-Added," Journal of Educational and Behavioral Statistics, , vol. 36(5), pages 616-637, October.
    20. Thomas J. Kane & Douglas O. Staiger, 2001. "Improving School Accountability Measures," NBER Working Papers 8156, National Bureau of Economic Research, Inc.
    21. Sean F. Reardon & Stephen W. Raudenbush, 2009. "Assumptions of Value-Added Models for Estimating School Effects," Education Finance and Policy, MIT Press, vol. 4(4), pages 492-519, October.
    22. Yona Rubinstein & James J. Heckman, 2001. "The Importance of Noncognitive Skills: Lessons from the GED Testing Program," American Economic Review, American Economic Association, vol. 91(2), pages 145-149, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dinand Webbink & José María Cabrera, 2016. "Do higher salaries yield better teachers and better student outcomes?," Documentos de Trabajo/Working Papers 1604, Facultad de Ciencias Empresariales y Economia. Universidad de Montevideo..
    2. Andrew Agopsowicz & Chris Robinson & Ralph Stinebrickner & Todd Stinebrickner, 2020. "Careers and Mismatch for College Graduates: College and Noncollege Jobs," Journal of Human Resources, University of Wisconsin Press, vol. 55(4), pages 1194-1221.
    3. Jose Maria Cabrera & Dinand Webbink, 2020. "Do Higher Salaries Yield Better Teachers and Better Student Outcomes?," Journal of Human Resources, University of Wisconsin Press, vol. 55(4), pages 1222-1257.
    4. Aedin Doris & Donal O'Neill & Olive Sweetman, 2019. "Good Schools or Good Students? The Importance of Selectivity for School Rankings," Economics Department Working Paper Series n293-19.pdf, Department of Economics, National University of Ireland - Maynooth.
    5. Andrew McEachin & Allison Atteberry, 2017. "The Impact of Summer Learning Loss on Measures of School Performance," Education Finance and Policy, MIT Press, vol. 12(4), pages 468-491, Fall.
    6. Figlio, D. & Karbownik, K. & Salvanes, K.G., 2016. "Education Research and Administrative Data," Handbook of the Economics of Education,, Elsevier.
    7. Naven, Matthew, 2019. "Human-Capital Formation During Childhood and Adolescence: Evidence from School Quality and Postsecondary Success in California," MPRA Paper 97716, University Library of Munich, Germany.
    8. David Blazar, 2018. "Validating Teacher Effects on Students’ Attitudes and Behaviors: Evidence from Random Assignment of Teachers to Students," Education Finance and Policy, MIT Press, vol. 13(3), pages 281-309, Summer.
    9. Gershenson, Seth, 2021. "Identifying and Producing Effective Teachers," IZA Discussion Papers 14096, Institute of Labor Economics (IZA).
    10. Matthew A. Kraft & John P. Papay & Olivia L. Chi, 2020. "Teacher Skill Development: Evidence from Performance Ratings by Principals," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 39(2), pages 315-347, March.
    11. Ajzenman, Nicolás & Elacqua, Gregory & Marotta, Luana & Westh Olsen, Anne Sofie, 2021. "Order Effects and Employment Decisions: Experimental Evidence from a Nationwide Program," IDB Publications (Working Papers) 11541, Inter-American Development Bank.
    12. Christine Mulhern & Isaac M. Opper, 2021. "Measuring and Summarizing the Multiple Dimensions of Teacher Effectiveness," CESifo Working Paper Series 9263, CESifo.
    13. Hayes, Michael S. & Liu, Jing & Gershenson, Seth, 2023. "Who refers whom? The effects of teacher characteristics on disciplinary office referrals," Economics of Education Review, Elsevier, vol. 93(C).
    14. Jean-William Laliberté, "undated". "Long-term Contextual Effects in Education: Schools and Neighborhoods," Working Papers 2019-01, Department of Economics, University of Calgary.
    15. Gottfried, Michael & Jacob Kirksey, J. & Hutt, Ethan, 2020. "Can teacher education programs help prepare new kindergarten and first grade teachers to address student absenteeism?," Children and Youth Services Review, Elsevier, vol. 119(C).
    16. Cheng, Albert & Zamarro, Gema, 2018. "Measuring teacher non-cognitive skills and its impact on students: Insight from the Measures of Effective Teaching Longitudinal Database," Economics of Education Review, Elsevier, vol. 64(C), pages 251-260.
    17. Cowan, James & Goldhaber, Dan, 2018. "Do bonuses affect teacher staffing and student achievement in high poverty schools? Evidence from an incentive for national board certified teachers in Washington State," Economics of Education Review, Elsevier, vol. 65(C), pages 138-152.
    18. Papay, John P. & Kraft, Matthew A., 2015. "Productivity returns to experience in the teacher labor market: Methodological challenges and new evidence on long-term career improvement," Journal of Public Economics, Elsevier, vol. 130(C), pages 105-119.
    19. Cordero, Jose M. & Gil-Izquierdo, María, 2018. "The effect of teaching strategies on student achievement: An analysis using TALIS-PISA-link," Journal of Policy Modeling, Elsevier, vol. 40(6), pages 1313-1331.
    20. Annalisa Loviglio, 2023. "School Quality Beyond Test Scores: the Role of Schools in Shaping Educational Outcomes," Working Papers wp1184, Dipartimento Scienze Economiche, Universita' di Bologna.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jedbes:v:44:y:2019:i:5:p:507-542. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.