IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/19862.html
   My bibliography  Save this paper

The (Surprising) Efficacy of Academic and Behavioral Intervention with Disadvantaged Youth: Results from a Randomized Experiment in Chicago

Author

Listed:
  • Philip J. Cook
  • Kenneth Dodge
  • George Farkas
  • Roland G. Fryer, Jr
  • Jonathan Guryan
  • Jens Ludwig
  • Susan Mayer
  • Harold Pollack
  • Laurence Steinberg

Abstract

There is growing concern that improving the academic skills of disadvantaged youth is too difficult and costly, so policymakers should instead focus either on vocationally oriented instruction for teens or else on early childhood education. Yet this conclusion may be premature given that so few previous interventions have targeted a potential fundamental barrier to school success: "mismatch" between what schools deliver and the needs of disadvantaged youth who have fallen behind in their academic or non-academic development. This paper reports on a randomized controlled trial of a two-pronged intervention that provides disadvantaged youth with non-academic supports that try to teach youth social-cognitive skills based on the principles of cognitive behavioral therapy (CBT), and intensive individualized academic remediation. The study sample consists of 106 male 9th and 10th graders in a public high school on the south side of Chicago, of whom 95% are black and 99% are free or reduced price lunch eligible. Participation increased math test scores by 0.65 of a control group standard deviation (SD) and 0.48 SD in the national distribution, increased math grades by 0.67 SD, and seems to have increased expected graduation rates by 14 percentage points (46%). While some questions remain about the intervention, given these effects and a cost per participant of around $4,400 (with a range of $3,000 to $6,000), this intervention seems to yield larger gains in adolescent outcomes per dollar spent than many other intervention strategies.

Suggested Citation

  • Philip J. Cook & Kenneth Dodge & George Farkas & Roland G. Fryer, Jr & Jonathan Guryan & Jens Ludwig & Susan Mayer & Harold Pollack & Laurence Steinberg, 2014. "The (Surprising) Efficacy of Academic and Behavioral Intervention with Disadvantaged Youth: Results from a Randomized Experiment in Chicago," NBER Working Papers 19862, National Bureau of Economic Research, Inc.
    • Handle: RePEc:nbr:nberwo:19862
    Note: CH DAE DEV ED EFG EH LE LS PE
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w19862.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Yoav Benjamini & Abba M. Krieger & Daniel Yekutieli, 2006. "Adaptive linear step-up procedures that control the false discovery rate," Biometrika, Biometrika Trust, vol. 93(3), pages 491-507, September.
    2. Anderson, Michael L, 2008. "Multiple Inference and Gender Differences in the Effects of Early Intervention: A Reevaluation of the Abecedarian, Perry Preschool, and Early Training Projects," Department of Agricultural & Resource Economics, UC Berkeley, Working Paper Series qt15n8j26f, Department of Agricultural & Resource Economics, UC Berkeley.
    3. James Heckman & Flavio Cunha, 2007. "The Technology of Skill Formation," American Economic Review, American Economic Association, vol. 97(2), pages 31-47, May.
    4. Abhijit V. Banerjee & Shawn Cole & Esther Duflo & Leigh Linden, 2007. "Remedying Education: Evidence from Two Randomized Experiments in India," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(3), pages 1235-1264.
    5. Elizabeth U. Cascio & Douglas O. Staiger, 2012. "Knowledge, Tests, and Fadeout in Educational Interventions," NBER Working Papers 18038, National Bureau of Economic Research, Inc.
    6. Howard S. Bloom, 1984. "Accounting for No-Shows in Experimental Evaluation Designs," Evaluation Review, , vol. 8(2), pages 225-246, April.
    7. Lex Borghans & Angela Lee Duckworth & James J. Heckman & Bas ter Weel, 2008. "The Economics and Psychology of Personality Traits," Journal of Human Resources, University of Wisconsin Press, vol. 43(4).
    8. Gordon B. Dahl & Lance Lochner, 2012. "The Impact of Family Income on Child Achievement: Evidence from the Earned Income Tax Credit," American Economic Review, American Economic Association, vol. 102(5), pages 1927-1956, August.
    9. Esther Duflo & Pascaline Dupas & Michael Kremer, 2011. "Peer Effects, Teacher Incentives, and the Impact of Tracking: Evidence from a Randomized Evaluation in Kenya," American Economic Review, American Economic Association, vol. 101(5), pages 1739-1774, August.
    10. Sara Heller & Harold A. Pollack & Roseanna Ander & Jens Ludwig, 2013. "Preventing Youth Violence and Dropout: A Randomized Field Experiment," NBER Working Papers 19014, National Bureau of Economic Research, Inc.
    11. James J. Heckman & Jora Stixrud & Sergio Urzua, 2006. "The Effects of Cognitive and Noncognitive Abilities on Labor Market Outcomes and Social Behavior," Journal of Labor Economics, University of Chicago Press, vol. 24(3), pages 411-482, July.
    12. Steven D. Levitt & Sudhir Alladi Venkatesh, 2000. "An Economic Analysis of a Drug-Selling Gang's Finances," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 115(3), pages 755-789.
    13. Jeffrey R Kling & Jeffrey B Liebman & Lawrence F Katz, 2007. "Experimental Analysis of Neighborhood Effects," Econometrica, Econometric Society, vol. 75(1), pages 83-119, January.
    14. Anderson, Michael L., 2008. "Multiple Inference and Gender Differences in the Effects of Early Intervention: A Reevaluation of the Abecedarian, Perry Preschool, and Early Training Projects," Journal of the American Statistical Association, American Statistical Association, vol. 103(484), pages 1481-1495.
    15. Alan B. Krueger, 2003. "Economic Considerations and Class Size," Economic Journal, Royal Economic Society, vol. 113(485), pages 34-63, February.
    16. James J. Heckman & Paul A. LaFontaine, 2010. "The American High School Graduation Rate: Trends and Levels," The Review of Economics and Statistics, MIT Press, vol. 92(2), pages 244-262, May.
    17. Melissa Osborne & Herbert Gintis & Samuel Bowles, 2001. "The Determinants of Earnings: A Behavioral Approach," Journal of Economic Literature, American Economic Association, vol. 39(4), pages 1137-1176, December.
    18. Roland G. Fryer, Jr, 2011. "Injecting Successful Charter School Strategies into Traditional Public Schools: A Field Experiment in Houston," NBER Working Papers 17494, National Bureau of Economic Research, Inc.
    19. Alan B. Krueger, 1999. "Experimental Estimates of Education Production Functions," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(2), pages 497-532.
    20. Jonathan Guryan, 2004. "Desegregation and Black Dropout Rates," American Economic Review, American Economic Association, vol. 94(4), pages 919-943, September.
    21. Barrow, Lisa & Schanzenbach, Diane Whitmore & Claessens, Amy, 2015. "The impact of Chicago’s small high school initiative," Journal of Urban Economics, Elsevier, vol. 87(C), pages 100-113.
    22. Charles T. Clotfelter & Helen F. Ladd & Jacob L. Vigdor, 2009. "The Academic Achievement Gap in Grades 3 to 8," The Review of Economics and Statistics, MIT Press, vol. 91(2), pages 398-419, May.
    23. Roland G. Fryer, Jr, 2010. "Racial Inequality in the 21st Century: The Declining Significance of Discrimination," NBER Working Papers 16256, National Bureau of Economic Research, Inc.
    24. Helen F. Ladd, 2012. "Education and Poverty: Confronting the Evidence," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 31(2), pages 203-227, March.
    25. Edward P. Lazear, 2001. "Educational Production," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 116(3), pages 777-803.
    26. Philip Oreopoulos & Kjell G. Salvanes, 2011. "Priceless: The Nonpecuniary Benefits of Schooling," Journal of Economic Perspectives, American Economic Association, vol. 25(1), pages 159-184, Winter.
    27. Julie Berry Cullen & Steven D. Levitt & Erin Robertson & Sally Sadoff, 2013. "What Can Be Done to Improve Struggling High Schools?," Journal of Economic Perspectives, American Economic Association, vol. 27(2), pages 133-152, Spring.
    28. Yona Rubinstein & James J. Heckman, 2001. "The Importance of Noncognitive Skills: Lessons from the GED Testing Program," American Economic Review, American Economic Association, vol. 91(2), pages 145-149, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sara Heller & Harold A. Pollack & Roseanna Ander & Jens Ludwig, 2013. "Preventing Youth Violence and Dropout: A Randomized Field Experiment," NBER Working Papers 19014, National Bureau of Economic Research, Inc.
    2. Islam, Asad & Lee, Wang-Sheng & Nicholas, Aaron, 2021. "The Effects of Chess Instruction on Academic and Non-cognitive Outcomes: Field Experimental Evidence from a Developing Country," Journal of Development Economics, Elsevier, vol. 150(C).
    3. Shoji, Masahiro, 2020. "Early-Life Circumstances and Adult Locus of Control: Evidence from 46 Developing Countries," MPRA Paper 99987, University Library of Munich, Germany.
    4. Kautz, Tim & Heckman, James J. & Diris, Ron & ter Weel, Bas & Borghans, Lex, 2014. "Fostering and Measuring Skills: Improving Cognitive and Non-Cognitive Skills to Promote Lifetime Success," IZA Discussion Papers 8696, Institute of Labor Economics (IZA).
    5. James J. Heckman, 2008. "Schools, Skills, And Synapses," Economic Inquiry, Western Economic Association International, vol. 46(3), pages 289-324, July.
    6. Weili Ding & Steven Lehrer, 2011. "Experimental estimates of the impacts of class size on test scores: robustness and heterogeneity," Education Economics, Taylor & Francis Journals, vol. 19(3), pages 229-252.
    7. Almond, Douglas & Currie, Janet, 2011. "Human Capital Development before Age Five," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 15, pages 1315-1486, Elsevier.
    8. Sara B. Heller & Anuj K. Shah & Jonathan Guryan & Jens Ludwig & Sendhil Mullainathan & Harold A. Pollack, 2017. "Thinking, Fast and Slow? Some Field Experiments to Reduce Crime and Dropout in Chicago," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 132(1), pages 1-54.
    9. Richard J. Murnane, 2013. "U.S. High School Graduation Rates: Patterns and Explanations," Journal of Economic Literature, American Economic Association, vol. 51(2), pages 370-422, June.
    10. Jessica Leight & Elaine M. Liu, 2020. "Maternal Education, Parental Investment, and Noncognitive Characteristics in Rural China," Economic Development and Cultural Change, University of Chicago Press, vol. 69(1), pages 213-251.
    11. Sarah Baird & Joan Hamory Hicks & Michael Kremer & Edward Miguel, 2016. "Worms at Work: Long-run Impacts of a Child Health Investment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(4), pages 1637-1680.
    12. Martins, Pedro S., 2017. "Can Non-Cognitive Skills Programs Improve Achievement? Quasi-Experimental Evidence from EPIS," GLO Discussion Paper Series 105, Global Labor Organization (GLO).
    13. Mari, Gabriele & Keizer, Renske, 2020. "Families of Austerity: Welfare Cuts and Family Stress in Britain," SocArXiv vdej8, Center for Open Science.
    14. Pedro S. Martins, 2017. "(How) Do Non-Cognitive Skills Programs Improve Adolescent School Achievement? Experimental Evidence," Working Papers 81, Queen Mary, University of London, School of Business and Management, Centre for Globalisation Research.
    15. Huong Thu Le & Ha Trong Nguyen, 2017. "Parental health and children's cognitive and noncognitive development: New evidence from the longitudinal survey of Australian children," Health Economics, John Wiley & Sons, Ltd., vol. 26(12), pages 1767-1788, December.
    16. James Heckman & Tim Kautz, 2013. "Fostering and Measuring Skills: Interventions That Improve Character and Cognition," Working Papers 2013-019, Human Capital and Economic Opportunity Working Group.
    17. Dohmen, Thomas, 2014. "Behavioral labor economics: Advances and future directions," Labour Economics, Elsevier, vol. 30(C), pages 71-85.
    18. Beam, Emily A. & Mukherjee, Priya & Navarro-Sola, Laia, 2022. "Lowering Barriers to Remote Education: Experimental Impacts on Parental Responses and Learning," IZA Discussion Papers 15596, Institute of Labor Economics (IZA).
    19. Miguel Urquiola, 2015. "Progress and challenges in achieving an evidence-based education policy in Latin America and the Caribbean," Latin American Economic Review, Springer;Centro de Investigaciòn y Docencia Económica (CIDE), vol. 24(1), pages 1-30, December.
    20. Thiel, Hendrik & Thomsen, Stephan L., 2013. "Noncognitive skills in economics: Models, measurement, and empirical evidence," Research in Economics, Elsevier, vol. 67(2), pages 189-214.

    More about this item

    JEL classification:

    • I0 - Health, Education, and Welfare - - General
    • I20 - Health, Education, and Welfare - - Education - - - General
    • I24 - Health, Education, and Welfare - - Education - - - Education and Inequality
    • I3 - Health, Education, and Welfare - - Welfare, Well-Being, and Poverty
    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity
    • Z18 - Other Special Topics - - Cultural Economics - - - Public Policy

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:19862. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.