IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/19862.html
   My bibliography  Save this paper

The (Surprising) Efficacy of Academic and Behavioral Intervention with Disadvantaged Youth: Results from a Randomized Experiment in Chicago

Author

Listed:
  • Philip J. Cook
  • Kenneth Dodge
  • George Farkas
  • Roland G. Fryer, Jr
  • Jonathan Guryan
  • Jens Ludwig
  • Susan Mayer
  • Harold Pollack
  • Laurence Steinberg

Abstract

There is growing concern that improving the academic skills of disadvantaged youth is too difficult and costly, so policymakers should instead focus either on vocationally oriented instruction for teens or else on early childhood education. Yet this conclusion may be premature given that so few previous interventions have targeted a potential fundamental barrier to school success: "mismatch" between what schools deliver and the needs of disadvantaged youth who have fallen behind in their academic or non-academic development. This paper reports on a randomized controlled trial of a two-pronged intervention that provides disadvantaged youth with non-academic supports that try to teach youth social-cognitive skills based on the principles of cognitive behavioral therapy (CBT), and intensive individualized academic remediation. The study sample consists of 106 male 9th and 10th graders in a public high school on the south side of Chicago, of whom 95% are black and 99% are free or reduced price lunch eligible. Participation increased math test scores by 0.65 of a control group standard deviation (SD) and 0.48 SD in the national distribution, increased math grades by 0.67 SD, and seems to have increased expected graduation rates by 14 percentage points (46%). While some questions remain about the intervention, given these effects and a cost per participant of around $4,400 (with a range of $3,000 to $6,000), this intervention seems to yield larger gains in adolescent outcomes per dollar spent than many other intervention strategies.

Suggested Citation

  • Philip J. Cook & Kenneth Dodge & George Farkas & Roland G. Fryer, Jr & Jonathan Guryan & Jens Ludwig & Susan Mayer & Harold Pollack & Laurence Steinberg, 2014. "The (Surprising) Efficacy of Academic and Behavioral Intervention with Disadvantaged Youth: Results from a Randomized Experiment in Chicago," NBER Working Papers 19862, National Bureau of Economic Research, Inc.
    • Handle: RePEc:nbr:nberwo:19862
    Note: CH DAE DEV ED EFG EH LE LS PE
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w19862.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Yoav Benjamini & Abba M. Krieger & Daniel Yekutieli, 2006. "Adaptive linear step-up procedures that control the false discovery rate," Biometrika, Biometrika Trust, vol. 93(3), pages 491-507, September.
    2. Anderson, Michael L, 2008. "Multiple Inference and Gender Differences in the Effects of Early Intervention: A Reevaluation of the Abecedarian, Perry Preschool, and Early Training Projects," Department of Agricultural & Resource Economics, UC Berkeley, Working Paper Series qt15n8j26f, Department of Agricultural & Resource Economics, UC Berkeley.
    3. James Heckman & Flavio Cunha, 2007. "The Technology of Skill Formation," American Economic Review, American Economic Association, vol. 97(2), pages 31-47, May.
    4. Abhijit V. Banerjee & Shawn Cole & Esther Duflo & Leigh Linden, 2007. "Remedying Education: Evidence from Two Randomized Experiments in India," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(3), pages 1235-1264.
    5. Elizabeth U. Cascio & Douglas O. Staiger, 2012. "Knowledge, Tests, and Fadeout in Educational Interventions," NBER Working Papers 18038, National Bureau of Economic Research, Inc.
    6. Howard S. Bloom, 1984. "Accounting for No-Shows in Experimental Evaluation Designs," Evaluation Review, , vol. 8(2), pages 225-246, April.
    7. Lex Borghans & Angela Lee Duckworth & James J. Heckman & Bas ter Weel, 2008. "The Economics and Psychology of Personality Traits," Journal of Human Resources, University of Wisconsin Press, vol. 43(4).
    8. Gordon B. Dahl & Lance Lochner, 2012. "The Impact of Family Income on Child Achievement: Evidence from the Earned Income Tax Credit," American Economic Review, American Economic Association, vol. 102(5), pages 1927-1956, August.
    9. Esther Duflo & Pascaline Dupas & Michael Kremer, 2011. "Peer Effects, Teacher Incentives, and the Impact of Tracking: Evidence from a Randomized Evaluation in Kenya," American Economic Review, American Economic Association, vol. 101(5), pages 1739-1774, August.
    10. Sara Heller & Harold A. Pollack & Roseanna Ander & Jens Ludwig, 2013. "Preventing Youth Violence and Dropout: A Randomized Field Experiment," NBER Working Papers 19014, National Bureau of Economic Research, Inc.
    11. James J. Heckman & Jora Stixrud & Sergio Urzua, 2006. "The Effects of Cognitive and Noncognitive Abilities on Labor Market Outcomes and Social Behavior," Journal of Labor Economics, University of Chicago Press, vol. 24(3), pages 411-482, July.
    12. Steven D. Levitt & Sudhir Alladi Venkatesh, 2000. "An Economic Analysis of a Drug-Selling Gang's Finances," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 115(3), pages 755-789.
    13. Jeffrey R Kling & Jeffrey B Liebman & Lawrence F Katz, 2007. "Experimental Analysis of Neighborhood Effects," Econometrica, Econometric Society, vol. 75(1), pages 83-119, January.
    14. Anderson, Michael L., 2008. "Multiple Inference and Gender Differences in the Effects of Early Intervention: A Reevaluation of the Abecedarian, Perry Preschool, and Early Training Projects," Journal of the American Statistical Association, American Statistical Association, vol. 103(484), pages 1481-1495.
    15. Alan B. Krueger, 2003. "Economic Considerations and Class Size," Economic Journal, Royal Economic Society, vol. 113(485), pages 34-63, February.
    16. James J. Heckman & Paul A. LaFontaine, 2010. "The American High School Graduation Rate: Trends and Levels," The Review of Economics and Statistics, MIT Press, vol. 92(2), pages 244-262, May.
    17. Melissa Osborne & Herbert Gintis & Samuel Bowles, 2001. "The Determinants of Earnings: A Behavioral Approach," Journal of Economic Literature, American Economic Association, vol. 39(4), pages 1137-1176, December.
    18. Roland G. Fryer, Jr, 2011. "Injecting Successful Charter School Strategies into Traditional Public Schools: A Field Experiment in Houston," NBER Working Papers 17494, National Bureau of Economic Research, Inc.
    19. Alan B. Krueger, 1999. "Experimental Estimates of Education Production Functions," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(2), pages 497-532.
    20. Jonathan Guryan, 2004. "Desegregation and Black Dropout Rates," American Economic Review, American Economic Association, vol. 94(4), pages 919-943, September.
    21. Barrow, Lisa & Schanzenbach, Diane Whitmore & Claessens, Amy, 2015. "The impact of Chicago’s small high school initiative," Journal of Urban Economics, Elsevier, vol. 87(C), pages 100-113.
    22. Charles T. Clotfelter & Helen F. Ladd & Jacob L. Vigdor, 2009. "The Academic Achievement Gap in Grades 3 to 8," The Review of Economics and Statistics, MIT Press, vol. 91(2), pages 398-419, May.
    23. Roland G. Fryer, Jr, 2010. "Racial Inequality in the 21st Century: The Declining Significance of Discrimination," NBER Working Papers 16256, National Bureau of Economic Research, Inc.
    24. Helen F. Ladd, 2012. "Education and Poverty: Confronting the Evidence," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 31(2), pages 203-227, March.
    25. Edward P. Lazear, 2001. "Educational Production," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 116(3), pages 777-803.
    26. Philip Oreopoulos & Kjell G. Salvanes, 2011. "Priceless: The Nonpecuniary Benefits of Schooling," Journal of Economic Perspectives, American Economic Association, vol. 25(1), pages 159-184, Winter.
    27. Julie Berry Cullen & Steven D. Levitt & Erin Robertson & Sally Sadoff, 2013. "What Can Be Done to Improve Struggling High Schools?," Journal of Economic Perspectives, American Economic Association, vol. 27(2), pages 133-152, Spring.
    28. Yona Rubinstein & James J. Heckman, 2001. "The Importance of Noncognitive Skills: Lessons from the GED Testing Program," American Economic Review, American Economic Association, vol. 91(2), pages 145-149, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sara Heller & Harold A. Pollack & Roseanna Ander & Jens Ludwig, 2013. "Preventing Youth Violence and Dropout: A Randomized Field Experiment," NBER Working Papers 19014, National Bureau of Economic Research, Inc.
    2. Islam, Asad & Lee, Wang-Sheng & Nicholas, Aaron, 2021. "The Effects of Chess Instruction on Academic and Non-cognitive Outcomes: Field Experimental Evidence from a Developing Country," Journal of Development Economics, Elsevier, vol. 150(C).
    3. Shoji, Masahiro, 2020. "Early-Life Circumstances and Adult Locus of Control: Evidence from 46 Developing Countries," MPRA Paper 99987, University Library of Munich, Germany.
    4. Kautz, Tim & Heckman, James J. & Diris, Ron & ter Weel, Bas & Borghans, Lex, 2014. "Fostering and Measuring Skills: Improving Cognitive and Non-Cognitive Skills to Promote Lifetime Success," IZA Discussion Papers 8696, Institute of Labor Economics (IZA).
    5. Sara B. Heller & Anuj K. Shah & Jonathan Guryan & Jens Ludwig & Sendhil Mullainathan & Harold A. Pollack, 2017. "Thinking, Fast and Slow? Some Field Experiments to Reduce Crime and Dropout in Chicago," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 132(1), pages 1-54.
    6. Richard J. Murnane, 2013. "U.S. High School Graduation Rates: Patterns and Explanations," Journal of Economic Literature, American Economic Association, vol. 51(2), pages 370-422, June.
    7. James J. Heckman, 2008. "Schools, Skills, And Synapses," Economic Inquiry, Western Economic Association International, vol. 46(3), pages 289-324, July.
    8. Weili Ding & Steven Lehrer, 2011. "Experimental estimates of the impacts of class size on test scores: robustness and heterogeneity," Education Economics, Taylor & Francis Journals, vol. 19(3), pages 229-252.
    9. Almond, Douglas & Currie, Janet, 2011. "Human Capital Development before Age Five," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 15, pages 1315-1486, Elsevier.
    10. Tahir Andrabi & Jishnu Das & Asim Ijaz Khwaja & Tristan Zajonc, 2011. "Do Value-Added Estimates Add Value? Accounting for Learning Dynamics," American Economic Journal: Applied Economics, American Economic Association, vol. 3(3), pages 29-54, July.
    11. Lex Borghans & Angela Lee Duckworth & James J. Heckman & Bas ter Weel, 2008. "The Economics and Psychology of Personality Traits," Journal of Human Resources, University of Wisconsin Press, vol. 43(4).
    12. Emily Beam & Priya Mukherjee & Laia Navarro-Sola, 2022. "Lowering Barriers to Remote Education: Experimental Impacts on Parental Responses and Learning," Working Papers 2022-030, Human Capital and Economic Opportunity Working Group.
    13. Jessica Leight & Elaine M. Liu, 2020. "Maternal Education, Parental Investment, and Noncognitive Characteristics in Rural China," Economic Development and Cultural Change, University of Chicago Press, vol. 69(1), pages 213-251.
    14. Christopher Blattman & Julian C. Jamison & Margaret Sheridan, 2015. "Reducing crime and violence: Experimental evidence from cognitive behavioral therapy in Liberia," NBER Working Papers 21204, National Bureau of Economic Research, Inc.
    15. Thiel, Hendrik & Thomsen, Stephan L., 2013. "Noncognitive skills in economics: Models, measurement, and empirical evidence," Research in Economics, Elsevier, vol. 67(2), pages 189-214.
    16. Heckman, James J. & Kautz, Tim, 2012. "Hard evidence on soft skills," Labour Economics, Elsevier, vol. 19(4), pages 451-464.
    17. Pedro Carneiro & Oswald Koussihouèdé & Nathalie Lahire & Costas Meghir & Corina Mommaerts, 2020. "School Grants and Education Quality: Experimental Evidence from Senegal," Economica, London School of Economics and Political Science, vol. 87(345), pages 28-51, January.
    18. Sarah Baird & Joan Hamory Hicks & Michael Kremer & Edward Miguel, 2016. "Worms at Work: Long-run Impacts of a Child Health Investment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(4), pages 1637-1680.
    19. Martins, Pedro S., 2017. "Can Non-Cognitive Skills Programs Improve Achievement? Quasi-Experimental Evidence from EPIS," GLO Discussion Paper Series 105, Global Labor Organization (GLO).
    20. Mari, Gabriele & Keizer, Renske, 2020. "Families of Austerity: Welfare Cuts and Family Stress in Britain," SocArXiv vdej8, Center for Open Science.

    More about this item

    JEL classification:

    • I0 - Health, Education, and Welfare - - General
    • I20 - Health, Education, and Welfare - - Education - - - General
    • I24 - Health, Education, and Welfare - - Education - - - Education and Inequality
    • I3 - Health, Education, and Welfare - - Welfare, Well-Being, and Poverty
    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity
    • Z18 - Other Special Topics - - Cultural Economics - - - Public Policy

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:19862. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.