IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/15473.html
   My bibliography  Save this paper

Are High Quality Schools Enough to Close the Achievement Gap? Evidence from a Social Experiment in Harlem

Author

Listed:
  • Will Dobbie
  • Roland G. Fryer, Jr

Abstract

Harlem Children's Zone (HCZ), which combines community investments with reform minded charter schools, is one of the most ambitious social experiments to alleviate poverty of our time. We provide the first empirical test of the causal impact of HCZ on educational outcomes, with an eye toward informing the long-standing debate whether schools alone can eliminate the achievement gap or whether the issues that poor children bring to school are too much for educators alone to overcome. Both lottery and instrumental variable identification strategies lead us to the same story: Harlem Children's Zone is effective at increasing the achievement of the poorest minority children. Taken at face value, the effects in middle school are enough to close the black-white achievement gap in mathematics and reduce it by nearly half in English Language Arts. The effects in elementary school close the racial achievement gap in both subjects. We conclude by presenting four pieces of evidence that high-quality schools or high-quality schools coupled with community investments generate the achievement gains. Community investments alone cannot explain the results.

Suggested Citation

  • Will Dobbie & Roland G. Fryer, Jr, 2009. "Are High Quality Schools Enough to Close the Achievement Gap? Evidence from a Social Experiment in Harlem," NBER Working Papers 15473, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:15473
    Note: CH ED LS
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w15473.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Brian A. Jacob, 2004. "Public Housing, Housing Vouchers, and Student Achievement: Evidence from Public Housing Demolitions in Chicago," American Economic Review, American Economic Association, vol. 94(1), pages 233-258, March.
    2. Anderson, Michael L, 2008. "Multiple Inference and Gender Differences in the Effects of Early Intervention: A Reevaluation of the Abecedarian, Perry Preschool, and Early Training Projects," Department of Agricultural & Resource Economics, UC Berkeley, Working Paper Series qt15n8j26f, Department of Agricultural & Resource Economics, UC Berkeley.
    3. Hanushek, Eric A. & Kain, John F. & Rivkin, Steven G. & Branch, Gregory F., 2007. "Charter school quality and parental decision making with school choice," Journal of Public Economics, Elsevier, vol. 91(5-6), pages 823-848, June.
    4. David Deming, 2009. "Early Childhood Intervention and Life-Cycle Skill Development: Evidence from Head Start," American Economic Journal: Applied Economics, American Economic Association, vol. 1(3), pages 111-134, July.
    5. Eliana Garces & Duncan Thomas & Janet Currie, 2002. "Longer-Term Effects of Head Start," American Economic Review, American Economic Association, vol. 92(4), pages 999-1012, September.
    6. Thomas J. Kane & Douglas O. Staiger, 2008. "Estimating Teacher Impacts on Student Achievement: An Experimental Evaluation," NBER Working Papers 14607, National Bureau of Economic Research, Inc.
    7. Neal, Derek, 2006. "Why Has Black-White Skill Convergence Stopped?," Handbook of the Economics of Education, in: Erik Hanushek & F. Welch (ed.), Handbook of the Economics of Education, edition 1, volume 1, chapter 9, pages 511-576, Elsevier.
    8. Brian A. Jacob & Lars Lefgren, 2004. "Remedial Education and Student Achievement: A Regression-Discontinuity Analysis," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 226-244, February.
    9. Steven D. Levitt & Lance Lochner, 2001. "The Determinants of Juvenile Crime," NBER Chapters, in: Risky Behavior among Youths: An Economic Analysis, pages 327-374, National Bureau of Economic Research, Inc.
    10. Lisa Sanbonmatsu & Jeffrey R. Kling & Greg J. Duncan & Jeanne Brooks-Gunn, 2006. "Neighborhoods and Academic Achievement: Results from the Moving to Opportunity Experiment," Journal of Human Resources, University of Wisconsin Press, vol. 41(4).
    11. Jens Ludwig & Douglas L. Miller, 2007. "Does Head Start Improve Children's Life Chances? Evidence from a Regression Discontinuity Design," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(1), pages 159-208.
    12. Daniel Aaronson & Lisa Barrow & William Sander, 2007. "Teachers and Student Achievement in the Chicago Public High Schools," Journal of Labor Economics, University of Chicago Press, vol. 25(1), pages 95-135.
    13. Cullen, Julie Berry & Jacob, Brian A. & Levitt, Steven D., 2005. "The impact of school choice on student outcomes: an analysis of the Chicago Public Schools," Journal of Public Economics, Elsevier, vol. 89(5-6), pages 729-760, June.
    14. Robert Kaestner & Kevin Callison, 2011. "Adolescent Cognitive and Noncognitive Correlates of Adult Health," Journal of Human Capital, University of Chicago Press, vol. 5(1), pages 29-69.
    15. Card, David & Rothstein, Jesse, 2007. "Racial segregation and the black-white test score gap," Journal of Public Economics, Elsevier, vol. 91(11-12), pages 2158-2184, December.
    16. Kane, Thomas J. & Rockoff, Jonah E. & Staiger, Douglas O., 2008. "What does certification tell us about teacher effectiveness? Evidence from New York City," Economics of Education Review, Elsevier, vol. 27(6), pages 615-631, December.
    17. Janet Currie & Duncan Thomas, 2000. "School Quality and the Longer-Term Effects of Head Start," Journal of Human Resources, University of Wisconsin Press, vol. 35(4), pages 755-774.
    18. Adriana Lleras-Muney, 2005. "The Relationship Between Education and Adult Mortality in the United States," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(1), pages 189-221.
    19. Christopher Jepsen & Steven Rivkin, 2002. "What is the Tradeoff Between Smaller Classes and Teacher Quality?," NBER Working Papers 9205, National Bureau of Economic Research, Inc.
    20. Anderson, Michael L., 2008. "Multiple Inference and Gender Differences in the Effects of Early Intervention: A Reevaluation of the Abecedarian, Perry Preschool, and Early Training Projects," Journal of the American Statistical Association, American Statistical Association, vol. 103(484), pages 1481-1495.
    21. Card, David, 1999. "The causal effect of education on earnings," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 30, pages 1801-1863, Elsevier.
    22. Carmit Segal, 2006. "Motivation, test scores and economic success," Economics Working Papers 1124, Department of Economics and Business, Universitat Pompeu Fabra, revised Oct 2008.
    23. Currie, Janet & Thomas, Duncan, 1995. "Does Head Start Make a Difference?," American Economic Review, American Economic Association, vol. 85(3), pages 341-364, June.
    24. Krueger, Alan B & Whitmore, Diane M, 2001. "The Effect of Attending a Small Class in the Early Grades on College-Test Taking and Middle School Test Results: Evidence from Project STAR," Economic Journal, Royal Economic Society, vol. 111(468), pages 1-28, January.
    25. Lance Lochner & Enrico Moretti, 2004. "The Effect of Education on Crime: Evidence from Prison Inmates, Arrests, and Self-Reports," American Economic Review, American Economic Association, vol. 94(1), pages 155-189, March.
    26. Oreopoulos, Philip, 2007. "Do dropouts drop out too soon? Wealth, health and happiness from compulsory schooling," Journal of Public Economics, Elsevier, vol. 91(11-12), pages 2213-2229, December.
    27. Alan B. Krueger, 1999. "Experimental Estimates of Education Production Functions," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(2), pages 497-532.
    28. Marianne Bertrand & Esther Duflo & Sendhil Mullainathan, 2004. "How Much Should We Trust Differences-In-Differences Estimates?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(1), pages 249-275.
    29. Card, David, 2001. "Estimating the Return to Schooling: Progress on Some Persistent Econometric Problems," Econometrica, Econometric Society, vol. 69(5), pages 1127-1160, September.
    30. Roland G. Fryer & Steven D. Levitt, 2004. "Understanding the Black-White Test Score Gap in the First Two Years of School," The Review of Economics and Statistics, MIT Press, vol. 86(2), pages 447-464, May.
    31. Caroline M. Hoxby & Sonali Murarka, 2009. "Charter Schools in New York City: Who Enrolls and How They Affect Their Students' Achievement," NBER Working Papers 14852, National Bureau of Economic Research, Inc.
    32. Jonathan Gruber, 2001. "Risky Behavior among Youths: An Economic Analysis," NBER Books, National Bureau of Economic Research, Inc, number grub01-1, March.
    33. David Orr, 1999. "Book," Journal of Industrial Ecology, Yale University, vol. 3(4), pages 155-156, October.
    34. Brian A. Jacob & Steven D. Levitt, 2003. "Rotten Apples: An Investigation of the Prevalence and Predictors of Teacher Cheating," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(3), pages 843-877.
    35. O. Ashenfelter & D. Card (ed.), 1999. "Handbook of Labor Economics," Handbook of Labor Economics, Elsevier, edition 1, volume 3, number 3.
    36. Levin, Henry M. & Belfield, Clive & Muennig, Peter & Rouse, Cecilia, 2007. "The public returns to public educational investments in African-American males," Economics of Education Review, Elsevier, vol. 26(6), pages 699-708, December.
    37. Brian Jacob & Jens Ludwig, 2008. "Improving Educational Outcomes for Poor Children," NBER Working Papers 14550, National Bureau of Economic Research, Inc.
    38. Neal, Derek A & Johnson, William R, 1996. "The Role of Premarket Factors in Black-White Wage Differences," Journal of Political Economy, University of Chicago Press, vol. 104(5), pages 869-895, October.
    39. Justine S. Hastings & Thomas J. Kane & Douglas O. Staiger, 2006. "Gender and Performance: Evidence from School Assignment by Randomized Lottery," American Economic Review, American Economic Association, vol. 96(2), pages 232-236, May.
    40. Lawrence F. Katz & Jeffrey R. Kling & Jeffrey B. Liebman, 2001. "Moving to Opportunity in Boston: Early Results of a Randomized Mobility Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 116(2), pages 607-654.
    41. Cecilia Elena Rouse, 1998. "Private School Vouchers and Student Achievement: An Evaluation of the Milwaukee Parental Choice Program," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 113(2), pages 553-602.
    42. repec:mpr:mprres:4150 is not listed on IDEAS
    43. Joshua D. Angrist & Alan B. Keueger, 1991. "Does Compulsory School Attendance Affect Schooling and Earnings?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 106(4), pages 979-1014.
    44. Michael J. Podgursky & Matthew G. Springer, 2007. "Teacher performance pay: A review," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 26(4), pages 909-950.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Will Dobbie & Roland G. Fryer, 2011. "Are High-Quality Schools Enough to Increase Achievement among the Poor? Evidence from the Harlem Children's Zone," American Economic Journal: Applied Economics, American Economic Association, vol. 3(3), pages 158-187, July.
    2. Roland G. Fryer, Jr, 2010. "Racial Inequality in the 21st Century: The Declining Significance of Discrimination," NBER Working Papers 16256, National Bureau of Economic Research, Inc.
    3. Vilsa E. Curto & Roland G. Fryer Jr., 2014. "The Potential of Urban Boarding Schools for the Poor: Evidence from SEED," Journal of Labor Economics, University of Chicago Press, vol. 32(1), pages 65-93.
    4. Roland G. Fryer, Jr, 2011. "Injecting Successful Charter School Strategies into Traditional Public Schools: A Field Experiment in Houston," NBER Working Papers 17494, National Bureau of Economic Research, Inc.
    5. Roland G. Fryer, Jr, 2010. "Financial Incentives and Student Achievement: Evidence from Randomized Trials," NBER Working Papers 15898, National Bureau of Economic Research, Inc.
    6. Dionissi Aliprantis, 2012. "Redshirting, Compulsory Schooling Laws, and Educational Attainment," Journal of Educational and Behavioral Statistics, , vol. 37(2), pages 316-338, April.
    7. Roland G. Fryer, 2011. "Teacher Incentives and Student Achievement: Evidence from New York City Public Schools," NBER Working Papers 16850, National Bureau of Economic Research, Inc.
    8. Chalfin, Aaron & Deza, Monica, 2019. "The intergenerational effects of education on delinquency," Journal of Economic Behavior & Organization, Elsevier, vol. 159(C), pages 553-571.
    9. Strauss, Jack, 2013. "The Economic Gains to Colorado of Amendment 66," MPRA Paper 49928, University Library of Munich, Germany.
    10. Joshua D. Angrist & Sarah R. Cohodes & Susan M. Dynarski & Parag A. Pathak & Christopher R. Walters, 2016. "Stand and Deliver: Effects of Boston's Charter High Schools on College Preparation, Entry, and Choice," Journal of Labor Economics, University of Chicago Press, vol. 34(2), pages 275-318.
    11. Wael S. Moussa, 2017. "Closer to the Finish Line? Compulsory Attendance, Grade Attainment, and High School Graduation," Education Finance and Policy, MIT Press, vol. 12(1), pages 28-53, Winter.
    12. Sara Heller & Harold A. Pollack & Roseanna Ander & Jens Ludwig, 2013. "Preventing Youth Violence and Dropout: A Randomized Field Experiment," NBER Working Papers 19014, National Bureau of Economic Research, Inc.
    13. Chloe Gibbs & Jens Ludwig & Douglas L. Miller, 2011. "Does Head Start Do Any Lasting Good?," NBER Working Papers 17452, National Bureau of Economic Research, Inc.
    14. Raj Chetty & John N. Friedman & Nathaniel Hilger & Emmanuel Saez & Diane Whitmore Schanzenbach & Danny Yagan, 2011. "How Does Your Kindergarten Classroom Affect Your Earnings? Evidence from Project Star," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(4), pages 1593-1660.
    15. Will Dobbie & Roland G. Fryer Jr., 2013. "Getting beneath the Veil of Effective Schools: Evidence from New York City," American Economic Journal: Applied Economics, American Economic Association, vol. 5(4), pages 28-60, October.
    16. Koedel, Cory & Mihaly, Kata & Rockoff, Jonah E., 2015. "Value-added modeling: A review," Economics of Education Review, Elsevier, vol. 47(C), pages 180-195.
    17. Denis Fougere & Arthur Heim, 2019. "L'évaluation socioéconomique de l'investissement social: Comment mettre en oeuvre des analyses coûts-bénéfices pour les politiques d'emploi, de santé et d'éducation," Sciences Po publications info:hdl:2441/5lge9h8e809, Sciences Po.
    18. Doug Miller & Jens Ludwig, 2005. "Does Head Start Improve Children?s Life Chances? Evidence from a Regression Discontinuity Design," Working Papers 534, University of California, Davis, Department of Economics.
    19. Ludger Wößmann, 2008. "Efficiency and equity of European education and training policies," International Tax and Public Finance, Springer;International Institute of Public Finance, vol. 15(2), pages 199-230, April.
    20. Denis Fougère & Arthur Heim, 2019. "L'évaluation socioéconomique de l'investissement social," Working Papers hal-03456048, HAL.

    More about this item

    JEL classification:

    • I20 - Health, Education, and Welfare - - Education - - - General
    • J01 - Labor and Demographic Economics - - General - - - Labor Economics: General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:15473. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.