IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/20781.html
   My bibliography  Save this paper

Group-Average Observables as Controls for Sorting on Unobservables When Estimating Group Treatment Effects: the Case of School and Neighborhood Effects

Author

Listed:
  • Joseph G. Altonji
  • Richard K. Mansfield

Abstract

We consider the classic problem of estimating group treatment effects when individuals sort based on observed and unobserved characteristics that affect the outcome. Using a standard choice model, we show that controlling for group averages of observed individual characteristics potentially absorbs all the across-group variation in unobservable individual characteristics. We use this insight to bound the treatment effect variance of school systems and associated neighborhoods for various outcomes. Across four datasets, our most conservative estimates indicate that a 90th versus 10th percentile school system increases the high school graduation probability by between 0.047 and 0.085 and increases the college enrollment probability by between 0.11 and 0.13. We also find large effects on adult earnings. We discuss a number of other applications of our methodology, including measurement of teacher value-added.

Suggested Citation

  • Joseph G. Altonji & Richard K. Mansfield, 2014. "Group-Average Observables as Controls for Sorting on Unobservables When Estimating Group Treatment Effects: the Case of School and Neighborhood Effects," NBER Working Papers 20781, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:20781
    Note: CH ED LS
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w20781.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jesse Rothstein, 2009. "Student Sorting and Bias in Value-Added Estimation: Selection on Observables and Unobservables," Education Finance and Policy, MIT Press, vol. 4(4), pages 537-571, October.
    2. Dionissi Aliprantis, 2011. "Assessing the evidence on neighborhood effects from moving to opportunity," Working Papers (Old Series) 1101, Federal Reserve Bank of Cleveland.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bryan S. Graham, 2018. "Identifying and Estimating Neighborhood Effects," Journal of Economic Literature, American Economic Association, vol. 56(2), pages 450-500, June.
    2. Dante Contreras & Jorge Rodríguez & Sergio Urzúa, 2019. "The Return to Private Education: Evidence from School-to-Work Transitions," Working Papers wp479, University of Chile, Department of Economics.
    3. Jean-William Laliberté, "undated". "Long-term Contextual Effects in Education: Schools and Neighborhoods," Working Papers 2019-01, Department of Economics, University of Calgary.
    4. Scott E. Carrell & Michal Kurlaender, 2016. "Estimating the Productivity of Community Colleges in Paving the Road to Four-Year Success," NBER Working Papers 22904, National Bureau of Economic Research, Inc.
    5. Díaz, Juan & Sánchez, Rafael & Villarroel, Gabriel & Villena, Mauricio G., 2021. "Effects of Measures of Teachers' Quality on Tertiary Education Attendance: Evaluation Tests versus Value Added," IZA Discussion Papers 14277, Institute of Labor Economics (IZA).
    6. Hellerstein, Judith K. & Kutzbach, Mark J. & Neumark, David, 2019. "Labor market networks and recovery from mass layoffs: Evidence from the Great Recession period," Journal of Urban Economics, Elsevier, vol. 113(C).
    7. Jonathan Smith & Kevin Stange, 2016. "A New Measure of College Quality to Study the Effects of College Sector and Peers on Degree Attainment," Education Finance and Policy, MIT Press, vol. 11(4), pages 369-403, Fall.
    8. David Slichter, 2023. "The employment effects of the minimum wage: A selection ratio approach to measuring treatment effects," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(3), pages 334-357, April.
    9. Cook, Jason B. & Mansfield, Richard K., 2016. "Task-specific experience and task-specific talent: Decomposing the productivity of high school teachers," Journal of Public Economics, Elsevier, vol. 140(C), pages 51-72.
    10. Eleanor Jawon Choi & Hyungsik Roger Moon & Geert Ridder, 2019. "Within-District School Lotteries, District Selection, and the Average Partial Effects of School Inputs," Korean Economic Review, Korean Economic Association, vol. 35, pages 275-306.
    11. Nidhiya Menon & Yana van der Meulen Rodgers, 2017. "The Impact of the Minimum Wage on Male and Female Employment and Earnings in India," Asian Development Review, MIT Press, vol. 34(1), pages 28-64, March.
    12. Scott E. Carrell & Michal Kurlaender, 2018. "Estimating the Productivity of Community Colleges in Paving the Road to Four-Year College Success," NBER Chapters, in: Productivity in Higher Education, pages 291-315, National Bureau of Economic Research, Inc.
    13. Dmitry Arkhangelsky & Guido Imbens, 2018. "Fixed Effects and the Generalized Mundlak Estimator," Papers 1807.02099, arXiv.org, revised Aug 2023.
    14. Jo Blanden & Kirstine Hansen & Sandra McNally, 2017. "Quality in early years settings and children’s school achievement," CEP Discussion Papers dp1468, Centre for Economic Performance, LSE.
    15. Evan Riehl & Juan E. Saavedra & Miguel Urquiola, 2018. "Learning and Earning: An Approximation to College Value Added in Two Dimensions," NBER Chapters, in: Productivity in Higher Education, pages 105-132, National Bureau of Economic Research, Inc.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Koedel Cory & Leatherman Rebecca & Parsons Eric, 2012. "Test Measurement Error and Inference from Value-Added Models," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 12(1), pages 1-37, November.
    2. Stacy, Brian, 2014. "Ranking Teachers when Teacher Value-Added is Heterogeneous Across Students," EconStor Preprints 104743, ZBW - Leibniz Information Centre for Economics.
    3. Jesse Rothstein, 2015. "Teacher Quality Policy When Supply Matters," American Economic Review, American Economic Association, vol. 105(1), pages 100-130, January.
    4. Patrick Bayer & Stephen L. Ross, 2006. "Identifying Individual and Group Effects in the Presence of Sorting: A Neighborhood Effects Application," Working papers 2006-13, University of Connecticut, Department of Economics, revised Jan 2009.
    5. Canales, Andrea & Maldonado, Luis, 2018. "Teacher quality and student achievement in Chile: Linking teachers' contribution and observable characteristics," International Journal of Educational Development, Elsevier, vol. 60(C), pages 33-50.
    6. Nirav Mehta, 2019. "Measuring quality for use in incentive schemes: The case of “shrinkage” estimators," Quantitative Economics, Econometric Society, vol. 10(4), pages 1537-1577, November.
    7. Jeffrey Max & Steven Glazerman, 2014. "Do Disadvantaged Students Get Less Effective Teaching? Key Findings from Recent Institute of Education Sciences Studies (Evaluation Brief)," Mathematica Policy Research Reports a7da30900bb047038d31acd56, Mathematica Policy Research.
    8. Goldhaber, Dan & Krieg, John & Theobald, Roddy, 2020. "Effective like me? Does having a more productive mentor improve the productivity of mentees?," Labour Economics, Elsevier, vol. 63(C).
    9. Koedel, Cory & Mihaly, Kata & Rockoff, Jonah E., 2015. "Value-added modeling: A review," Economics of Education Review, Elsevier, vol. 47(C), pages 180-195.
    10. repec:mpr:mprres:8000 is not listed on IDEAS
    11. Jonah E. Rockoff & Douglas O. Staiger & Thomas J. Kane & Eric S. Taylor, 2012. "Information and Employee Evaluation: Evidence from a Randomized Intervention in Public Schools," American Economic Review, American Economic Association, vol. 102(7), pages 3184-3213, December.
    12. Simon Burgess, 2019. "Understanding teacher effectiveness to raise pupil attainment," IZA World of Labor, Institute of Labor Economics (IZA), pages 465-465, December.
    13. Jesse Rothstein, 2010. "Teacher Quality in Educational Production: Tracking, Decay, and Student Achievement," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(1), pages 175-214.
    14. Marta De Philippis, 2021. "Multi-Task Agents and Incentives: The Case of Teaching and Research for University Professors," The Economic Journal, Royal Economic Society, vol. 131(636), pages 1643-1681.
    15. Francesco Ferrante, 2017. "Assessing Quality in Higher Education: Some Caveats," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 131(2), pages 727-743, March.
    16. Nirav Mehta, 2019. "Measuring quality for use in incentive schemes: The case of “shrinkage” estimators," Quantitative Economics, Econometric Society, vol. 10(4), pages 1537-1577, November.
    17. Delhommer, Scott, 2022. "High school role models and minority college achievement," Economics of Education Review, Elsevier, vol. 87(C).
    18. Alastair Muriel & Jeffrey Smith, 2011. "On Educational Performance Measures," Fiscal Studies, Institute for Fiscal Studies, vol. 32(2), pages 187-206, June.
    19. William E. Becker & Suzanne R. Becker, 2011. "Potpourri: Reflections from Husband/Wife Academic Editors," The American Economist, Sage Publications, vol. 56(2), pages 74-84, November.
    20. Victor Lavy & Genia Rachkovski & Adi Boiko, 2017. "Effects and Mechanisms of CEOs Quality in Public Education," NBER Working Papers 24028, National Bureau of Economic Research, Inc.
    21. Dionissi Aliprantis, 2013. "Human capital in the inner city," Working Papers (Old Series) 1302, Federal Reserve Bank of Cleveland.

    More about this item

    JEL classification:

    • C20 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - General
    • I20 - Health, Education, and Welfare - - Education - - - General
    • I24 - Health, Education, and Welfare - - Education - - - Education and Inequality
    • I26 - Health, Education, and Welfare - - Education - - - Returns to Education
    • R20 - Urban, Rural, Regional, Real Estate, and Transportation Economics - - Household Analysis - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:20781. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.