IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/16865.html
   My bibliography  Save this paper

From Natural Variation to Optimal Policy? The Lucas Critique Meets Peer Effects

Author

Listed:
  • Scott E. Carrell
  • Bruce I. Sacerdote
  • James E. West

Abstract

We take cohorts of entering freshmen at the United States Air Force Academy and assign half to peer groups with the goal of maximizing the academic performance of the lowest ability students. Our assignment algorithm uses peer effects estimates from the observational data. We find a negative and significant treatment effect for the students we intended to help. We show that within our "optimal" peer groups, students self-selected into bifurcated sub-groups with social dynamics entirely different from those in the observational data. Our results suggest that using reduced-form estimates to make out-of-sample policy predictions can lead to unanticipated outcomes.

Suggested Citation

  • Scott E. Carrell & Bruce I. Sacerdote & James E. West, 2011. "From Natural Variation to Optimal Policy? The Lucas Critique Meets Peer Effects," NBER Working Papers 16865, National Bureau of Economic Research, Inc.
    • Handle: RePEc:nbr:nberwo:16865
    Note: CH ED LS PE
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w16865.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Scott E. Carrell & Frederick V. Malmstrom & James E. West, 2008. "Peer Effects in Academic Cheating," Journal of Human Resources, University of Wisconsin Press, vol. 43(1).
    2. Esther Duflo & Pascaline Dupas & Michael Kremer, 2011. "Peer Effects, Teacher Incentives, and the Impact of Tracking: Evidence from a Randomized Evaluation in Kenya," American Economic Review, American Economic Association, vol. 101(5), pages 1739-1774, August.
    3. Stinebrickner, Ralph & Stinebrickner, Todd R., 2006. "What can be learned about peer effects using college roommates? Evidence from new survey data and students from disadvantaged backgrounds," Journal of Public Economics, Elsevier, vol. 90(8-9), pages 1435-1454, September.
    4. Bryan S. Graham & Guido W. Imbens & Geert Ridder, 2014. "Complementarity and aggregate implications of assortative matching: A nonparametric analysis," Quantitative Economics, Econometric Society, vol. 5, pages 29-66, March.
    5. David J. Zimmerman, 2003. "Peer Effects in Academic Outcomes: Evidence from a Natural Experiment," The Review of Economics and Statistics, MIT Press, vol. 85(1), pages 9-23, February.
    6. Charles F. Manski, 1993. "Identification of Endogenous Social Effects: The Reflection Problem," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 60(3), pages 531-542.
    7. Foster, Gigi, 2006. "It's not your peers, and it's not your friends: Some progress toward understanding the educational peer effect mechanism," Journal of Public Economics, Elsevier, vol. 90(8-9), pages 1455-1475, September.
    8. Scott E. Carrell & James E. West, 2010. "Does Professor Quality Matter? Evidence from Random Assignment of Students to Professors," Journal of Political Economy, University of Chicago Press, vol. 118(3), pages 409-432, June.
    9. Bhattacharya, Debopam, 2009. "Inferring Optimal Peer Assignment From Experimental Data," Journal of the American Statistical Association, American Statistical Association, vol. 104(486), pages 486-500.
    10. Scott E. Carrell & Richard L. Fullerton & James E. West, 2009. "Does Your Cohort Matter? Measuring Peer Effects in College Achievement," Journal of Labor Economics, University of Chicago Press, vol. 27(3), pages 439-464, July.
    11. David S. Lyle, 2007. "Estimating and Interpreting Peer and Role Model Effects from Randomly Assigned Social Groups at West Point," The Review of Economics and Statistics, MIT Press, vol. 89(2), pages 289-299, May.
    12. Bruce Sacerdote, 2001. "Peer Effects with Random Assignment: Results for Dartmouth Roommates," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 116(2), pages 681-704.
    13. Lucas, Robert Jr, 1976. "Econometric policy evaluation: A critique," Carnegie-Rochester Conference Series on Public Policy, Elsevier, vol. 1(1), pages 19-46, January.
    14. Friedman, Milton & Schwartz, Anna J, 1991. "Alternative Approaches to Analyzing Economic Data," American Economic Review, American Economic Association, vol. 81(1), pages 39-49, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. de Gendre, Alexandra & Salamanca, Nicolás, 2020. "On the Mechanisms of Ability Peer Effects," IZA Discussion Papers 13938, Institute of Labor Economics (IZA).
    2. Fischer, Stefanie, 2017. "The downside of good peers: How classroom composition differentially affects men's and women's STEM persistence," Labour Economics, Elsevier, vol. 46(C), pages 211-226.
    3. Brodaty, Thibault & Gurgand, Marc, 2016. "Good peers or good teachers? Evidence from a French University," Economics of Education Review, Elsevier, vol. 54(C), pages 62-78.
    4. Heather Antecol & Ozkan Eren & Serkan Ozbeklik, 2016. "Peer Effects in Disadvantaged Primary Schools: Evidence from a Randomized Experiment," Journal of Human Resources, University of Wisconsin Press, vol. 51(1), pages 95-132.
    5. Li, Tao & Han, Li & Zhang, Linxiu & Rozelle, Scott, 2014. "Encouraging classroom peer interactions: Evidence from Chinese migrant schools," Journal of Public Economics, Elsevier, vol. 111(C), pages 29-45.
    6. Coveney, Max & Oosterveen, Matthijs, 2021. "What drives ability peer effects?," European Economic Review, Elsevier, vol. 136(C).
    7. Giorgio Brunello & Maria De Paola & Vincenzo Scoppa, 2010. "Peer Effects In Higher Education: Does The Field Of Study Matter?," Economic Inquiry, Western Economic Association International, vol. 48(3), pages 621-634, July.
    8. Brady, Ryan R. & Insler, Michael A. & Rahman, Ahmed S., 2017. "Bad Company: Understanding negative peer effects in college achievement," European Economic Review, Elsevier, vol. 98(C), pages 144-168.
    9. Carrell, Scott E. & Hoekstra, Mark & West, James E., 2011. "Is poor fitness contagious?: Evidence from randomly assigned friends," Journal of Public Economics, Elsevier, vol. 95(7-8), pages 657-663, August.
    10. Scott E. Carrell & Richard L. Fullerton & James E. West, 2009. "Does Your Cohort Matter? Measuring Peer Effects in College Achievement," Journal of Labor Economics, University of Chicago Press, vol. 27(3), pages 439-464, July.
    11. Matias Berthelon & Eric Bettinger & Diana I. Kruger & Alejandro Montecinos-Pearce, 2019. "The Structure of Peers: The Impact of Peer Networks on Academic Achievement," Research in Higher Education, Springer;Association for Institutional Research, vol. 60(7), pages 931-959, November.
    12. Nicolás de Roux & Evan Riehl, 2019. "Isolating Peer Effects in the Returns to College Selectivity," Documentos CEDE 17413, Universidad de los Andes, Facultad de Economía, CEDE.
    13. Lépine, Andrea & Estevan, Fernanda, 2021. "Do ability peer effects matter for academic and labor market outcomes?," Labour Economics, Elsevier, vol. 71(C).
    14. Silvia Mendolia & Alfredo R Paloyo & Ian Walker, 2018. "Heterogeneous effects of high school peers on educational outcomes," Oxford Economic Papers, Oxford University Press, vol. 70(3), pages 613-634.
    15. Scott E. Carrell & James E. West, 2010. "Does Professor Quality Matter? Evidence from Random Assignment of Students to Professors," Journal of Political Economy, University of Chicago Press, vol. 118(3), pages 409-432, June.
    16. Stephen Gibbons & Shqiponja Telhaj, 2016. "Peer Effects: Evidence from Secondary School Transition in England," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 78(4), pages 548-575, August.
    17. Oleg Poldin & Diliara Valeeva & Maria Yudkevich, 2016. "Which Peers Matter: How Social Ties Affect Peer-group Effects," Research in Higher Education, Springer;Association for Institutional Research, vol. 57(4), pages 448-468, June.
    18. Berlinski, Samuel & Busso, Matias & Giannola, Michele, 2023. "Helping struggling students and benefiting all: Peer effects in primary education," Journal of Public Economics, Elsevier, vol. 224(C).
    19. Vincenzo Andrietti & Xuejuan Su, 2019. "Education curriculum and student achievement: theory and evidence," Education Economics, Taylor & Francis Journals, vol. 27(1), pages 4-19, January.
    20. Tarun Jain & Nishtha Langer, 2019. "Does Whom You Know Matter? Unraveling The Influence Of Peers' Network Attributes On Academic Performance," Economic Inquiry, Western Economic Association International, vol. 57(1), pages 141-161, January.

    More about this item

    JEL classification:

    • I2 - Health, Education, and Welfare - - Education
    • J01 - Labor and Demographic Economics - - General - - - Labor Economics: General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:16865. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.