IDEAS home Printed from https://ideas.repec.org/a/eee/ecoedu/v89y2022ics0272775722000607.html
   My bibliography  Save this article

Qualitative information in undergraduate admissions: A pilot study of letters of recommendation

Author

Listed:
  • Rothstein, Jesse

Abstract

A subset of undergraduate applicants to the University of California, Berkeley were invited to submit letters of recommendation as part of their applications. I use scraped text of the submitted letters, natural language processing tools, and a within-subject experimental design wherein applications were read in parallel with and without their letters to understand the role that this qualitative information plays in admissions. I show that letters written on behalf of underrepresented applicants were modestly distinctive. I also construct an index of letter strength, measuring the predicted impact of the letter on the student's application score. I show that underrepresented applicants tend to get weaker letters, but that readers pay less attention to letter strength for underrepresented students. Overall, the inclusion of letters modestly improved application outcomes for the average underrepresented student.

Suggested Citation

  • Rothstein, Jesse, 2022. "Qualitative information in undergraduate admissions: A pilot study of letters of recommendation," Economics of Education Review, Elsevier, vol. 89(C).
    • Handle: RePEc:eee:ecoedu:v:89:y:2022:i:c:s0272775722000607
    DOI: 10.1016/j.econedurev.2022.102285
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0272775722000607
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.econedurev.2022.102285?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Amira Nurlatifah & Bambang Suratman & Hariyati, 2021. "Good University Governance Higher Education," Technium Social Sciences Journal, Technium Science, vol. 16(1), pages 222-228, February.
    2. Caroline Hoxby & Christopher Avery, 2013. "The Missing "One-Offs": The Hidden Supply of High-Achieving, Low-Income Students," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 44(1 (Spring), pages 1-65.
    3. Rothstein, Jesse M, 2004. "College performance predictions and the SAT," Department of Economics, Working Paper Series qt59s4j4m4, Department of Economics, Institute for Business and Economic Research, UC Berkeley.
    4. ., 2021. "Universities and the UK economy," Chapters, in: Networks, SMEs, and the University, chapter 5, pages 56-71, Edward Elgar Publishing.
    5. Zachary Bleemer, 2022. "Affirmative Action, Mismatch, and Economic Mobility after California’s Proposition 209," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 137(1), pages 115-160.
    6. Hermann Simon, 2021. "University Life … And Beyond," Springer Books, in: Many Worlds, One Life, chapter 8, pages 127-156, Springer.
    7. ., 2021. "Collaboration and the engaged university," Chapters, in: Networks, SMEs, and the University, chapter 3, pages 25-30, Edward Elgar Publishing.
    8. Marianne Bertrand & Sendhil Mullainathan, 2004. "Are Emily and Greg More Employable Than Lakisha and Jamal? A Field Experiment on Labor Market Discrimination," American Economic Review, American Economic Association, vol. 94(4), pages 991-1013, September.
    9. Sarah R. Cohodes & Joshua S. Goodman, 2014. "Merit Aid, College Quality, and College Completion: Massachusetts' Adams Scholarship as an In-Kind Subsidy," American Economic Journal: Applied Economics, American Economic Association, vol. 6(4), pages 251-285, October.
    10. Ioannis N. M. Papadakis, 2021. "On the Universal Encoding Optimality of Primes," Mathematics, MDPI, vol. 9(24), pages 1-14, December.
    11. Alan Krueger & Jesse Rothstein & Sarah Turner, 2006. "Race, Income, and College in 25 Years: Evaluating Justice O'Connor's Conjecture," American Law and Economics Review, Oxford University Press, vol. 8(2), pages 282-311.
    12. ., 2021. "University–industry collaboration: why it matters," Chapters, in: Networks, SMEs, and the University, chapter 1, pages 1-10, Edward Elgar Publishing.
    13. Lai, Yung-Lien & Zhao, Jihong Solomon, 2010. "The impact of race/ethnicity, neighborhood context, and police/citizen interaction on residents' attitudes toward the police," Journal of Criminal Justice, Elsevier, vol. 38(4), pages 685-692, July.
    14. Dongfu (Franco) Li & Xiaoqing (Maggie) Fu, 2021. "The Efficiency of University Technology Transfer in China," Asian Economic Papers, MIT Press, vol. 20(3), pages 114-137, Fall.
    15. Pierre Lecointre & Sophia Laney & Martyna Michalska & Tao Li & Alexandre Tanguy & Ioannis Papakonstantinou & David Quéré, 2021. "Unique and universal dew-repellency of nanocones," Nature Communications, Nature, vol. 12(1), pages 1-9, December.
    16. Michael N. Bastedo & Nicholas A. Bowman & Kristen M. Glasener & Jandi L. Kelly, 2018. "What are We Talking About When We Talk About Holistic Review? Selective College Admissions and its Effects on Low-SES Students," The Journal of Higher Education, Taylor & Francis Journals, vol. 89(5), pages 782-805, September.
    17. Rothstein, J.M.Jesse M., 2004. "College performance predictions and the SAT," Journal of Econometrics, Elsevier, vol. 121(1-2), pages 297-317.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Gandil, Mikkel & Leuven, Edwin, 2022. "College admission as a screening and sorting device," Memorandum 2/2022, Oslo University, Department of Economics.
    2. Gonzalez, Felipe & Coy, Felipe & Prem, Mounu & von Dessauer, Cristine, 2022. "Uncertainty from dictatorship to democracy: Evidence from business communications," SocArXiv gz934, Center for Open Science.
    3. AJ Alvero & Jasmine Pal & Katelyn M. Moussavian, 2022. "Linguistic, cultural, and narrative capital: computational and human readings of transfer admissions essays," Journal of Computational Social Science, Springer, vol. 5(2), pages 1709-1734, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Raj Chetty & John N. Friedman & Emmanuel Saez & Nicholas Turner & Danny Yagan, 2020. "The Determinants of Income Segregation and Intergenerational Mobility: Using Test Scores to Measure Undermatching," NBER Working Papers 26748, National Bureau of Economic Research, Inc.
    2. Rajeev Darolia & Cory Koedel, 2018. "High Schools And Students' Initial Colleges And Majors," Contemporary Economic Policy, Western Economic Association International, vol. 36(4), pages 692-710, October.
    3. Peter Arcidiacono & Cory Koedel, 2014. "Race and College Success: Evidence from Missouri," American Economic Journal: Applied Economics, American Economic Association, vol. 6(3), pages 20-57, July.
    4. de Roux, Nicolás & Riehl, Evan, 2022. "Do college students benefit from placement into higher-achieving classes?," Journal of Public Economics, Elsevier, vol. 210(C).
    5. Debopam Bhattacharya & Shin Kanaya & Margaret Stevens, 2017. "Are University Admissions Academically Fair?," The Review of Economics and Statistics, MIT Press, vol. 99(3), pages 449-464, July.
    6. Andrews, Rodney J. & Imberman, Scott A. & Lovenheim, Michael F., 2020. "Recruiting and supporting low-income, high-achieving students at flagship universities," Economics of Education Review, Elsevier, vol. 74(C).
    7. Gurantz, Oded & Pender, Matea & Mabel, Zachary & Larson, Cassandra & Bettinger, Eric, 2020. "Virtual advising for high-achieving high school students," Economics of Education Review, Elsevier, vol. 75(C).
    8. Rodney J. Andrews & Kevin M. Stange, 2019. "Price Regulation, Price Discrimination, and Equality of Opportunity in Higher Education: Evidence from Texas," American Economic Journal: Economic Policy, American Economic Association, vol. 11(4), pages 31-65, November.
    9. Cecilia Machado & Germ'an Reyes & Evan Riehl, 2023. "The Direct and Spillover Effects of Large-scale Affirmative Action at an Elite Brazilian University," Papers 2305.02513, arXiv.org, revised Jun 2023.
    10. Hanson, Andrew, 2017. "Do college admissions counselors discriminate? Evidence from a correspondence-based field experiment," Economics of Education Review, Elsevier, vol. 60(C), pages 86-96.
    11. Brian Knight & Nathan Schiff, 2022. "Reducing Frictions in College Admissions: Evidence from the Common Application," American Economic Journal: Economic Policy, American Economic Association, vol. 14(1), pages 179-206, February.
    12. Aguirre, Josefa & Matta, Juan, 2021. "Walking in your footsteps: Sibling spillovers in higher education choices," Economics of Education Review, Elsevier, vol. 80(C).
    13. Cecilia Machado & Germán Reyes & Evan Riehl, 2023. "The Efficacy of Large-Scale Affirmative Action at Elite Universities," CEDLAS, Working Papers 0311, CEDLAS, Universidad Nacional de La Plata.
    14. Nicolás de Roux & Evan Riehl, 2019. "Isolating Peer Effects in the Returns to College Selectivity," Documentos CEDE 17413, Universidad de los Andes, Facultad de Economía, CEDE.
    15. Page, Lindsay C. & Scott-Clayton, Judith, 2016. "Improving college access in the United States: Barriers and policy responses," Economics of Education Review, Elsevier, vol. 51(C), pages 4-22.
    16. Bulman, George, 2017. "Weighting recent performance to improve college and labor market outcomes," Journal of Public Economics, Elsevier, vol. 146(C), pages 97-108.
    17. Smith, Jonathan & Hurwitz, Michael & Howell, Jessica, 2015. "Screening mechanisms and student responses in the college market," Economics of Education Review, Elsevier, vol. 44(C), pages 17-28.
    18. Peter Bergman, 2020. "Nudging Technology Use: Descriptive and Experimental Evidence from School Information Systems," Education Finance and Policy, MIT Press, vol. 15(4), pages 623-647, Fall.
    19. Bo, Shiyu & Liu, Jing & Shiu, Ji-Liang & Song, Yan & Zhou, Sen, 2019. "Admission mechanisms and the mismatch between colleges and students: Evidence from a large administrative dataset from China," Economics of Education Review, Elsevier, vol. 68(C), pages 27-37.
    20. Goodman, Joshua & Hurwitz, Michael & Smith, Jonathan & Fox, Julia, 2015. "The relationship between siblings’ college choices: Evidence from one million SAT-taking families," Economics of Education Review, Elsevier, vol. 48(C), pages 75-85.

    More about this item

    Keywords

    College admissions; Natural language processing; Holistic review;
    All these keywords.

    JEL classification:

    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions
    • I25 - Health, Education, and Welfare - - Education - - - Education and Economic Development

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecoedu:v:89:y:2022:i:c:s0272775722000607. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/econedurev .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.