IDEAS home Printed from https://ideas.repec.org/p/cdl/cshedu/qt66n4x6g4.html
   My bibliography  Save this paper

Admissions Bias: A New Approach to Validity Estimation in Selected Samples

Author

Listed:
  • Rothstein, Jesse M

Abstract

Validity researchers typically work with nonrandom samples, membership in which depends in part on the exam score being investigated. In a study of the SAT's validity for freshman GPA at a particular college, for example, FGPA is not observed for the entire pool of potential applicants, but only for those who are admitted and enroll. This sample selection biases validity estimates. Corrections for restriction of range remedy the problem only when the exam score is the sole determinant of selection, and even then do not permit consistent estimation of the exam's incremental validity. Regression omitted variables results motivate a proposed validity estimator that is consistent whenever the determinants of selection are observed. An algorithm is suggested for calculation of these "robust" validity coefficients, and used to estimate the SAT's validity at the University of California. The usual validity estimates are shown to be substantially biased, in the hypothesized directions, by admissions-induced sample selection.

Suggested Citation

  • Rothstein, Jesse M, 2002. "Admissions Bias: A New Approach to Validity Estimation in Selected Samples," University of California at Berkeley, Center for Studies in Higher Education qt66n4x6g4, Center for Studies in Higher Education, UC Berkeley.
    • Handle: RePEc:cdl:cshedu:qt66n4x6g4
    as

    Download full text from publisher

    File URL: https://www.escholarship.org/uc/item/66n4x6g4.pdf;origin=repeccitec
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Rothstein, J.M.Jesse M., 2004. "College performance predictions and the SAT," Journal of Econometrics, Elsevier, vol. 121(1-2), pages 297-317.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bertrand, Marianne, 2011. "New Perspectives on Gender," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 17, pages 1543-1590, Elsevier.
    2. de Roux, Nicolás & Riehl, Evan, 2022. "Do college students benefit from placement into higher-achieving classes?," Journal of Public Economics, Elsevier, vol. 210(C).
    3. Peter Bergman, 2020. "Nudging Technology Use: Descriptive and Experimental Evidence from School Information Systems," Education Finance and Policy, MIT Press, vol. 15(4), pages 623-647, Fall.
    4. Rajeev Darolia & Cory Koedel, 2018. "High Schools And Students' Initial Colleges And Majors," Contemporary Economic Policy, Western Economic Association International, vol. 36(4), pages 692-710, October.
    5. Peter Leopold S. Bergman & Elizabeth Kopko & Julio Rodriguez, 2021. "Using Predictive Analytics to Track Students: Evidence from a Seven-College Experiment," CESifo Working Paper Series 9157, CESifo.
    6. Attali, Yigal & Neeman, Zvika & Schlosser, Analia, 2011. "Rise to the Challenge or Not Give a Damn: Differential Performance in High vs. Low Stakes Tests," Foerder Institute for Economic Research Working Papers 275743, Tel-Aviv University > Foerder Institute for Economic Research.
    7. Sandra E. Black & Jeffrey T. Denning & Jesse Rothstein, 2023. "Winners and Losers? The Effect of Gaining and Losing Access to Selective Colleges on Education and Labor Market Outcomes," American Economic Journal: Applied Economics, American Economic Association, vol. 15(1), pages 26-67, January.
    8. Corinne Bendersky & Neha Parikh Shah, 2012. "The Cost of Status Enhancement: Performance Effects of Individuals' Status Mobility in Task Groups," Organization Science, INFORMS, vol. 23(2), pages 308-322, April.
    9. Milan Ranđelović & Aleksandar Aleksić & Radovan Radovanović & Vladica Stojanović & Milan Čabarkapa & Dragan Ranđelović, 2022. "One Aggregated Approach in Multidisciplinary Based Modeling to Predict Further Students’ Education," Mathematics, MDPI, vol. 10(14), pages 1-23, July.
    10. David Card & Alan B. Krueger, 2005. "Would the Elimination of Affirmative Action Affect Highly Qualified Minority Applicants? Evidence from California and Texas," ILR Review, Cornell University, ILR School, vol. 58(3), pages 416-434, April.
    11. repec:pri:cepsud:123rothstein is not listed on IDEAS
    12. Verbetsky, Alexey D. (Вербецкий, Алексей) & Friedman, Alla A. (Фридман, Алла), 2016. "Universities’ Admission Policy and Student Competition [Политика Приема В Вузы И Конкуренция Абитуриентов]," Ekonomicheskaya Politika / Economic Policy, Russian Presidential Academy of National Economy and Public Administration, vol. 5, pages 68-91, October.
    13. Eric P. Bettinger & Brent J. Evans & Devin G. Pope, 2013. "Improving College Performance and Retention the Easy Way: Unpacking the ACT Exam," American Economic Journal: Economic Policy, American Economic Association, vol. 5(2), pages 26-52, May.
    14. Silva, Pedro Luís, 2022. "Specialists or All-Rounders: How Best to Select University Students?," IZA Discussion Papers 15271, Institute of Labor Economics (IZA).
    15. Geiser, Saul & Maria Veronica Santelices, 2007. "Validity Of High-School Grades In Predicting Student Success Beyond The Freshman Year: High-School Record vs. Standardized Tests as Indicators of Four-Year College Outcomes," University of California at Berkeley, Center for Studies in Higher Education qt7306z0zf, Center for Studies in Higher Education, UC Berkeley.
    16. Poldin, Oleg, 2011. "Predicting success in college on the basis of the results of unified national exam," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 21(1), pages 56-69.
    17. Jason Fletcher & Marta Tienda, 2010. "Race and Ethnic Differences in College Achievement: Does High School Attended Matter?," The ANNALS of the American Academy of Political and Social Science, , vol. 627(1), pages 144-166, January.
    18. Beattie, Graham & Laliberté, Jean-William P. & Oreopoulos, Philip, 2018. "Thrivers and divers: Using non-academic measures to predict college success and failure," Economics of Education Review, Elsevier, vol. 62(C), pages 170-182.
    19. Peresetsky, Anatoly & Davtian, Misak, 2011. "Russian USE and olympiads as instruments for university admission selection," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 23(3), pages 41-56.
    20. Geiser, Saul, 2008. "Not So Fast! A Second Opinion on a University of California Proposal to Endorse the New SAT," University of California at Berkeley, Center for Studies in Higher Education qt0x09n63m, Center for Studies in Higher Education, UC Berkeley.
    21. Jesse Rothstein & Albert Yoon, 2006. "Mismatch in Law School," Working Papers 29, Princeton University, School of Public and International Affairs, Education Research Section..

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cdl:cshedu:qt66n4x6g4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Lisa Schiff (email available below). General contact details of provider: https://escholarship.org/uc/cshe/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.