IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2507.13798.html
   My bibliography  Save this paper

Choosing and Using Information in Evaluation Decisions

Author

Listed:
  • Katherine B. Coffman
  • Scott Kostyshak
  • Perihan O. Saygin

Abstract

We use a controlled experiment to study how information acquisition impacts candidate evaluations. We provide evaluators with group-level information on performance and the opportunity to acquire additional, individual-level performance information before making a final evaluation. We find that, on average, evaluators under-acquire individual-level information, leading to more stereotypical evaluations of candidates. Consistent with stereotyping, we find that (irrelevant) group-level comparisons have a significant impact on how candidates are evaluated; group-level comparisons bias initial assessments, responses to information, and final evaluations. This leads to under-recognition of talented candidates from comparatively weaker groups and over-selection of untalented candidates from comparatively stronger groups.

Suggested Citation

  • Katherine B. Coffman & Scott Kostyshak & Perihan O. Saygin, 2025. "Choosing and Using Information in Evaluation Decisions," Papers 2507.13798, arXiv.org.
  • Handle: RePEc:arx:papers:2507.13798
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2507.13798
    File Function: Latest version
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Alberto Alesina & Armando Miano & Stefanie Stantcheva, 2023. "Immigration and Redistribution," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 90(1), pages 1-39.
    2. J. Aislinn Bohren & Kareem Haggag & Alex Imas & Devin G. Pope, 2019. "Inaccurate Statistical Discrimination: An Identification Problem," PIER Working Paper Archive 19-010, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 17 Jul 2020.
    3. Pedro Bordalo & John Conlon & Nicola Gennaioli & Spencer Kwon & Andrei Shleifer, 2023. "How People Use Statistics," Working Papers 699, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    4. Katherine B. Coffman & Christine L. Exley & Muriel Niederle, 2021. "The Role of Beliefs in Driving Gender Discrimination," Management Science, INFORMS, vol. 67(6), pages 3551-3569, June.
    5. Michela Carlana, 2019. "Implicit Stereotypes: Evidence from Teachers’ Gender Bias," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 134(3), pages 1163-1224.
    6. Mark Egan & Gregor Matvos & Amit Seru, 2022. "When Harry Fired Sally: The Double Standard in Punishing Misconduct," Journal of Political Economy, University of Chicago Press, vol. 130(5), pages 1184-1248.
    7. Lepage, Louis Pierre, 2021. "Endogenous learning, persistent employer biases, and discrimination," CLEF Working Paper Series 34, Canadian Labour Economics Forum (CLEF), University of Waterloo.
    8. Joshua Schwartzstein & Adi Sunderam, 2021. "Using Models to Persuade," American Economic Review, American Economic Association, vol. 111(1), pages 276-323, January.
    9. Vojtěch Bartoš & Michal Bauer & Julie Chytilová & Filip Matějka, 2016. "Attention Discrimination: Theory and Field Experiments with Monitoring Information Acquisition," American Economic Review, American Economic Association, vol. 106(6), pages 1437-1475, June.
    10. Ruzzier, Christian A. & Woo, Marcelo D., 2023. "Discrimination with inaccurate beliefs and confirmation bias," Journal of Economic Behavior & Organization, Elsevier, vol. 210(C), pages 379-390.
    11. Marianne Bertrand & Sendhil Mullainathan, 2004. "Are Emily and Greg More Employable Than Lakisha and Jamal? A Field Experiment on Labor Market Discrimination," American Economic Review, American Economic Association, vol. 94(4), pages 991-1013, September.
    12. Matthew Rabin & Joel L. Schrag, 1999. "First Impressions Matter: A Model of Confirmatory Bias," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(1), pages 37-82.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kai Barron & Ruth Ditlmann & Stefan Gehrig & Sebastian Schweighofer-Kodritsch, 2025. "Explicit and Implicit Belief-Based Gender Discrimination: A Hiring Experiment," Management Science, INFORMS, vol. 71(2), pages 1600-1622, February.
    2. Miguel A. Fonseca & Ashley McCrea, 2023. "The role of shortlisting in shifting gender beliefs on performance: experimental evidence," Discussion Papers 2315, University of Exeter, Department of Economics.
    3. Ayaita, Adam, 2021. "Labor Market Discrimination and Statistical Differences in Unobserved Characteristics of Applicants," EconStor Preprints 236615, ZBW - Leibniz Information Centre for Economics.
    4. Darya Korlyakova, 2021. "Learning about Ethnic Discrimination from Different Information Sources," CERGE-EI Working Papers wp689, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
    5. Ayaita, Adam, 2023. "Ethnic Minority Background and Personality Characteristics: Evidence from a Representative Sample of the Adult Population," EconStor Preprints 251745, ZBW - Leibniz Information Centre for Economics, revised 2023.
    6. Henning Hermes & Philipp Lergetporer & Fabian Mierisch & Frauke Peter & Simon Wiederhold, 2023. "Discrimination on the Child Care Market: A Nationwide Field Experiment," Working Papers 225, Bavarian Graduate Program in Economics (BGPE).
    7. J. Michelle Brock & Ralph De Haas, 2023. "Discriminatory Lending: Evidence from Bankers in the Lab," American Economic Journal: Applied Economics, American Economic Association, vol. 15(2), pages 31-68, April.
    8. Daniel Martin & Philip Marx, 2022. "A Robust Test of Prejudice for Discrimination Experiments," Management Science, INFORMS, vol. 68(6), pages 4527-4536, June.
    9. Yulia Evsyukova & Felix Rusche & Wladislaw Mill, 2025. "LinkedOut? A Field Experiment on Discrimination in Job Network Formation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 140(1), pages 283-334.
    10. Nikoloz Kudashvili & Philipp Lergetporer, 2019. "Do Minorities Misrepresent Their Ethnicity to Avoid Discrimination?," CESifo Working Paper Series 7861, CESifo.
    11. Alberto Alesina & Michela Carlana & Eliana La Ferrara & Paolo Pinotti, 2024. "Revealing Stereotypes: Evidence from Immigrants in Schools," American Economic Review, American Economic Association, vol. 114(7), pages 1916-1948, July.
    12. Sabrina T. Howell & Theresa Kuchler & David Snitkof & Johannes Stroebel & Jun Wong, 2024. "Lender Automation and Racial Disparities in Credit Access," Journal of Finance, American Finance Association, vol. 79(2), pages 1457-1512, April.
    13. Jan Feld & Edwin Ip & Andreas Leibbrandt & Joseph Vecci, 2022. "Identifying and Overcoming Gender Barriers in Tech: A Field Experiment on Inaccurate Statistical Discrimination," CESifo Working Paper Series 9970, CESifo.
    14. Darya Korlyakova, 2022. "Do Pessimistic Expectations About Discrimination Make Minorities Withdraw Their Effort? Causal Evidence," CERGE-EI Working Papers wp731, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
    15. Nayoung Rim & Roman Rivera & Andrea Kiss & Bocar Ba, 2020. "The Black-White Recognition Gap in Award Nominations," Working Papers 2020-065, Human Capital and Economic Opportunity Working Group.
    16. Greenwald, Daniel L. & Howell, Sabrina T. & Li, Cangyuan & Yimfor, Emmanuel, 2024. "Regulatory arbitrage or random errors? Implications of race prediction algorithms in fair lending analysis," Journal of Financial Economics, Elsevier, vol. 157(C).
    17. Sona Badalyan & Darya Korlyakova & Rastislav Rehak, 2023. "Disclosure Discrimination: An Experiment Focusing on Communication in the Hiring Process," CERGE-EI Working Papers wp743, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
    18. Chiara Aina & Florian H. Schneider, 2025. "Weighting Competing Models," CEBI working paper series 25-04, University of Copenhagen. Department of Economics. The Center for Economic Behavior and Inequality (CEBI).
    19. Ankush Asri & Deepti Bhatia & Urs Fischbacher, 2022. "Caste and Unequal Access to Education: An Experimental Study," TWI Research Paper Series 127, Thurgauer Wirtschaftsinstitut, Universität Konstanz.
    20. Ewens, Michael, 2022. "Race and Gender in Entrepreneurial Finance," SocArXiv djf8z, Center for Open Science.

    More about this item

    JEL classification:

    • J16 - Labor and Demographic Economics - - Demographic Economics - - - Economics of Gender; Non-labor Discrimination
    • J71 - Labor and Demographic Economics - - Labor Discrimination - - - Hiring and Firing

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2507.13798. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.