IDEAS home Printed from https://ideas.repec.org/p/ces/ceswps/_11024.html
   My bibliography  Save this paper

Choosing and Using Information in Evaluation Decisions

Author

Listed:
  • Katherine B. Coffman
  • Scott Kostyshak
  • Perihan O. Saygin
  • Katie Coffman

Abstract

Most studies of gender discrimination consider how male versus female candidates are assessed given otherwise identical information about them. But, in many settings of interest, evaluators have a choice about how much information to acquire about a candidate before making a final assessment. We use a large controlled experiment to explore how this type of endogenous information acquisition amplifies discriminatory outcomes in a simulated hiring environment. Across evaluators, we vary the composition of candidate pools, exploring not only environments where men outperform women on average but also environments with no gender difference or with a female advantage. Perhaps surprisingly, we observe no gender discrimination overall: conditional on their likelihood of being qualified, male and female candidates receive indistinguishable evaluations. But, we observe important differences across candidate pools. Candidates belonging to an advantaged group—the gender with the performance advantage in the pool—receive significantly better evaluations than equally qualified candidates in pools with no gender gap in performance. Similarly, candidates belonging to a disadvantaged group—the gender with a performance disadvantage in the pool—receive significantly worse evaluations relative to equally qualified candidates in pools with no gender gap in performance. This “relative advantage” bias appears in initial assessments, influences how evaluators update their beliefs about a candidate after acquiring more information, and persists in final evaluations. This bias has a significantly larger impact on evaluations when evaluators endogenously acquire information compared to treatments where we exogenously provide it, in part because we observe significant under-acquisition of information. We show that this bias leads to two important types of mistakes: evaluators miss out on talented candidates from disadvantaged groups and over-select less talented candidates from advantaged groups.

Suggested Citation

  • Katherine B. Coffman & Scott Kostyshak & Perihan O. Saygin & Katie Coffman, 2024. "Choosing and Using Information in Evaluation Decisions," CESifo Working Paper Series 11024, CESifo.
  • Handle: RePEc:ces:ceswps:_11024
    as

    Download full text from publisher

    File URL: https://www.cesifo.org/DocDL/cesifo1_wp11024.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Alberto Alesina & Armando Miano & Stefanie Stantcheva, 2023. "Immigration and Redistribution," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 90(1), pages 1-39.
    2. J. Aislinn Bohren & Kareem Haggag & Alex Imas & Devin G. Pope, 2019. "Inaccurate Statistical Discrimination: An Identification Problem," PIER Working Paper Archive 19-010, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 17 Jul 2020.
    3. Pedro Bordalo & John Conlon & Nicola Gennaioli & Spencer Kwon & Andrei Shleifer, 2023. "How People Use Statistics," Working Papers 699, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    4. Katherine B. Coffman & Christine L. Exley & Muriel Niederle, 2021. "The Role of Beliefs in Driving Gender Discrimination," Management Science, INFORMS, vol. 67(6), pages 3551-3569, June.
    5. Michela Carlana, 2019. "Implicit Stereotypes: Evidence from Teachers’ Gender Bias," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 134(3), pages 1163-1224.
    6. Mark Egan & Gregor Matvos & Amit Seru, 2022. "When Harry Fired Sally: The Double Standard in Punishing Misconduct," Journal of Political Economy, University of Chicago Press, vol. 130(5), pages 1184-1248.
    7. Joshua Schwartzstein & Adi Sunderam, 2021. "Using Models to Persuade," American Economic Review, American Economic Association, vol. 111(1), pages 276-323, January.
    8. Vojtěch Bartoš & Michal Bauer & Julie Chytilová & Filip Matějka, 2016. "Attention Discrimination: Theory and Field Experiments with Monitoring Information Acquisition," American Economic Review, American Economic Association, vol. 106(6), pages 1437-1475, June.
    9. Ruzzier, Christian A. & Woo, Marcelo D., 2023. "Discrimination with inaccurate beliefs and confirmation bias," Journal of Economic Behavior & Organization, Elsevier, vol. 210(C), pages 379-390.
    10. Marianne Bertrand & Sendhil Mullainathan, 2004. "Are Emily and Greg More Employable Than Lakisha and Jamal? A Field Experiment on Labor Market Discrimination," American Economic Review, American Economic Association, vol. 94(4), pages 991-1013, September.
    11. Matthew Rabin & Joel L. Schrag, 1999. "First Impressions Matter: A Model of Confirmatory Bias," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(1), pages 37-82.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Barron, Kai & Ditlmann, Ruth & Gehrig, Stefan & Schweighofer-Kodritsch, Sebastian, 2020. "Explicit and implicit belief-based gender discrimination: A hiring experiment," Discussion Papers, Research Unit: Economics of Change SP II 2020-306, WZB Berlin Social Science Center.
    2. Ayaita, Adam, 2021. "Labor Market Discrimination and Statistical Differences in Unobserved Characteristics of Applicants," EconStor Preprints 236615, ZBW - Leibniz Information Centre for Economics.
    3. Darya Korlyakova, 2021. "Learning about Ethnic Discrimination from Different Information Sources," CERGE-EI Working Papers wp689, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
    4. Miguel A. Fonseca & Ashley McCrea, 2023. "The role of shortlisting in shifting gender beliefs on performance: experimental evidence," Discussion Papers 2315, University of Exeter, Department of Economics.
    5. Henning Hermes & Philipp Lergetporer & Fabian Mierisch & Frauke Peter & Simon Wiederhold, 2023. "Discrimination on the Child Care Market: A Nationwide Field Experiment," Working Papers 225, Bavarian Graduate Program in Economics (BGPE).
    6. J. Michelle Brock & Ralph De Haas, 2023. "Discriminatory Lending: Evidence from Bankers in the Lab," American Economic Journal: Applied Economics, American Economic Association, vol. 15(2), pages 31-68, April.
    7. Daniel Martin & Philip Marx, 2022. "A Robust Test of Prejudice for Discrimination Experiments," Management Science, INFORMS, vol. 68(6), pages 4527-4536, June.
    8. Alberto Alesina & Michela Carlana & Eliana La Ferrara & Paolo Pinotti, 2024. "Revealing Stereotypes: Evidence from Immigrants in Schools," American Economic Review, American Economic Association, vol. 114(7), pages 1916-1948, July.
    9. Yulia Evsyukova & Felix Rusche & Wladislaw Mill, 2023. "LinkedOut? A Field Experiment on Discrimination in Job Network Formation," CRC TR 224 Discussion Paper Series crctr224_2023_482v2, University of Bonn and University of Mannheim, Germany, revised Oct 2024.
    10. Greenwald, Daniel L. & Howell, Sabrina T. & Li, Cangyuan & Yimfor, Emmanuel, 2024. "Regulatory arbitrage or random errors? Implications of race prediction algorithms in fair lending analysis," Journal of Financial Economics, Elsevier, vol. 157(C).
    11. Nikoloz Kudashvili & Philipp Lergetporer, 2019. "Do Minorities Misrepresent Their Ethnicity to Avoid Discrimination?," CERGE-EI Working Papers wp644, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
    12. Sona Badalyan & Darya Korlyakova & Rastislav Rehak, 2023. "Disclosure Discrimination: An Experiment Focusing on Communication in the Hiring Process," CERGE-EI Working Papers wp743, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
    13. Kudashvili, Nikoloz & Lergetporer, Philipp, 2022. "Minorities’ strategic response to discrimination: Experimental evidence," Journal of Public Economics, Elsevier, vol. 208(C).
    14. Darya Korlyakova, 2022. "Do Pessimistic Expectations About Discrimination Make Minorities Withdraw Their Effort? Causal Evidence," CERGE-EI Working Papers wp731, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
    15. Nayoung Rim & Roman Rivera & Andrea Kiss & Bocar Ba, 2020. "The Black-White Recognition Gap in Award Nominations," Working Papers 2020-065, Human Capital and Economic Opportunity Working Group.
    16. Ewens, Michael, 2022. "Race and Gender in Entrepreneurial Finance," SocArXiv djf8z, Center for Open Science.
    17. Ayaita, Adam, 2023. "Ethnic Minority Background and Personality Characteristics: Evidence from a Representative Sample of the Adult Population," EconStor Preprints 251745, ZBW - Leibniz Information Centre for Economics, revised 2023.
    18. Francesco Capozza & Ingar Haaland & Christopher Roth & Johannes Wohlfart, 2021. "Studying Information Acquisition in the Field: A Practical Guide and Review," CEBI working paper series 21-15, University of Copenhagen. Department of Economics. The Center for Economic Behavior and Inequality (CEBI).
    19. Cattaneo, Cristina & Grieco, Daniela, 2021. "Turning opposition into support to immigration: The role of narratives," Journal of Economic Behavior & Organization, Elsevier, vol. 190(C), pages 785-801.
    20. Bartosz Maćkowiak & Filip Matějka & Mirko Wiederholt, 2023. "Rational Inattention: A Review," Journal of Economic Literature, American Economic Association, vol. 61(1), pages 226-273, March.

    More about this item

    Keywords

    discrimination; information acquisition; beliefs; belief updating; stereotypes;
    All these keywords.

    JEL classification:

    • J16 - Labor and Demographic Economics - - Demographic Economics - - - Economics of Gender; Non-labor Discrimination
    • J71 - Labor and Demographic Economics - - Labor Discrimination - - - Hiring and Firing

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ces:ceswps:_11024. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Klaus Wohlrabe (email available below). General contact details of provider: https://edirc.repec.org/data/cesifde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.