IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2605.13866.html

AI Alignment Amplifies the Role of Race, Gender, and Disability in Hiring Decisions

Author

Listed:
  • Ze Wang
  • Guobin Shen
  • Michael Thaler

Abstract

Humans increasingly delegate decisions to language models, yet whether these systems reproduce or reshape human patterns of discrimination remains unclear. Here we run a large-scale study to analyse whether language models use demographic information in hiring decisions. We show, across 27 models and 177 occupations, that language models give female and Black candidates hiring advantages relative to otherwise-comparable male and white candidates, while giving disabled candidates disadvantages. The differences are meaningful in magnitude: the role of race, gender, and disability status is comparable to six months to one year of additional education. Post-training alignment is the primary driver: relative to matched pre-trained models, alignment amplifies advantages for female and Black candidates by 325% and 330%, and disadvantages for disabled candidates by 171%. Compared with previous human correspondence studies, language models reverse the direction of racial discrimination, attenuate the disability penalty, and amplify the female advantage by 190%. Alignment changes how models use qualification signals: alignment increases returns to skills and work experience overall, but relatively more so for female and Black candidates. Meanwhile, the absence of qualification signals harms marginalised groups more, particularly for disabled candidates, differences that may explain the asymmetry of alignment effects across groups we observe.

Suggested Citation

  • Ze Wang & Guobin Shen & Michael Thaler, 2026. "AI Alignment Amplifies the Role of Race, Gender, and Disability in Hiring Decisions," Papers 2605.13866, arXiv.org.
  • Handle: RePEc:arx:papers:2605.13866
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2605.13866
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Phelps, Edmund S, 1972. "The Statistical Theory of Racism and Sexism," American Economic Review, American Economic Association, vol. 62(4), pages 659-661, September.
    2. Marianne Bertrand & Sendhil Mullainathan, 2004. "Are Emily and Greg More Employable Than Lakisha and Jamal? A Field Experiment on Labor Market Discrimination," American Economic Review, American Economic Association, vol. 94(4), pages 991-1013, September.
    3. J. Aislinn Bohren & Kareem Haggag & Alex Imas & Devin G. Pope, 2025. "Inaccurate Statistical Discrimination: An Identification Problem," The Review of Economics and Statistics, MIT Press, vol. 107(3), pages 605-620, May.
    4. A. Colin Cameron & Jonah B. Gelbach & Douglas L. Miller, 2011. "Robust Inference With Multiway Clustering," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 29(2), pages 238-249, April.
    5. A. Colin Cameron & Jonah B. Gelbach & Douglas L. Miller, 2008. "Bootstrap-Based Improvements for Inference with Clustered Errors," The Review of Economics and Statistics, MIT Press, vol. 90(3), pages 414-427, August.
    6. Patrick Kline & Evan K Rose & Christopher R Walters, 2022. "Systemic Discrimination Among Large U.S. Employers [“Teachers and Student Achievement in the Chicago Public High Schools,”]," The Quarterly Journal of Economics, Oxford University Press, vol. 137(4), pages 1963-2036.
    7. A. Colin Cameron & Douglas L. Miller, 2015. "A Practitioner’s Guide to Cluster-Robust Inference," Journal of Human Resources, University of Wisconsin Press, vol. 50(2), pages 317-372.
    8. Joseph G. Altonji & Charles R. Pierret, 2001. "Employer Learning and Statistical Discrimination," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 116(1), pages 313-350.
    9. Valentin Hofmann & Pratyusha Ria Kalluri & Dan Jurafsky & Sharese King, 2024. "AI generates covertly racist decisions about people based on their dialect," Nature, Nature, vol. 633(8028), pages 147-154, September.
    10. Lavender Yao Jiang & Xujin Chris Liu & Nima Pour Nejatian & Mustafa Nasir-Moin & Duo Wang & Anas Abidin & Kevin Eaton & Howard Antony Riina & Ilya Laufer & Paawan Punjabi & Madeline Miceli & Nora C. K, 2023. "Health system-scale language models are all-purpose prediction engines," Nature, Nature, vol. 619(7969), pages 357-362, July.
    11. J. Aislinn Bohren & Alex Imas & Michael Rosenberg, 2019. "The Dynamics of Discrimination: Theory and Evidence," American Economic Review, American Economic Association, vol. 109(10), pages 3395-3436, October.
    12. Jon Kleinberg & Himabindu Lakkaraju & Jure Leskovec & Jens Ludwig & Sendhil Mullainathan, 2018. "Human Decisions and Machine Predictions," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(1), pages 237-293.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. J. Michelle Brock & Ralph De Haas, 2023. "Discriminatory Lending: Evidence from Bankers in the Lab," American Economic Journal: Applied Economics, American Economic Association, vol. 15(2), pages 31-68, April.
    2. Ruzzier, Christian A. & Woo, Marcelo D., 2023. "Discrimination with inaccurate beliefs and confirmation bias," Journal of Economic Behavior & Organization, Elsevier, vol. 210(C), pages 379-390.
    3. Ayaita, Adam, 2021. "Labor Market Discrimination and Statistical Differences in Unobserved Characteristics of Applicants," EconStor Preprints 236615, ZBW - Leibniz Information Centre for Economics.
    4. Kristy Buzard & Laura K Gee & Olga Stoddard, 2025. "Who You Gonna Call? Gender Inequality in External Demands for Parental Involvement," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 140(4), pages 2805-2849.
    5. Sona Badalyan & Darya Korlyakova & Rastislav Rehak, 2023. "Disclosure Discrimination: An Experiment Focusing on Communication in the Hiring Process," CERGE-EI Working Papers wp743, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
    6. Dustan, Andrew & Koutout, Kristine & Leo, Greg, 2022. "Second-order beliefs and gender," Journal of Economic Behavior & Organization, Elsevier, vol. 200(C), pages 752-781.
    7. Kai Barron & Ruth Ditlmann & Stefan Gehrig & Sebastian Schweighofer-Kodritsch, 2025. "Explicit and Implicit Belief-Based Gender Discrimination: A Hiring Experiment," Management Science, INFORMS, vol. 71(2), pages 1600-1622, February.
    8. Yulia Evsyukova & Felix Rusche & Wladislaw Mill, 2025. "LinkedOut? A Field Experiment on Discrimination in Job Network Formation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 140(1), pages 283-334.
    9. Cordoba, Juan C. & Isojärvi, Anni & Li, Haoran, 2020. "Equilibrium Unemployment: The Role Of Discrimination," ISU General Staff Papers 202011140800001116, Iowa State University, Department of Economics.
    10. Lemaro Thompson, 2026. "Taste-Based Statistical Discrimination: A New Framework for Understanding Organizational Inequality in a Polarized Era," Journal of Business Ethics, Springer, vol. 204(3), pages 663-682, March.
    11. Yang, Xiaoliang & Zhou, Peng, 2025. "Unveiling citation bias in economics: Taste-based discrimination against Chinese-authored papers," Labour Economics, Elsevier, vol. 94(C).
    12. Forth, John & Theodoropoulos, Nikos, 2022. "Earnings Discrimination in the Workplace," IZA Discussion Papers 15357, IZA Network @ LISER.
    13. Gagnon, Nickolas & Nosenzo, Daniele, 2026. "Discrimination Preferences," EconStor Preprints 340785, ZBW - Leibniz Information Centre for Economics.
    14. Gomez-Gonzalez, Carlos & Clochard, Gwen-Jirō & Dietl, Helmut & Duhalde, Juan Cruz, 2026. "Migration and sources of discrimination in a social context: Experimental evidence from 15 Latin American countries," Journal of Development Economics, Elsevier, vol. 179(C).
    15. Lippens, Louis & Dalle, Axana & D'hondt, Fanny & Verhaeghe, Pieter-Paul & Baert, Stijn, 2023. "Understanding ethnic hiring discrimination: A contextual analysis of experimental evidence," Labour Economics, Elsevier, vol. 85(C).
    16. Vojtech Bartos & Urlich Glogowsky & Johannes Rincke, 2025. "The Color of Knowledge: Impacts of Tutor Race on Learning and Performance," Economics working papers 2025-08, Department of Economics, Johannes Kepler University Linz, Austria.
    17. Nickolas Gagnon & Daniele Nosenzo, 2026. "Discrimination Preferences," RFBerlin Discussion Paper Series 26125, ROCKWOOL Foundation Berlin (RFBerlin).
    18. Duhalde Juan Cruz & Gomez Gonzalez Carlos & Clochard Gwen-Jiro & Dietl Helmut, 2025. "A large-scale field experiment to disentangle sources of statistical discrimination in a social setting," Asociación Argentina de Economía Política: Working Papers 4796, Asociación Argentina de Economía Política.
    19. Nayoung Rim & Roman Rivera & Andrea Kiss & Bocar Ba, 2020. "The Black-White Recognition Gap in Award Nominations," Working Papers 2020-065, Human Capital and Economic Opportunity Working Group.
    20. Yasuda, Hiroki, 2023. "Employers’ stereotypes and taste-based discrimination," Journal of the Japanese and International Economies, Elsevier, vol. 67(C).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2605.13866. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.