IDEAS home Printed from https://ideas.repec.org/p/ajk/ajkdps/398.html

Human–AI Evaluation and Gender Transparency: Application Decisions in Competitive Hiring

Author

Listed:
  • Bernd Irlenbusch

    (University of Cologne & London School of Economics and Political Science)

  • Holger A. Rau

    (University of Duisburg-Essen & University of Gottingen)

  • Rainer Michael Rilke

    (WHU – Otto Beisheim School of Management)

Abstract

LLMs are rapidly entering the hiring process, but their most pronounced effects may occur before any screening by changing who chooses to apply. We study how human versus LLM-based evaluation and gender transparency shape entry into competitive jobs. In a preregistered online experiment, participants first complete a Niederle and Vesterlund (2007) tournament task to measure competitive preferences, then prepare text-based job applications and decide whether to apply under each of four evaluation regimes—human only, LLM only, and two hybrid human-in-the-loop configurations—while gender disclosure is randomized between subjects. LLM involvement reduces application rates, with stronger effects for women than men, including under hybrid designs. Effects are driven by non-competitive candidates; non-competitive women, the group most exposed to AI-induced deterrence, receive the strongest objective evaluations under pure AI assessment across all subgroups, yet are systematically underconfident and apply least often. Competitive men persistently apply and exhibit overconfidence-driven adverse selection, whereas competitive women show resilience to AI-induced deterrence while remaining well-calibrated under AI evaluation and exhibiting positive self-selection across regimes. We find no effects of gender transparency.

Suggested Citation

  • Bernd Irlenbusch & Holger A. Rau & Rainer Michael Rilke, 2026. "Human–AI Evaluation and Gender Transparency: Application Decisions in Competitive Hiring," ECONtribute Discussion Papers Series 398, University of Bonn and University of Cologne, Germany.
  • Handle: RePEc:ajk:ajkdps:398
    as

    Download full text from publisher

    File URL: https://www.econtribute.de/RePEc/ajk/ajkdps/ECONtribute_398_2026.pdf
    File Function: First version, 2026
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Bo Cowgill & Patryk Perkowski, 2024. "Delegation in Hiring: Evidence from a Two-Sided Audit," Journal of Political Economy Microeconomics, University of Chicago Press, vol. 2(4), pages 852-882.
    2. Marie-Pierre Dargnies & Rustamdjan Hakimov & Dorothea Kübler, 2026. "Aversion to Hiring Algorithms: Transparency, Gender Profiling, and Self-Confidence," Management Science, INFORMS, vol. 72(1), pages 285-301, January.
    3. Charness, Gary & Cobo-Reyes, Ramón & Meraglia, Simone & Sánchez, Ángela, 2020. "Anticipated Discrimination, Choices, and Performance: Experimental Evidence," European Economic Review, Elsevier, vol. 127(C).
    4. Muriel Niederle & Lise Vesterlund, 2007. "Do Women Shy Away From Competition? Do Men Compete Too Much?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(3), pages 1067-1101.
    5. Thomas Buser & Muriel Niederle & Hessel Oosterbeek, 2014. "Gender, Competitiveness, and Career Choices," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 129(3), pages 1409-1447.
    6. Sabrina Zeike & Katherine Bradbury & Lara Lindert & Holger Pfaff, 2019. "Digital Leadership Skills and Associations with Psychological Well-Being," IJERPH, MDPI, vol. 16(14), pages 1-12, July.
    7. Ernesto Reuben & Paola Sapienza & Luigi Zingales, 2024. "Overconfidence and Preferences for Competition," Journal of Finance, American Finance Association, vol. 79(2), pages 1087-1121, April.
    8. Jussupow, Ekaterina & Benbasat, Izak & Heinzl, Armin, 2024. "An integrative perspective on algorithm aversion and appreciation in decision-making," Publications of Darmstadt Technical University, Institute for Business Studies (BWL) 154733, Darmstadt Technical University, Department of Business Administration, Economics and Law, Institute for Business Studies (BWL).
    9. Anna Lena Hunkenschroer & Christoph Luetge, 2022. "Ethics of AI-Enabled Recruiting and Selection: A Review and Research Agenda," Journal of Business Ethics, Springer, vol. 178(4), pages 977-1007, July.
    10. Karen Evelyn Hauge & Andreas Kotsadam & Anine Riege, 2023. "Culture and Gender Differences in Willingness to Compete," The Economic Journal, Royal Economic Society, vol. 133(654), pages 2403-2426.
    11. Jussupow, Ekaterina & Benbasat, Izak & Heinzl, Armin, 2024. "An integrative perspective on algorithm aversion and appreciation in decision-making," Publications of Darmstadt Technical University, Institute for Business Studies (BWL) 150432, Darmstadt Technical University, Department of Business Administration, Economics and Law, Institute for Business Studies (BWL).
    12. Pisanelli, Elena, 2022. "Your resume is your gatekeeper: Automated resume screening as a strategy to reduce gender gaps in hiring," Economics Letters, Elsevier, vol. 221(C).
    13. Fumagalli, Elena & Rezaei, Sarah & Salomons, Anna, 2022. "OK computer: Worker perceptions of algorithmic recruitment," Research Policy, Elsevier, vol. 51(2).
    14. Brad M. Barber & Terrance Odean, 2001. "Boys will be Boys: Gender, Overconfidence, and Common Stock Investment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 116(1), pages 261-292.
    15. Berkeley J. Dietvorst & Joseph P. Simmons & Cade Massey, 2018. "Overcoming Algorithm Aversion: People Will Use Imperfect Algorithms If They Can (Even Slightly) Modify Them," Management Science, INFORMS, vol. 64(3), pages 1155-1170, March.
    16. Florian Pethig & Julia Kroenung, 2023. "Biased Humans, (Un)Biased Algorithms?," Journal of Business Ethics, Springer, vol. 183(3), pages 637-652, March.
    17. Armin Falk & Anke Becker & Thomas Dohmen & David Huffman & Uwe Sunde, 2023. "The Preference Survey Module: A Validated Instrument for Measuring Risk, Time, and Social Preferences," Management Science, INFORMS, vol. 69(4), pages 1935-1950, April.
    18. Markowsky, Eva & Beblo, Miriam, 2022. "When do we observe a gender gap in competition entry? A meta-analysis of the experimental literature," Journal of Economic Behavior & Organization, Elsevier, vol. 198(C), pages 139-163.
    19. Buser, Thomas & Cappelen, Alexander & Gneezy, Uri & Hoffman, Moshe & Tungodden, Bertil, 2021. "Competitiveness, gender and handedness," Economics & Human Biology, Elsevier, vol. 43(C).
    20. Mitchell Hoffman & Lisa B Kahn & Danielle Li, 2018. "Discretion in Hiring," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(2), pages 765-800.
    21. Mallory Avery & Andreas Leibbrandt & Joseph Vecci, 2023. "Does Artificial Intelligence Help or Hurt Gender Diversity? Evidence from Two Field Experiments on Recruitment in Tech," Monash Economics Working Papers 2023-09, Monash University, Department of Economics.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Boneva, Teodora & Buser, Thomas & Falk, Armin & Kosse, Fabian, 2021. "The Origins of Gender Differences in Competitiveness and Earnings Expectations: Causal Evidence from a Mentoring Intervention," Rationality and Competition Discussion Paper Series 295, CRC TRR 190 Rationality and Competition.
    2. Mourelatos, Evangelos & Zervas, Panagiotis & Lagios, Dimitris & Tzimas, Giannis, 2024. "Can AI Bridge the Gender Gap in Competitiveness?," GLO Discussion Paper Series 1404, Global Labor Organization (GLO).
    3. Carvajal, Daniel & Franco, Catalina & Isaksson, Siri, 2024. "Will Artificial Intelligence Get in the Way of Achieving Gender Equality?," Discussion Paper Series in Economics 3/2024, Norwegian School of Economics, Department of Economics, revised 28 Apr 2025.
    4. Chen, Yvonne Jie & Dutz, Deniz & Li, Li & Moon, Sarah & Vytlacil, Edward & Zhong, Songfa, 2024. "Eliciting willingness-to-pay to decompose beliefs and preferences that determine selection into competition in lab experiments," Journal of Econometrics, Elsevier, vol. 243(1).
    5. Thomas Buser & Leonie Gerhards & Joël Weele, 2018. "Responsiveness to feedback as a personal trait," Journal of Risk and Uncertainty, Springer, vol. 56(2), pages 165-192, April.
    6. Thomas Buser & Muriel Niederle & Hessel Oosterbeek, 2020. "Can competitiveness predict education and labor market outcomes? Evidence from incentivized choice and survey measures," Tinbergen Institute Discussion Papers 20-048/I, Tinbergen Institute.
    7. Thomas Buser & Hessel Oosterbeek, "undated". "The anatomy of competitiveness," Tinbergen Institute Discussion Papers 23-031/I, Tinbergen Institute.
    8. Hoyer, Britta & van Huizen, Thomas & Keijzer, Linda & Rezaei, Sarah & Rosenkranz, Stephanie & Westbrock, Bastian, 2020. "Gender, competitiveness, and task difficulty: Evidence from the field," Labour Economics, Elsevier, vol. 64(C).
    9. Marie-Pierre Dargnies & Rustamdjan Hakimov & Dorothea Kübler, 2025. "Behavioral Measures Improve AI Hiring: A Field Experiment," Rationality and Competition Discussion Paper Series 532, CRC TRR 190 Rationality and Competition.
    10. Jørgensen, Lotte Kofoed & Piovesan, Marco & Willadsen, Helene, 2022. "Gender differences in competitiveness: Friends matter," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 101(C).
    11. Thomas Buser & Sahar Sangi, 2025. "Willingness to Compete in Dirty Competitions," Tinbergen Institute Discussion Papers 25-007/I, Tinbergen Institute.
    12. Boggio, Cecilia & Coda Moscarola, Flavia & Gallice, Andrea, 2020. "What is good for the goose is good for the gander?," Economics of Education Review, Elsevier, vol. 75(C).
    13. Bobba, Matteo & Frisancho, Veronica, 2022. "Self-perceptions about academic achievement: Evidence from Mexico City," Journal of Econometrics, Elsevier, vol. 231(1), pages 58-73.
    14. Jonathan F Schulz & Christian Thöni, 2016. "Overconfidence and Career Choice," PLOS ONE, Public Library of Science, vol. 11(1), pages 1-8, January.
    15. Clot, Sophie & Della Giusta, Marina & Razzu, Giovanni, 2020. "Gender Gaps in Competition: New Experimental Evidence from UK Professionals," IZA Discussion Papers 13323, IZA Network @ LISER.
    16. Fang,Sheng & Goh,Chorching & Roberts,Mark & Xu,L. Colin & Zeufack,Albert G., 2020. "Female Business Leaders, Business and Cultural Environment, and Productivity around the World," Policy Research Working Paper Series 9275, The World Bank.
    17. José Garcia Montalvo & Marta Reynal-Querol, 2019. "Gender and credit risk: a view from the loan officer's desk," Economics Working Papers 1644, Department of Economics and Business, Universitat Pompeu Fabra.
    18. Thomas (T.) Buser & Noemi Peter & Stefan Wolter, 2017. "Gender, Willingness to Compete and Career Choices Along the Whole Ability Distribution," Tinbergen Institute Discussion Papers 17-081/I, Tinbergen Institute.
    19. Lüthi, Samuel & Wolter, Stefan C., 2023. "Is being competitive always an advantage? Competitiveness, gender, and labour market success," Labour Economics, Elsevier, vol. 85(C).
    20. Laura Hospido & Luc Laeven & Ana Lamo, 2022. "The Gender Promotion Gap: Evidence from Central Banking," The Review of Economics and Statistics, MIT Press, vol. 104(5), pages 981-996, December.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    JEL classification:

    • C92 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Group Behavior
    • J71 - Labor and Demographic Economics - - Labor Discrimination - - - Hiring and Firing
    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity
    • O33 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Technological Change: Choices and Consequences; Diffusion Processes

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ajk:ajkdps:398. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ECONtribute Office (email available below). General contact details of provider: https://www.econtribute.de .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.