IDEAS home Printed from https://ideas.repec.org/p/rco/dpaper/532.html
   My bibliography  Save this paper

Behavioral Measures Improve AI Hiring: A Field Experiment

Author

Listed:
  • Marie-Pierre Dargnies

    (University of Paris Dauphine)

  • Rustamdjan Hakimov

    (University of Lausanne)

  • Dorothea Kübler

    (WZB Berlin, Technische Universität Berlin, CES Ifo)

Abstract

The adoption of Artificial Intelligence (AI) for hiring processes is often impeded by a scarcity of comprehensive employee data. We hypothesize that the inclusion of behavioral measures elicited from applicants can enhance the predictive accuracy of AI in hiring. We study this hypothesis in the context of microfinance loan officers. Our findings suggest that survey-based behavioral measures markedly improve the predictions of a random-forest algorithm trained to predict productivity within sample relative to demographic information alone. We then validate the algorithm’s robustness to the selectivity of the training sample and potential strategic responses by applicants by running two out-of-sample tests: one forecasting the future performance of novice employees, and another with a field experiment on hiring. Both tests corroborate the effectiveness of incorporating behavioral data to predict performance. The comparison of workers hired by the algorithm with those hired by human managers in the field experiment reveals that algorithmic hiring is marginally more efficient than managerial hiring.

Suggested Citation

  • Marie-Pierre Dargnies & Rustamdjan Hakimov & Dorothea Kübler, 2025. "Behavioral Measures Improve AI Hiring: A Field Experiment," Rationality and Competition Discussion Paper Series 532, CRC TRR 190 Rationality and Competition.
  • Handle: RePEc:rco:dpaper:532
    as

    Download full text from publisher

    File URL: https://rationality-and-competition.de/wp-content/uploads/discussion_paper/532.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Mitchell Hoffman & Lisa B Kahn & Danielle Li, 2018. "Discretion in Hiring," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(2), pages 765-800.
    2. Alessandro Bonatti & Gonzalo Cisternas, 2020. "Consumer Scores and Price Discrimination," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 87(2), pages 750-791.
    3. Aaron Chalfin & Oren Danieli & Andrew Hillis & Zubin Jelveh & Michael Luca & Jens Ludwig & Sendhil Mullainathan, 2016. "Productivity and Selection of Human Capital with Machine Learning," American Economic Review, American Economic Association, vol. 106(5), pages 124-127, May.
    4. Tanjim Hossain & John A. List, 2012. "The Behavioralist Visits the Factory: Increasing Productivity Using Simple Framing Manipulations," Management Science, INFORMS, vol. 58(12), pages 2151-2167, December.
    5. Scott Mayer McKinney & Marcin Sieniek & Varun Godbole & Jonathan Godwin & Natasha Antropova & Hutan Ashrafian & Trevor Back & Mary Chesus & Greg S. Corrado & Ara Darzi & Mozziyar Etemadi & Florencia G, 2020. "International evaluation of an AI system for breast cancer screening," Nature, Nature, vol. 577(7788), pages 89-94, January.
    6. Thomas Dohmen & Armin Falk & David Huffman & Uwe Sunde & Jürgen Schupp & Gert G. Wagner, 2011. "Individual Risk Attitudes: Measurement, Determinants, And Behavioral Consequences," Journal of the European Economic Association, European Economic Association, vol. 9(3), pages 522-550, June.
    7. Tim Kautz & James J. Heckman & Ron Diris & Bas ter Weel & Lex Borghans, 2014. "Fostering and Measuring Skills: Improving Cognitive and Non-cognitive Skills to Promote Lifetime Success," OECD Education Working Papers 110, OECD Publishing.
    8. Thomas Dohmen & Armin Falk & David Huffman & Uwe Sunde, 2009. "Homo Reciprocans: Survey Evidence on Behavioural Outcomes," Economic Journal, Royal Economic Society, vol. 119(536), pages 592-612, March.
    9. Supreet Kaur & Michael Kremer & Sendhil Mullainathan, 2015. "Self-Control at Work," Journal of Political Economy, University of Chicago Press, vol. 123(6), pages 1227-1277.
    10. Miriam Krueger & Guido Friebel, 2022. "A Pay Change and Its Long-Term Consequences," Journal of Labor Economics, University of Chicago Press, vol. 40(3), pages 543-572.
    11. Steven Blader & Claudine Gartenberg & Andrea Prat, 2020. "The Contingent Effect of Management Practices," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 87(2), pages 721-749.
    12. Dargnies, Marie-Pierre & Hakimov, Rustamdjan & Kübler, Dorothea, 2022. "Aversion to hiring algorithms: Transparency, gender profiling, and self-confidence," Discussion Papers, Research Unit: Market Behavior SP II 2022-202, WZB Berlin Social Science Center.
    13. Thomas Buser & Muriel Niederle & Hessel Oosterbeek, 2014. "Gender, Competitiveness, and Career Choices," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 129(3), pages 1409-1447.
    14. Melissa Osborne & Herbert Gintis & Samuel Bowles, 2001. "The Determinants of Earnings: A Behavioral Approach," Journal of Economic Literature, American Economic Association, vol. 39(4), pages 1137-1176, December.
    15. Brice Corgnet, 2023. "An Experimental Test of Algorithmic Dismissals," Working Papers 2302, Groupe d'Analyse et de Théorie Economique Lyon St-Étienne (GATE Lyon St-Étienne), Université de Lyon.
    16. Armin Falk & Anke Becker & Thomas Dohmen & Benjamin Enke & David B. Huffman & Uwe Sunde, 2017. "Global Evidence on Economic Preferences," NBER Working Papers 23943, National Bureau of Economic Research, Inc.
    17. Greer K. Gosnell & John A. List & Robert D. Metcalfe, 2020. "The Impact of Management Practices on Employee Productivity: A Field Experiment with Airline Captains," Journal of Political Economy, University of Chicago Press, vol. 128(4), pages 1195-1233.
    18. Armin Falk & Anke Becker & Thomas Dohmen & Benjamin Enke & David Huffman & Uwe Sunde, 2018. "Global Evidence on Economic Preferences," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(4), pages 1645-1692.
    19. Scott Mayer McKinney & Marcin Sieniek & Varun Godbole & Jonathan Godwin & Natasha Antropova & Hutan Ashrafian & Trevor Back & Mary Chesus & Greg S. Corrado & Ara Darzi & Mozziyar Etemadi & Florencia G, 2020. "Addendum: International evaluation of an AI system for breast cancer screening," Nature, Nature, vol. 586(7829), pages 19-19, October.
    20. Mallory Avery & Andreas Leibbrandt & Joseph Vecci, 2023. "Does Artificial Intelligence Help or Hurt Gender Diversity? Evidence from Two Field Experiments on Recruitment in Tech," Monash Economics Working Papers 2023-09, Monash University, Department of Economics.
    21. Sule Alan & Teodora Boneva & Seda Ertac, 2019. "Ever Failed, Try Again, Succeed Better: Results from a Randomized Educational Intervention on Grit," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 134(3), pages 1121-1162.
    22. Melanie Arntz & Terry Gregory & Ulrich Zierahn, 2016. "The Risk of Automation for Jobs in OECD Countries: A Comparative Analysis," OECD Social, Employment and Migration Working Papers 189, OECD Publishing.
    23. Highhouse, Scott, 2008. "Stubborn Reliance on Intuition and Subjectivity in Employee Selection," Industrial and Organizational Psychology, Cambridge University Press, vol. 1(3), pages 333-342, September.
    24. Ajay Agrawal & Joshua Gans & Avi Goldfarb, 2019. "The Economics of Artificial Intelligence: An Agenda," NBER Books, National Bureau of Economic Research, Inc, number agra-1, October.
    25. David H. Autor, 2015. "Why Are There Still So Many Jobs? The History and Future of Workplace Automation," Journal of Economic Perspectives, American Economic Association, vol. 29(3), pages 3-30, Summer.
    26. Andreas Hackethal & Michael Kirchler & Christine Laudenbach & Michael Razen & Annika Weber, 2023. "On the role of monetary incentives in risk preference elicitation experiments," Journal of Risk and Uncertainty, Springer, vol. 66(2), pages 189-213, April.
    27. Tomáš Jagelka, 2024. "Are Economists’ Preferences Psychologists’ Personality Traits? A Structural Approach," Journal of Political Economy, University of Chicago Press, vol. 132(3), pages 910-970.
    28. Sule Alan & Gozde Corekcioglu & Matthias Sutter, 2023. "Improving Workplace Climate in Large Corporations: A Clustered Randomized Intervention," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 138(1), pages 151-203.
    29. Matthias Schonlau & Rosie Yuyan Zou, 2020. "The random forest algorithm for statistical learning," Stata Journal, StataCorp LLC, vol. 20(1), pages 3-29, March.
    30. Jon Kleinberg & Himabindu Lakkaraju & Jure Leskovec & Jens Ludwig & Sendhil Mullainathan, 2018. "Human Decisions and Machine Predictions," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(1), pages 237-293.
    31. Guido Friebel & Matthias Heinz & Mitchell Hoffman & Nick Zubanov, 2023. "What Do Employee Referral Programs Do? Measuring the Direct and Overall Effects of a Management Practice," Journal of Political Economy, University of Chicago Press, vol. 131(3), pages 633-686.
    32. Lönnqvist, Jan-Erik & Verkasalo, Markku & Walkowitz, Gari & Wichardt, Philipp C., 2015. "Measuring individual risk attitudes in the lab: Task or ask? An empirical comparison," Journal of Economic Behavior & Organization, Elsevier, vol. 119(C), pages 254-266.
    33. Robert B. Barsky & F. Thomas Juster & Miles S. Kimball & Matthew D. Shapiro, 1997. "Preference Parameters and Behavioral Heterogeneity: An Experimental Approach in the Health and Retirement Study," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 112(2), pages 537-579.
    34. Mitchell Hoffman & Christopher T. Stanton, 2024. "People, Practices, and Productivity: A Review of New Advances in Personnel Economics," NBER Working Papers 32849, National Bureau of Economic Research, Inc.
    35. Sendhil Mullainathan & Ziad Obermeyer, 2022. "Diagnosing Physician Error: A Machine Learning Approach to Low-Value Health Care [“The Determinants of Productivity in Medical Testing: Intensity and Allocation of Care,”]," The Quarterly Journal of Economics, Oxford University Press, vol. 137(2), pages 679-727.
    36. Jing Cai & Shing-Yi Wang, 2022. "Improving Management Through Worker Evaluations: Evidence from Auto Manufacturing [“Expectations, Wage Hikes, and Worker Voice,”]," The Quarterly Journal of Economics, Oxford University Press, vol. 137(4), pages 2459-2497.
    37. David H. Autor & David Scarborough, 2008. "Does Job Testing Harm Minority Workers? Evidence from Retail Establishments," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 123(1), pages 219-277.
    38. Ferdinand M. Vieider & Mathieu Lefebvre & Ranoua Bouchouicha & Thorsten Chmura & Rustamdjan Hakimov & Michal Krawczyk & Peter Martinsson, 2015. "Common Components Of Risk And Uncertainty Attitudes Across Contexts And Domains: Evidence From 30 Countries," Journal of the European Economic Association, European Economic Association, vol. 13(3), pages 421-452, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Breitkopf, Laura & Chowdhury, Shyamal K. & Priyam, Shambhavi & Schildberg-Hörisch, Hannah & Sutter, Matthias, 2020. "Do economic preferences of children predict behavior?," DICE Discussion Papers 342, Heinrich Heine University Düsseldorf, Düsseldorf Institute for Competition Economics (DICE).
    2. Dohmen, Thomas & Quercia, Simone & Willrodt, Jana, 2018. "Willingness to Take Risk: The Role of Risk Conception and Optimism," IZA Discussion Papers 11642, Institute of Labor Economics (IZA).
    3. Thomas Dohmen & Simone Quercia & Jana Willrodt, 2023. "On the psychology of the relation between optimism and risk taking," Journal of Risk and Uncertainty, Springer, vol. 67(2), pages 193-214, October.
    4. Bašić, Zvonimir & Bortolotti, Stefania & Salicath, Daniel & Schmidt, Stefan & Schneider, Sebastian O. & Sutter, Matthias, 2024. "One Size Fits All? The Interplay of Incentives, Effort Provision, and Personality," IZA Discussion Papers 17287, Institute of Labor Economics (IZA).
    5. Bohren, Noah & Hakimov, Rustamdjan & Lalive, Rafael, 2024. "Creative and Strategic Capabilities of Generative AI: Evidence from Large-Scale Experiments," IZA Discussion Papers 17302, Institute of Labor Economics (IZA).
    6. Dahmann, Sarah C. & Kettlewell, Nathan & Lam, Jack, 2022. "Parental Separation and the Formation of Economic Preferences," IZA Discussion Papers 14993, Institute of Labor Economics (IZA).
    7. Joshua Tasoff & Wenjie Zhang, 2022. "The Performance of Time-Preference and Risk-Preference Measures in Surveys," Management Science, INFORMS, vol. 68(2), pages 1149-1173, February.
    8. Gary Charness & Thomas Garcia & Theo Offerman & Marie Claire Villeval, 2020. "Do measures of risk attitude in the laboratory predict behavior under risk in and outside of the laboratory?," Journal of Risk and Uncertainty, Springer, vol. 60(2), pages 99-123, April.
    9. Pushkar Maitra & Ananta Neelim, 2021. "Behavioural characteristics, stability of preferences and entrepreneurial success," Chapters, in: Ananish Chaudhuri (ed.), A Research Agenda for Experimental Economics, chapter 5, pages 93-118, Edward Elgar Publishing.
    10. Armin Falk & Anke Becker & Thomas Dohmen & David Huffman & Uwe Sunde, 2023. "The Preference Survey Module: A Validated Instrument for Measuring Risk, Time, and Social Preferences," Management Science, INFORMS, vol. 69(4), pages 1935-1950, April.
    11. Michael Kosfeld & Zahra Sharafi & Maíra Sontag González & Na Zou, 2025. "Measuring Economic Preferences with Surveys and Behavioral Experiments," CESifo Working Paper Series 11631, CESifo.
    12. Gorny, Paul M. & Groos, Eva & Strobel, Christina, 2024. "Do Personalized AI Predictions Change Subsequent Decision-Outcomes? The Impact of Human Oversight," MPRA Paper 121065, University Library of Munich, Germany.
    13. Dietmar Fehr & Yannick Reichlin, 2021. "Status, Control Beliefs, and Risk-Taking," CESifo Working Paper Series 9253, CESifo.
    14. Toshi H. Arimura & Elke D. Groh & Miwa Nakai & Andreas Ziegler, 2022. "The causal effect of private and organizational climate-related identity on climate protection activities: Evidence from a framed field experiment in Japan," MAGKS Papers on Economics 202229, Philipps-Universität Marburg, Faculty of Business Administration and Economics, Department of Economics (Volkswirtschaftliche Abteilung).
    15. Ranoua Bouchouicha & Ferdinand M. Vieider, 2019. "Growth, entrepreneurship, and risk-tolerance: a risk-income paradox," Journal of Economic Growth, Springer, vol. 24(3), pages 257-282, September.
    16. Gerhardt, Michaela V. & Kanberger, Elke D. & Ziegler, Andreas, 2023. "The Relevance of Life-Cycle CO₂ Emissions for Vehicle Purchase Decisions: A Stated Choice Experiment for Germany," VfS Annual Conference 2023 (Regensburg): Growth and the "sociale Frage" 277675, Verein für Socialpolitik / German Economic Association.
    17. Daniel Engler & Gunnar Gutsche & Amantia Simixhiu & Andreas Ziegler, 2022. "Social norms and individual climate protection activities: A framed field experiment for Germany," MAGKS Papers on Economics 202230, Philipps-Universität Marburg, Faculty of Business Administration and Economics, Department of Economics (Volkswirtschaftliche Abteilung).
    18. Boto-García, David & Bucciol, Alessandro, 2023. "Couple and individual willingness to take risks," Journal of Economic Psychology, Elsevier, vol. 99(C).
    19. Michaela V. Gerhardt & Elke D. Kanberger & Andreas Ziegler, 2023. "The Relevance of Life-Cycle CO2 Emissions for Vehicle Purchase Decisions: A Stated Choice Experiment for Germany," MAGKS Papers on Economics 202305, Philipps-Universität Marburg, Faculty of Business Administration and Economics, Department of Economics (Volkswirtschaftliche Abteilung).
    20. Engler, Daniel & Ziegler, Andreas & Gutsche, Gunnar & Simixhiu, Amantia, 2023. "Social Norms and Individual Climate Protection Activities: A Framed Field Experiment for Germany," VfS Annual Conference 2023 (Regensburg): Growth and the "sociale Frage" 277662, Verein für Socialpolitik / German Economic Association.

    More about this item

    Keywords

    hiring; ai; economic and behavioral measures; selective labels;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:rco:dpaper:532. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Viviana Lalli (email available below). General contact details of provider: https://rationality-and-competition.de .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.