IDEAS home Printed from https://ideas.repec.org/a/eee/respol/v51y2022i2s0048733321002146.html
   My bibliography  Save this article

OK computer: Worker perceptions of algorithmic recruitment

Author

Listed:
  • Fumagalli, Elena
  • Rezaei, Sarah
  • Salomons, Anna

Abstract

We provide evidence on how workers on an online platform perceive algorithmic versus human recruitment through two incentivized experiments designed to elicit willingness to pay for human or algorithmic evaluation. In particular, we test how information on workers’ performance affects their recruiter choice and whether the algorithmic recruiter is perceived as more or less gender-biased than the human one. We find that workers do perceive human and algorithmic evaluation differently, even though both recruiters are given the same inputs in our controlled setting. Specifically, human recruiters are perceived to be more error-prone evaluators and place more weight on personal characteristics, whereas algorithmic recruiters are seen as placing more weight on task performance. Consistent with these perceptions, workers with good task performance relative to others prefer algorithmic evaluation, whereas those with lower task performance prefer human evaluation. We also find suggestive evidence that perceived differences in gender bias drive preferences for human versus algorithmic recruitment.

Suggested Citation

  • Fumagalli, Elena & Rezaei, Sarah & Salomons, Anna, 2022. "OK computer: Worker perceptions of algorithmic recruitment," Research Policy, Elsevier, vol. 51(2).
  • Handle: RePEc:eee:respol:v:51:y:2022:i:2:s0048733321002146
    DOI: 10.1016/j.respol.2021.104420
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0048733321002146
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.respol.2021.104420?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Mitchell Hoffman & Lisa B Kahn & Danielle Li, 2018. "Discretion in Hiring," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(2), pages 765-800.
    2. Alina Köchling & Marius Claus Wehner, 2020. "Discriminated by an algorithm: a systematic review of discrimination and fairness by algorithmic decision-making in the context of HR recruitment and HR development," Business Research, Springer;German Academic Association for Business Research, vol. 13(3), pages 795-848, November.
    3. John Horton & David Rand & Richard Zeckhauser, 2011. "The online laboratory: conducting experiments in a real labor market," Experimental Economics, Springer;Economic Science Association, vol. 14(3), pages 399-425, September.
    4. Heather Sarsons & Klarita Gërxhani & Ernesto Reuben & Arthur Schram, 2021. "Gender Differences in Recognition for Group Work," Journal of Political Economy, University of Chicago Press, vol. 129(1), pages 101-147.
    5. Anja Lambrecht & Catherine Tucker, 2019. "Algorithmic Bias? An Empirical Study of Apparent Gender-Based Discrimination in the Display of STEM Career Ads," Management Science, INFORMS, vol. 65(7), pages 2966-2981, July.
    6. Antonio A. Arechar & Simon Gächter & Lucas Molleman, 2018. "Conducting interactive experiments online," Experimental Economics, Springer;Economic Science Association, vol. 21(1), pages 99-131, March.
    7. Thomas Dohmen & Armin Falk & David Huffman & Uwe Sunde & Jürgen Schupp & Gert G. Wagner, 2011. "Individual Risk Attitudes: Measurement, Determinants, And Behavioral Consequences," Journal of the European Economic Association, European Economic Association, vol. 9(3), pages 522-550, June.
    8. Thomas Buser & Muriel Niederle & Hessel Oosterbeek, 2020. "Can competitiveness predict education and labor market outcomes? Evidence from incentivized choice and survey measures," Tinbergen Institute Discussion Papers 20-048/I, Tinbergen Institute.
    9. Newman, David T. & Fast, Nathanael J. & Harmon, Derek J., 2020. "When eliminating bias isn’t fair: Algorithmic reductionism and procedural justice in human resource decisions," Organizational Behavior and Human Decision Processes, Elsevier, vol. 160(C), pages 149-167.
    10. Muriel Niederle & Lise Vesterlund, 2007. "Do Women Shy Away From Competition? Do Men Compete Too Much?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(3), pages 1067-1101.
    11. Berkeley J. Dietvorst & Joseph P. Simmons & Cade Massey, 2018. "Overcoming Algorithm Aversion: People Will Use Imperfect Algorithms If They Can (Even Slightly) Modify Them," Management Science, INFORMS, vol. 64(3), pages 1155-1170, March.
    12. repec:cup:judgdm:v:5:y:2010:i:5:p:411-419 is not listed on IDEAS
    13. Ben Weidmann & David J. Deming, 2020. "Team Players: How Social Skills Improve Group Performance," NBER Working Papers 27071, National Bureau of Economic Research, Inc.
    14. Castellacci, Fulvio & Tveito, Vegard, 2018. "Internet use and well-being: A survey and a theoretical framework," Research Policy, Elsevier, vol. 47(1), pages 308-325.
    15. Chen, Daniel L. & Schonger, Martin & Wickens, Chris, 2016. "oTree—An open-source platform for laboratory, online, and field experiments," Journal of Behavioral and Experimental Finance, Elsevier, vol. 9(C), pages 88-97.
    16. Venkatesh, Viswanath & Speier, Cheri, 1999. "Computer Technology Training in the Workplace: A Longitudinal Investigation of the Effect of Mood, ," Organizational Behavior and Human Decision Processes, Elsevier, vol. 79(1), pages 1-28, July.
    17. Goos, Maarten & Rademakers, Emilie & Salomons, Anna & Willekens, Bert, 2019. "Markets for jobs and their task overlap," Labour Economics, Elsevier, vol. 61(C).
    18. Pénard, Thierry & Poussing, Nicolas & Suire, Raphaël, 2013. "Does the Internet make people happier?," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 46(C), pages 105-116.
    19. Logg, Jennifer M. & Minson, Julia A. & Moore, Don A., 2019. "Algorithm appreciation: People prefer algorithmic to human judgment," Organizational Behavior and Human Decision Processes, Elsevier, vol. 151(C), pages 90-103.
    20. Steffen Lohmann, 2015. "Information technologies and subjective well-being: does the Internet raise material aspirations?," Oxford Economic Papers, Oxford University Press, vol. 67(3), pages 740-759.
    21. Jonathan Gruber & Benjamin R. Handel & Samuel H. Kina & Jonathan T. Kolstad, 2020. "Managing Intelligence: Skilled Experts and AI in Markets for Complex Products," NBER Working Papers 27038, National Bureau of Economic Research, Inc.
    22. Graham, Carol & Nikolova, Milena, 2013. "Does access to information technology make people happier? Insights from well-being surveys from around the world," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 44(C), pages 126-139.
    23. John J. Horton, 2017. "The Effects of Algorithmic Labor Market Recommendations: Evidence from a Field Experiment," Journal of Labor Economics, University of Chicago Press, vol. 35(2), pages 345-385.
    24. Jon Kleinberg & Himabindu Lakkaraju & Jure Leskovec & Jens Ludwig & Sendhil Mullainathan, 2018. "Human Decisions and Machine Predictions," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(1), pages 237-293.
    25. Danielle Li & Lindsey R. Raymond & Peter Bergman, 2020. "Hiring as Exploration," NBER Working Papers 27736, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Brice Corgnet, 2023. "An Experimental Test of Algorithmic Dismissals," Working Papers 2302, Groupe d'Analyse et de Théorie Economique Lyon St-Étienne (GATE Lyon St-Étienne), Université de Lyon.
    2. Mathieu Chevrier & Brice Corgnet & Eric Guerci & Julie Rosaz, 2024. "Algorithm Credulity: Human and Algorithmic Advice in Prediction Experiments," GREDEG Working Papers 2024-03, Groupe de REcherche en Droit, Economie, Gestion (GREDEG CNRS), Université Côte d'Azur, France.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bauer, Kevin & Gill, Andrej, 2021. "Mirror, mirror on the wall: Machine predictions and self-fulfilling prophecies," SAFE Working Paper Series 313, Leibniz Institute for Financial Research SAFE.
    2. Keding, Christoph & Meissner, Philip, 2021. "Managerial overreliance on AI-augmented decision-making processes: How the use of AI-based advisory systems shapes choice behavior in R&D investment decisions," Technological Forecasting and Social Change, Elsevier, vol. 171(C).
    3. Fulvio Castellacci & Henrik Schwabe, 2020. "Internet, unmet aspirations and the U-shape of life," PLOS ONE, Public Library of Science, vol. 15(6), pages 1-22, June.
    4. Gagnon, Nickolas & Bosmans, Kristof & Riedl, Arno, 2020. "The Effect of Unfair Chances and Gender Discrimination on Labor Supply," IZA Discussion Papers 12912, Institute of Labor Economics (IZA).
    5. Castellacci, Fulvio & Tveito, Vegard, 2018. "Internet use and well-being: A survey and a theoretical framework," Research Policy, Elsevier, vol. 47(1), pages 308-325.
    6. Chugunova, Marina & Sele, Daniela, 2022. "We and It: An interdisciplinary review of the experimental evidence on how humans interact with machines," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 99(C).
    7. Dargnies, Marie-Pierre & Hakimov, Rustamdjan & Kübler, Dorothea, 2022. "Aversion to hiring algorithms: Transparency, gender profiling, and self-confidence," Discussion Papers, Research Unit: Market Behavior SP II 2022-202, WZB Berlin Social Science Center.
    8. Zhang, Lixuan & Yencha, Christopher, 2022. "Examining perceptions towards hiring algorithms," Technology in Society, Elsevier, vol. 68(C).
    9. Silva Goncalves, Juliana & van Veldhuizen, Roel, 2020. "Subjective Judgment and Gender Bias in Advice: Evidence from the Laboratory," Working Papers 2020:27, Lund University, Department of Economics.
    10. Liang, Wanqi & Li, Wenying, 2023. "Impact of internet usage on the subjective well-being of urban and rural households: Evidence from Vietnam," Telecommunications Policy, Elsevier, vol. 47(3).
    11. Fulvio Castellacci & Henrik Schwabe, 2018. "Internet Use and the U-shaped relationship between Age and Well-being," Working Papers on Innovation Studies 20180215, Centre for Technology, Innovation and Culture, University of Oslo.
    12. Giacomo Degli Antoni & Chiara Franco, 2022. "The effect of technological behaviour and beliefs on subjective well-being: the role of technological infrastructure," Journal of Evolutionary Economics, Springer, vol. 32(2), pages 553-590, April.
    13. Nathan Barrymore & Cristian L. Dezső & Benjamin C. King, 2022. "Gender and competitiveness when earning for others: Experimental evidence and implications for sponsorship," Strategic Management Journal, Wiley Blackwell, vol. 43(5), pages 905-934, May.
    14. Bauer, Kevin & von Zahn, Moritz & Hinz, Oliver, 2022. "Expl(AI)ned: The impact of explainable Artificial Intelligence on cognitive processes," SAFE Working Paper Series 315, Leibniz Institute for Financial Research SAFE, revised 2022.
    15. Piasenti, Stefano & Valente, Marica & Van Veldhuizen, Roel & Pfeifer, Gregor, 2023. "Does Unfairness Hurt Women? The Effects of Losing Unfair Competitions," Working Papers 2023:7, Lund University, Department of Economics.
    16. Mahmud, Hasan & Islam, A.K.M. Najmul & Ahmed, Syed Ishtiaque & Smolander, Kari, 2022. "What influences algorithmic decision-making? A systematic literature review on algorithm aversion," Technological Forecasting and Social Change, Elsevier, vol. 175(C).
    17. Jonas Radbruch & Amelie Schiprowski, 2020. "Interview Sequences and the Formation of Subjective Assessments," ECONtribute Discussion Papers Series 045, University of Bonn and University of Cologne, Germany.
    18. Klockmann, Victor & von Schenk, Alicia & Villeval, Marie Claire, 2022. "Artificial intelligence, ethics, and intergenerational responsibility," Journal of Economic Behavior & Organization, Elsevier, vol. 203(C), pages 284-317.
    19. Brandts, Jordi & El Baroudi, Sabrine & Huber, Stefanie J. & Rott, Christina, 2021. "Gender differences in private and public goal setting," Journal of Economic Behavior & Organization, Elsevier, vol. 192(C), pages 222-247.
    20. Antoci, Angelo & Bonelli, Laura & Paglieri, Fabio & Reggiani, Tommaso & Sabatini, Fabio, 2019. "Civility and trust in social media," Journal of Economic Behavior & Organization, Elsevier, vol. 160(C), pages 83-99.

    More about this item

    Keywords

    Algorithmic evaluation; Technological change; Online labor market; Online experiment;
    All these keywords.

    JEL classification:

    • C9 - Mathematical and Quantitative Methods - - Design of Experiments
    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity
    • M51 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Personnel Economics - - - Firm Employment Decisions; Promotions
    • O33 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Technological Change: Choices and Consequences; Diffusion Processes

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:respol:v:51:y:2022:i:2:s0048733321002146. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/respol .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.