IDEAS home Printed from https://ideas.repec.org/a/inm/orisre/v33y2022i2p678-696.html

Cognitive Challenges in Human–Artificial Intelligence Collaboration: Investigating the Path Toward Productive Delegation

Author

Listed:
  • Andreas Fügener

    (University of Cologne, 50923 Cologne, Germany)

  • Jörn Grahl

    (University of Cologne, 50923 Cologne, Germany)

  • Alok Gupta

    (University of Minnesota, Minneapolis, Minnesota 55455)

  • Wolfgang Ketter

    (University of Cologne, 50923 Cologne, Germany; Erasmus University Rotterdam, 3062 PA Rotterdam, Netherlands)

Abstract

We study how humans make decisions when they collaborate with an artificial intelligence (AI) in a setting where humans and the AI perform classification tasks. Our experimental results suggest that humans and AI who work together can outperform the AI that outperforms humans when it works on its own. However, the combined performance improves only when the AI delegates work to humans but not when humans delegate work to the AI. The AI’s delegation performance improved even when it delegated to low-performing subjects; by contrast, humans did not delegate well and did not benefit from delegation to the AI. This bad delegation performance cannot be explained with some kind of algorithm aversion. On the contrary, subjects acted rationally in an internally consistent manner by trying to follow a proven delegation strategy and appeared to appreciate the AI support. However, human performance suffered as a result of a lack of metaknowledge—that is, humans were not able to assess their own capabilities correctly, which in turn led to poor delegation decisions. Lacking metaknowledge, in contrast to reluctance to use AI, is an unconscious trait. It fundamentally limits how well human decision makers can collaborate with AI and other algorithms. The results have implications for the future of work, the design of human–AI collaborative environments, and education in the digital age.

Suggested Citation

  • Andreas Fügener & Jörn Grahl & Alok Gupta & Wolfgang Ketter, 2022. "Cognitive Challenges in Human–Artificial Intelligence Collaboration: Investigating the Path Toward Productive Delegation," Information Systems Research, INFORMS, vol. 33(2), pages 678-696, June.
    • Handle: RePEc:inm:orisre:v:33:y:2022:i:2:p:678-696
    DOI: 10.1287/isre.2021.1079
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/isre.2021.1079
    Download Restriction: no
    File URL: https://libkey.io/10.1287/isre.2021.1079?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Mirko Kremer & Brent Moritz & Enno Siemsen, 2011. "Demand Forecasting Behavior: System Neglect and Change Detection," Management Science, INFORMS, vol. 57(10), pages 1827-1843, October.
    2. Andre Esteva & Brett Kuprel & Roberto A. Novoa & Justin Ko & Susan M. Swetter & Helen M. Blau & Sebastian Thrun, 2017. "Correction: Corrigendum: Dermatologist-level classification of skin cancer with deep neural networks," Nature, Nature, vol. 546(7660), pages 686-686, June.
    3. David H. Autor & Frank Levy & Richard J. Murnane, 2003. "The Skill Content of Recent Technological Change: An Empirical Exploration," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(4), pages 1279-1333.
    4. Logg, Jennifer M. & Minson, Julia A. & Moore, Don A., 2019. "Algorithm appreciation: People prefer algorithmic to human judgment," Organizational Behavior and Human Decision Processes, Elsevier, vol. 151(C), pages 90-103.
    5. repec:dar:wpaper:137446 is not listed on IDEAS
    6. Berkeley J. Dietvorst & Joseph P. Simmons & Cade Massey, 2018. "Overcoming Algorithm Aversion: People Will Use Imperfect Algorithms If They Can (Even Slightly) Modify Them," Management Science, INFORMS, vol. 64(3), pages 1155-1170, March.
    7. John Horton & David Rand & Richard Zeckhauser, 2011. "The online laboratory: conducting experiments in a real labor market," Experimental Economics, Springer;Economic Science Association, vol. 14(3), pages 399-425, September.
    8. Ruyi Ge & Zhiqiang (Eric) Zheng & Xuan Tian & Li Liao, 2021. "Human–Robot Interaction: When Investors Adjust the Usage of Robo-Advisors in Peer-to-Peer Lending," Information Systems Research, INFORMS, vol. 32(3), pages 774-785, September.
    9. Andre Esteva & Brett Kuprel & Roberto A. Novoa & Justin Ko & Susan M. Swetter & Helen M. Blau & Sebastian Thrun, 2017. "Dermatologist-level classification of skin cancer with deep neural networks," Nature, Nature, vol. 542(7639), pages 115-118, February.
    10. Coppock, Alexander, 2019. "Generalizing from Survey Experiments Conducted on Mechanical Turk: A Replication Approach," Political Science Research and Methods, Cambridge University Press, vol. 7(3), pages 613-628, July.
    11. Yun Shin Lee & Yong Won Seo & Enno Siemsen, 2018. "Running Behavioral Operations Experiments Using Amazon's Mechanical Turk," Production and Operations Management, Production and Operations Management Society, vol. 27(5), pages 973-989, May.
    12. Nosek, Brian A. & Ebersole, Charles R. & DeHaven, Alexander Carl & Mellor, David Thomas, 2018. "The Preregistration Revolution," OSF Preprints 2dxu5, Center for Open Science.
    13. David H. Autor & Frank Levy & Richard J. Murnane, 2003. "The skill content of recent technological change: an empirical exploration," Proceedings, Federal Reserve Bank of San Francisco, issue nov.
    14. David Autor, 2014. "Polanyi's Paradox and the Shape of Employment Growth," NBER Working Papers 20485, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mario Passalacqua & Robert Pellerin & Florian Magnani & Laurent Joblot & Frédéric Rosin & Esma Yahia & Pierre-Majorique Léger, 2025. "Safeguarding worker psychosocial well-being in the age of AI: The critical role of decision control," Post-Print hal-05345071, HAL.
    2. Juan Wu & Zhe & Zhang & Amit Mehra, 2026. "When Is Self-Disclosure Optimal? Incentives and Governance of AI-Generated Content," Papers 2601.18654, arXiv.org.
    3. Araz Zirar, 2023. "Can artificial intelligence’s limitations drive innovative work behaviour?," Review of Managerial Science, Springer, vol. 17(6), pages 2005-2034, August.
    4. Guo, Lihong & Pei, Huacheng & Liu, Yizi, 2025. "Artificial intelligence and corporate green innovation: Evidence from China," Research in International Business and Finance, Elsevier, vol. 79(C).
    5. Yu Jeffrey Hu & Jeroen Rombouts & Ines Wilms, 2025. "MLOps Monitoring at Scale for Digital Platforms," Papers 2504.16789, arXiv.org.
    6. Bowen Lou & Tian Lu & T. S. Raghu & Yingjie Zhang, 2025. "Unraveling Human-AI Teaming: A Review and Outlook," Papers 2504.05755, arXiv.org, revised Apr 2025.
    7. Martin Haupt & Jan Freidank & Alexander Haas, 2025. "Consumer responses to human-AI collaboration at organizational frontlines: strategies to escape algorithm aversion in content creation," Review of Managerial Science, Springer, vol. 19(2), pages 377-413, February.
    8. Binh Nguyen Thanh & Ha Xuan Son & Diem Thi Hong Vo, 2024. "Blockchain: The Economic and Financial Institution for Autonomous AI?," JRFM, MDPI, vol. 17(2), pages 1-20, January.
    9. Danatzis, Ilias & Field, Joy M. & Subramony, Mahesh, 2025. "Creating human-technology synergies at the organizational frontlines," Journal of Business Research, Elsevier, vol. 200(C).
    10. Dawei (David) Zhang & Gang Peng & Yuliang Yao & Tyson R. Browning, 2024. "Is a College Education Still Enough? The IT-Labor Relationship with Education Level, Task Routineness, and Artificial Intelligence," Information Systems Research, INFORMS, vol. 35(3), pages 992-1010, September.
    11. Martin Adam & Konstantin Roethke & Alexander Benlian, 2023. "Human vs. Automated Sales Agents: How and Why Customer Responses Shift Across Sales Stages," Information Systems Research, INFORMS, vol. 34(3), pages 1148-1168, September.
    12. Weiguang Wang & Guodong (Gordon) Gao & Ritu Agarwal, 2024. "Friend or Foe? Teaming Between Artificial Intelligence and Workers with Variation in Experience," Management Science, INFORMS, vol. 70(9), pages 5753-5775, September.
    13. Zirar, Araz & Ali, Syed Imran & Islam, Nazrul, 2023. "Worker and workplace Artificial Intelligence (AI) coexistence: Emerging themes and research agenda," Technovation, Elsevier, vol. 124(C).
    14. Cathy & Yang & Kevin Bauer & Xitong Li & Oliver Hinz, 2025. "My Advisor, Her AI and Me: Evidence from a Field Experiment on Human-AI Collaboration and Investment Decisions," Papers 2506.03707, arXiv.org.
    15. Ulrich Gnewuch & Stefan Morana & Oliver Hinz & Ralf Kellner & Alexander Maedche, 2024. "More Than a Bot? The Impact of Disclosing Human Involvement on Customer Interactions with Hybrid Service Agents," Information Systems Research, INFORMS, vol. 35(3), pages 936-955, September.
    16. Gyeong Kim, Min & Chang Lee, Kun, 2025. "Proposing the “Digital Agenticity Theory” to analyze user engagement in conversational AI chatbot," Journal of Business Research, Elsevier, vol. 189(C).
    17. Ivanov, Dmitry, 2023. "Intelligent digital twin (iDT) for supply chain stress-testing, resilience, and viability," International Journal of Production Economics, Elsevier, vol. 263(C).
    18. Wang, Weisha & Wang, Yichuan & Chen, Long & Ma, Rui & Zhang, Minhao, 2024. "Justice at the Forefront: Cultivating felt accountability towards Artificial Intelligence among healthcare professionals," Social Science & Medicine, Elsevier, vol. 347(C).
    19. Jayarajan Samuel & Zhiqiang (Eric) Zheng & Vijay Mookerjee, 2024. "Task Characteristics and Incentives in Collaborative Problem Solving: Evidence from Three Field Experiments," Information Systems Research, INFORMS, vol. 35(1), pages 414-433, March.
    20. Mario Passalacqua & Robert Pellerin & Florian Magnani & Philippe Doyon-Poulin & Laurène Del-Aguila & Jared Boasen & Pierre-Majorique Léger, 2024. "Human-centred AI in industry 5.0: a systematic review," Post-Print hal-04723054, HAL.
    21. Christos K. Filelis-Papadopoulos & Samuel N. Kirshner & Philip O’Reilly, 2025. "Sustainability with Limited Data: A Novel Predictive Analytics Approach for Forecasting CO2 Emissions," Information Systems Frontiers, Springer, vol. 27(3), pages 1227-1251, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Riccardo Zanardelli, 2025. "Navigating the safe harbor paradox in human-machine systems," Papers 2509.14057, arXiv.org, revised Jan 2026.
    2. Venkat Ram Reddy Ganuthula & Krishna Kumar Balaraman, 2025. "The Paradox of Professional Input: How Expert Collaboration with AI Systems Shapes Their Future Value," Papers 2504.12654, arXiv.org.
    3. Daniel Susskind, 2017. "Re-Thinking the Capabilities of Machines in Economics," Economics Series Working Papers 825, University of Oxford, Department of Economics.
    4. Daniel Susskind, 2019. "Re-thinking the capabilities of technology in economics," Economics Bulletin, AccessEcon, vol. 39(1), pages 280-288.
    5. Ivanov, Dmitry, 2023. "Intelligent digital twin (iDT) for supply chain stress-testing, resilience, and viability," International Journal of Production Economics, Elsevier, vol. 263(C).
    6. Aleksandra Parteka & Joanna Wolszczak-Derlacz, 2020. "Wage response to global production links: evidence for workers from 28 European countries (2005–2014)," Review of World Economics (Weltwirtschaftliches Archiv), Springer;Institut für Weltwirtschaft (Kiel Institute for the World Economy), vol. 156(4), pages 769-801, November.
    7. David J. Deming, 2017. "The Growing Importance of Social Skills in the Labor Market," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 132(4), pages 1593-1640.
    8. Abel Brodeur, Nikolai M. Cook, Anthony Heyes, 2022. "We Need to Talk about Mechanical Turk: What 22,989 Hypothesis Tests Tell Us about Publication Bias and p-Hacking in Online Experiments," LCERPA Working Papers am0133, Laurier Centre for Economic Research and Policy Analysis.
    9. Ross, Matthew B., 2017. "Routine-biased technical change: Panel evidence of task orientation and wage effects," Labour Economics, Elsevier, vol. 48(C), pages 198-214.
    10. Michael Coelli & Jeff Borland, 2016. "Job Polarisation and Earnings Inequality in Australia," The Economic Record, The Economic Society of Australia, vol. 92(296), pages 1-27, March.
    11. David Deming & Lisa B. Kahn, 2018. "Skill Requirements across Firms and Labor Markets: Evidence from Job Postings for Professionals," Journal of Labor Economics, University of Chicago Press, vol. 36(S1), pages 337-369.
    12. Kevin Bauer & Andrej Gill, 2024. "Mirror, Mirror on the Wall: Algorithmic Assessments, Transparency, and Self-Fulfilling Prophecies," Information Systems Research, INFORMS, vol. 35(1), pages 226-248, March.
    13. Brodeur, Abel & Cook, Nikolai & Heyes, Anthony, 2022. "We Need to Talk about Mechanical Turk: What 22,989 Hypothesis Tests Tell us about p-Hacking and Publication Bias in Online Experiments," GLO Discussion Paper Series 1157, Global Labor Organization (GLO).
    14. Aaron Chatterji & Daniel Rock & Eduard Talamas, 2025. "Transformative AI and Firms," NBER Chapters, in: The Economics of Transformative AI, National Bureau of Economic Research, Inc.
    15. Daniel Susskind, 2017. "A Model of Technological Unemployment," Economics Series Working Papers 819, University of Oxford, Department of Economics.
    16. Keding, Christoph & Meissner, Philip, 2021. "Managerial overreliance on AI-augmented decision-making processes: How the use of AI-based advisory systems shapes choice behavior in R&D investment decisions," Technological Forecasting and Social Change, Elsevier, vol. 171(C).
    17. António Moniz & Marta Candeias & Nuno Boavida, 2022. "Changes in productivity and labour relations," Post-Print hal-04670873, HAL.
    18. Wojciech Hardy & Roma Keister & Piotr Lewandowski, 2018. "Educational upgrading, structural change and the task composition of jobs in Europe," The Economics of Transition, The European Bank for Reconstruction and Development, vol. 26(2), pages 201-231, April.
    19. Georg Graetz & Guy Michaels, 2018. "Robots at Work," The Review of Economics and Statistics, MIT Press, vol. 100(5), pages 753-768, December.
    20. repec:osf:metaar:a9vhr_v1 is not listed on IDEAS
    21. Azio Barani, 2021. "Innovazione tecnologica e lavoro: automazione, occupazione e impatti socio-economici," QUADERNI DI ECONOMIA DEL LAVORO, FrancoAngeli Editore, vol. 0(114), pages 51-79.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:orisre:v:33:y:2022:i:2:p:678-696. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.