IDEAS home Printed from https://ideas.repec.org/p/ems/eureri/115830.html
   My bibliography  Save this paper

Cognitive challenges in human-AI collaboration: Investigating the path towards productive delegation

Author

Listed:
  • Fügener, A.
  • Grahl, J.
  • Gupta, A.
  • Ketter, W.

Abstract

We study how humans make decisions when they collaborate with an artificial intelligence (AI): each instance of a classification task could be classified by themselves or by the AI. Experimental results suggest that humans and AI who work together can outperform the superior AI when it works alone. However, this only occurred when the AI delegated work to humans, not when humans delegated work to the AI. The AI profited, even from working with low-performing subjects, but humans did not delegate well. This bad delegation performance cannot be explained with algorithm aversion. On the contrary, subjects tried to follow a provided delegation strategy diligently and appeared to appreciate the AI support. However, human results suffered due to a lack of metaknowledge. They were not able to assess their own capabilities correctly, which in turn leads to poor delegation decisions. In contrast to reluctance to use AI, lacking metaknowledge is an unconscious trait. It limits fundamentally how well human decision makers can collaborate with AI and other algorithms. The results have implications for the future of work, the design of human-AI collaborative environments and education in the digital age.

Suggested Citation

  • Fügener, A. & Grahl, J. & Gupta, A. & Ketter, W., 2019. "Cognitive challenges in human-AI collaboration: Investigating the path towards productive delegation," ERIM Report Series Research in Management ERS-2019-003-LIS, Erasmus Research Institute of Management (ERIM), ERIM is the joint research institute of the Rotterdam School of Management, Erasmus University and the Erasmus School of Economics (ESE) at Erasmus University Rotterdam.
    • Handle: RePEc:ems:eureri:115830
    as

    Download full text from publisher

    File URL: https://repub.eur.nl/pub/115830/ERS-2019-003-LIS_v1.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Martin Bichler & Alok Gupta & Wolfgang Ketter, 2010. "Research Commentary ---Designing Smart Markets," Information Systems Research, INFORMS, vol. 21(4), pages 688-699, December.
    2. Micha T. Kahlen & Wolfgang Ketter & Jan van Dalen, 2018. "Electric Vehicle Virtual Power Plant Dilemma: Grid Balancing Versus Customer Mobility," Production and Operations Management, Production and Operations Management Society, vol. 27(11), pages 2054-2070, November.
    3. Frey, Carl Benedikt & Osborne, Michael A., 2017. "The future of employment: How susceptible are jobs to computerisation?," Technological Forecasting and Social Change, Elsevier, vol. 114(C), pages 254-280.
    4. Jing Wang & Panagiotis G. Ipeirotis & Foster Provost, 2017. "Cost-Effective Quality Assurance in Crowd Labeling," Information Systems Research, INFORMS, vol. 28(1), pages 137-158, March.
    5. Herbert A. Simon, 1955. "A Behavioral Model of Rational Choice," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 69(1), pages 99-118.
    6. Dario Floreano & Robert J. Wood, 2015. "Science, technology and the future of small autonomous drones," Nature, Nature, vol. 521(7553), pages 460-466, May.
    7. Andre Esteva & Brett Kuprel & Roberto A. Novoa & Justin Ko & Susan M. Swetter & Helen M. Blau & Sebastian Thrun, 2017. "Dermatologist-level classification of skin cancer with deep neural networks," Nature, Nature, vol. 542(7639), pages 115-118, February.
    8. Nosek, Brian A. & Ebersole, Charles R. & DeHaven, Alexander Carl & Mellor, David Thomas, 2018. "The Preregistration Revolution," OSF Preprints 2dxu5, Center for Open Science.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andreas Fügener & Jörn Grahl & Alok Gupta & Wolfgang Ketter, 2022. "Cognitive Challenges in Human–Artificial Intelligence Collaboration: Investigating the Path Toward Productive Delegation," Information Systems Research, INFORMS, vol. 33(2), pages 678-696, June.
    2. Wolfgang Ketter & Karsten Schroer & Konstantina Valogianni, 2023. "Information Systems Research for Smart Sustainable Mobility: A Framework and Call for Action," Information Systems Research, INFORMS, vol. 34(3), pages 1045-1065, September.
    3. Daniel Susskind, 2019. "Re-thinking the capabilities of technology in economics," Economics Bulletin, AccessEcon, vol. 39(1), pages 280-288.
    4. Konstantina Valogianni & Wolfgang Ketter & John Collins & Dmitry Zhdanov, 2020. "Sustainable Electric Vehicle Charging using Adaptive Pricing," Production and Operations Management, Production and Operations Management Society, vol. 29(6), pages 1550-1572, June.
    5. Smith, Robert Elliott, 2016. "Idealizations of Uncertainty, and Lessons from Artificial Intelligence," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 10, pages 1-40.
    6. Jermain C. Kaminski & Christian Hopp, 2020. "Predicting outcomes in crowdfunding campaigns with textual, visual, and linguistic signals," Small Business Economics, Springer, vol. 55(3), pages 627-649, October.
    7. Torgler, Benno & Schneider, Friedrich & Schaltegger, Christoph A., 2007. "With or Against the People? The Impact of a Bottom-Up Approach on Tax Morale and the Shadow Economy," Berkeley Olin Program in Law & Economics, Working Paper Series qt6331x6vz, Berkeley Olin Program in Law & Economics.
    8. Loebbing, Jonas, 2018. "An Elementary Theory of Endogenous Technical Change and Wage Inequality," VfS Annual Conference 2018 (Freiburg, Breisgau): Digital Economy 181603, Verein für Socialpolitik / German Economic Association.
    9. Daniel Fonseca Costa & Francisval Carvalho & Bruno César Moreira & José Willer Prado, 2017. "Bibliometric analysis on the association between behavioral finance and decision making with cognitive biases such as overconfidence, anchoring effect and confirmation bias," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(3), pages 1775-1799, June.
    10. Christina Leuker & Thorsten Pachur & Ralph Hertwig & Timothy J. Pleskac, 2019. "Do people exploit risk–reward structures to simplify information processing in risky choice?," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 5(1), pages 76-94, August.
    11. Jae Wook Yoo & Richard Reed & Shung Jae Shin & David J. Lemak, 2009. "Strategic Choice and Performance in Late Movers: Influence of the Top Management Team's External Ties," Journal of Management Studies, Wiley Blackwell, vol. 46(2), pages 308-335, March.
    12. Giovanni Calice & Levent Kutlu & Ming Zeng, 2021. "Understanding US firm efficiency and its asset pricing implications," Empirical Economics, Springer, vol. 60(2), pages 803-827, February.
    13. Westerhoff, Frank H. & Dieci, Roberto, 2006. "The effectiveness of Keynes-Tobin transaction taxes when heterogeneous agents can trade in different markets: A behavioral finance approach," Journal of Economic Dynamics and Control, Elsevier, vol. 30(2), pages 293-322, February.
    14. José Castro Caldas & Helder Coelho, 1999. "The Origin of Institutions: Socio-Economic Processes, Choice, Norms and Conventions," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 2(2), pages 1-1.
    15. Nagler Matthew G., 2007. "Understanding the Internet's Relevance to Media Ownership Policy: A Model of Too Many Choices," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 7(1), pages 1-28, June.
    16. Basso, Henrique S. & Jimeno, Juan F., 2021. "From secular stagnation to robocalypse? Implications of demographic and technological changes," Journal of Monetary Economics, Elsevier, vol. 117(C), pages 833-847.
    17. Iftekhairul Islam & Fahad Shaon, 2020. "If the Prospect of Some Occupations Are Stagnating With Technological Advancement? A Task Attribute Approach to Detect Employment Vulnerability," Papers 2001.02783, arXiv.org.
    18. Ranganathan, Kavitha & Lejarraga, Tomás, 2021. "Elicitation of risk preferences through satisficing," Journal of Behavioral and Experimental Finance, Elsevier, vol. 32(C).
    19. Westerhoff Frank H., 2008. "The Use of Agent-Based Financial Market Models to Test the Effectiveness of Regulatory Policies," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 228(2-3), pages 195-227, April.
    20. Ayhan, Fatih & Elal, Onuray, 2023. "The IMPACTS of technological change on employment: Evidence from OECD countries with panel data analysis," Technological Forecasting and Social Change, Elsevier, vol. 190(C).

    More about this item

    Keywords

    Future of work; Artificial Intelligence; Deep Learning; Machine Learning; Deep Learning; Human-AI Collaboration; Machine Learning; Intelligent Software Agents;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ems:eureri:115830. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: RePub (email available below). General contact details of provider: https://edirc.repec.org/data/erimanl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.