IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v70y2024i9p5753-5775.html
   My bibliography  Save this article

Friend or Foe? Teaming Between Artificial Intelligence and Workers with Variation in Experience

Author

Listed:
  • Weiguang Wang

    (Simon Business School, University of Rochester, Rochester, New York 14627)

  • Guodong (Gordon) Gao

    (Carey Business School, Johns Hopkins University, Baltimore, Maryland 21202)

  • Ritu Agarwal

    (Carey Business School, Johns Hopkins University, Baltimore, Maryland 21202)

Abstract

As artificial intelligence (AI) applications become more pervasive, it is critical to understand how knowledge workers with different levels and types of experience can team with AI for productivity gains. We focus on the influence of two major types of human work experience (narrow experience based on the specific task volume and broad experience based on seniority) on the human-AI team dynamics. We developed an AI solution for medical chart coding in a publicly traded company and conducted a field study among the knowledge workers. Based on a detailed analysis performed at the medical chart level, we find evidence that AI benefits workers with greater task-based experience, but senior workers gain less from AI than their junior colleagues. Further investigation reveals that the relatively lower productivity lift from AI is not a result of seniority per se but lower trust in AI, likely triggered by the senior workers’ broader job responsibilities. This study provides new empirical insights into the differential roles of worker experience in the collaborative dynamics between AI and knowledge workers, which have important societal and business implications.

Suggested Citation

  • Weiguang Wang & Guodong (Gordon) Gao & Ritu Agarwal, 2024. "Friend or Foe? Teaming Between Artificial Intelligence and Workers with Variation in Experience," Management Science, INFORMS, vol. 70(9), pages 5753-5775, September.
  • Handle: RePEc:inm:ormnsc:v:70:y:2024:i:9:p:5753-5775
    DOI: 10.1287/mnsc.2021.00588
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mnsc.2021.00588
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mnsc.2021.00588?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Card, David & Krueger, Alan B, 1994. "Minimum Wages and Employment: A Case Study of the Fast-Food Industry in New Jersey and Pennsylvania," American Economic Review, American Economic Association, vol. 84(4), pages 772-793, September.
    2. Andreas Fügener & Jörn Grahl & Alok Gupta & Wolfgang Ketter, 2022. "Cognitive Challenges in Human–Artificial Intelligence Collaboration: Investigating the Path Toward Productive Delegation," Information Systems Research, INFORMS, vol. 33(2), pages 678-696, June.
    3. Chiara Longoni & Andrea Bonezzi & Carey K Morewedge, 2019. "Resistance to Medical Artificial Intelligence," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 46(4), pages 629-650.
    4. Scott Mayer McKinney & Marcin Sieniek & Varun Godbole & Jonathan Godwin & Natasha Antropova & Hutan Ashrafian & Trevor Back & Mary Chesus & Greg S. Corrado & Ara Darzi & Mozziyar Etemadi & Florencia G, 2020. "International evaluation of an AI system for breast cancer screening," Nature, Nature, vol. 577(7788), pages 89-94, January.
    5. Anne Case & Angus Deaton, 2017. "Mortality and Morbidity in the 21st Century," Working Papers 2017-spring, Princeton University, Woodrow Wilson School of Public and International Affairs, Research Program in Development Studies..
    6. repec:dar:wpaper:137446 is not listed on IDEAS
    7. Anton Korinek & Joseph E. Stiglitz, 2018. "Artificial Intelligence and Its Implications for Income Distribution and Unemployment," NBER Chapters, in: The Economics of Artificial Intelligence: An Agenda, pages 349-390, National Bureau of Economic Research, Inc.
    8. Erik Brynjolfsson, 2022. "The Turing Trap: The Promise & Peril of Human-Like Artificial Intelligence," Papers 2201.04200, arXiv.org.
    9. David Card & Alan Krueger, 1993. "Minimum Wages and Employment: A Case Study of the Fast Food Industry in New Jersey and Pennsylvania," Working Papers 694, Princeton University, Department of Economics, Industrial Relations Section..
    10. Claudia Goldin & Lawrence F. Katz, 1998. "The Origins of Technology-Skill Complementarity," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 113(3), pages 693-732.
    11. Chad Syverson, 2017. "Challenges to Mismeasurement Explanations for the US Productivity Slowdown," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 165-186, Spring.
    12. Ruyi Ge & Zhiqiang (Eric) Zheng & Xuan Tian & Li Liao, 2021. "Human–Robot Interaction: When Investors Adjust the Usage of Robo-Advisors in Peer-to-Peer Lending," Information Systems Research, INFORMS, vol. 32(3), pages 774-785, September.
    13. Kristian Lum, 2017. "Limitations of mitigating judicial bias with machine learning," Nature Human Behaviour, Nature, vol. 1(7), pages 1-1, July.
    14. Sturm, Timo & Gerlach, Jin & Pumplun, Luisa & Mesbah, Neda & Peters, Felix & Tauchert, Christoph & Nan, Ning & Buxmann, Peter, 2021. "Coordinating Human and Machine Learning for Effective Organizational Learning," Publications of Darmstadt Technical University, Institute for Business Studies (BWL) 125653, Darmstadt Technical University, Department of Business Administration, Economics and Law, Institute for Business Studies (BWL).
    15. Scott Mayer McKinney & Marcin Sieniek & Varun Godbole & Jonathan Godwin & Natasha Antropova & Hutan Ashrafian & Trevor Back & Mary Chesus & Greg S. Corrado & Ara Darzi & Mozziyar Etemadi & Florencia G, 2020. "Addendum: International evaluation of an AI system for breast cancer screening," Nature, Nature, vol. 586(7829), pages 19-19, October.
    16. Timothy F. Bresnahan & Erik Brynjolfsson & Lorin M. Hitt, 2002. "Information Technology, Workplace Organization, and the Demand for Skilled Labor: Firm-Level Evidence," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 117(1), pages 339-376.
    17. Ragnar Fjelland, 2020. "Why general artificial intelligence will not be realized," Palgrave Communications, Palgrave Macmillan, vol. 7(1), pages 1-9, December.
    18. Tinglong Dai & Shubhranshu Singh, 2020. "Conspicuous by Its Absence: Diagnostic Expert Testing Under Uncertainty," Marketing Science, INFORMS, vol. 39(3), pages 540-563, May.
    19. Anne Case & Angus Deaton, 2017. "Mortality and Morbidity in the 21st Century," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 48(1 (Spring), pages 397-476.
    20. Volodymyr Mnih & Koray Kavukcuoglu & David Silver & Andrei A. Rusu & Joel Veness & Marc G. Bellemare & Alex Graves & Martin Riedmiller & Andreas K. Fidjeland & Georg Ostrovski & Stig Petersen & Charle, 2015. "Human-level control through deep reinforcement learning," Nature, Nature, vol. 518(7540), pages 529-533, February.
    21. Tom Fangyun Tan & Serguei Netessine, 2020. "At Your Service on the Table: Impact of Tabletop Technology on Restaurant Performance," Management Science, INFORMS, vol. 66(10), pages 4496-4515, October.
    22. D. Harrison McKnight & Vivek Choudhury & Charles Kacmar, 2002. "Developing and Validating Trust Measures for e-Commerce: An Integrative Typology," Information Systems Research, INFORMS, vol. 13(3), pages 334-359, September.
    23. Ekaterina Jussupow & Kai Spohrer & Armin Heinzl & Joshua Gawlitza, 2021. "Augmenting Medical Diagnosis Decisions? An Investigation into Physicians’ Decision-Making Process with Artificial Intelligence," Information Systems Research, INFORMS, vol. 32(3), pages 713-735, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Christoph Riedl & Eric Bogert, 2024. "Effects of AI Feedback on Learning, the Skill Gap, and Intellectual Diversity," Papers 2409.18660, arXiv.org.
    2. Hanzhe Li & Jin Li & Ye Luo & Xiaowei Zhang, 2024. "AI Persuasion, Bayesian Attribution, and Career Concerns of Doctors," Papers 2410.01114, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dawei (David) Zhang & Gang Peng & Yuliang Yao & Tyson R. Browning, 2024. "Is a College Education Still Enough? The IT-Labor Relationship with Education Level, Task Routineness, and Artificial Intelligence," Information Systems Research, INFORMS, vol. 35(3), pages 992-1010, September.
    2. Kevin Bauer & Andrej Gill, 2024. "Mirror, Mirror on the Wall: Algorithmic Assessments, Transparency, and Self-Fulfilling Prophecies," Information Systems Research, INFORMS, vol. 35(1), pages 226-248, March.
    3. Robert J. Gordon, 2018. "Why Has Economic Growth Slowed When Innovation Appears to be Accelerating?," NBER Working Papers 24554, National Bureau of Economic Research, Inc.
    4. Zhai, Muxin & Kishan, Ruby P. & Showalter, Dean, 2022. "Social capital and suicidal behaviors: Evidence from the United States counties," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 98(C).
    5. Gordon, Robert J., 2018. "Why Has Economic Growth Slowed When Innovation Appears To Be Accelerating?," CEPR Discussion Papers 13039, C.E.P.R. Discussion Papers.
    6. Anna Godoey & Michael Reich, 2021. "Are Minimum Wage Effects Greater in Low‐Wage Areas?," Industrial Relations: A Journal of Economy and Society, Wiley Blackwell, vol. 60(1), pages 36-83, January.
    7. Gordon, Robert J., 2018. "Declining American economic growth despite ongoing innovation," Explorations in Economic History, Elsevier, vol. 69(C), pages 1-12.
    8. Louis‐Philippe Beland & Jason Huh & Dongwoo Kim, 2024. "The effect of opioid use on traffic fatalities," Health Economics, John Wiley & Sons, Ltd., vol. 33(6), pages 1123-1132, June.
    9. Dickens, Richard & Machin, Stephen & Manning, Alan, 1998. "Estimating the effect of minimum wages on employment from the distribution of wages: A critical view," Labour Economics, Elsevier, vol. 5(2), pages 109-134, June.
    10. Do, Manh Hung & Nguyen, Trung Thanh & Grote, Ulrike, 2023. "Land consolidation, rice production, and agricultural transformation: Evidence from household panel data for Vietnam," Economic Analysis and Policy, Elsevier, vol. 77(C), pages 157-173.
    11. Alexander Cheung & Joseph Marchand & Patricia Mark, 2022. "Loss of Life and Labor Productivity: The Canadian Opioid Crisis," The ANNALS of the American Academy of Political and Social Science, , vol. 703(1), pages 303-323, September.
    12. Majd Oteibi & Adam Tamimi & Kaneez Abbas & Gabriel Tamimi & Danesh Khazaei & Hadi Khazaei, 2024. "Advancing Digital Health using AI and Machine Learning Solutions for Early Ultrasonic Detection of Breast Disorders in Women," International Journal of Research and Scientific Innovation, International Journal of Research and Scientific Innovation (IJRSI), vol. 11(11), pages 518-527, November.
    13. Pearce Edwards & Patrick Pierson, 2023. "Incumbent-Aligned Terrorism and Voting Behavior: Evidence from Argentina’s 1973 Elections," Journal of Conflict Resolution, Peace Science Society (International), vol. 67(4), pages 672-700, April.
    14. Tinglong Dai & Sridhar Tayur, 2022. "Designing AI‐augmented healthcare delivery systems for physician buy‐in and patient acceptance," Production and Operations Management, Production and Operations Management Society, vol. 31(12), pages 4443-4451, December.
    15. Dow, Wiiliam H & Godoey, Anna & Lowenstein, Christopher A & Reich, Michael, 2019. "Can Economic Policies Reduce Deaths of Despair? Working Paper #104-19," Institute for Research on Labor and Employment, Working Paper Series qt14f015df, Institute of Industrial Relations, UC Berkeley.
    16. Leora Friedberg, 2003. "The Impact of Technological Change on Older Workers: Evidence from Data on Computer Use," ILR Review, Cornell University, ILR School, vol. 56(3), pages 511-529, April.
    17. Komlos, John & Schubert, Hermann, 2019. "Les origines du triomphe de Donald Trump," Revue de la Régulation - Capitalisme, institutions, pouvoirs, Association Recherche et Régulation, vol. 26.
    18. Christopher Bennett & Brent Evans & Christopher Marsicano, 2021. "Taken for Granted? Effects of Loan-Reduction Initiatives on Student Borrowing, Admission Metrics, and Campus Diversity," Research in Higher Education, Springer;Association for Institutional Research, vol. 62(5), pages 569-599, August.
    19. Christopher J. Ruhm, 2019. "Shackling the Identification Police?," Southern Economic Journal, John Wiley & Sons, vol. 85(4), pages 1016-1026, April.
    20. Bell, William Paul & Zheng, Xuemei, 2018. "Inclusive growth and climate change adaptation and mitigation in Australia and China : Removing barriers to solving wicked problems," MPRA Paper 84509, University Library of Munich, Germany.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:70:y:2024:i:9:p:5753-5775. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.