IDEAS home Printed from https://ideas.repec.org/a/bla/stratm/v42y2021i9p1600-1631.html
   My bibliography  Save this article

The Janus face of artificial intelligence feedback: Deployment versus disclosure effects on employee performance

Author

Listed:
  • Siliang Tong
  • Nan Jia
  • Xueming Luo
  • Zheng Fang

Abstract

Companies are increasingly using artificial intelligence (AI) to provide performance feedback to employees, by tracking employee behavior at work, automating performance evaluations, and recommending job improvements. However, this application of AI has provoked much debate. On the one hand, powerful AI data analytics increase the quality of feedback, which may enhance employee productivity (“deployment effect”). On the other hand, employees may develop a negative perception of AI feedback once it is disclosed to them, thus harming their productivity (“disclosure effect”). We examine these two effects theoretically and test them empirically using data from a field experiment. We find strong evidence that both effects coexist, and that the adverse disclosure effect is mitigated by employees' tenure in the firm. These findings offer pivotal implications for management theory, practice, and public policies. Managerial abstract Artificial intelligence (AI) technologies are bound to transform how companies manage employees. We examine the use of AI to generate performance feedback for employees. We demonstrate that AI significantly increases the accuracy and consistency of the analyses of information collected, and the relevance of feedback to each employee. These advantages of AI help employees achieve greater job performance at scale, and thus create value for companies. However, our study also alerts companies to the negative effect of disclosing using AI to employee that results from employees' negative perceptions about the deployment of AI, which offsets the business value created by AI. To alleviate value‐destroying disclosure effect, we suggest that companies be more proactive in communicating with their employees about the objectives, benefits, and scope of AI applications in order to assuage their concerns. Moreover, the result of the allayed negative AI disclosure effect among employees with a longer tenure in the company suggests that companies may consider deploying AI in a tiered instead of a uniform fashion, that is, using AI to provide performance feedback to veteran employees but using human managers to provide performance feedback to novices.

Suggested Citation

  • Siliang Tong & Nan Jia & Xueming Luo & Zheng Fang, 2021. "The Janus face of artificial intelligence feedback: Deployment versus disclosure effects on employee performance," Strategic Management Journal, Wiley Blackwell, vol. 42(9), pages 1600-1631, September.
  • Handle: RePEc:bla:stratm:v:42:y:2021:i:9:p:1600-1631
    DOI: 10.1002/smj.3322
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/smj.3322
    Download Restriction: no

    File URL: https://libkey.io/10.1002/smj.3322?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Chiara Longoni & Andrea Bonezzi & Carey K Morewedge, 2019. "Resistance to Medical Artificial Intelligence," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 46(4), pages 629-650.
    2. Jarrahi, Mohammad Hossein, 2018. "Artificial intelligence and the future of work: Human-AI symbiosis in organizational decision making," Business Horizons, Elsevier, vol. 61(4), pages 577-586.
    3. Newman, David T. & Fast, Nathanael J. & Harmon, Derek J., 2020. "When eliminating bias isn’t fair: Algorithmic reductionism and procedural justice in human resource decisions," Organizational Behavior and Human Decision Processes, Elsevier, vol. 160(C), pages 149-167.
    4. Philippe Aghion & Benjamin F. Jones & Charles I. Jones, 2018. "Artificial Intelligence and Economic Growth," NBER Chapters, in: The Economics of Artificial Intelligence: An Agenda, pages 237-282, National Bureau of Economic Research, Inc.
    5. Daron Acemoglu & Pascual Restrepo, 2020. "Robots and Jobs: Evidence from US Labor Markets," Journal of Political Economy, University of Chicago Press, vol. 128(6), pages 2188-2244.
    6. Saravanan Kesavan & Tarun Kushwaha, 2020. "Field Experiment on the Profit Implications of Merchants’ Discretionary Power to Override Data-Driven Decision-Making Tools," Management Science, INFORMS, vol. 66(11), pages 5182-5190, November.
    7. Daron Acemoglu & Pascual Restrepo, 2018. "The Race between Man and Machine: Implications of Technology for Growth, Factor Shares, and Employment," American Economic Review, American Economic Association, vol. 108(6), pages 1488-1542, June.
    8. Erik Brynjolfsson & Xiang Hui & Meng Liu, 2019. "Does Machine Translation Affect International Trade? Evidence from a Large Digital Platform," Management Science, INFORMS, vol. 65(12), pages 5449-5460, December.
    9. Henry Mintzberg, 1990. "The design school: Reconsidering the basic premises of strategic management," Strategic Management Journal, Wiley Blackwell, vol. 11(3), pages 171-195, March.
    10. Ravi Aron & Shantanu Dutta & Ramkumar Janakiraman & Praveen A. Pathak, 2011. "The Impact of Automation of Systems on Medical Errors: Evidence from Field Research," Information Systems Research, INFORMS, vol. 22(3), pages 429-446, September.
    11. Prithwiraj Choudhury & Evan Starr & Rajshree Agarwal, 2020. "Machine learning and human capital complementarities: Experimental evidence on bias mitigation," Strategic Management Journal, Wiley Blackwell, vol. 41(8), pages 1381-1411, August.
    12. Robert Seamans & Manav Raj, 2018. "AI, Labor, Productivity and the Need for Firm-Level Data," NBER Working Papers 24239, National Bureau of Economic Research, Inc.
    13. Ajay Agrawal & Joshua S. Gans & Avi Goldfarb, 2019. "Artificial Intelligence: The Ambiguous Labor Market Impact of Automating Prediction," Journal of Economic Perspectives, American Economic Association, vol. 33(2), pages 31-50, Spring.
    14. Logg, Jennifer M. & Minson, Julia A. & Moore, Don A., 2019. "Algorithm appreciation: People prefer algorithmic to human judgment," Organizational Behavior and Human Decision Processes, Elsevier, vol. 151(C), pages 90-103.
    15. Georg Meyer & Gediminas Adomavicius & Paul E. Johnson & Mohamed Elidrisi & William A. Rush & JoAnn M. Sperl-Hillen & Patrick J. O'Connor, 2014. "A Machine Learning Approach to Improving Dynamic Decision Making," Information Systems Research, INFORMS, vol. 25(2), pages 239-263, June.
    16. Xueming Luo & Siliang Tong & Zheng Fang & Zhe Qu, 2019. "Frontiers: Machines vs. Humans: The Impact of Artificial Intelligence Chatbot Disclosure on Customer Purchases," Marketing Science, INFORMS, vol. 38(6), pages 937-947, November.
    17. Michelle Rogan & Marie Louise Mors, 2014. "A Network Perspective on Individual-Level Ambidexterity in Organizations," Organization Science, INFORMS, vol. 25(6), pages 1860-1877, December.
    18. Nic Fleming, 2018. "How artificial intelligence is changing drug discovery," Nature, Nature, vol. 557(7707), pages 55-57, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Manav Raj & Justin Berg & Rob Seamans, 2023. "Art-ificial Intelligence: The Effect of AI Disclosure on Evaluations of Creative Content," Papers 2303.06217, arXiv.org.
    2. Mengmeng Wang & Xiaoming Pan, 2022. "Drivers of Artificial Intelligence and Their Effects on Supply Chain Resilience and Performance: An Empirical Analysis on an Emerging Market," Sustainability, MDPI, vol. 14(24), pages 1-16, December.
    3. Oduro, Stephen & De Nisco, Alessandro & Mainolfi, Giada, 2023. "Do digital technologies pay off? A meta-analytic review of the digital technologies/firm performance nexus," Technovation, Elsevier, vol. 128(C).
    4. Pletcher, Scott Nicholas, 2023. "Practical and Ethical Perspectives on AI-Based Employee Performance Evaluation," OSF Preprints 29yej, Center for Open Science.
    5. Prentice, Catherine & Wong, IpKin Anthony & Lin, Zhiwei (CJ), 2023. "Artificial intelligence as a boundary-crossing object for employee engagement and performance," Journal of Retailing and Consumer Services, Elsevier, vol. 73(C).
    6. Johannes Habel & Sascha Alavi & Nicolas Heinitz, 2023. "A theory of predictive sales analytics adoption," AMS Review, Springer;Academy of Marketing Science, vol. 13(1), pages 34-54, June.
    7. Shengxing Yang, 2022. "A systematic literature review on the disruptions of artificial intelligence within the business world: in terms of the evolution of competences [Une revue systématique de la littérature sur les bo," Post-Print hal-03694170, HAL.
    8. Jing Wang & Zeyu Xing & Rui Zhang, 2023. "AI technology application and employee responsibility," Palgrave Communications, Palgrave Macmillan, vol. 10(1), pages 1-17, December.
    9. Milan Miric & Nan Jia & Kenneth G. Huang, 2023. "Using supervised machine learning for large‐scale classification in management research: The case for identifying artificial intelligence patents," Strategic Management Journal, Wiley Blackwell, vol. 44(2), pages 491-519, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Peng, Leiqing & Luo, Mengting & Guo, Yulang, 2023. "Deposit AI as the “invisible hand†to make the resale easier: A moderated mediation model," Journal of Retailing and Consumer Services, Elsevier, vol. 75(C).
    2. Keding, Christoph & Meissner, Philip, 2021. "Managerial overreliance on AI-augmented decision-making processes: How the use of AI-based advisory systems shapes choice behavior in R&D investment decisions," Technological Forecasting and Social Change, Elsevier, vol. 171(C).
    3. Jasmine Mondolo, 2022. "The composite link between technological change and employment: A survey of the literature," Journal of Economic Surveys, Wiley Blackwell, vol. 36(4), pages 1027-1068, September.
    4. Genz, Sabrina & Schnabel, Claus, 2021. "Digging into the digital divide: Workers' exposure to digitalization and its consequences for individual employment," Discussion Papers 118, Friedrich-Alexander University Erlangen-Nuremberg, Chair of Labour and Regional Economics.
    5. Linh Tu Ho & Christopher Gan & Shan Jin & Bryan Le, 2022. "Artificial Intelligence and Firm Performance: Does Machine Intelligence Shield Firms from Risks?," JRFM, MDPI, vol. 15(7), pages 1-20, July.
    6. Basso, Henrique S. & Jimeno, Juan F., 2021. "From secular stagnation to robocalypse? Implications of demographic and technological changes," Journal of Monetary Economics, Elsevier, vol. 117(C), pages 833-847.
    7. Cristiano CODAGNONE & Giovanni LIVA & Egidijus BARCEVICIUS & Gianluca MISURACA & Luka KLIMAVICIUTE & Michele BENEDETTI & Irene VANINI & Giancarlo VECCHI & Emily RYEN GLOINSON & Katherine STEWART & Sti, 2020. "Assessing the impacts of digital government transformation in the EU: Conceptual framework and empirical case studies," JRC Research Reports JRC120865, Joint Research Centre.
    8. Venturini, Francesco, 2022. "Intelligent technologies and productivity spillovers: Evidence from the Fourth Industrial Revolution," Journal of Economic Behavior & Organization, Elsevier, vol. 194(C), pages 220-243.
    9. Mahmud, Hasan & Islam, A.K.M. Najmul & Ahmed, Syed Ishtiaque & Smolander, Kari, 2022. "What influences algorithmic decision-making? A systematic literature review on algorithm aversion," Technological Forecasting and Social Change, Elsevier, vol. 175(C).
    10. Zhu, Yimin & Zhang, Jiemin & Wu, Jifei & Liu, Yingyue, 2022. "AI is better when I'm sure: The influence of certainty of needs on consumers' acceptance of AI chatbots," Journal of Business Research, Elsevier, vol. 150(C), pages 642-652.
    11. Zhu, Jun & Zhang, Jingting & Feng, Yiqing, 2022. "Hard budget constraints and artificial intelligence technology," Technological Forecasting and Social Change, Elsevier, vol. 183(C).
    12. Christoph Keding, 2021. "Understanding the interplay of artificial intelligence and strategic management: four decades of research in review," Management Review Quarterly, Springer, vol. 71(1), pages 91-134, February.
    13. Lingli Wang & Ni Huang & Yili Hong & Luning Liu & Xunhua Guo & Guoqing Chen, 2023. "Voice‐based AI in call center customer service: A natural field experiment," Production and Operations Management, Production and Operations Management Society, vol. 32(4), pages 1002-1018, April.
    14. Ozgun, Burcu & Broekel, Tom, 2021. "The geography of innovation and technology news - An empirical study of the German news media," Technological Forecasting and Social Change, Elsevier, vol. 167(C).
    15. Bernardo S Buarque & Ronald B Davies & Ryan M Hynes & Dieter F Kogler, 2020. "OK Computer: the creation and integration of AI in Europe," Cambridge Journal of Regions, Economy and Society, Cambridge Political Economy Society, vol. 13(1), pages 175-192.
    16. Hémous, David & Dechezleprêtre, Antoine & Olsen, Morten & Zanella, carlo, 2019. "Automating Labor: Evidence from Firm-level Patent Data," CEPR Discussion Papers 14249, C.E.P.R. Discussion Papers.
    17. Cebreros Alfonso & Heffner-Rodríguez Aldo & Livas René & Puggioni Daniela, 2020. "Automation Technologies and Employment at Risk: The Case of Mexico," Working Papers 2020-04, Banco de México.
    18. Volkmar, Gioia & Fischer, Peter M. & Reinecke, Sven, 2022. "Artificial Intelligence and Machine Learning: Exploring drivers, barriers, and future developments in marketing management," Journal of Business Research, Elsevier, vol. 149(C), pages 599-614.
    19. Naude, Wim, 2019. "The race against the robots and the fallacy of the giant cheesecake: Immediate and imagined impacts of artificial intelligence," MERIT Working Papers 2019-005, United Nations University - Maastricht Economic and Social Research Institute on Innovation and Technology (MERIT).
    20. Chen Yang & Jing Hu, 2022. "When do consumers prefer AI-enabled customer service? The interaction effect of brand personality and service provision type on brand attitudes and purchase intentions," Journal of Brand Management, Palgrave Macmillan, vol. 29(2), pages 167-189, March.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:stratm:v:42:y:2021:i:9:p:1600-1631. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://onlinelibrary.wiley.com/journal/10.1111/0143-2095 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.