IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2504.06145.html
   My bibliography  Save this paper

Deploying Chatbots in Customer Service: Adoption Hurdles and Simple Remedies

Author

Listed:
  • Evgeny Kagan
  • Brett Hathaway
  • Maqbool Dada

Abstract

Despite recent advances in Artificial Intelligence, the use of chatbot technology in customer service continues to face adoption hurdles. This paper explores reasons for these adoption hurdles and tests several service design levers to increase chatbot uptake. We use incentivized online experiments to study chatbot uptake in a variety of scenarios. The results of these experiments are threefold. First, people respond positively to improvements in chatbot performance; however, the chatbot channel is utilized less frequently than expected-time minimization would predict. A key driver of this underutilization is the reluctance to engage with a gatekeeper process, i.e., a process with an imperfect initial service stage and possible transfer to a second, expert service stage -- a behavior we term "gatekeeper aversion". We show that gatekeeper aversion can be further amplified by a secondary hurdle, algorithm aversion. Second, chatbot uptake can be increased by providing customers with average waiting times in the chatbot channel, as well as by being more transparent about chatbot capabilities and limitations. Third, methodologically, we show that chatbot adoption can depend on experimental implementation. In particular, chatbot adoption decreases further as (i) stakes are increased, (ii) the human/algorithmic nature of the server is manipulated with more realism. Our results suggest that firms should continue to prioritize investments in chatbot technology. However, less expensive, process-related interventions can also be effective. These may include being more transparent about the types of queries that are (or are not) suitable for chatbots, emphasizing chatbot reliability and quick resolution times, as well as providing faster live agent access to customers who experienced chatbot failure.

Suggested Citation

  • Evgeny Kagan & Brett Hathaway & Maqbool Dada, 2025. "Deploying Chatbots in Customer Service: Adoption Hurdles and Simple Remedies," Papers 2504.06145, arXiv.org.
    • Handle: RePEc:arx:papers:2504.06145
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2504.06145
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Kumar, Piyush & Dada, Maqbool, 2021. "Investigating the impact of service line formats on satisfaction with waiting," International Journal of Research in Marketing, Elsevier, vol. 38(4), pages 974-993.
    2. Robert A. Shumsky & Edieal J. Pinker, 2003. "Gatekeepers and Referrals in Services," Management Science, INFORMS, vol. 49(7), pages 839-856, July.
    3. John A. List & Azeem M. Shaikh & Yang Xu, 2019. "Multiple hypothesis testing in experimental economics," Experimental Economics, Springer;Economic Science Association, vol. 22(4), pages 773-793, December.
    4. Ryan W. Buell, 2021. "Last-Place Aversion in Queues," Management Science, INFORMS, vol. 67(3), pages 1430-1452, March.
    5. Catherine C. Eckel & Philip J. Grossman, 2002. "Sex Differences and Statistical Stereotyping in Attitudes Toward Financial Risk," Monash Economics Working Papers archive-03, Monash University, Department of Economics.
    6. Leclerc, France & Schmitt, Bernd H & Dube, Laurette, 1995. "Waiting Time and Decision Making: Is Time like Money?," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 22(1), pages 110-119, June.
    7. Chiara Longoni & Andrea Bonezzi & Carey K Morewedge, 2019. "Resistance to Medical Artificial Intelligence," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 46(4), pages 629-650.
    8. Naor, P, 1969. "The Regulation of Queue Size by Levying Tolls," Econometrica, Econometric Society, vol. 37(1), pages 15-24, January.
    9. Dilip Soman & Mengze Shi, 2003. "Virtual Progress: The Effect of Path Characteristics on Perceptions of Progress and Choice," Management Science, INFORMS, vol. 49(9), pages 1229-1250, September.
    10. Tversky, Amos & Kahneman, Daniel, 1992. "Advances in Prospect Theory: Cumulative Representation of Uncertainty," Journal of Risk and Uncertainty, Springer, vol. 5(4), pages 297-323, October.
    11. Xueming Luo & Siliang Tong & Zheng Fang & Zhe Qu, 2019. "Frontiers: Machines vs. Humans: The Impact of Artificial Intelligence Chatbot Disclosure on Customer Purchases," Marketing Science, INFORMS, vol. 38(6), pages 937-947, November.
    12. Noah Castelo & Johannes Boegershausen & Christian Hildebrand & Alexander P Henkel & June Cotte & Klaus Wertenbroch, 2023. "Understanding and Improving Consumer Reactions to Service Bots," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 50(4), pages 848-863.
    13. Piyush Kumar & Manohar U. Kalwani & Maqbool Dada, 1997. "The Impact of Waiting Time Guarantees on Customers' Waiting Experiences," Marketing Science, INFORMS, vol. 16(4), pages 295-314.
    14. Andrew Prahl & Lyn Van Swol, 2017. "Understanding algorithm aversion: When is advice from automation discounted?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 36(6), pages 691-702, September.
    15. Jiankun Sun & Dennis J. Zhang & Haoyuan Hu & Jan A. Van Mieghem, 2022. "Predicting Human Discretion to Adjust Algorithmic Prescription: A Large-Scale Field Experiment in Warehouse Operations," Management Science, INFORMS, vol. 68(2), pages 846-865, February.
    16. James C. Cox & Glenn W. Harrison, 2008. "Risk aversion in experiments: An introduction," Research in Experimental Economics, in: Risk Aversion in Experiments, pages 1-7, Emerald Group Publishing Limited.
    17. Ryan W. Buell & Tami Kim & Chia-Jung Tsay, 2017. "Creating Reciprocal Value Through Operational Transparency," Management Science, INFORMS, vol. 63(6), pages 1673-1695, June.
    18. Michael Freeman & Nicos Savva & Stefan Scholtes, 2017. "Gatekeepers at Work: An Empirical Analysis of a Maternity Unit," Management Science, INFORMS, vol. 63(10), pages 3147-3167, October.
    19. Eike B. Kroll & Bodo Vogt, 2008. "Loss Aversion for time: An experimental investigation of time preferences," FEMM Working Papers 08027, Otto-von-Guericke University Magdeburg, Faculty of Economics and Management.
    20. Sheehan, Ben & Jin, Hyun Seung & Gottlieb, Udo, 2020. "Customer service chatbots: Anthropomorphism and adoption," Journal of Business Research, Elsevier, vol. 115(C), pages 14-24.
    21. Ryan W. Buell & Michael I. Norton, 2011. "The Labor Illusion: How Operational Transparency Increases Perceived Value," Management Science, INFORMS, vol. 57(9), pages 1564-1579, February.
    22. Festjens, Anouk & Bruyneel, Sabrina & Diecidue, Enrico & Dewitte, Siegfried, 2015. "Time-based versus money-based decision making under risk: An experimental investigation," Journal of Economic Psychology, Elsevier, vol. 50(C), pages 52-72.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Doll, Monika & Seebauer, Michael & Tonn, Maren, 2017. "Bargaining over waiting time in gain and loss framed ultimatum games," FAU Discussion Papers in Economics 15/2017, Friedrich-Alexander University Erlangen-Nuremberg, Institute for Economics.
    2. Sezer Ülkü & Chris Hydock & Shiliang Cui, 2020. "Making the Wait Worthwhile: Experiments on the Effect of Queueing on Consumption," Management Science, INFORMS, vol. 66(3), pages 1149-1171, March.
    3. Festjens, Anouk & Bruyneel, Sabrina & Diecidue, Enrico & Dewitte, Siegfried, 2015. "Time-based versus money-based decision making under risk: An experimental investigation," Journal of Economic Psychology, Elsevier, vol. 50(C), pages 52-72.
    4. Ruijie Zhang & Xiaohua Han & Rowan Wang & Jianghua Zhang & Yinghao Zhang, 2023. "Please don't make me wait! Influence of customers' waiting preference and no‐show behavior on appointment systems," Production and Operations Management, Production and Operations Management Society, vol. 32(6), pages 1597-1616, June.
    5. Tinglong Dai & Sridhar Tayur, 2022. "Designing AI‐augmented healthcare delivery systems for physician buy‐in and patient acceptance," Production and Operations Management, Production and Operations Management Society, vol. 31(12), pages 4443-4451, December.
    6. Ryan W. Buell, 2017. "Last Place Aversion in Queues," Harvard Business School Working Papers 18-053, Harvard Business School, revised Oct 2019.
    7. Zhu, Yimin & Zhang, Jiemin & Wu, Jifei & Liu, Yingyue, 2022. "AI is better when I'm sure: The influence of certainty of needs on consumers' acceptance of AI chatbots," Journal of Business Research, Elsevier, vol. 150(C), pages 642-652.
    8. Oualid Jouini & Zeynep Akşin & Yves Dallery, 2011. "Call Centers with Delay Information: Models and Insights," Manufacturing & Service Operations Management, INFORMS, vol. 13(4), pages 534-548, October.
    9. Zhang, Yaqiong & Wang, Shifu, 2023. "The influence of anthropomorphic appearance of artificial intelligence products on consumer behavior and brand evaluation under different product types," Journal of Retailing and Consumer Services, Elsevier, vol. 74(C).
    10. Chugunova, Marina & Sele, Daniela, 2022. "We and It: An interdisciplinary review of the experimental evidence on how humans interact with machines," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 99(C).
    11. Diwas S. KC & Bradley R. Staats & Maryam Kouchaki & Francesca Gino, 2020. "Task Selection and Workload: A Focus on Completing Easy Tasks Hurts Performance," Management Science, INFORMS, vol. 66(10), pages 4397-4416, October.
    12. Gabriel R. Bitran & Juan-Carlos Ferrer & Paulo Rocha e Oliveira, 2008. "OM Forum--Managing Customer Experiences: Perspectives on the Temporal Aspects of Service Encounters," Manufacturing & Service Operations Management, INFORMS, vol. 10(1), pages 61-83, July.
    13. Mustafa Akan & Barı ş Ata & Tava Olsen, 2012. "Congestion-Based Lead-Time Quotation for Heterogenous Customers with Convex-Concave Delay Costs: Optimality of a Cost-Balancing Policy Based on Convex Hull Functions," Operations Research, INFORMS, vol. 60(6), pages 1505-1519, December.
    14. Qiuping Yu & Yiming Zhang & Yong-Pin Zhou, 2022. "Delay Information in Virtual Queues: A Large-Scale Field Experiment on a Major Ride-Sharing Platform," Management Science, INFORMS, vol. 68(8), pages 5745-5757, August.
    15. Ryan W. Buell, 2021. "Last-Place Aversion in Queues," Management Science, INFORMS, vol. 67(3), pages 1430-1452, March.
    16. Yuanyuan Zhou & Zhuoying Fei & Yuanqiong He & Zhilin Yang, 2022. "How Human–Chatbot Interaction Impairs Charitable Giving: The Role of Moral Judgment," Journal of Business Ethics, Springer, vol. 178(3), pages 849-865, July.
    17. Yui Law & Sinchit Lai & Ning Liu, 2025. "Leniency experiments: an evaluation of external validity," European Journal of Law and Economics, Springer, vol. 59(1), pages 19-76, February.
    18. Leah Warfield Smith & Randall Lee Rose & Alex R. Zablah & Heath McCullough & Mohammad “Mike” Saljoughian, 2023. "Examining post-purchase consumer responses to product automation," Journal of the Academy of Marketing Science, Springer, vol. 51(3), pages 530-550, May.
    19. Katharina Klein & Luis F. Martinez, 2023. "The impact of anthropomorphism on customer satisfaction in chatbot commerce: an experimental study in the food sector," Electronic Commerce Research, Springer, vol. 23(4), pages 2789-2825, December.
    20. Siliang Tong & Nan Jia & Xueming Luo & Zheng Fang, 2021. "The Janus face of artificial intelligence feedback: Deployment versus disclosure effects on employee performance," Strategic Management Journal, Wiley Blackwell, vol. 42(9), pages 1600-1631, September.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2504.06145. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.