IDEAS home Printed from https://ideas.repec.org/a/eee/jbrese/v145y2022icp552-568.html

Classifying and measuring the service quality of AI chatbot in frontline service

Author

Listed:
  • Chen, Qian
  • Gong, Yeming
  • Lu, Yaobin
  • Tang, Jing

Abstract

AI chatbots have been widely applied in the frontline to serve customers. Yet, the existing dimensions and scales of service quality can hardly fit the new AI environment. To address this gap, we define the dimensions of AI chatbot service quality (AICSQ) and develop the associated scales with a mixed-method approach. In the qualitative analysis, with the coding of the interviews from 55 global organizations in 17 countries and 47 customers, we develop new multi-level dimensions of AICSQ, including seven second-order and 18 first-order constructs. Then we follow a 10-step scale development method to establish the valid scales. The nomological test result shows that AICSQ positively influences customers’ satisfaction with, perceived value of, and intention of continuous use of AI chatbots. The innovative dimensions and scales of AI chatbot service quality provide conceptual classification and measurement instruments for the future study of chatbot service in the frontline.

Suggested Citation

  • Chen, Qian & Gong, Yeming & Lu, Yaobin & Tang, Jing, 2022. "Classifying and measuring the service quality of AI chatbot in frontline service," Journal of Business Research, Elsevier, vol. 145(C), pages 552-568.
    • Handle: RePEc:eee:jbrese:v:145:y:2022:i:c:p:552-568
    DOI: 10.1016/j.jbusres.2022.02.088
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0148296322002272
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jbusres.2022.02.088?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Loureiro, Sandra Maria Correia & Guerreiro, João & Tussyadiah, Iis, 2021. "Artificial intelligence in business: State of the art and future research agenda," Journal of Business Research, Elsevier, vol. 129(C), pages 911-926.
    2. Kar Yan Tam & Shuk Ying Ho, 2005. "Web Personalization as a Persuasion Strategy: An Elaboration Likelihood Model Perspective," Information Systems Research, INFORMS, vol. 16(3), pages 271-291, September.
    3. Barbara H. Wixom & Peter A. Todd, 2005. "A Theoretical Integration of User Satisfaction and Technology Acceptance," Information Systems Research, INFORMS, vol. 16(1), pages 85-102, March.
    4. Sulin Ba & Jan Stallaert & Zhongju Zhang, 2010. "Balancing IT with the Human Touch: Optimal Investment in IT-Based Customer Service," Information Systems Research, INFORMS, vol. 21(3), pages 423-442, September.
    5. Thomas P. Novak & Donna L. Hoffman, 2019. "Relationship journeys in the internet of things: a new framework for understanding interactions between consumers and smart objects," Journal of the Academy of Marketing Science, Springer, vol. 47(2), pages 216-237, March.
    6. Murtarelli, Grazia & Gregory, Anne & Romenti, Stefania, 2021. "A conversation-based perspective for shaping ethical human–machine interactions: The particular challenge of chatbots," Journal of Business Research, Elsevier, vol. 129(C), pages 927-935.
    7. William H. DeLone & Ephraim R. McLean, 1992. "Information Systems Success: The Quest for the Dependent Variable," Information Systems Research, INFORMS, vol. 3(1), pages 60-95, March.
    8. Sheehan, Ben & Jin, Hyun Seung & Gottlieb, Udo, 2020. "Customer service chatbots: Anthropomorphism and adoption," Journal of Business Research, Elsevier, vol. 115(C), pages 14-24.
    9. Rijsdijk, S.A. & Hultink, E.J. & Diamantopoulos, A., 2007. "Product Intelligence: Its Conceptualization, Measurement and Impact on Consumer Satisfaction," ERIM Report Series Research in Management ERS-2007-006-ORG, Erasmus Research Institute of Management (ERIM), ERIM is the joint research institute of the Rotterdam School of Management, Erasmus University and the Erasmus School of Economics (ESE) at Erasmus University Rotterdam.
    10. Ronald T. Cenfetelli & Izak Benbasat & Sameh Al-Natour, 2008. "Addressing the What and How of Online Services: Positioning Supporting-Services Functionality and Service Quality for Business-to-Consumer Success," Information Systems Research, INFORMS, vol. 19(2), pages 161-181, June.
    11. Felipe Thomaz & Carolina Salge & Elena Karahanna & John Hulland, 2020. "Learning from the Dark Web: leveraging conversational agents in the era of hyper-privacy to enhance marketing," Journal of the Academy of Marketing Science, Springer, vol. 48(1), pages 43-63, January.
    12. Xueming Luo & Siliang Tong & Zheng Fang & Zhe Qu, 2019. "Frontiers: Machines vs. Humans: The Impact of Artificial Intelligence Chatbot Disclosure on Customer Purchases," Marketing Science, INFORMS, vol. 38(6), pages 937-947, November.
    13. Jonathan W. Palmer, 2002. "Web Site Usability, Design, and Performance Metrics," Information Systems Research, INFORMS, vol. 13(2), pages 151-167, June.
    14. James A. Mourey & Jenny G. Olson & Carolyn Yoon, 2017. "Products as Pals: Engaging with Anthropomorphic Products Mitigates the Effects of Social Exclusion," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 44(2), pages 414-431.
    15. Zied Mani & Inès Chouk, 2018. "Consumer resistance to innovation in services: Challenges and barriers in the Internet of Things era," Post-Print hal-03700875, HAL.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Justina Sidlauskiene & Yannick Joye & Vilte Auruskeviciene, 2023. "AI-based chatbots in conversational commerce and their effects on product and price perceptions," Electronic Markets, Springer;IIM University of St. Gallen, vol. 33(1), pages 1-21, December.
    2. Mariani, Marcello M. & Hashemi, Novin & Wirtz, Jochen, 2023. "Artificial intelligence empowered conversational agents: A systematic literature review and research agenda," Journal of Business Research, Elsevier, vol. 161(C).
    3. Mark Anthony Camilleri & Ciro Troise, 2023. "Live support by chatbots with artificial intelligence: A future research agenda," Service Business, Springer;Pan-Pacific Business Association, vol. 17(1), pages 61-80, March.
    4. Baabdullah, Abdullah M. & Alalwan, Ali Abdallah & Algharabat, Raed S. & Metri, Bhimaraya & Rana, Nripendra P., 2022. "Virtual agents and flow experience: An empirical examination of AI-powered chatbots," Technological Forecasting and Social Change, Elsevier, vol. 181(C).
    5. Sriram Thirumalai & Kingshuk K. Sinha, 2013. "To Personalize or Not to Personalize Online Purchase Interactions: Implications of Self-Selection by Retailers," Information Systems Research, INFORMS, vol. 24(3), pages 683-708, September.
    6. Dimitrios Tsekouras & Dominik Gutt & Irina Heimbach, 2024. "The robo bias in conversational reviews: How the solicitation medium anthropomorphism affects product rating valence and review helpfulness," Journal of the Academy of Marketing Science, Springer, vol. 52(6), pages 1651-1672, November.
    7. Ming-Hui Huang & Roland T. Rust, 2021. "A strategic framework for artificial intelligence in marketing," Journal of the Academy of Marketing Science, Springer, vol. 49(1), pages 30-50, January.
    8. Song, Jaeki & Baker, Jeff & Lee, Sangno & Wetherbe, James C., 2012. "Examining online consumers’ behavior: A service-oriented view," International Journal of Information Management, Elsevier, vol. 32(3), pages 221-231.
    9. Massilva Dekkal & Manon Arcand & Sandrine Prom Tep & Lova Rajaobelina & Line Ricard, 2024. "Factors affecting user trust and intention in adopting chatbots: the moderating role of technology anxiety in insurtech," Journal of Financial Services Marketing, Palgrave Macmillan, vol. 29(3), pages 699-728, September.
    10. Selamat, Moch Akbar & Windasari, Nila Armelia, 2021. "Chatbot for SMEs: Integrating customer and business owner perspectives," Technology in Society, Elsevier, vol. 66(C).
    11. Alabed, Amani & Javornik, Ana & Gregory-Smith, Diana, 2022. "AI anthropomorphism and its effect on users' self-congruence and self–AI integration: A theoretical framework and research agenda," Technological Forecasting and Social Change, Elsevier, vol. 182(C).
    12. Hwang, ShinYoung, 2018. "Would satisfaction with smart speakers transfer into loyalty towards the smart speaker provider?," 22nd ITS Biennial Conference, Seoul 2018. Beyond the boundaries: Challenges for business, policy and society 190336, International Telecommunications Society (ITS).
    13. Rajat Kumar Behera & Pradip Kumar Bala & Arghya Ray, 2024. "Cognitive Chatbot for Personalised Contextual Customer Service: Behind the Scene and beyond the Hype," Information Systems Frontiers, Springer, vol. 26(3), pages 899-919, June.
    14. Murtaza, Zara & Sharma, Isha & Carbonell, Pilar, 2024. "Examining chatbot usage intention in a service encounter: Role of task complexity, communication style, and brand personality," Technological Forecasting and Social Change, Elsevier, vol. 209(C).
    15. Shengliang Zhang & Xinfeng Lin & Xiaodong Li & Ai Ren, 2022. "Service robots’ anthropomorphism: dimensions, factors and internal relationships," Electronic Markets, Springer;IIM University of St. Gallen, vol. 32(1), pages 277-295, March.
    16. Kull, Alexander J. & Romero, Marisabel & Monahan, Lisa, 2021. "How may I help you? Driving brand engagement through the warmth of an initial chatbot message," Journal of Business Research, Elsevier, vol. 135(C), pages 840-850.
    17. Darima Fotheringham & Michael A. Wiles, 2023. "The effect of implementing chatbot customer service on stock returns: an event study analysis," Journal of the Academy of Marketing Science, Springer, vol. 51(4), pages 802-822, July.
    18. Meng, Lu (Monroe) & Li, Tongmao & Shi, Xiaolin (Crystal) & Huang, Xin, 2023. "Double-sided messages improve the acceptance of chatbots," Annals of Tourism Research, Elsevier, vol. 102(C).
    19. Katharina Klein & Luis F. Martinez, 2023. "The impact of anthropomorphism on customer satisfaction in chatbot commerce: an experimental study in the food sector," Electronic Commerce Research, Springer, vol. 23(4), pages 2789-2825, December.
    20. Yi Sun & Shihui Li & Lingling Yu, 2022. "The dark sides of AI personal assistant: effects of service failure on user continuance intention," Electronic Markets, Springer;IIM University of St. Gallen, vol. 32(1), pages 17-39, March.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jbrese:v:145:y:2022:i:c:p:552-568. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jbusres .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.