IDEAS home Printed from https://ideas.repec.org/a/eee/jbrese/v192y2025ics0148296325001055.html
   My bibliography  Save this article

Serve with voice: The role of agents’ vocal cues in the call center service

Author

Listed:
  • Zhou, Yuanyuan
  • Fei, Zhuoying
  • Yang, Jun
  • Kong, Demei

Abstract

Since pure voice-to-voice communications mainly characterize the call center context, vocal cues provide a novel lens to comprehend consumer-agent dynamics beyond mere words. This study proposes an analytical framework exploiting speech recognition and interpretable machine learning to convert unstructured audio data into quantifiable measures and examines the impact of agents’ voices in a natural setting. The results show that incorporating agents’ vocal cues into consumer dissatisfaction and callback analysis improves out-of-sample forecast accuracy, with an average improvement of 11.65% and 4.30%, respectively. Vocal cues surpass verbal and demographic variables in predictive importance. An affirmative tone and a relatively quick speech rate are identified as key factors that significantly reduce dissatisfaction and callbacks. Our proposed voice feature framework enhances telephone-based service quality assessment, offers practical insights for agent training, and provides novel insights to improve consumer service operations, ultimately leading to the maximization of financial benefits.

Suggested Citation

  • Zhou, Yuanyuan & Fei, Zhuoying & Yang, Jun & Kong, Demei, 2025. "Serve with voice: The role of agents’ vocal cues in the call center service," Journal of Business Research, Elsevier, vol. 192(C).
    • Handle: RePEc:eee:jbrese:v:192:y:2025:i:c:s0148296325001055
    DOI: 10.1016/j.jbusres.2025.115282
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0148296325001055
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jbusres.2025.115282?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Josie I Chen & Tai-Sen He & Hsin-Ya Liao, 2022. "Does speech rate influence intertemporal decisions? an experimental investigation," PLOS ONE, Public Library of Science, vol. 17(2), pages 1-8, February.
    2. Chiara Longoni & Andrea Bonezzi & Carey K Morewedge, 2019. "Resistance to Medical Artificial Intelligence," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 46(4), pages 629-650.
    3. repec:oup:jconrs:v:47:y:2021:i:5:p:787-806. is not listed on IDEAS
    4. Ruomeng Cui & Santiago Gallino & Antonio Moreno & Dennis J. Zhang, 2018. "The Operational Value of Social Media Information," Production and Operations Management, Production and Operations Management Society, vol. 27(10), pages 1749-1769, October.
    5. Pascal Belin & Robert J. Zatorre & Philippe Lafaille & Pierre Ahad & Bruce Pike, 2000. "Voice-selective areas in human auditory cortex," Nature, Nature, vol. 403(6767), pages 309-312, January.
    6. Kejia Hu & Gad Allon & Achal Bassamboo, 2022. "Understanding Customer Retrials in Call Centers: Preferences for Service Quality and Service Speed," Manufacturing & Service Operations Management, INFORMS, vol. 24(2), pages 1002-1020, March.
    7. Casey A Klofstad & Rindy C Anderson & Stephen Nowicki, 2015. "Perceptions of Competence, Strength, and Age Influence Voters to Select Leaders with Lower-Pitched Voices," PLOS ONE, Public Library of Science, vol. 10(8), pages 1-14, August.
    8. Bitty Balducci & Detelina Marinova, 2018. "Unstructured data in marketing," Journal of the Academy of Marketing Science, Springer, vol. 46(4), pages 557-590, July.
    9. Davazdahemami, Behrooz & Kalgotra, Pankush & Zolbanin, Hamed M. & Delen, Dursun, 2023. "A developer-oriented recommender model for the app store: A predictive network analytics approach," Journal of Business Research, Elsevier, vol. 158(C).
    10. Hildebrand, Christian & Efthymiou, Fotis & Busquet, Francesc & Hampton, William H. & Hoffman, Donna L. & Novak, Thomas P., 2020. "Voice analytics in business research: Conceptual foundations, acoustic feature extraction, and applications," Journal of Business Research, Elsevier, vol. 121(C), pages 364-374.
    11. Xin (Shane) Wang & Shijie Lu & X I Li & Mansur Khamitov & Neil Bendle & J. Jeffrey Inman & Andrew T Stephen, 2021. "Audio Mining: The Role of Vocal Tone in Persuasion," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 48(2), pages 189-211.
    12. Ozkan-Tektas, Oznur & Basgoze, Pinar, 2017. "Pre-recovery emotions and satisfaction: A moderated mediation model of service recovery and reputation in the banking sector," European Management Journal, Elsevier, vol. 35(3), pages 388-395.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Allison, Thomas H. & Warnick, Benjamin J. & Davis, Blakley C. & Cardon, Melissa S., 2022. "Can you hear me now? Engendering passion and preparedness perceptions with vocal expressions in crowdfunding pitches," Journal of Business Venturing, Elsevier, vol. 37(3).
    2. Xin (Shane) Wang & Neil Bendle & Yinjie Pan, 2024. "Beyond text: Marketing strategy in a world turned upside down," Journal of the Academy of Marketing Science, Springer, vol. 52(4), pages 939-954, July.
    3. Zhu, Jingjie & Cheng, Mingming, 2024. "Automatic video analytics in tourism: A methodological review," Annals of Tourism Research, Elsevier, vol. 108(C).
    4. Lingli Wang & Ni Huang & Yili Hong & Luning Liu & Xunhua Guo & Guoqing Chen, 2023. "Voice‐based AI in call center customer service: A natural field experiment," Production and Operations Management, Production and Operations Management Society, vol. 32(4), pages 1002-1018, April.
    5. Oliver Schaer & Nikolaos Kourentzes & Robert Fildes, 2022. "Predictive competitive intelligence with prerelease online search traffic," Production and Operations Management, Production and Operations Management Society, vol. 31(10), pages 3823-3839, October.
    6. Ming-Hui Huang & Roland T. Rust, 2021. "A strategic framework for artificial intelligence in marketing," Journal of the Academy of Marketing Science, Springer, vol. 49(1), pages 30-50, January.
    7. Shuili Du & Assaad El Akremi & Ming Jia, 2023. "Quantitative Research on Corporate Social Responsibility: A Quest for Relevance and Rigor in a Quickly Evolving, Turbulent World," Journal of Business Ethics, Springer, vol. 187(1), pages 1-15, September.
    8. Grewal, Dhruv & Herhausen, Dennis & Ludwig, Stephan & Villarroel Ordenes, Francisco, 2022. "The Future of Digital Communication Research: Considering Dynamics and Multimodality," Journal of Retailing, Elsevier, vol. 98(2), pages 224-240.
    9. Ding, Zhenbin & Zhang, Yali & Sun, Jun & Goh, Mark & Yang, Zhaojun, 2025. "To reveal or conceal: AI identity disclosure strategies for merchants," International Journal of Production Economics, Elsevier, vol. 283(C).
    10. Schraml, Christopher, 2025. "Automated Video Analytics in Marketing Research: A Systematic Literature Review and a Novel Multimodal Large Language Model Method," OSF Preprints 63nbc_v1, Center for Open Science.
    11. Huang, Ming-Hui & Rust, Roland T., 2022. "A Framework for Collaborative Artificial Intelligence in Marketing," Journal of Retailing, Elsevier, vol. 98(2), pages 209-223.
    12. Chen, Changdong, 2024. "How consumers respond to service failures caused by algorithmic mistakes: The role of algorithmic interpretability," Journal of Business Research, Elsevier, vol. 176(C).
    13. Tinglong Dai & Sridhar Tayur, 2022. "Designing AI‐augmented healthcare delivery systems for physician buy‐in and patient acceptance," Production and Operations Management, Production and Operations Management Society, vol. 31(12), pages 4443-4451, December.
    14. Leah Warfield Smith & Randall Lee Rose & Alex R. Zablah & Heath McCullough & Mohammad “Mike” Saljoughian, 2023. "Examining post-purchase consumer responses to product automation," Journal of the Academy of Marketing Science, Springer, vol. 51(3), pages 530-550, May.
    15. Chou, Ping & Chuang, Howard Hao-Chun & Chou, Yen-Chun & Liang, Ting-Peng, 2022. "Predictive analytics for customer repurchase: Interdisciplinary integration of buy till you die modeling and machine learning," European Journal of Operational Research, Elsevier, vol. 296(2), pages 635-651.
    16. Yoganathan, Vignesh & Osburg, Victoria-Sophie, 2024. "The mind in the machine: Estimating mind perception's effect on user satisfaction with voice-based conversational agents," Journal of Business Research, Elsevier, vol. 175(C).
    17. Siliang Tong & Nan Jia & Xueming Luo & Zheng Fang, 2021. "The Janus face of artificial intelligence feedback: Deployment versus disclosure effects on employee performance," Strategic Management Journal, Wiley Blackwell, vol. 42(9), pages 1600-1631, September.
    18. Shrestha, Yash Raj & Krishna, Vaibhav & von Krogh, Georg, 2021. "Augmenting organizational decision-making with deep learning algorithms: Principles, promises, and challenges," Journal of Business Research, Elsevier, vol. 123(C), pages 588-603.
    19. Chamaret, Cécile & Steyer, Véronique & Mayer, Julie C., 2020. "“Hands off my meter!” when municipalities resist smart meters: Linking arguments and degrees of resistance," Energy Policy, Elsevier, vol. 144(C).
    20. Borah, Abhishek & Rutz, Oliver, 2024. "Enhanced sales forecasting model using textual search data: Fusing dynamics with big data," International Journal of Research in Marketing, Elsevier, vol. 41(4), pages 632-647.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jbrese:v:192:y:2025:i:c:s0148296325001055. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jbusres .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.