IDEAS home Printed from https://ideas.repec.org/a/eee/bushor/v62y2019i6p785-797.html
   My bibliography  Save this article

In bot we trust: A new methodology of chatbot performance measures

Author

Listed:
  • Przegalinska, Aleksandra
  • Ciechanowski, Leon
  • Stroz, Anna
  • Gloor, Peter
  • Mazurek, Grzegorz

Abstract

Chatbots are used frequently in business to facilitate various processes, particularly those related to customer service and personalization. In this article, we propose novel methods of tracking human-chatbot interactions and measuring chatbot performance that take into consideration ethical concerns, particularly trust. Our proposed methodology links neuroscientific methods, text mining, and machine learning. We argue that trust is the focal point of successful human-chatbot interaction and assess how trust as a relevant category is being redefined with the advent of deep learning supported chatbots. We propose a novel method of analyzing the content of messages produced in human-chatbot interactions, using the Condor Tribefinder system we developed for text mining that is based on a machine learning classification engine. Our results will help build better social bots for interaction in business or commercial environments.

Suggested Citation

  • Przegalinska, Aleksandra & Ciechanowski, Leon & Stroz, Anna & Gloor, Peter & Mazurek, Grzegorz, 2019. "In bot we trust: A new methodology of chatbot performance measures," Business Horizons, Elsevier, vol. 62(6), pages 785-797.
    • Handle: RePEc:eee:bushor:v:62:y:2019:i:6:p:785-797
    DOI: 10.1016/j.bushor.2019.08.005
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S000768131930117X
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.bushor.2019.08.005?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Alun Preece, 2018. "Asking ‘Why’ in AI: Explainability of intelligent systems – perspectives and challenges," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 25(2), pages 63-72, April.
    2. Anna-Maria Seeger & Armin Heinzl, 2018. "Human Versus Machine: Contingency Factors of Anthropomorphism as a Trust-Inducing Design Strategy for Conversational Agents," Lecture Notes in Information Systems and Organization, in: Fred D. Davis & René Riedl & Jan vom Brocke & Pierre-Majorique Léger & Adriane B. Randolph (ed.), Information Systems and Neuroscience, pages 129-139, Springer.
    3. Francesca Grippa & João Leitão & Julia Gluesing & Ken Riopelle & Peter Gloor (ed.), 2018. "Collaborative Innovation Networks," Studies on Entrepreneurship, Structural Change and Industrial Dynamics, Springer, number 978-3-319-74295-3, April.
    4. Bernard Cova & Veronique Cova, 2002. "Tribal marketing: The tribalisation of society and its impact on the conduct of marketing," Post-Print hal-01822665, HAL.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nicoletta Buratti & Francesco Derchi & Giorgia Profumo, 2015. "The blurred boundary between empowered and working consumers: insights from the winner taco case," MERCATI & COMPETITIVIT?, FrancoAngeli Editore, vol. 2015(4), pages 133-156.
    2. Valentina Daniela N. CONSTANTIN & Roxana-Denisa G. STOENESCU, 2014. "The Impact Of Origin On Creating A Cult Brand: The Case Of Apple," SEA - Practical Application of Science, Romanian Foundation for Business Intelligence, Editorial Department, issue 3, pages 123-134, April.
    3. Sharifah Faridah Syed Alwi & T. C. Melewar & Maria Teresa Cuomo & Manfred Schwaiger, 2020. "Digital Society and Corporate Reputation: Towards the Next Generation of Insights," Corporate Reputation Review, Palgrave Macmillan, vol. 23(3), pages 129-132, August.
    4. Krzysztof Herman & Leon Ciechanowski & Aleksandra Przegalińska, 2021. "Emotional Well-Being in Urban Wilderness: Assessing States of Calmness and Alertness in Informal Green Spaces (IGSs) with Muse—Portable EEG Headband," Sustainability, MDPI, vol. 13(4), pages 1-20, February.
    5. Hemant C. Sashittal & Avan R. Jassawalla, 2020. "The personal influence of Instagram bloggers on consumer–brand interactions: brands as tribal artifacts," Journal of Brand Management, Palgrave Macmillan, vol. 27(6), pages 679-690, November.
    6. Baraldi, Enrico & Gressetvold, Espen & Harrison, Debbie, 2012. "Resource interaction in inter-organizational networks: Foundations, comparison, and a research agenda," Journal of Business Research, Elsevier, vol. 65(2), pages 266-276.
    7. Debucquet, G. & Guillotreau, P. & Lazuech, G. & Salladarré, F. & Troiville, J., 2020. "Sense of belonging and commitment to a community-supported fishery. The case of Yeu Island, France," Review of Agricultural, Food and Environmental Studies, Institut National de la Recherche Agronomique (INRA), vol. 101(4), January.
    8. Luigi Cantone & Pierpaolo Testa & Teresa Marrone, 2022. "Issues in defining and placing consumer brand engagement," Italian Journal of Marketing, Springer, vol. 2022(2), pages 135-172, June.
    9. Angelica-Nicoleta NECULAESEI (ONEA), 2017. "Ethnomarketing And Tribal Marketing – General Issues," CrossCultural Management Journal, Fundația Română pentru Inteligența Afacerii, Editorial Department, issue 2, pages 121-127, December.
    10. Hauke A. Wetzel & Stefan Hattula & Maik Hammerschmidt & Harald J. Heerde, 2018. "Building and leveraging sports brands: evidence from 50 years of German professional soccer," Journal of the Academy of Marketing Science, Springer, vol. 46(4), pages 591-611, July.
    11. Thuy Duong Oesterreich & Eduard Anton & Julian Schuir & Alexander Brehm & Frank Teuteberg, 2023. "How can I help you? Design principles for task-oriented speech dialog systems in customer service," Information Systems and e-Business Management, Springer, vol. 21(1), pages 37-79, March.
    12. Contreras, Dante & Elacqua, Gregory & Martinez, Matías & Miranda, Álvaro, 2016. "Bullying, identity and school performance: Evidence from Chile," International Journal of Educational Development, Elsevier, vol. 51(C), pages 147-162.
    13. Rodrigo César Tavares Cavalcanti & André Luiz Maranhão de Souza-Leão & Bruno Melo Moura, 2021. "Fan Affirmation: Alethurgy on an Indie Music Fandom," RAC - Revista de Administração Contemporânea (Journal of Contemporary Administration), ANPAD - Associação Nacional de Pós-Graduação e Pesquisa em Administração, vol. 25(5), pages 190395-1903.
    14. Margurite Hook & Stacey Baxter & Alicia Kulczynski, 2018. "Antecedents and consequences of participation in brand communities: a literature review," Journal of Brand Management, Palgrave Macmillan, vol. 25(4), pages 277-292, July.
    15. Jeremy J. Sierra & Harry A. Taute, 2019. "Brand tribalism in technology and sport: determinants and outcomes," Journal of Brand Management, Palgrave Macmillan, vol. 26(2), pages 209-225, March.
    16. Michaela Merk & Géraldine Michel, 2019. "The dark side of salesperson brand identification in the luxury sector: When brand orientation generates management issues and negative customer perception," Post-Print hal-02045833, HAL.
    17. Chapman, Alexis & Dilmperi, Athina, 2022. "Luxury brand value co-creation with online brand communities in the service encounter," Journal of Business Research, Elsevier, vol. 144(C), pages 902-921.
    18. Nuttall, Peter & Arnold, Sally & Carless, Luke & Crockford, Lily & Finnamore, Katie & Frazier, Richard & Hill, Alicia, 2011. "Understanding music consumption through a tribal lens," Journal of Retailing and Consumer Services, Elsevier, vol. 18(2), pages 152-159.
    19. Dean, Dianne & Arroyo-Gamez, Ramon E. & Punjaisri, Khanyapuss & Pich, Christopher, 2016. "Internal brand co-creation: The experiential brand meaning cycle in higher education," Journal of Business Research, Elsevier, vol. 69(8), pages 3041-3048.
    20. Healy, Michael John & Beverland, Michael B., 2016. "Being sub-culturally authentic and acceptable to the mainstream: Civilizing practices and self-authentication," Journal of Business Research, Elsevier, vol. 69(1), pages 224-233.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:bushor:v:62:y:2019:i:6:p:785-797. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/bushor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.