IDEAS home Printed from https://ideas.repec.org/a/spr/soinre/v178y2025i3d10.1007_s11205-024-03362-3.html
   My bibliography  Save this article

Importance Performance Matrix Analysis for Assessing User Experience with Intelligent Voice Assistants: A Strategic Evaluation

Author

Listed:
  • Rosanna Cataldo

    (University of Naples Federico II)

  • Martha Friel

    (IULM)

  • Maria Gabriella Grassia

    (University of Naples Federico II)

  • Marina Marino

    (University of Naples Federico II)

  • Emma Zavarrone

    (IULM)

Abstract

The digital transformation, in which we have actively participated over the last decades, involves integrating new technology into every aspect of the business and necessitates a significant overhaul of traditional business structures. Recently there has been an exponential increase in the presence of Artificial Intelligence (AI) in people’s daily lives, and many new AI-infused products have been developed. This technology is relatively young and has the potential to significantly affect both industry and society. The paper focuses on the Intelligent Voice Assistants (IVAs) and the User eXperience (UX) evaluation. IVAs are a relatively new phenomenon that has generated much academic and industrial research interest. Starting from the contribution to systematization provided by the Artificial Intelligence User Experience (AIXE®) scale, the idea is to develop an easy UX evaluation tool for IVAs that decision-makers can adopt. The work proposes the Partial Least Squares-Path Modeling (PLS-PM) to investigate different dimensions that affect the UX, and to verify if it becomes possible to quantify the impact and performance of each dimension on the general latent dimension of UX. The Importance Performance Matrix Analysis (IPMA) is utilised to evaluate and identify the primary factors that significantly influence the adoption of IVAs. IVA developers should examine the main aspects as a guide to enhancing the UX for individuals utilising IVAs.

Suggested Citation

  • Rosanna Cataldo & Martha Friel & Maria Gabriella Grassia & Marina Marino & Emma Zavarrone, 2025. "Importance Performance Matrix Analysis for Assessing User Experience with Intelligent Voice Assistants: A Strategic Evaluation," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 178(3), pages 1053-1079, July.
    • Handle: RePEc:spr:soinre:v:178:y:2025:i:3:d:10.1007_s11205-024-03362-3
    DOI: 10.1007/s11205-024-03362-3
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11205-024-03362-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11205-024-03362-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Chiara Longoni & Andrea Bonezzi & Carey K Morewedge, 2019. "Resistance to Medical Artificial Intelligence," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 46(4), pages 629-650.
    2. Kasilingam, Dharun Lingam, 2020. "Understanding the attitude and intention to use smartphone chatbots for shopping," Technology in Society, Elsevier, vol. 62(C).
    3. Jyoti Rana & Loveleen Gaur & Gurmeet Singh & Usama Awan & Muhammad Imran Rasheed, 2021. "Reinforcing customer journey through artificial intelligence: a review and research agenda," International Journal of Emerging Markets, Emerald Group Publishing Limited, vol. 17(7), pages 1738-1758, December.
    4. Jain, Shilpi & Basu, Sriparna & Dwivedi, Yogesh K & Kaur, Sumeet, 2022. "Interactive voice assistants – Does brand credibility assuage privacy risks?," Journal of Business Research, Elsevier, vol. 139(C), pages 701-717.
    5. Jones, Valerie K., 2018. "Voice-activated change: Marketing in the age of artificial intelligence and virtual assistants," Journal of Brand Strategy, Henry Stewart Publications, vol. 7(3), pages 233-245, December.
    6. Joseph F. Hair & G. Tomas M. Hult & Christian M. Ringle & Marko Sarstedt & Kai Oliver Thiele, 2017. "Mirror, mirror on the wall: a comparative evaluation of composite-based structural equation modeling methods," Journal of the Academy of Marketing Science, Springer, vol. 45(5), pages 616-632, September.
    7. Hasan, Rajibul & Shams, Riad & Rahman, Mizan, 2021. "Consumer trust and perceived risk for voice-controlled artificial intelligence: The case of Siri," Journal of Business Research, Elsevier, vol. 131(C), pages 591-597.
    8. Arts, Joep W.C. & Frambach, Ruud T. & Bijmolt, Tammo H.A., 2011. "Generalizations on consumer innovation adoption: A meta-analysis on drivers of intention and behavior," International Journal of Research in Marketing, Elsevier, vol. 28(2), pages 134-144.
    9. Jerónimo García-Fernández & Jesús Fernández-Gavira & Antonio Jesús Sánchez-Oliver & Pablo Gálvez-Ruíz & Moisés Grimaldi-Puyana & Gabriel Cepeda-Carrión, 2020. "Importance-Performance Matrix Analysis (IPMA) to Evaluate Servicescape Fitness Consumer by Gender and Age," IJERPH, MDPI, vol. 17(18), pages 1-19, September.
    10. Natale Carlo Lauro & Maria Gabriella Grassia & Rosanna Cataldo, 2018. "Model Based Composite Indicators: New Developments in Partial Least Squares-Path Modeling for the Building of Different Types of Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 135(2), pages 421-455, January.
    11. Rosanna Cataldo & Corrado Crocetta & Maria Gabriella Grassia & Natale Carlo Lauro & Marina Marino & Viktoriya Voytsekhovska, 2021. "Methodological PLS-PM Framework for SDGs System," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 156(2), pages 701-723, August.
    12. Chang, Woojung & Franke, George R. & Lee, Nick, 2016. "Comparing reflective and formative measures: New insights from relevant simulations," Journal of Business Research, Elsevier, vol. 69(8), pages 3177-3185.
    13. Thomas Davenport & Abhijit Guha & Dhruv Grewal & Timna Bressgott, 2020. "How artificial intelligence will change the future of marketing," Journal of the Academy of Marketing Science, Springer, vol. 48(1), pages 24-42, January.
    14. Collins, Christopher & Dennehy, Denis & Conboy, Kieran & Mikalef, Patrick, 2021. "Artificial intelligence in information systems research: A systematic literature review and research agenda," International Journal of Information Management, Elsevier, vol. 60(C).
    15. Heetae Yang & Hwansoo Lee, 2019. "Understanding user behavior of virtual personal assistant devices," Information Systems and e-Business Management, Springer, vol. 17(1), pages 65-87, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mariani, Marcello M. & Hashemi, Novin & Wirtz, Jochen, 2023. "Artificial intelligence empowered conversational agents: A systematic literature review and research agenda," Journal of Business Research, Elsevier, vol. 161(C).
    2. Zhang, Yangting & Fang, Jiaming & Liao, Miyan & Han, Lintong & Wen, Chao & Clement, Addo Prince, 2025. "Typography meets question type: Unveiling their matching effect on willingness to pay for AI products," Journal of Business Research, Elsevier, vol. 192(C).
    3. Jan, Ihsan Ullah & Ji, Seonggoo & Kim, Changju, 2023. "What (de) motivates customers to use AI-powered conversational agents for shopping? The extended behavioral reasoning perspective," Journal of Retailing and Consumer Services, Elsevier, vol. 75(C).
    4. Vlačić, Božidar & Corbo, Leonardo & Costa e Silva, Susana & Dabić, Marina, 2021. "The evolving role of artificial intelligence in marketing: A review and research agenda," Journal of Business Research, Elsevier, vol. 128(C), pages 187-203.
    5. Cataldo, Rosanna & Cascella, Clelia & Grassia, Maria Gabriella & Lauro, Carlo Natale & Voytsekhovska, Viktoriya, 2024. "A PLS-Hierarchical Path Modeling approach to analyze and address gender equality in the EU countries," Socio-Economic Planning Sciences, Elsevier, vol. 96(C).
    6. Arce-Urriza, Marta & Chocarro, Raquel & Cortiñas, Mónica & Marcos-Matás, Gustavo, 2025. "From familiarity to acceptance: The impact of Generative Artificial Intelligence on consumer adoption of retail chatbots," Journal of Retailing and Consumer Services, Elsevier, vol. 84(C).
    7. Manjunath Padigar & Ljubomir Pupovac & Ashish Sinha & Rajendra Srivastava, 2022. "The effect of marketing department power on investor responses to announcements of AI-embedded new product innovations," Journal of the Academy of Marketing Science, Springer, vol. 50(6), pages 1277-1298, November.
    8. Rohit, Kumar & Shankar, Amit & Katiyar, Gagan & Mehrotra, Ankit & Alzeiby, Ebtesam Abdullah, 2024. "Consumer engagement in chatbots and voicebots. A multiple-experiment approach in online retailing context," Journal of Retailing and Consumer Services, Elsevier, vol. 78(C).
    9. Leah Warfield Smith & Randall Lee Rose & Alex R. Zablah & Heath McCullough & Mohammad “Mike” Saljoughian, 2023. "Examining post-purchase consumer responses to product automation," Journal of the Academy of Marketing Science, Springer, vol. 51(3), pages 530-550, May.
    10. Habib, Muhammad Danish & Attri, Rekha & Salam, Mohammad Asif & Yaqub, Muhammad Zafar, 2025. "Retail consumers' conundrum: An in-depth qualitative study navigating the motivations and aversion of chatbots," Journal of Retailing and Consumer Services, Elsevier, vol. 82(C).
    11. Poushneh, Atieh & Vasquez-Parraga, Arturo & Gearhart, Richard S., 2024. "The effect of empathetic response and consumers’ narcissism in voice-based artificial intelligence," Journal of Retailing and Consumer Services, Elsevier, vol. 79(C).
    12. David A. Schweidel & Yakov Bart & J. Jeffrey Inman & Andrew T. Stephen & Barak Libai & Michelle Andrews & Ana Babić Rosario & Inyoung Chae & Zoey Chen & Daniella Kupor & Chiara Longoni & Felipe Thomaz, 2022. "How consumer digital signals are reshaping the customer journey," Journal of the Academy of Marketing Science, Springer, vol. 50(6), pages 1257-1276, November.
    13. Zhang, Yaqiong & Wang, Shifu, 2023. "The influence of anthropomorphic appearance of artificial intelligence products on consumer behavior and brand evaluation under different product types," Journal of Retailing and Consumer Services, Elsevier, vol. 74(C).
    14. Chenfeng Yan & Quan Chen & Xinyue Zhou & Xin Dai & Zhilin Yang, 2024. "When the Automated fire Backfires: The Adoption of Algorithm-based HR Decision-making Could Induce Consumer’s Unfavorable Ethicality Inferences of the Company," Journal of Business Ethics, Springer, vol. 190(4), pages 841-859, April.
    15. Maduku, Daniel K. & Mpinganjira, Mercy & Rana, Nripendra P. & Thusi, Philile & Ledikwe, Aobakwe & Mkhize, Njabulo Happy-boy, 2023. "Assessing customer passion, commitment, and word-of-mouth intentions in digital assistant usage: The moderating role of technology anxiety," Journal of Retailing and Consumer Services, Elsevier, vol. 71(C).
    16. Vasileva Steliana, 2025. "The Impact of AI along the Customer Journey Mapping: How AI Agents are Changing Customer Journey," Proceedings of the International Conference on Business Excellence, Sciendo, vol. 19(1), pages 1088-1102.
    17. Jochen Wirtz & Valentina Pitardi, 2023. "How intelligent automation, service robots, and AI will reshape service products and their delivery," Italian Journal of Marketing, Springer, vol. 2023(3), pages 289-300, September.
    18. Maroufkhani, Parisa & Asadi, Shahla & Ghobakhloo, Morteza & Jannesari, Milad T. & Ismail, Wan Khairuzaman Wan, 2022. "How do interactive voice assistants build brands' loyalty?," Technological Forecasting and Social Change, Elsevier, vol. 183(C).
    19. Ming-Hui Huang & Roland T. Rust, 2021. "A strategic framework for artificial intelligence in marketing," Journal of the Academy of Marketing Science, Springer, vol. 49(1), pages 30-50, January.
    20. Abhijit Guha & Timna Bressgott & Dhruv Grewal & Dominik Mahr & Martin Wetzels & Elisa Schweiger, 2023. "How artificiality and intelligence affect voice assistant evaluations," Journal of the Academy of Marketing Science, Springer, vol. 51(4), pages 843-866, July.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:soinre:v:178:y:2025:i:3:d:10.1007_s11205-024-03362-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.