IDEAS home Printed from https://ideas.repec.org/a/eee/teinso/v83y2025ics0160791x25002106.html

Beyond simple interaction: Uncovering the perception-interaction intrinsic mechanism of generative AI agents—A multi-modal big data analysis with PLS-SEM and fsQCA

Author

Listed:
  • He, Hao
  • Bai, Shizhen
  • Han, Chunjia
  • Yang, Mu
  • Fan, Weijia
  • Gupta, Brij B.

Abstract

Generative Artificial Intelligence (GenAI) is increasingly being adopted across industries, yet existing literature has not fully explored the unique traits and the complex mechanism it introduces. To address this gap, this study investigates the unique characteristics of GenAI agents and their impact on user interaction behaviors. By analyzing user-generated text and AI-generated images from the Character.AI platform, we examine three key perceptual characteristics: social personalization, functional customization, and emotional affordance. Through multi-modal machine learning approaches combining Structural Topic Modeling (STM) and Facial Action Coding System (FACS), we propose the “perceived characteristics of GenAI agent-empathy-interactive willingness” (PCoGenAI-E-IW) theoretical model to explore how user perceptions transform into interactive behaviors. Furthermore, the PLS-SEM analysis and configurational approach identify 10 distinct variable combinations that influence users’ interaction willingness. The findings validate our multi-modal analytical framework while providing valuable empirical evidence for marketing strategy formulation, service experience optimization, and theoretical advancement in human-AI interaction research.

Suggested Citation

  • He, Hao & Bai, Shizhen & Han, Chunjia & Yang, Mu & Fan, Weijia & Gupta, Brij B., 2025. "Beyond simple interaction: Uncovering the perception-interaction intrinsic mechanism of generative AI agents—A multi-modal big data analysis with PLS-SEM and fsQCA," Technology in Society, Elsevier, vol. 83(C).
    • Handle: RePEc:eee:teinso:v:83:y:2025:i:c:s0160791x25002106
    DOI: 10.1016/j.techsoc.2025.103020
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0160791X25002106
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.techsoc.2025.103020?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Li, Huanli & Wu, Yun & Cao, Dongmei & Wang, Yichuan, 2021. "Organizational mindfulness towards digital transformation as a prerequisite of information processing capability to achieve market agility," Journal of Business Research, Elsevier, vol. 122(C), pages 700-712.
    2. Zhou, Fei & Zhang, Na & Wang, Na & Mou, Jian, 2023. "Design affordance in VR and customization intention: Is customer inspiration a missing link?," Technological Forecasting and Social Change, Elsevier, vol. 192(C).
    3. Qian, Yiming & Wan, Xiaoang, 2025. "Co-experiencing with AI: Effects on social bonding and empathy in human-AI relationships," Technology in Society, Elsevier, vol. 83(C).
    4. Wongkitrungrueng, Apiradee & Assarut, Nuttapol, 2020. "The role of live streaming in building consumer trust and engagement with social commerce sellers," Journal of Business Research, Elsevier, vol. 117(C), pages 543-556.
    5. Chakraborty, Debarun & Kumar Kar, Arpan & Patre, Smruti & Gupta, Shivam, 2024. "Enhancing trust in online grocery shopping through generative AI chatbots," Journal of Business Research, Elsevier, vol. 180(C).
    6. Leung, Chi Hong & Chan, Winslet Ting Yan, 2017. "Using emoji effectively in marketing: An empirical study," Journal of Digital & Social Media Marketing, Henry Stewart Publications, vol. 5(1), pages 76-95, March.
    7. Lim, Weng Marc & Jasim, K. Mohamed & Malathi, A., 2025. "Service robots in healthcare: Toward a healthcare service robot acceptance model (sRAM)," Technology in Society, Elsevier, vol. 82(C).
    8. Xie, Yuguang & Liang, Changyong & Zhou, Peiyu & Jiang, Li, 2024. "Exploring the influence mechanism of chatbot-expressed humor on service satisfaction in online customer service," Journal of Retailing and Consumer Services, Elsevier, vol. 76(C).
    9. Santos-Vijande, María Leticia & Gómez-Rico, Mar & Molina-Collado, Arturo & Davison, Robert M., 2022. "Building user engagement to mhealth apps from a learning perspective: Relationships among functional, emotional and social drivers of user value," Journal of Retailing and Consumer Services, Elsevier, vol. 66(C).
    10. Gain Park & Myungok Chris Yim & Jiyun Chung & Seyoung Lee, 2023. "Effect of AI chatbot empathy and identity disclosure on willingness to donate: the mediation of humanness and social presence," Behaviour and Information Technology, Taylor & Francis Journals, vol. 42(12), pages 1998-2010, September.
    11. Jbid Arsenyan & Agata Mirowska, 2021. "Almost human? A comparative case study on the social media presence of virtual influencers," Post-Print hal-05176250, HAL.
    12. Yuping Liu-Thompkins & Shintaro Okazaki & Hairong Li, 2022. "Artificial empathy in marketing interactions: Bridging the human-AI gap in affective and social customer experience," Journal of the Academy of Marketing Science, Springer, vol. 50(6), pages 1198-1218, November.
    13. Cheng, Zhendong & Fan, Wenfang & Shao, Bingjia & Jia, Wenli & Zhang, Yong, 2024. "The impact of intelligent customer service agents’ initial response on consumers’ continuous interaction intention," Journal of Retailing and Consumer Services, Elsevier, vol. 76(C).
    14. Islam, A.K.M. Najmul & Laato, Samuli & Talukder, Shamim & Sutinen, Erkki, 2020. "Misinformation sharing and social media fatigue during COVID-19: An affordance and cognitive load perspective," Technological Forecasting and Social Change, Elsevier, vol. 159(C).
    15. Andersen, Jens Peter & Degn, Lise & Fishberg, Rachel & Graversen, Ebbe K. & Horbach, Serge P.J.M. & Schmidt, Evanthia Kalpazidou & Schneider, Jesper W. & Sørensen, Mads P., 2025. "Generative Artificial Intelligence (GenAI) in the research process – A survey of researchers’ practices and perceptions," Technology in Society, Elsevier, vol. 81(C).
    16. Mehmood, Khalid & Kautish, Pradeep & Shah, Tejas R., 2024. "Embracing digital companions: Unveiling customer engagement with anthropomorphic AI service robots in cross-cultural context," Journal of Retailing and Consumer Services, Elsevier, vol. 79(C).
    17. Yu, Joanne & Dickinger, Astrid & So, Kevin Kam Fung & Egger, Roman, 2024. "Artificial intelligence-generated virtual influencer: Examining the effects of emotional display on user engagement," Journal of Retailing and Consumer Services, Elsevier, vol. 76(C).
    18. Ziller, Conrad & Loepp, Benedikt & Kindermann, Bastian & Köchling, Gerrit & Fadeeva, Yuliya, 2025. "Willingness to share personal data online: The role of social influence and sustainability," Technology in Society, Elsevier, vol. 83(C).
    19. Mari, Alex & Mandelli, Andreina & Algesheimer, René, 2024. "Empathic voice assistants: Enhancing consumer responses in voice commerce," Journal of Business Research, Elsevier, vol. 175(C).
    20. Kittipanya-ngam, Pichawadee & Tan, Kim Hua & Cavite, Harry Jay, 2025. "Future-ready AI: A framework for ethical and sustainable adoption," Technology in Society, Elsevier, vol. 83(C).
    21. Kim, Hyojung & Park, Minjung, 2024. "When digital celebrity talks to you: How human-like virtual influencers satisfy consumer's experience through social presence on social media endorsements," Journal of Retailing and Consumer Services, Elsevier, vol. 76(C).
    22. R. Filieri & Z. Lin & Y. Li & X. Lu & X. Yang, 2022. "Customer Emotions in Service Robot Encounters: A Hybrid Machine-Human Intelligence Approach," Post-Print hal-04779123, HAL.
    23. Hung, Chih-Lung & Wu, Jen-Her & Chiang, Po-Chuen & Li, Qi & Chen, Yi-Cheng, 2025. "Factors driving user behavior and value creation with text-to-image generative artificial intelligence (AI): A systems theory perspective," Technology in Society, Elsevier, vol. 83(C).
    24. Joachim Büschken & Greg M. Allenby, 2016. "Sentence-Based Text Analysis for Customer Reviews," Marketing Science, INFORMS, vol. 35(6), pages 953-975, November.
    25. Borghi, Matteo & Mariani, Marcello M., 2022. "The role of emotions in the consumer meaning-making of interactions with social robots," Technological Forecasting and Social Change, Elsevier, vol. 182(C).
    26. Abou-Foul, Mohamad & Ruiz-Alba, Jose L. & López-Tenorio, Pablo J., 2023. "The impact of artificial intelligence capabilities on servitization: The moderating role of absorptive capacity-A dynamic capabilities perspective," Journal of Business Research, Elsevier, vol. 157(C).
    27. Chaturvedi, Rijul & Verma, Sanjeev & Das, Ronnie & Dwivedi, Yogesh K., 2023. "Social companionship with artificial intelligence: Recent trends and future avenues," Technological Forecasting and Social Change, Elsevier, vol. 193(C).
    28. Niu, Ben & Mvondo, Gustave Florentin Nkoulou, 2024. "I Am ChatGPT, the ultimate AI Chatbot! Investigating the determinants of users' loyalty and ethical usage concerns of ChatGPT," Journal of Retailing and Consumer Services, Elsevier, vol. 76(C).
    29. Yoon, Jeewhan & Vonortas, Nicholas S. & Han, SungWon, 2020. "Do-It-Yourself laboratories and attitude toward use: The effects of self-efficacy and the perception of security and privacy," Technological Forecasting and Social Change, Elsevier, vol. 159(C).
    30. Elizabeth Han & Dezhi Yin & Han Zhang, 2023. "Bots with Feelings: Should AI Agents Express Positive Emotion in Customer Service?," Information Systems Research, INFORMS, vol. 34(3), pages 1296-1311, September.
    31. Iranmanesh, Mohammad & Min, Connie Low & Senali, Madugoda Gunaratnege & Nikbin, Davoud & Foroughi, Behzad, 2022. "Determinants of switching intention from web-based stores to retail apps: Habit as a moderator," Journal of Retailing and Consumer Services, Elsevier, vol. 66(C).
    32. Yu, Wantao & Zhao, Gen & Liu, Qi & Song, Yongtao, 2021. "Role of big data analytics capability in developing integrated hospital supply chains and operational flexibility: An organizational information processing theory perspective," Technological Forecasting and Social Change, Elsevier, vol. 163(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Li, Zhitang & He, Peng & Xu, Henry, 2025. "Optimizing cooperation mechanisms for augmented reality (AR) services: Balancing product returns, pricing, and customer satisfaction," Journal of Retailing and Consumer Services, Elsevier, vol. 85(C).
    2. Yang, Defeng & Zhang, Jiaen & Sun, Yu & Huang, Zan, 2024. "Showing usage behavior or not? The effect of virtual influencers’ product usage behavior on consumers," Journal of Retailing and Consumer Services, Elsevier, vol. 79(C).
    3. Zhang, Weida & Yang, Bo & Yang, Meifang & Xie, Le & Zheng, Yu, 2025. "Sincerity or incompetence? The double-edged sword effect of sadness expression in chatbots service failure," Journal of Retailing and Consumer Services, Elsevier, vol. 86(C).
    4. Ko, Chaeeun & Baek, Hyunmi, 2026. "Effects of emotional expression on user engagement in virtual influencers’ Instagram posts: A comparative analysis with human influencers," Journal of Retailing and Consumer Services, Elsevier, vol. 88(C).
    5. P. Pushparaj & Bijay Prasad Kushwaha & Sanjeev Prashar, 2025. "A systematic literature review of virtual influencers in marketing using bibliometric analysis," International Review on Public and Nonprofit Marketing, Springer;International Association of Public and Non-Profit Marketing, vol. 22(3), pages 631-662, September.
    6. Shao, Zhucheng, 2026. "Dual congruence in live-streaming commerce: A mixed-method to examine the role of virtual influencers and live content on consumer purchase behavior," Journal of Retailing and Consumer Services, Elsevier, vol. 88(C).
    7. Yuan Xinying & Liu Shuzhen & Faiz Izwan Anuar, 2025. "The Influence Mechanism of Virtual Influencers on Destination Brand Attachment: An Analysis Based on the Elaboration Likelihood Model (ELM)," Information Management and Business Review, AMH International, vol. 17(3), pages 551-564.
    8. Liu, Qixuan & Ma, Ning & Zhang, Xiaoyi, 2025. "Can AI-virtual anchors replace human internet celebrities for live streaming sales of products? An emotion theory perspective," Journal of Retailing and Consumer Services, Elsevier, vol. 82(C).
    9. Pathak, Kanishka & Prakash, Gyan & Samadhiya, Ashutosh & Kumar, Anil & Luthra, Sunil, 2025. "Impact of Gen-AI chatbots on consumer services experiences and behaviors: Focusing on the sensation of awe and usage intentions through a cybernetic lens," Journal of Retailing and Consumer Services, Elsevier, vol. 82(C).
    10. Yao, Ruiqi & Qi, Guijie & Wu, Zhiqiang & Sun, Hua & Sheng, Dongfang, 2024. "Digital human calls you dear: How do customers respond to virtual streamers’ social-oriented language in e-commerce livestreaming? A stereotyping perspective," Journal of Retailing and Consumer Services, Elsevier, vol. 79(C).
    11. Guo, Yuanyuan & Xu, Linlin & Wang, Chaoyou, 2025. "Exploring the effect of empathic response and its boundaries in artificial intelligence service recovery," Journal of Retailing and Consumer Services, Elsevier, vol. 82(C).
    12. Xia, Hui & Zhang, Longyun & Chen, Junjie & Wang, Xinchun, 2025. "Decoding virtual influencer endorsement using machine learning: The role of virtual influencer, posting, and disclosure characteristics," Journal of Retailing and Consumer Services, Elsevier, vol. 87(C).
    13. Xia, Hui & Yang, Yuqing & Wang, Xinchun, 2025. "Too pretty to resist? Exploring the impact of virtual influencers’ beauty level on consumer reactions," Journal of Retailing and Consumer Services, Elsevier, vol. 87(C).
    14. Gül Yazıcı & Tuğçe Ozansoy Çadırcı, 2024. "Creating meaningful insights from customer reviews: a methodological comparison of topic modeling algorithms and their use in marketing research," Journal of Marketing Analytics, Palgrave Macmillan, vol. 12(4), pages 865-887, December.
    15. Lim, Weng Marc & Jasim, K. Mohamed & Malathi, A., 2025. "Service robots in healthcare: Toward a healthcare service robot acceptance model (sRAM)," Technology in Society, Elsevier, vol. 82(C).
    16. Silayach, Nikee & Ray, Rajeev Kumar & Singh, Navneet Kumar & Dash, Devi Prasad & Singh, Amit, 2025. "When algorithms meet emotions: Understanding consumer satisfaction in AI companion applications," Journal of Retailing and Consumer Services, Elsevier, vol. 85(C).
    17. Roy, Sanjit K. & Tehrani, Ali N. & Pandit, Ameet & Apostolidis, Chrysostomos & Ray, Subhasis, 2025. "AI-capable relationship marketing: Shaping the future of customer relationships," Journal of Business Research, Elsevier, vol. 192(C).
    18. Bai, Shizhen & Yu, Dingyao & Han, Chunjia & Yang, Mu & Gupta, Brij B. & Arya, Varsha & Panigrahi, Prabin Kumar & Tang, Rui & He, Hao & Zhao, Jiayuan, 2024. "Warmth trumps competence? Uncovering the influence of multimodal AI anthropomorphic interaction experience on intelligent service evaluation: Insights from the high-evoked automated social presence," Technological Forecasting and Social Change, Elsevier, vol. 204(C).
    19. Liu, Ruoran & Hao, Jin-Xing & Yu, Yan & Shan, Wei, 2025. "Helpful or harmful? A curvilinear perspective on AI agent anthropomorphism in service failure tolerance," Journal of Retailing and Consumer Services, Elsevier, vol. 85(C).
    20. Yao, Ruiqi & Qi, Guijie & Sun, Hua & Sheng, Dongfang, 2025. "A double-edged sword: Exploring the effectiveness of expressed subjectivity in virtual influencer endorsements," Journal of Retailing and Consumer Services, Elsevier, vol. 87(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:teinso:v:83:y:2025:i:c:s0160791x25002106. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/technology-in-society .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.