IDEAS home Printed from https://ideas.repec.org/a/eee/teinso/v85y2026ics0160791x25003720.html

Understanding user susceptibility to risks in AI companionship applications

Author

Listed:
  • Lombard, Adriaan
  • Flowerday, Stephen
  • Hale, John

Abstract

The growing adoption of emotionally adaptive Artificial Intelligence (AI) companionship applications raises critical concerns about privacy, emotional dependency, and behavioural susceptibility. These systems provide affective gratification while relying on continuous data tracking, generating tension between intimacy and surveillance. This study investigates how users’ understanding of tracking mechanisms, perceived risks, and perceived benefits jointly shape susceptibility, which is behavioural susceptibility to AI influence. Integrating cognitive dissonance theory, cognitive adaptation theory, and the privacy paradox, the research develops and validates an affective-override privacy calculus that explains how emotional rationalisation mediates privacy decision-making. The study compares users and non-users of AI companionship apps using cross-sectional survey data (n = 698) and partial least squares structural equation modelling with multi-group analysis. Results show that tracking awareness is a cognitive safeguard for non-users but an emotional rationalisation tool for users, amplifying perceived benefits and engagement despite recognised risks. The model demonstrates that emotional attachment can invert conventional risk–behaviour relationships, reframing awareness as context-dependent. Findings inform the ethical design of emotional AI, highlighting the need for emotional transparency, privacy literacy, and regulatory attention to affective coercion.

Suggested Citation

  • Lombard, Adriaan & Flowerday, Stephen & Hale, John, 2026. "Understanding user susceptibility to risks in AI companionship applications," Technology in Society, Elsevier, vol. 85(C).
  • Handle: RePEc:eee:teinso:v:85:y:2026:i:c:s0160791x25003720
    DOI: 10.1016/j.techsoc.2025.103182
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0160791X25003720
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.techsoc.2025.103182?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Ziller, Conrad & Loepp, Benedikt & Kindermann, Bastian & Köchling, Gerrit & Fadeeva, Yuliya, 2025. "Willingness to share personal data online: The role of social influence and sustainability," Technology in Society, Elsevier, vol. 83(C).
    2. Gansser, Oliver Alexander & Reich, Christina Stefanie, 2021. "A new acceptance model for artificial intelligence with extensions to UTAUT2: An empirical study in three segments of application," Technology in Society, Elsevier, vol. 65(C).
    3. Edward Shih-Tse Wang & Ruenn-Lien Lin, 2017. "Perceived quality factors of location-based apps on trust, perceived privacy risk, and continuous usage intention," Behaviour and Information Technology, Taylor & Francis Journals, vol. 36(1), pages 2-10, January.
    4. Wynne W. Chin & Barbara L. Marcolin & Peter R. Newsted, 2003. "A Partial Least Squares Latent Variable Modeling Approach for Measuring Interaction Effects: Results from a Monte Carlo Simulation Study and an Electronic-Mail Emotion/Adoption Study," Information Systems Research, INFORMS, vol. 14(2), pages 189-217, June.
    5. Tamara Dinev & Paul Hart, 2006. "An Extended Privacy Calculus Model for E-Commerce Transactions," Information Systems Research, INFORMS, vol. 17(1), pages 61-80, March.
    6. Ersin Dincelli & InduShobha Chengalur-Smith, 2020. "Choose your own training adventure: designing a gamified SETA artefact for improving information security and privacy through interactive storytelling," European Journal of Information Systems, Taylor & Francis Journals, vol. 29(6), pages 669-687, November.
    7. Xusen Cheng & Linlin Su & Xin (Robert) Luo & Jose Benitez & Shun Cai, 2022. "The good, the bad, and the ugly: impact of analytics and artificial intelligence-enabled personal information collection on privacy and participation in ridesharing," European Journal of Information Systems, Taylor & Francis Journals, vol. 31(3), pages 339-363, May.
    8. Marko Sarstedt & Christian M. Ringle & Joseph F. Hair, 2022. "Partial Least Squares Structural Equation Modeling," Springer Books, in: Christian Homburg & Martin Klarmann & Arnd Vomberg (ed.), Handbook of Market Research, pages 587-632, Springer.
    9. Bawack, Ransome Epie & Wamba, Samuel Fosso & Carillo, Kevin Daniel André, 2021. "Exploring the role of personality, trust, and privacy in customer experience performance during voice shopping: Evidence from SEM and fuzzy set qualitative comparative analysis," International Journal of Information Management, Elsevier, vol. 58(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jinjing Yang & Cong Cao & Chensang Ye & Yangyan Shi, 2022. "Effects of Interface Design and Live Atmosphere on Consumers’ Impulse-Buying Behaviour from the Perspective of Human–Computer Interaction," Sustainability, MDPI, vol. 14(12), pages 1-21, June.
    2. Chaeyoung Lim & Jongchang Ahn, 2021. "Social Overload and Discontinuance Intention on Facebook: A Comparative Study," Sustainability, MDPI, vol. 13(22), pages 1-17, November.
    3. Hussain, Bilal & Feng, Zhao Rui & Radulescu, Magdalena & Batool, Komal & Alomair, Abdulrahman, 2026. "Predicting intentions to adopt AI-based transport management systems for sustainable mobility in an uncertain world: An extended UTAUT model," Research in Transportation Economics, Elsevier, vol. 117(C).
    4. Lu, Baozhou & Yi, Xiaoyang, 2023. "Institutional trust and repurchase intention in the sharing economy: The moderating roles of information privacy concerns and security concerns," Journal of Retailing and Consumer Services, Elsevier, vol. 73(C).
    5. Hu, Bo & Liu, Yu-li & Yan, Wenjia, 2021. "Should I scan my face? The influence of perceived value and trust on Chinese users' intention to use facial recognition payment," 23rd ITS Biennial Conference, Online Conference / Gothenburg 2021. Digital societies and industrial transformations: Policies, markets, and technologies in a post-Covid world 238028, International Telecommunications Society (ITS).
    6. Serena Filippelli & Salvatore Ammirato & Alberto Michele Felicetti & Ciro Troise, 2025. "Digital Platforms for Sustainable Development: Unveiling the Psychology of Green Food Choices," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 32(6), pages 8258-8279, November.
    7. Dalvi-Esfahani, Mohammad & Barati-Ahmadabadi, Hajar & Ramayah, T. & Turner, Jason J. & A. Iahad, Noorminshah & Azar, Nasrin, 2025. "Stimulus-organism-response framework of decision-makers intention to adopt generative AI to replace entry-level jobs: The moderating impact of personality traits," Technological Forecasting and Social Change, Elsevier, vol. 219(C).
    8. Alper Yayla & Ersin Dincelli & Srikanth Parameswaran, 2024. "A Mining Town in a Digital Land: Browser-Based Cryptocurrency Mining as an Alternative to Online Advertising," Information Systems Frontiers, Springer, vol. 26(2), pages 609-631, April.
    9. Chen, Chih-Jou & Cheng, Julian Ming-Sung, 2026. "When help feels creepy: A MOA model of AI smart-retail adoption via perceived intrusiveness and the moderating role of trust in AI," Journal of Retailing and Consumer Services, Elsevier, vol. 90(C).
    10. Li, Jin & Zhang, Yulan & Mou, Jian, 2023. "Understanding information disclosures and privacy sensitivity on short-form video platforms: An empirical investigation," Journal of Retailing and Consumer Services, Elsevier, vol. 72(C).
    11. Maroufkhani, Parisa & Asadi, Shahla & Ghobakhloo, Morteza & Jannesari, Milad T. & Ismail, Wan Khairuzaman Wan, 2022. "How do interactive voice assistants build brands' loyalty?," Technological Forecasting and Social Change, Elsevier, vol. 183(C).
    12. Rongbin Yang & Santoso Wibowo, 2022. "User trust in artificial intelligence: A comprehensive conceptual framework," Electronic Markets, Springer;IIM University of St. Gallen, vol. 32(4), pages 2053-2077, December.
    13. Cong Fang & Mingyuan Zhang & Paul Vinod Khiatani & Huan Lin & Wei Liu & Stephen Jia Wang, 2026. "A comparative analysis of generative AI adoption among design professionals in China and the United Kingdom: a UTAUT perspective," Humanities and Social Sciences Communications, Palgrave Macmillan, vol. 13(1), pages 1-19, December.
    14. Wagih Salama & Mohamed Nor El Deen & Azzam Albakhit & Karam Zaki, 2022. "Understanding the Connection between Sustainable Human Resource Management and the Hotel Business Outcomes: Evidence from the Green-Certified Hotels of Egypt," Sustainability, MDPI, vol. 14(9), pages 1-22, May.
    15. Alzaidi, Maram Saeed & Agag, Gomaa, 2022. "The role of trust and privacy concerns in using social media for e-retail services: The moderating role of COVID-19," Journal of Retailing and Consumer Services, Elsevier, vol. 68(C).
    16. Badghish, Saeed & Shaik, Aqueeb Sohail & Sahore, Nidhi & Srivastava, Shalini & Masood, Ayesha, 2024. "Can transactional use of AI-controlled voice assistants for service delivery pickup pace in the near future? A social learning theory (SLT) perspective," Technological Forecasting and Social Change, Elsevier, vol. 198(C).
    17. Darrell Carpenter & Alexander McLeod & Chelsea Hicks & Michele Maasberg, 0. "Privacy and biometrics: An empirical examination of employee concerns," Information Systems Frontiers, Springer, vol. 0, pages 1-20.
    18. Baozhou Lu & Zhenhua Wang, 2022. "Trust Transfer in Sharing Accommodation: The Moderating Role of Privacy Concerns," Sustainability, MDPI, vol. 14(12), pages 1-18, June.
    19. Heng Xu & Hock-Hai Teo & Bernard C. Y. Tan & Ritu Agarwal, 2012. "Research Note ---Effects of Individual Self-Protection, Industry Self-Regulation, and Government Regulation on Privacy Concerns: A Study of Location-Based Services," Information Systems Research, INFORMS, vol. 23(4), pages 1342-1363, December.
    20. Kim, Yaeri & Seok, Junhee & Roh, Taewoo, 2023. "The linkage between quality of information systems and the impact of trust-based privacy on behavioral outcomes in unmanned convenience store: Moderating effect of gender and experience," Technological Forecasting and Social Change, Elsevier, vol. 196(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:teinso:v:85:y:2026:i:c:s0160791x25003720. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/technology-in-society .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.