IDEAS home Printed from https://ideas.repec.org/p/osf/socarx/4ahj9_v1.html

The Fake Friend Dilemma: Trust and the Political Economy of Conversational AI

Author

Listed:
  • Erickson, Jacob

    (Vassar College)

Abstract

As conversational AI systems become increasingly integrated into everyday life, they raise pressing concerns about user autonomy, trust, and the commercial interests that influence their behavior. To address these concerns, this paper develops the Fake Friend Dilemma (FFD), a sociotechnical condition in which users place trust in AI agents that appear supportive while pursuing goals that are misaligned with the user’s own. The FFD provides a critical framework for examining how anthropomorphic AI systems facilitate subtle forms of manipulation and exploitation. Drawing on literature in trust, AI alignment, and surveillance capitalism, we construct a typology of harms, including covert advertising, political propaganda, behavioral nudging, and surveillance. We then assess possible mitigation strategies, including both structural and technical interventions. By focusing on trust as a vector of asymmetrical power, the FFD offers a lens for understanding how AI systems may undermine user autonomy while maintaining the appearance of helpfulness.

Suggested Citation

  • Erickson, Jacob, 2026. "The Fake Friend Dilemma: Trust and the Political Economy of Conversational AI," SocArXiv 4ahj9_v1, Center for Open Science.
    • Handle: RePEc:osf:socarx:4ahj9_v1
    DOI: 10.31219/osf.io/4ahj9_v1
    as

    Download full text from publisher

    File URL: https://osf.io/download/695d52173c1ba6a35806c8db/
    Download Restriction: no
    File URL: https://libkey.io/10.31219/osf.io/4ahj9_v1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Campbell, Margaret C & Kirmani, Amna, 2000. "Consumers' Use of Persuasion Knowledge: The Effects of Accessibility and Cognitive Capacity on Perceptions of an Influence Agent," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 27(1), pages 69-83, June.
    2. Friestad, Marian & Wright, Peter, 1994. "The Persuasion Knowledge Model: How People Cope with Persuasion Attempts," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 21(1), pages 1-31, June.
    3. Chang, Woondeog & Park, Jungkun, 2024. "A comparative study on the effect of ChatGPT recommendation and AI recommender systems on the formation of a consideration set," Journal of Retailing and Consumer Services, Elsevier, vol. 78(C).
    4. Steve Phelps & Rebecca Ranson, 2023. "Of Models and Tin Men: A Behavioural Economics Study of Principal-Agent Problems in AI Alignment using Large-Language Models," Papers 2307.11137, arXiv.org, revised Sep 2023.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Suwelack, Thomas & Hogreve, Jens & Hoyer, Wayne D., 2011. "Understanding Money-Back Guarantees: Cognitive, Affective, and Behavioral Outcomes," Journal of Retailing, Elsevier, vol. 87(4), pages 462-478.
    2. Skarmeas, Dionysis & Leonidou, Constantinos N., 2013. "When consumers doubt, Watch out! The role of CSR skepticism," Journal of Business Research, Elsevier, vol. 66(10), pages 1831-1838.
    3. Puccinelli, Nancy M. & Goodstein, Ronald C. & Grewal, Dhruv & Price, Robert & Raghubir, Priya & Stewart, David, 2009. "Customer Experience Management in Retailing: Understanding the Buying Process," Journal of Retailing, Elsevier, vol. 85(1), pages 15-30.
    4. Singh, Jaywant & Crisafulli, Benedetta & Quamina, La Toya & Xue, Melanie Tao, 2020. "‘To trust or not to trust’: The impact of social media influencers on the reputation of corporate brands in crisis," Journal of Business Research, Elsevier, vol. 119(C), pages 464-480.
    5. Caldieraro, Fabio & Cunha, Marcus, 2022. "Consumers’ response to weak unique selling propositions: Implications for optimal product recommendation strategy," International Journal of Research in Marketing, Elsevier, vol. 39(3), pages 724-744.
    6. Merle, Aurélie & St-Onge, Anik & Sénécal, Sylvain, 2022. "Does it pay to be honest? The effect of retailer-provided negative feedback on consumers’ product choice and shopping experience," Journal of Business Research, Elsevier, vol. 147(C), pages 532-543.
    7. Joëlle Vanhamme & Valérie Swaen & Guido Berens & Catherine Janssen, 2015. "Playing with fire: aggravating and buffering effects of ex ante CSR communication campaigns for companies facing allegations of social irresponsibility," Marketing Letters, Springer, vol. 26(4), pages 565-578, December.
    8. Wu, Fang & Swait, Joffre & Chen, Yuxin, 2019. "Feature-based attributes and the roles of consumers' perception bias and inference in choice," International Journal of Research in Marketing, Elsevier, vol. 36(2), pages 325-340.
    9. Zhuang, Mengzhou & Cui, Geng & Peng, Ling, 2018. "Manufactured opinions: The effect of manipulating online product reviews," Journal of Business Research, Elsevier, vol. 87(C), pages 24-35.
    10. Kumar, Vikas & Kaushal, Vikrant & Shashi,, 2023. "Role of customer perceived brand ethicality in inducing engagement in online brand communities," Journal of Retailing and Consumer Services, Elsevier, vol. 71(C).
    11. Mehdi Hossain & Ritesh Saini, 2014. "Suckers in the morning, skeptics in the evening: Time-of-Day effects on consumers’ vigilance against manipulation," Marketing Letters, Springer, vol. 25(2), pages 109-121, June.
    12. Khandeparkar, Kapil & Motiani, Manoj & Sharma, Amalesh, 2021. "Thank you for not smoking – A multi-method investigation to understand the effect of anti-smoking warnings in television programs," Journal of Business Research, Elsevier, vol. 128(C), pages 462-472.
    13. Freya De Keyzer & Nathalie Dens & Patrick De Pelsmacker, 2023. "The processing of native advertising compared to banner advertising: an eye-tracking experiment," Electronic Commerce Research, Springer, vol. 23(3), pages 1921-1940, September.
    14. Zhao, Haichuan & Zhang, Mingyue & Chen, Haipeng (Allan), 2025. "Friends or Enemies? The impact of partial competitor referral on consumer purchase," Journal of Retailing, Elsevier, vol. 101(1), pages 86-102.
    15. Jones, Michael A. & Taylor, Valerie A., 2018. "Marketer requests for positive post-purchase satisfaction evaluations: Consumer depth interview findings," Journal of Retailing and Consumer Services, Elsevier, vol. 41(C), pages 218-226.
    16. Tessitore, Tina & Geuens, Maggie, 2019. "Arming consumers against product placement: A comparison of factual and evaluative educational interventions," Journal of Business Research, Elsevier, vol. 95(C), pages 38-48.
    17. Avramova, Yana R. & Dens, Nathalie & De Pelsmacker, Patrick, 2021. "Brand placement across media: The interaction of placement modality and frequency in film versus text," Journal of Business Research, Elsevier, vol. 128(C), pages 20-30.
    18. Golovacheva, E., 2016. "When consumers activate persuasion knowledge: Review of antecedents and consequences," Working Papers 6440, Graduate School of Management, St. Petersburg State University.
    19. J?rg Tropp & Corinna Beuthner, 2018. "Customers¡¯ Understanding of Engagement Advertising," Studies in Media and Communication, Redfame publishing, vol. 6(2), pages 57-76, December.
    20. James J. Zboja & Ronald A. Clark & Diana L. Haytko, 2016. "An offer you can’t refuse: consumer perceptions of sales pressure," Journal of the Academy of Marketing Science, Springer, vol. 44(6), pages 806-821, November.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:socarx:4ahj9_v1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://arabixiv.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.