IDEAS home Printed from https://ideas.repec.org/a/eee/joreco/v87y2025ics0969698925001791.html

AI vs. human: A large-scale analysis of AI-generated fake reviews, human-generated fake reviews and authentic reviews

Author

Listed:
  • Zhao, Yuexin
  • Tang, Siyi
  • Zhang, Hongyu
  • Lyu, Long

Abstract

The rise of fake reviews generated by artificial intelligence (AI) poses significant challenges for online platforms, retailers, and consumers, as advanced generative models like ChatGPT produce fake reviews. More seriously, unlike human-generated fake reviews, which exhibit psychological cues, AI-generated fake reviews lack deceptive intent and instead reflect algorithmic patterns that are increasingly difficult to detect. This study investigates the linguistic distinctions among AI-generated fake reviews, human-generated fake reviews, and authentic reviews by integrating the theoretical model of textual differences and AI characteristics. Analyzing 714,016 reviews through text analysis, entropy weight method and hypothesis testing, this research finds that AI-generated fake reviews demonstrate higher comprehensibility, lower levels of specificity, exaggeration, and negligence compared to human-generated fakes and authentic reviews. These findings challenge the existing paradigms in fake review research. This means that in traditional detection, the situations where there are AI-generated fake reviews that do not conform to rules should be given further consideration. Additionally, AI-generated fake reviews exhibit significantly higher mechanicalness and lower empathy than authentic reviews, providing actionable linguistic cues for identification. These findings highlight the need for revised detection methods that account for AI characteristics. Theoretically, it innovatively combines the textual differences model with AI capabilities to investigate AI-generated fake reviews, enriching the fake review detection literature. Practically, it offers e-commerce platforms and consumers enhanced detection metrics to improve algorithmic accuracy in identifying AI-generated deception.

Suggested Citation

  • Zhao, Yuexin & Tang, Siyi & Zhang, Hongyu & Lyu, Long, 2025. "AI vs. human: A large-scale analysis of AI-generated fake reviews, human-generated fake reviews and authentic reviews," Journal of Retailing and Consumer Services, Elsevier, vol. 87(C).
    • Handle: RePEc:eee:joreco:v:87:y:2025:i:c:s0969698925001791
    DOI: 10.1016/j.jretconser.2025.104400
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0969698925001791
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jretconser.2025.104400?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Chen, Qian & Gong, Yeming & Lu, Yaobin & Tang, Jing, 2022. "Classifying and measuring the service quality of AI chatbot in frontline service," Journal of Business Research, Elsevier, vol. 145(C), pages 552-568.
    2. Salminen, Joni & Kandpal, Chandrashekhar & Kamel, Ahmed Mohamed & Jung, Soon-gyo & Jansen, Bernard J., 2022. "Creating and detecting fake reviews of online products," Journal of Retailing and Consumer Services, Elsevier, vol. 64(C).
    3. Brady D. Lund & Ting Wang & Nishith Reddy Mannuru & Bing Nie & Somipam Shimray & Ziang Wang, 2023. "ChatGPT and a new academic reality: Artificial Intelligence‐written research papers and the ethics of the large language models in scholarly publishing," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 74(5), pages 570-581, May.
    4. Shukla, Aishwarya Deep & Goh, Jie Mein, 2024. "Fighting fake reviews: Authenticated anonymous reviews using identity verification," Business Horizons, Elsevier, vol. 67(1), pages 71-81.
    5. Wu, Qian & Zheng, Han, 2025. "Consumers' questions as nudges: Comparing the effect of linguistic cues on LLM chatbot and human responses," Journal of Retailing and Consumer Services, Elsevier, vol. 84(C).
    6. Filieri, Raffaele, 2016. "What makes an online consumer review trustworthy?," Annals of Tourism Research, Elsevier, vol. 58(C), pages 46-64.
    7. Kapoor, Payal S. & M S, Balaji & Maity, Moutusy & Jain, Nikunj Kumar, 2021. "Why consumers exaggerate in online reviews? Moral disengagement and dark personality traits," Journal of Retailing and Consumer Services, Elsevier, vol. 60(C).
    8. Yu, Joanne & Dickinger, Astrid & So, Kevin Kam Fung & Egger, Roman, 2024. "Artificial intelligence-generated virtual influencer: Examining the effects of emotional display on user engagement," Journal of Retailing and Consumer Services, Elsevier, vol. 76(C).
    9. Loureiro, Sandra Maria Correia & Guerreiro, João & Tussyadiah, Iis, 2021. "Artificial intelligence in business: State of the art and future research agenda," Journal of Business Research, Elsevier, vol. 129(C), pages 911-926.
    10. Leonardo Banh & Gero Strobel, 2023. "Generative artificial intelligence," Electronic Markets, Springer;IIM University of St. Gallen, vol. 33(1), pages 1-17, December.
    11. Hossain, Md Shamim & Rahman, Mst Farjana, 2022. "Detection of potential customers’ empathy behavior towards customers' reviews," Journal of Retailing and Consumer Services, Elsevier, vol. 65(C).
    12. Ajay Kumar & Ram D. Gopal & Ravi Shankar & Kim Hua Tan, 2022. "Fraudulent review detection model focusing on emotional expressions and explicit aspects : investigating the potential of feature engineering," Post-Print hal-03630420, HAL.
    13. Daria Plotkina & Andreas Munzel & Jessie Pallud, 2020. "Illusions of truth—Experimental insights into human and algorithmic detections of fake online reviews," Post-Print hal-02423585, HAL.
    14. Anat Perry, 2023. "AI will never convey the essence of human empathy," Nature Human Behaviour, Nature, vol. 7(11), pages 1808-1809, November.
    15. Mari, Alex & Mandelli, Andreina & Algesheimer, René, 2024. "Empathic voice assistants: Enhancing consumer responses in voice commerce," Journal of Business Research, Elsevier, vol. 175(C).
    16. Daria Plotkina & Andréas Munzel & Jessie Pallud, 2020. "Illusions of truth - Experimental insights into human and algorithmic detections of fake online reviews," Post-Print hal-04077201, HAL.
    17. Shobhit Kakaria & Aline Simonetti & Enrique Bigne, 2024. "Interaction between extrinsic and intrinsic online review cues: perspectives from cue utilization theory," Electronic Commerce Research, Springer, vol. 24(4), pages 2469-2497, December.
    18. Kim, Jong Min & Park, Keeyeon Ki-cheon & Mariani, Marcello M., 2023. "Do online review readers react differently when exposed to credible versus fake online reviews?," Journal of Business Research, Elsevier, vol. 154(C).
    19. Ansari, Sana & Gupta, Sumeet, 2021. "Customer perception of the deceptiveness of online product reviews: A speech act theory perspective," International Journal of Information Management, Elsevier, vol. 57(C).
    20. Li, Yuanshuo & Zhang, Zili & Pedersen, Susanne & Liu, Xudong & Zhang, Ziqiong, 2023. "The influence of relative popularity on negative fake reviews: A case study on restaurant reviews," Journal of Business Research, Elsevier, vol. 162(C).
    21. Snehasish Banerjee & Alton Y. K. Chua & Jung-Jae Kim, 2017. "Don't be deceived: Using linguistic analysis to learn how to discern online review authenticity," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(6), pages 1525-1538, June.
    22. Birim, Şule Öztürk & Kazancoglu, Ipek & Kumar Mangla, Sachin & Kahraman, Aysun & Kumar, Satish & Kazancoglu, Yigit, 2022. "Detecting fake reviews through topic modelling," Journal of Business Research, Elsevier, vol. 149(C), pages 884-900.
    23. Simon, Françoise, 2013. "The influence of empathy in complaint handling: Evidence of gratitudinal and transactional routes to loyalty," Journal of Retailing and Consumer Services, Elsevier, vol. 20(6), pages 599-608.
    24. Plotkina, Daria & Munzel, Andreas & Pallud, Jessie, 2020. "Illusions of truth—Experimental insights into human and algorithmic detections of fake online reviews," Journal of Business Research, Elsevier, vol. 109(C), pages 511-523.
    25. Kim, Jungkeun & Kim, Jeong Hyun & Kim, Changju & Park, Jooyoung, 2023. "Decisions with ChatGPT: Reexamining choice overload in ChatGPT recommendations," Journal of Retailing and Consumer Services, Elsevier, vol. 75(C).
    26. Samuel Fosso Wamba & Cameron Guthrie & Maciel M. Queiroz & Stefan Minner, 2024. "ChatGPT and generative artificial intelligence: an exploratory study of key benefits and challenges in operations and supply chain management," International Journal of Production Research, Taylor & Francis Journals, vol. 62(16), pages 5676-5696, August.
    27. Moon, Sangkil & Kim, Moon-Yong & Iacobucci, Dawn, 2021. "Content analysis of fake consumer reviews by survey-based text categorization," International Journal of Research in Marketing, Elsevier, vol. 38(2), pages 343-364.
    28. Qian Chen & Yeming Gong & Yaobin Lu & Jing Tang, 2022. "Classifying and measuring the service quality of AI chatbot in frontline service," Post-Print hal-04325624, HAL.
    29. Banerjee, Snehasish, 2022. "Exaggeration in fake vs. authentic online reviews for luxury and budget hotels," International Journal of Information Management, Elsevier, vol. 62(C).
    30. Lyn M. Swol & Michael T. Braun, 2014. "Communicating Deception: Differences in Language Use, Justifications, and Questions for Lies, Omissions, and Truths," Group Decision and Negotiation, Springer, vol. 23(6), pages 1343-1367, November.
    31. Michael Luca & Georgios Zervas, 2016. "Fake It Till You Make It: Reputation, Competition, and Yelp Review Fraud," Management Science, INFORMS, vol. 62(12), pages 3412-3427, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zaman, Mustafeed & Vo-Thanh, Tan & Nguyen, Chi T.K. & Hasan, Rajibul & Akter, Shahriar & Mariani, Marcello & Hikkerova, Lubica, 2023. "Motives for posting fake reviews: Evidence from a cross-cultural comparison," Journal of Business Research, Elsevier, vol. 154(C).
    2. Wen Zhang & Qiang Wang & Jian Li & Zhenzhong Ma & Gokul Bhandari & Rui Peng, 2023. "What makes deceptive online reviews? A linguistic analysis perspective," Humanities and Social Sciences Communications, Palgrave Macmillan, vol. 10(1), pages 1-14, December.
    3. Hajek, Petr & Hikkerova, Lubica & Sahut, Jean-Michel, 2023. "Fake review detection in e-Commerce platforms using aspect-based sentiment analysis," Journal of Business Research, Elsevier, vol. 167(C).
    4. Costa Filho, Murilo & Nogueira Rafael, Diego & Salmonson Guimarães Barros, Lucia & Mesquita, Eduardo, 2023. "Mind the fake reviews! Protecting consumers from deception through persuasion knowledge acquisition," Journal of Business Research, Elsevier, vol. 156(C).
    5. Kim, Jong Min & Park, Keeyeon Ki-cheon & Mariani, Marcello & Wamba, Samuel Fosso, 2024. "Investigating reviewers' intentions to post fake vs. authentic reviews based on behavioral linguistic features," Technological Forecasting and Social Change, Elsevier, vol. 198(C).
    6. Harrison-Walker, L. Jean & Jiang, Ying, 2023. "Suspicion of online product reviews as fake: Cues and consequences," Journal of Business Research, Elsevier, vol. 160(C).
    7. Banerjee, Snehasish & Chua, Alton Y.K., 2023. "Understanding online fake review production strategies," Journal of Business Research, Elsevier, vol. 156(C).
    8. Tim Kollmer & Andreas Eckhardt & Victoria Reibenspiess, 2022. "Explaining consumer suspicion: insights of a vignette study on online product reviews," Electronic Markets, Springer;IIM University of St. Gallen, vol. 32(3), pages 1221-1238, September.
    9. Hajek, Petr & Sahut, Jean-Michel, 2022. "Mining behavioural and sentiment-dependent linguistic patterns from restaurant reviews for fake review detection," Technological Forecasting and Social Change, Elsevier, vol. 177(C).
    10. Josef Zelenka & Tracy Azubuike & Martina Pásková, 2021. "Trust Model for Online Reviews of Tourism Services and Evaluation of Destinations," Administrative Sciences, MDPI, vol. 11(2), pages 1-21, March.
    11. Chatterjee, Sheshadri & Chaudhuri, Ranjan & Kumar, Ajay & Lu Wang, Cheng & Gupta, Shivam, 2023. "Impacts of consumer cognitive process to ascertain online fake review: A cognitive dissonance theory approach," Journal of Business Research, Elsevier, vol. 154(C).
    12. Kim Shin Young & Sang-Gun Lee & Ga Youn Hong, 2024. "User satisfaction with the service quality of ChatGPT," Service Business, Springer;Pan-Pacific Business Association, vol. 18(3), pages 417-431, December.
    13. Sung Youl Jun & Tae Wook Ju & Hye Kyung Park & Jacob C. Lee & Tae Min Kim, 2023. "Information distortion in word-of-mouth retransmission: the effects of retransmitter intention and source expertise," Asian Business & Management, Palgrave Macmillan, vol. 22(5), pages 1848-1876, November.
    14. Birim, Şule Öztürk & Kazancoglu, Ipek & Kumar Mangla, Sachin & Kahraman, Aysun & Kumar, Satish & Kazancoglu, Yigit, 2022. "Detecting fake reviews through topic modelling," Journal of Business Research, Elsevier, vol. 149(C), pages 884-900.
    15. Choi, Sunhwa & Yi, Youjae & Zhao, Xiaohong, 2024. "The human touch vs. AI efficiency: How perceived status, effort, and loyalty shape consumer satisfaction with preferential treatment," Journal of Retailing and Consumer Services, Elsevier, vol. 81(C).
    16. Ben Jabeur, Sami & Ballouk, Hossein & Ben Arfi, Wissal & Sahut, Jean-Michel, 2023. "Artificial intelligence applications in fake review detection: Bibliometric analysis and future avenues for research," Journal of Business Research, Elsevier, vol. 158(C).
    17. Salminen, Joni & Kandpal, Chandrashekhar & Kamel, Ahmed Mohamed & Jung, Soon-gyo & Jansen, Bernard J., 2022. "Creating and detecting fake reviews of online products," Journal of Retailing and Consumer Services, Elsevier, vol. 64(C).
    18. Román, Sergio & Riquelme, Isabel P. & Iacobucci, Dawn, 2024. "Antecedents and consequences of perceived helpfulness of extremely positive and exaggerated reviews," Journal of Retailing and Consumer Services, Elsevier, vol. 80(C).
    19. Shawn Berry, 2024. "Fake Google restaurant reviews and the implications for consumers and restaurants," Papers 2401.11345, arXiv.org, revised Apr 2024.
    20. Mark Anthony Camilleri & Shakti Bodh Bhatnagar & Debarun Chakraborty, 2025. "Exaggerated statements in online consumer reviews: causes and implications," Service Business, Springer;Pan-Pacific Business Association, vol. 19(3), pages 1-22, September.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:joreco:v:87:y:2025:i:c:s0969698925001791. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/journal-of-retailing-and-consumer-services .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.