IDEAS home Printed from https://ideas.repec.org/a/eee/joreco/v64y2022ics0969698921003374.html

Creating and detecting fake reviews of online products

Author

Listed:
  • Salminen, Joni
  • Kandpal, Chandrashekhar
  • Kamel, Ahmed Mohamed
  • Jung, Soon-gyo
  • Jansen, Bernard J.

Abstract

Customers increasingly rely on reviews for product information. However, the usefulness of online reviews is impeded by fake reviews that give an untruthful picture of product quality. Therefore, detection of fake reviews is needed. Unfortunately, so far, automatic detection has only had partial success in this challenging task. In this research, we address the creation and detection of fake reviews. First, we experiment with two language models, ULMFiT and GPT-2, to generate fake product reviews based on an Amazon e-commerce dataset. Using the better model, GPT-2, we create a dataset for a classification task of fake review detection. We show that a machine classifier can accomplish this goal near-perfectly, whereas human raters exhibit significantly lower accuracy and agreement than the tested algorithms. The model was also effective on detected human generated fake reviews. The results imply that, while fake review detection is challenging for humans, “machines can fight machines†in the task of detecting fake reviews. Our findings have implications for consumer protection, defense of firms from unfair competition, and responsibility of review platforms.

Suggested Citation

  • Salminen, Joni & Kandpal, Chandrashekhar & Kamel, Ahmed Mohamed & Jung, Soon-gyo & Jansen, Bernard J., 2022. "Creating and detecting fake reviews of online products," Journal of Retailing and Consumer Services, Elsevier, vol. 64(C).
    • Handle: RePEc:eee:joreco:v:64:y:2022:i:c:s0969698921003374
    DOI: 10.1016/j.jretconser.2021.102771
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0969698921003374
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jretconser.2021.102771?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Kaushik, Kapil & Mishra, Rajhans & Rana, Nripendra P. & Dwivedi, Yogesh K., 2018. "Exploring reviews and review sequences on e-commerce platform: A study of helpful reviews on Amazon.in," Journal of Retailing and Consumer Services, Elsevier, vol. 45(C), pages 21-32.
    2. Filieri, Raffaele, 2016. "What makes an online consumer review trustworthy?," Annals of Tourism Research, Elsevier, vol. 58(C), pages 46-64.
    3. Ismagilova, Elvira & Slade, Emma & Rana, Nripendra P. & Dwivedi, Yogesh K., 2020. "The effect of characteristics of source credibility on consumer behaviour: A meta-analysis," Journal of Retailing and Consumer Services, Elsevier, vol. 53(C).
    4. Mustak, Mekhail & Salminen, Joni & Plé, Loïc & Wirtz, Jochen, 2021. "Artificial intelligence in marketing: Topic modeling, scientometric analysis, and research agenda," Journal of Business Research, Elsevier, vol. 124(C), pages 389-404.
    5. Sherry He & Brett Hollenbeck & Davide Proserpio, 2022. "The Market for Fake Reviews," Marketing Science, INFORMS, vol. 41(5), pages 896-921, September.
    6. Andreas Munzel, 2016. "Assisting consumers in detecting fake reviews: The role of identity information disclosure and consensus," Post-Print hal-02423574, HAL.
    7. Daria Plotkina & Andreas Munzel & Jessie Pallud, 2020. "Illusions of truth—Experimental insights into human and algorithmic detections of fake online reviews," Post-Print hal-02423585, HAL.
    8. Costa, Ana & Guerreiro, João & Moro, Sérgio & Henriques, Roberto, 2019. "Unfolding the characteristics of incentivized online reviews," Journal of Retailing and Consumer Services, Elsevier, vol. 47(C), pages 272-281.
    9. Munzel, Andreas, 2016. "Assisting consumers in detecting fake reviews: The role of identity information disclosure and consensus," Journal of Retailing and Consumer Services, Elsevier, vol. 32(C), pages 96-108.
    10. Tran, Gina A. & Strutton, David, 2020. "Comparing email and SNS users: Investigating e-servicescape, customer reviews, trust, loyalty and E-WOM," Journal of Retailing and Consumer Services, Elsevier, vol. 53(C).
    11. Mekhail Mustak & Joni Salminen & Loïc Plé & Jochen Wirtz, 2021. "Artificial intelligence in marketing: Topic modeling, scientometric analysis, and research agenda," Post-Print hal-03269994, HAL.
    12. Salminen, Joni & Yoganathan, Vignesh & Corporan, Juan & Jansen, Bernard J. & Jung, Soon-Gyo, 2019. "Machine learning approach to auto-tagging online content for content marketing efficiency: A comparative analysis between methods and content type," Journal of Business Research, Elsevier, vol. 101(C), pages 203-217.
    13. Andreas Munzel & Werner H. Kunz, 2014. "Creators, multipliers, and lurkers: who contributes and who benefits at online review sites," Post-Print hal-02423582, HAL.
    14. Endo, Seiji & Yang, Jun & Park, JungKun, 2012. "The investigation on dimensions of e-satisfaction for online shoes retailing," Journal of Retailing and Consumer Services, Elsevier, vol. 19(4), pages 398-405.
    15. Andreas Munzel, 2016. "Assisting consumers in detecting fake reviews: The role of identity information disclosure and consensus," Post-Print halshs-01522497, HAL.
    16. Plotkina, Daria & Munzel, Andreas & Pallud, Jessie, 2020. "Illusions of truth—Experimental insights into human and algorithmic detections of fake online reviews," Journal of Business Research, Elsevier, vol. 109(C), pages 511-523.
    17. George A. Akerlof, 1970. "The Market for "Lemons": Quality Uncertainty and the Market Mechanism," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 84(3), pages 488-500.
    18. Petrescu, Maria & O’Leary, Kathleen & Goldring, Deborah & Ben Mrad, Selima, 2018. "Incentivized reviews: Promising the moon for a few stars," Journal of Retailing and Consumer Services, Elsevier, vol. 41(C), pages 288-295.
    19. Loureiro, Sandra M.C. & Cavallero, Luisa & Miranda, Francisco Javier, 2018. "Fashion brands on retail websites: Customer performance expectancy and e-word-of-mouth," Journal of Retailing and Consumer Services, Elsevier, vol. 41(C), pages 131-141.
    20. Duarte, Paulo & Costa e Silva, Susana & Ferreira, Margarida Bernardo, 2018. "How convenient is it? Delivering online shopping convenience to enhance customer satisfaction and encourage e-WOM," Journal of Retailing and Consumer Services, Elsevier, vol. 44(C), pages 161-169.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fernandes, Semila & Panda, Rajesh & Venkatesh, V.G. & Swar, Biranchi Narayan & Shi, Yangyan, 2022. "Measuring the impact of online reviews on consumer purchase decisions – A scale development study," Journal of Retailing and Consumer Services, Elsevier, vol. 68(C).
    2. Runcheng Xia & Xuefan Dong & Jiajun An & Handi Wang, 2025. "The impact of fake online reviews on customer satisfaction: an empirical study on JD.com," Electronic Commerce Research, Springer, vol. 25(6), pages 4689-4716, December.
    3. Costa Filho, Murilo & Nogueira Rafael, Diego & Salmonson Guimarães Barros, Lucia & Mesquita, Eduardo, 2023. "Mind the fake reviews! Protecting consumers from deception through persuasion knowledge acquisition," Journal of Business Research, Elsevier, vol. 156(C).
    4. Perez, Dikla & Stockheim, Inbal & Baratz, Guy, 2022. "Complimentary competition: The impact of positive competitor reviews on review credibility and consumer purchase intentions," Journal of Retailing and Consumer Services, Elsevier, vol. 69(C).
    5. Costa, Ana & Guerreiro, João & Moro, Sérgio & Henriques, Roberto, 2019. "Unfolding the characteristics of incentivized online reviews," Journal of Retailing and Consumer Services, Elsevier, vol. 47(C), pages 272-281.
    6. Aghakhani, Hamed & Main, Kelley J., 2019. "Can two negatives make a positive? Social exclusion prevents carryover effects from deceptive advertising," Journal of Retailing and Consumer Services, Elsevier, vol. 47(C), pages 206-214.
    7. Mardumyan, Anna & Siret, Iris, 2023. "When review verification does more harm than good: How certified reviews determine customer–brand relationship quality," Journal of Business Research, Elsevier, vol. 160(C).
    8. Stockheim, Inbal & Perez, Dikla & Podkamien, Yael, 2024. "Friend and Foe: The impact of complimentary competitor content (CCC) on consumer response towards the endorsing competitor," Journal of Retailing and Consumer Services, Elsevier, vol. 79(C).
    9. Talwar, Shalini & Dhir, Amandeep & Kaur, Puneet & Zafar, Nida & Alrasheedy, Melfi, 2019. "Why do people share fake news? Associations between the dark side of social media use and fake news sharing behavior," Journal of Retailing and Consumer Services, Elsevier, vol. 51(C), pages 72-82.
    10. Birim, Şule Öztürk & Kazancoglu, Ipek & Kumar Mangla, Sachin & Kahraman, Aysun & Kumar, Satish & Kazancoglu, Yigit, 2022. "Detecting fake reviews through topic modelling," Journal of Business Research, Elsevier, vol. 149(C), pages 884-900.
    11. Petrescu, Maria & Ajjan, Haya & Harrison, Dana L., 2023. "Man vs machine – Detecting deception in online reviews," Journal of Business Research, Elsevier, vol. 154(C).
    12. Rosillo-Díaz, Elena & Muñoz-Rosas, Juan Francisco & Blanco-Encomienda, Francisco Javier, 2024. "Impact of heuristic–systematic cues on the purchase intention of the electronic commerce consumer through the perception of product quality," Journal of Retailing and Consumer Services, Elsevier, vol. 81(C).
    13. Onete Cristian Bogdan & Chita Sandra Diana & Vargas Vanesa Madalina, 2020. "The impact of fake news on the real estate market," Proceedings of the International Conference on Business Excellence, Sciendo, vol. 14(1), pages 316-323, July.
    14. Pop Mihai-Ionuț & Ene Irina, 2019. "Influence of the educational level on the spreading of Fake News regarding the energy field in the online environment," Proceedings of the International Conference on Business Excellence, Sciendo, vol. 13(1), pages 1108-1117, May.
    15. Josef Zelenka & Tracy Azubuike & Martina Pásková, 2021. "Trust Model for Online Reviews of Tourism Services and Evaluation of Destinations," Administrative Sciences, MDPI, vol. 11(2), pages 1-21, March.
    16. Pooja Katyal & Reetika Sehgal & Anand Kumar Gupta, 2025. "The impact of online consumer reviews on purchase intentions for electronic products," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 16(9), pages 3178-3197, September.
    17. Hossin Md Altab & Mu Yinping & Hosain Md Sajjad & Adasa Nkrumah Kofi Frimpong & Michelle Frempomaa Frempong & Stephen Sarfo Adu-Yeboah, 2022. "Understanding Online Consumer Textual Reviews and Rating: Review Length With Moderated Multiple Regression Analysis Approach," SAGE Open, , vol. 12(2), pages 21582440221, June.
    18. Visentin, Marco & Pizzi, Gabriele & Pichierri, Marco, 2019. "Fake News, Real Problems for Brands: The Impact of Content Truthfulness and Source Credibility on consumers' Behavioral Intentions toward the Advertised Brands," Journal of Interactive Marketing, Elsevier, vol. 45(C), pages 99-112.
    19. Sharma, Manu & Kaushal, Deepak & Joshi, Sudhanshu, 2023. "Adverse effect of social media on generation Z user's behavior: Government information support as a moderating variable," Journal of Retailing and Consumer Services, Elsevier, vol. 72(C).
    20. Truong Thi Hue & Ta Huy Hung, 2025. "Impact of artificial intelligence on branding: a bibliometric review and future research directions," Humanities and Social Sciences Communications, Palgrave Macmillan, vol. 12(1), pages 1-11, December.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:joreco:v:64:y:2022:i:c:s0969698921003374. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/journal-of-retailing-and-consumer-services .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.