IDEAS home Printed from https://ideas.repec.org/p/feb/framed/00821.html
   My bibliography  Save this paper

The Impact of Fake Reviews on Demand and Welfare

Author

Listed:
  • Jesper Akesson
  • Robert Hahn
  • Robert Metcalfe
  • Manuel Monti-Nussbaum

Abstract

Although fake online customer reviews have become prevalent on platforms such as Amazon, Google, and Facebook, little is known about how these reviews influence consumer behavior. This paper provides the first experimental estimates of the effects of fake reviews on individual demand and welfare. We conduct an incentive-compatible online experiment with a nationally representative sample of respondents from the United Kingdom. Consumers are asked to choose a product category, browse a platform resembling Amazon, and select one of five equally priced products. One of the products is of inferior quality, one is of superior quality, and three are of average quality. We randomly allocate participants to variants of the platform: five treatment groups see positive fake reviews for an inferior product, and the control group does not see fake reviews. Moreover, some participants are randomly selected to receive an educational intervention that aims to mitigate the potential effects of fake reviews. Our analysis of the experimental data yields four findings. First, fake reviews make consumers more likely to choose lower-quality products. Second, we estimate that welfare losses from such reviews may be important - on the order of .12 dollars for each dollar spent in the setting we study. Third, we find that fake reviews have heterogeneous effects. For example, the effect of fake reviews is smaller for those who do not trust customer reviews. Fake reviews also have larger effects on those who shop online more frequently. Fourth, we show that the educational intervention reduces the adverse welfare impact of fake reviews by 44%.

Suggested Citation

  • Jesper Akesson & Robert Hahn & Robert Metcalfe & Manuel Monti-Nussbaum, 2025. "The Impact of Fake Reviews on Demand and Welfare," Framed Field Experiments 00821, The Field Experiments Website.
    • Handle: RePEc:feb:framed:00821
    as

    Download full text from publisher

    File URL: http://s3.amazonaws.com/fieldexperiments-papers2/papers/00821.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Dina Mayzlin & Yaniv Dover & Judith Chevalier, 2014. "Promotional Reviews: An Empirical Investigation of Online Review Manipulation," American Economic Review, American Economic Association, vol. 104(8), pages 2421-2455, August.
    2. Salvatore Piccolo & Piero Tedeschi & Giovanni Ursino, 2018. "Deceptive Advertising with Rational Buyers," Management Science, INFORMS, vol. 64(3), pages 1291-1310, March.
    3. Alessandro Bonatti & Gonzalo Cisternas, 2020. "Consumer Scores and Price Discrimination," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 87(2), pages 750-791.
    4. Raluca M. Ursu, 2018. "The Power of Rankings: Quantifying the Effect of Rankings on Online Consumer Search and Purchase Decisions," Marketing Science, INFORMS, vol. 37(4), pages 530-552, August.
    5. Patrick Bajari & Ali Hortaçsu, 2004. "Economic Insights from Internet Auctions," Journal of Economic Literature, American Economic Association, vol. 42(2), pages 457-486, June.
    6. Christopher T. Stanton & Catherine Thomas, 2016. "Landing the First Job: The Value of Intermediaries in Online Hiring," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 83(2), pages 810-854.
    7. Chrysanthos Dellarocas, 2006. "Strategic Manipulation of Internet Opinion Forums: Implications for Consumers and Firms," Management Science, INFORMS, vol. 52(10), pages 1577-1593, October.
    8. Dmitry Taubinsky & Alex Rees-Jones, 2018. "Attention Variation and Welfare: Theory and Evidence from a Tax Salience Experiment," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 85(4), pages 2462-2496.
    9. Kemal Kıvanç Aköz & Cemal Eren Arbatli & Levent Celik, 2020. "Manipulation Through Biased Product Reviews," Journal of Industrial Economics, Wiley Blackwell, vol. 68(4), pages 591-639, December.
    10. Tobias J. Klein & Christian Lambertz & Konrad O. Stahl, 2016. "Market Transparency, Adverse Selection, and Moral Hazard," Journal of Political Economy, University of Chicago Press, vol. 124(6), pages 1677-1713.
    11. Paul Dolfen & Liran Einav & Peter J. Klenow & Benjamin Klopack & Jonathan D. Levin & Larry Levin & Wayne Best, 2023. "Assessing the Gains from E-Commerce," American Economic Journal: Macroeconomics, American Economic Association, vol. 15(1), pages 342-370, January.
    12. Ginger Zhe Jin & Andrew Kato, 2006. "Price, quality, and reputation: evidence from an online field experiment," RAND Journal of Economics, RAND Corporation, vol. 37(4), pages 983-1005, December.
    13. Alan Benson & Aaron Sojourner & Akhmed Umyarov, 2020. "Can Reputation Discipline the Gig Economy? Experimental Evidence from an Online Labor Market," Management Science, INFORMS, vol. 66(5), pages 1802-1825, May.
    14. Paul Belleflamme & Martin Peitz, 2018. "Inside the Engine Room of Digital Platforms: Reviews, Ratings, and Recommendations," Working Papers halshs-01714549, HAL.
    15. Sherry He & Brett Hollenbeck & Davide Proserpio, 2022. "The Market for Fake Reviews," Marketing Science, INFORMS, vol. 41(5), pages 896-921, September.
    16. Ginger Zhe Jin & Phillip Leslie, 2003. "The Effect of Information on Product Quality: Evidence from Restaurant Hygiene Grade Cards," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(2), pages 409-451.
    17. Zhuang, Mengzhou & Cui, Geng & Peng, Ling, 2018. "Manufactured opinions: The effect of manipulating online product reviews," Journal of Business Research, Elsevier, vol. 87(C), pages 24-35.
    18. Salminen, Joni & Kandpal, Chandrashekhar & Kamel, Ahmed Mohamed & Jung, Soon-gyo & Jansen, Bernard J., 2022. "Creating and detecting fake reviews of online products," Journal of Retailing and Consumer Services, Elsevier, vol. 64(C).
    19. Hunt Allcott & Judd B. Kessler, 2019. "The Welfare Effects of Nudges: A Case Study of Energy Use Social Comparisons," American Economic Journal: Applied Economics, American Economic Association, vol. 11(1), pages 236-276, January.
    20. Michael Anderson & Jeremy Magruder, 2012. "Learning from the Crowd: Regression Discontinuity Estimates of the Effects of an Online Review Database," Economic Journal, Royal Economic Society, vol. 122(563), pages 957-989, September.
    21. Luigi Butera & Robert Metcalfe & William Morrison & Dmitry Taubinsky, 2022. "Measuring the Welfare Effects of Shame and Pride," American Economic Review, American Economic Association, vol. 112(1), pages 122-168, January.
    22. Uttara M. Ananthakrishnan & Beibei Li & Michael D. Smith, 2020. "A Tangled Web: Should Online Review Portals Display Fraudulent Reviews?," Information Systems Research, INFORMS, vol. 31(3), pages 950-971, September.
    23. Gordon Pennycook & Adam Bear & Evan T. Collins & David G. Rand, 2020. "The Implied Truth Effect: Attaching Warnings to a Subset of Fake News Headlines Increases Perceived Accuracy of Headlines Without Warnings," Management Science, INFORMS, vol. 66(11), pages 4944-4957, November.
    24. Luís Cabral & Ali Hortaçsu, 2010. "The Dynamics Of Seller Reputation: Evidence From Ebay," Journal of Industrial Economics, Wiley Blackwell, vol. 58(1), pages 54-78, March.
    25. Michael Dinerstein & Liran Einav & Jonathan Levin & Neel Sundaresan, 2018. "Consumer Price Search and Platform Design in Internet Commerce," American Economic Review, American Economic Association, vol. 108(7), pages 1820-1859, July.
    26. Judith A. Chevalier & Yaniv Dover & Dina MayzlinDina Mayzlin, 2018. "Channels of Impact: User Reviews When Quality Is Dynamic and Managers Respond," Marketing Science, INFORMS, vol. 37(5), pages 688-709, September.
    27. Imke Reimers & Joel Waldfogel, 2021. "Digitization and Pre-purchase Information: The Causal and Welfare Impacts of Reviews and Crowd Ratings," American Economic Review, American Economic Association, vol. 111(6), pages 1944-1971, June.
    28. Chunhua Wu & Hai Che & Tat Y. Chan & Xianghua Lu, 2015. "The Economic Value of Online Reviews," Marketing Science, INFORMS, vol. 34(5), pages 739-754, September.
    29. Paul Belleflamme & Martin Peitz, 2018. "Inside the Engine Room of Digital Platforms: Reviews, Ratings, and Recommendations," Working Papers halshs-01714549, HAL.
    30. John A. List, 2006. "The Behavioralist Meets the Market: Measuring Social Preferences and Reputation Effects in Actual Transactions," Journal of Political Economy, University of Chicago Press, vol. 114(1), pages 1-37, February.
    31. Michael Luca, 2011. "Reviews, Reputation, and Revenue: The Case of Yelp.com," Harvard Business School Working Papers 12-016, Harvard Business School, revised Mar 2016.
    32. Moshe A. Barach & Joseph M. Golden & John J. Horton, 2020. "Steering in Online Markets: The Role of Platform Incentives and Credibility," Management Science, INFORMS, vol. 66(9), pages 4047-4070, September.
    33. Navdeep S Sahni & Harikesh S Nair, 2020. "Does Advertising Serve as a Signal? Evidence from a Field Experiment in Mobile Search," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 87(3), pages 1529-1564.
    34. John A. List, 2020. "Non est Disputandum de Generalizability? A Glimpse into The External Validity Trial," NBER Working Papers 27535, National Bureau of Economic Research, Inc.
    35. Paul Resnick & Richard Zeckhauser & John Swanson & Kate Lockwood, 2006. "The value of reputation on eBay: A controlled experiment," Experimental Economics, Springer;Economic Science Association, vol. 9(2), pages 79-101, June.
    36. Ruomeng Cui & Jun Li & Dennis J. Zhang, 2020. "Reducing Discrimination with Reviews in the Sharing Economy: Evidence from Field Experiments on Airbnb," Management Science, INFORMS, vol. 66(3), pages 1071-1094, March.
    37. Charles Hodgson & Gregory Lewis, 2020. "You Can Lead a Horse to Water: Spatial Learning and Path Dependence in Consumer Search," Cowles Foundation Discussion Papers 2246, Cowles Foundation for Research in Economics, Yale University.
    38. Justine S. Hastings & Brigitte C. Madrian & William L. Skimmyhorn, 2013. "Financial Literacy, Financial Education, and Economic Outcomes," Annual Review of Economics, Annual Reviews, vol. 5(1), pages 347-373, May.
    39. John J. Horton, 2017. "The Effects of Algorithmic Labor Market Recommendations: Evidence from a Field Experiment," Journal of Labor Economics, University of Chicago Press, vol. 35(2), pages 345-385.
    40. John A. List, 2003. "Does Market Experience Eliminate Market Anomalies?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(1), pages 41-71.
    41. Pedro Bordalo & Nicola Gennaioli & Andrei Shleifer, 2015. "Salience Theory of Judicial Decisions," The Journal of Legal Studies, University of Chicago Press, vol. 44(S1), pages 7-33.
    42. Andrey Fradkin & David Holtz, 2023. "Do Incentives to Review Help the Market? Evidence from a Field Experiment on Airbnb," Marketing Science, INFORMS, vol. 42(5), pages 853-865, September.
    43. Theodoros Lappas & Gaurav Sabnis & Georgios Valkanas, 2016. "The Impact of Fake Reviews on Online Visibility: A Vulnerability Assessment of the Hotel Industry," Information Systems Research, INFORMS, vol. 27(4), pages 940-961, December.
    44. Ginger Zhe Jin & Andrew Kato, 2006. "Price, quality, and reputation: evidence from an online field experiment," RAND Journal of Economics, The RAND Corporation, vol. 37(4), pages 983-1005, December.
    45. Dina Mayzlin, 2006. "Promotional Chat on the Internet," Marketing Science, INFORMS, vol. 25(2), pages 155-163, 03-04.
    46. Steven Tadelis, 2016. "Reputation and Feedback Systems in Online Platform Markets," Annual Review of Economics, Annual Reviews, vol. 8(1), pages 321-340, October.
    47. Amanda Pallais, 2014. "Inefficient Hiring in Entry-Level Labor Markets," American Economic Review, American Economic Association, vol. 104(11), pages 3565-3599, November.
    48. Michael Luca & Georgios Zervas, 2016. "Fake It Till You Make It: Reputation, Competition, and Yelp Review Fraud," Management Science, INFORMS, vol. 62(12), pages 3412-3427, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gesche, Tobias, 2018. "Reference Price Shifts and Customer Antagonism: Evidence from Reviews for Online Auctions," VfS Annual Conference 2018 (Freiburg, Breisgau): Digital Economy 181650, Verein für Socialpolitik / German Economic Association.
    2. Paul Belleflamme & Martin Peitz, 2018. "Inside the Engine Room of Digital Platforms: Reviews, Ratings, and Recommendations," Working Papers halshs-01714549, HAL.
    3. Yasui, Yuta, 2021. "Controlling Fake Reviews," MPRA Paper 108177, University Library of Munich, Germany.
    4. Hui, Xiang & Klein, Tobias & Stahl, Konrad, 2022. "Learning from Online Ratings," CEPR Discussion Papers 17006, C.E.P.R. Discussion Papers.
    5. Brett Hollenbeck & Sridhar Moorthy & Davide Proserpio, 2019. "Advertising Strategy in the Presence of Reviews: An Empirical Analysis," Marketing Science, INFORMS, vol. 38(5), pages 793-811, September.
    6. Hui Zhao & Xiaoyuan Wang & Debing Ni & Kevin W. Li, 2023. "The Quality-Signaling Role of Manipulated Consumer Reviews," Group Decision and Negotiation, Springer, vol. 32(3), pages 503-536, June.
    7. Xiang Hui & Meng Liu & Raphael Thomadsen, 2022. "Quality Certificates Alleviate Consumer Aversion to Sponsored Search Advertising," CESifo Working Paper Series 9886, CESifo.
    8. Andrey Fradkin & David Holtz, 2023. "Do Incentives to Review Help the Market? Evidence from a Field Experiment on Airbnb," Marketing Science, INFORMS, vol. 42(5), pages 853-865, September.
    9. Harrison-Walker, L. Jean & Jiang, Ying, 2023. "Suspicion of online product reviews as fake: Cues and consequences," Journal of Business Research, Elsevier, vol. 160(C).
    10. Michael Luca & Oren Reshef, 2020. "The Effect of Price on Firm Reputation," NBER Working Papers 27405, National Bureau of Economic Research, Inc.
    11. Tobias J. Klein & Christian Lambertz & Konrad O. Stahl, 2016. "Market Transparency, Adverse Selection, and Moral Hazard," Journal of Political Economy, University of Chicago Press, vol. 124(6), pages 1677-1713.
    12. Zhuang, Mengzhou & Cui, Geng & Peng, Ling, 2018. "Manufactured opinions: The effect of manipulating online product reviews," Journal of Business Research, Elsevier, vol. 87(C), pages 24-35.
    13. Apostolos Filippas & John J. Horton & Joseph M. Golden, 2022. "Reputation Inflation," Marketing Science, INFORMS, vol. 41(4), pages 733-745, July.
    14. Kuo, Fang-Chang, 2024. "Shirking with good reputation? Evidence from hotel industry," International Journal of Industrial Organization, Elsevier, vol. 97(C).
    15. Piolatto, A. & Schuett, Florian, 2022. "Information vs Competition : How Platform Design Affects Profits and Surplus," Discussion Paper 2022-002, Tilburg University, Tilburg Law and Economic Center.
    16. Ian Ayres & Mahzarin Banaji & Christine Jolls, 2015. "Race effects on eBay," RAND Journal of Economics, RAND Corporation, vol. 46(4), pages 891-917, October.
    17. Yassine Lefouili & Leonardo Madio, 2022. "The economics of platform liability," European Journal of Law and Economics, Springer, vol. 53(3), pages 319-351, June.
    18. Krügel, Jan Philipp & Paetzel, Fabian, 2024. "The impact of fraud on reputation systems," Games and Economic Behavior, Elsevier, vol. 144(C), pages 329-354.
    19. Georgios Zervas & Davide Proserpio & John W. Byers, 2021. "A first look at online reputation on Airbnb, where every stay is above average," Marketing Letters, Springer, vol. 32(1), pages 1-16, March.
    20. Daniela Rroshi & Michael Weichselbaumer, 2021. "What is in a price? Evidence on quality signaling for experience goods," Department of Economics Working Papers wuwp311, Vienna University of Economics and Business, Department of Economics.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:feb:framed:00821. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Franco Daniel Albino (email available below). General contact details of provider: http://www.fieldexperiments.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.