IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v68y2022i9p6865-6888.html
   My bibliography  Save this article

More than the Quantity: The Value of Editorial Reviews for a User-Generated Content Platform

Author

Listed:
  • Yipu Deng

    (Faculty of Business and Economics, The University of Hong Kong, Hong Kong)

  • Jinyang Zheng

    (Krannert School of Management, Purdue University, West Lafayette, Indiana 47907)

  • Warut Khern-am-nuai

    (Desautels Faculty of Management, McGill University, Montreal, Quebec H3A 1G5, Canada)

  • Karthik Kannan

    (Krannert School of Management, Purdue University, West Lafayette, Indiana 47907)

Abstract

We investigate an editorial review program for which a review platform supplements user reviews with editorial ones written by professional writers. Specifically, we examine whether and how editorial reviews influence subsequent user reviews (reviews written by noneditor reviewers). A quasiexperiment conducted on a leading review platform in Asia, based on several econometric and natural language processing techniques, yields empirical evidence of an overall positive effect of editorial reviews on subsequent user reviews from the platform’s perspective. First, more reviews are provided for restaurants that receive editorial reviews. In addition, these reviews discuss substantive topics while also including a discussion on other topics, leading to a net increase in content length and variety. They also are more neutral in sentiment and are associated with lower rating valences. Further analysis of the mechanism reveals that the subsequent user reviews of the restaurants that receive editorial reviews become more similar to the editorial reviews in regard to topics, sentiment/rating, length, and readability, indicating a herding effect in how to write a review as the main driver of the change in the subsequent reviews. We further empirically isolate this herding effect among long-time reviewers. The findings suggest that review platforms could use an editorial review program not only to boost the quantitative aspect of user reviews but also, to manage the qualitative aspect as well.

Suggested Citation

  • Yipu Deng & Jinyang Zheng & Warut Khern-am-nuai & Karthik Kannan, 2022. "More than the Quantity: The Value of Editorial Reviews for a User-Generated Content Platform," Management Science, INFORMS, vol. 68(9), pages 6865-6888, September.
    • Handle: RePEc:inm:ormnsc:v:68:y:2022:i:9:p:6865-6888
    DOI: 10.1287/mnsc.2021.4238
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mnsc.2021.4238
    Download Restriction: no
    File URL: https://libkey.io/10.1287/mnsc.2021.4238?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Dina Mayzlin & Yaniv Dover & Judith Chevalier, 2014. "Promotional Reviews: An Empirical Investigation of Online Review Manipulation," American Economic Review, American Economic Association, vol. 104(8), pages 2421-2455, August.
    2. Sam Ransbotham & Nicholas H. Lurie & Hongju Liu, 2019. "Creation and Consumption of Mobile Word of Mouth: How Are Mobile Reviews Different?," Marketing Science, INFORMS, vol. 38(5), pages 773-792, September.
    3. Yubo Chen & Jinhong Xie, 2005. "Third-Party Product Review and Firm Marketing Strategy," Marketing Science, INFORMS, vol. 24(2), pages 218-240, February.
    4. Luís Cabral & Lingfang (Ivy) Li, 2015. "A Dollar for Your Thoughts: Feedback-Conditional Rebates on eBay," Management Science, INFORMS, vol. 61(9), pages 2052-2063, September.
    5. Yan Chen & F. Maxwell Harper & Joseph Konstan & Sherry Xin Li, 2010. "Social Comparisons and Contributions to Online Communities: A Field Experiment on MovieLens," American Economic Review, American Economic Association, vol. 100(4), pages 1358-1398, September.
    6. Geetha, M. & Singha, Pratap & Sinha, Sumedha, 2017. "Relationship between customer sentiment and online customer ratings for hotels - An empirical analysis," Tourism Management, Elsevier, vol. 61(C), pages 43-54.
    7. Patrick J. Bateman & Peter H. Gray & Brian S. Butler, 2011. "Research Note ---The Impact of Community Commitment on Participation in Online Communities," Information Systems Research, INFORMS, vol. 22(4), pages 841-854, December.
    8. Marsh, Catherine, 1985. "Back on the Bandwagon: The Effect of Opinion Polls on Public Opinion," British Journal of Political Science, Cambridge University Press, vol. 15(1), pages 51-74, January.
    9. Yang Jiang & Yi-Chun (Chad) Ho & Xiangbin Yan & Yong Tan, 2020. "When Online Lending Meets Real Estate: Examining Investment Decisions in Lending-Based Real Estate Crowdfunding," Information Systems Research, INFORMS, vol. 31(3), pages 715-730, September.
    10. Jonah Berger & Alan T. Sorensen & Scott J. Rasmussen, 2010. "Positive Effects of Negative Publicity: When Negative Reviews Increase Sales," Marketing Science, INFORMS, vol. 29(5), pages 815-827, 09-10.
    11. Chrysanthos Dellarocas, 2003. "The Digitization of Word of Mouth: Promise and Challenges of Online Feedback Mechanisms," Management Science, INFORMS, vol. 49(10), pages 1407-1424, October.
    12. Nikolay Archak & Anindya Ghose & Panagiotis G. Ipeirotis, 2011. "Deriving the Pricing Power of Product Features by Mining Consumer Reviews," Management Science, INFORMS, vol. 57(8), pages 1485-1509, August.
    13. Elham Yazdani & Shyam Gopinath & Steve Carson, 2018. "Preaching to the Choir: The Chasm Between Top-Ranked Reviewers, Mainstream Customers, and Product Sales," Marketing Science, INFORMS, vol. 37(5), pages 838-851, September.
    14. Khim-Yong Goh & Cheng-Suang Heng & Zhijie Lin, 2013. "Social Media Brand Community and Consumer Behavior: Quantifying the Relative Impact of User- and Marketer-Generated Content," Information Systems Research, INFORMS, vol. 24(1), pages 88-107, March.
    15. Marianne Bertrand & Esther Duflo & Sendhil Mullainathan, 2004. "How Much Should We Trust Differences-In-Differences Estimates?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(1), pages 249-275.
    16. Dezhi Yin & Sabyasachi Mitra & Han Zhang, 2016. "Research Note—When Do Consumers Value Positive vs. Negative Reviews? An Empirical Investigation of Confirmation Bias in Online Word of Mouth," Information Systems Research, INFORMS, vol. 27(1), pages 131-144, March.
    17. David H. Autor, 2003. "Outsourcing at Will: The Contribution of Unjust Dismissal Doctrine to the Growth of Employment Outsourcing," Journal of Labor Economics, University of Chicago Press, vol. 21(1), pages 1-42, January.
    18. Vandith Pamuru & Warut Khern-am-nuai & Karthik Kannan, 2021. "The Impact of an Augmented-Reality Game on Local Businesses: A Study of Pokémon Go on Restaurants," Information Systems Research, INFORMS, vol. 32(3), pages 950-966, September.
    19. Ginger Zhe Jin & Phillip Leslie, 2003. "The Effect of Information on Product Quality: Evidence from Restaurant Hygiene Grade Cards," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(2), pages 409-451.
    20. Jean Tirole, 1988. "The Theory of Industrial Organization," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262200716, December.
    21. Luis Diestre & Benjamin Barber & Juan Santaló, 2020. "The Friday Effect: Firm Lobbying, the Timing of Drug Safety Alerts, and Drug Side Effects," Management Science, INFORMS, vol. 66(8), pages 3677-3698, August.
    22. Charles F. Manski, 1993. "Identification of Endogenous Social Effects: The Reflection Problem," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 60(3), pages 531-542.
    23. Vicki McKinney & Kanghyun Yoon & Fatemeh “Mariam” Zahedi, 2002. "The Measurement of Web-Customer Satisfaction: An Expectation and Disconfirmation Approach," Information Systems Research, INFORMS, vol. 13(3), pages 296-315, September.
    24. Ann E. Schlosser, 2005. "Posting versus Lurking: Communicating in a Multiple Audience Context," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 32(2), pages 260-265, September.
    25. Xiaohua Zeng & Liyuan Wei, 2013. "Social Ties and User Content Generation: Evidence from Flickr," Information Systems Research, INFORMS, vol. 24(1), pages 71-87, March.
    26. Koray Özpolat & Guodong (Gordon) Gao & Wolfgang Jank & Siva Viswanathan, 2013. "Research Note ---The Value of Third-Party Assurance Seals in Online Retailing: An Empirical Investigation," Information Systems Research, INFORMS, vol. 24(4), pages 1100-1111, December.
    27. Wendy W. Moe & David A. Schweidel, 2012. "Online Product Opinions: Incidence, Evaluation, and Evolution," Marketing Science, INFORMS, vol. 31(3), pages 372-386, May.
    28. Dellarocas, Chrysanthos, 2003. "The Digitization of Word-of-mouth: Promise and Challenges of Online Feedback Mechanisms," Working papers 4296-03, Massachusetts Institute of Technology (MIT), Sloan School of Management.
    29. Hongbin Cai & Yuyu Chen & Hanming Fang, 2009. "Observational Learning: Evidence from a Randomized Natural Field Experiment," American Economic Review, American Economic Association, vol. 99(3), pages 864-882, June.
    30. Theodoros Lappas & Gaurav Sabnis & Georgios Valkanas, 2016. "The Impact of Fake Reviews on Online Visibility: A Vulnerability Assessment of the Hotel Industry," Information Systems Research, INFORMS, vol. 27(4), pages 940-961, December.
    31. Warut Khern-am-nuai & Karthik Kannan & Hossein Ghasemkhani, 2018. "Extrinsic versus Intrinsic Rewards for Contributing Reviews in an Online Platform," Information Systems Research, INFORMS, vol. 29(4), pages 871-892, December.
    32. Ni Huang & Gordon Burtch & Bin Gu & Yili Hong & Chen Liang & Kanliang Wang & Dongpu Fu & Bo Yang, 2019. "Motivating User-Generated Content with Performance Feedback: Evidence from Randomized Field Experiments," Management Science, INFORMS, vol. 65(1), pages 327-345, January.
    33. Yi-Chun (Chad) Ho & Junjie Wu & Yong Tan, 2017. "Disconfirmation Effect on Online Rating Behavior: A Structural Model," Information Systems Research, INFORMS, vol. 28(3), pages 626-642, September.
    34. Xiaoquan (Michael) Zhang & Feng Zhu, 2011. "Group Size and Incentives to Contribute: A Natural Experiment at Chinese Wikipedia," American Economic Review, American Economic Association, vol. 101(4), pages 1601-1615, June.
    35. Juanjuan Zhang & Peng Liu, 2012. "Rational Herding in Microloan Markets," Management Science, INFORMS, vol. 58(5), pages 892-912, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dominik Gutt & Jürgen Neumann & Steffen Zimmermann & Dennis Kundisch & Jianqing Chen, 2018. "Design of Review Systems - A Strategic Instrument to shape Online Review Behavior and Economic Outcomes," Working Papers Dissertations 42, Paderborn University, Faculty of Business Administration and Economics.
    2. Marios Kokkodis & Theodoros Lappas & Gerald C. Kane, 2022. "Optional purchase verification in e‐commerce platforms: More representative product ratings and higher quality reviews," Production and Operations Management, Production and Operations Management Society, vol. 31(7), pages 2943-2961, July.
    3. Chong (Alex) Wang & Xiaoquan (Michael) Zhang & Il-Horn Hann, 2018. "Socially Nudged: A Quasi-Experimental Study of Friends’ Social Influence in Online Product Ratings," Information Systems Research, INFORMS, vol. 29(3), pages 641-655, September.
    4. Christoph Schneider & Markus Weinmann & Peter N.C. Mohr & Jan vom Brocke, 2021. "When the Stars Shine Too Bright: The Influence of Multidimensional Ratings on Online Consumer Ratings," Management Science, INFORMS, vol. 67(6), pages 3871-3898, June.
    5. Warut Khern-am-nuai & Karthik Kannan & Hossein Ghasemkhani, 2018. "Extrinsic versus Intrinsic Rewards for Contributing Reviews in an Online Platform," Information Systems Research, INFORMS, vol. 29(4), pages 871-892, December.
    6. Heeseung Andrew Lee & Angela Aerry Choi & Tianshu Sun & Wonseok Oh, 2021. "Reviewing Before Reading? An Empirical Investigation of Book-Consumption Patterns and Their Effects on Reviews and Sales," Information Systems Research, INFORMS, vol. 32(4), pages 1368-1389, December.
    7. Ana Babić Rosario & Kristine Valck & Francesca Sotgiu, 2020. "Conceptualizing the electronic word-of-mouth process: What we know and need to know about eWOM creation, exposure, and evaluation," Journal of the Academy of Marketing Science, Springer, vol. 48(3), pages 422-448, May.
    8. Paulo B. Goes & Mingfeng Lin & Ching-man Au Yeung, 2014. "“Popularity Effect” in User-Generated Content: Evidence from Online Product Reviews," Information Systems Research, INFORMS, vol. 25(2), pages 222-238, June.
    9. Marios Kokkodis & Theodoros Lappas, 2020. "Your Hometown Matters: Popularity-Difference Bias in Online Reputation Platforms," Information Systems Research, INFORMS, vol. 31(2), pages 412-430, June.
    10. Jake Hoskins & Shyam Gopinath & J. Cameron Verhaal & Elham Yazdani, 2021. "The influence of the online community, professional critics, and location similarity on review ratings for niche and mainstream brands," Journal of the Academy of Marketing Science, Springer, vol. 49(6), pages 1065-1087, November.
    11. Juan Feng & Xin Li & Xiaoquan (Michael) Zhang, 2019. "Online Product Reviews-Triggered Dynamic Pricing: Theory and Evidence," Information Systems Research, INFORMS, vol. 30(4), pages 1107-1123, December.
    12. Kim, Jong Min & Lee, Eunkyung & Mariani, Marcello M., 2021. "The influence of launching mobile channels on online customer reviews," Journal of Business Research, Elsevier, vol. 137(C), pages 366-378.
    13. S. Cicognani & P. Figini & M. Magnani, 2016. "Social Influence Bias in Online Ratings: A Field Experiment," Working Papers wp1060, Dipartimento Scienze Economiche, Universita' di Bologna.
    14. Ni Huang & Yili Hong & Gordon Burtch, 2015. "Digital Social Visibility, Anonymity and User Content Generation: Evidence from Natural Experiments," Working Papers 15-04, NET Institute.
    15. Ni Huang & Gordon Burtch & Bin Gu & Yili Hong & Chen Liang & Kanliang Wang & Dongpu Fu & Bo Yang, 2019. "Motivating User-Generated Content with Performance Feedback: Evidence from Randomized Field Experiments," Management Science, INFORMS, vol. 65(1), pages 327-345, January.
    16. Foster, Joshua, 2022. "How rating mechanisms shape user search, quality inference and engagement in online platforms: Experimental evidence," Journal of Business Research, Elsevier, vol. 142(C), pages 791-807.
    17. Jorge Mejia & Shawn Mankad & Anandasivam Gopal, 2019. "A for Effort? Using the Crowd to Identify Moral Hazard in New York City Restaurant Hygiene Inspections," Information Systems Research, INFORMS, vol. 30(4), pages 1363-1386, December.
    18. Young-Jin Lee & Kartik Hosanagar & Yong Tan, 2015. "Do I Follow My Friends or the Crowd? Information Cascades in Online Movie Ratings," Management Science, INFORMS, vol. 61(9), pages 2241-2258, September.
    19. Xiang Hui & Tobias J. Klein & Konrad Stahl, 2021. "When and Why Do Buyers Rate in Online Markets?," CRC TR 224 Discussion Paper Series crctr224_2021_267v1, University of Bonn and University of Mannheim, Germany.
    20. Cheng Zhao & Chong Alex Wang, 2023. "A cross-site comparison of online review manipulation using Benford’s law," Electronic Commerce Research, Springer, vol. 23(1), pages 365-406, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:68:y:2022:i:9:p:6865-6888. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.