IDEAS home Printed from https://ideas.repec.org/a/bla/popmgt/v31y2022i6p2393-2411.html
   My bibliography  Save this article

Swayed by the reviews: Disentangling the effects of average ratings and individual reviews in online word‐of‐mouth

Author

Listed:
  • Zhanfei Lei
  • Dezhi Yin
  • Sabyasachi Mitra
  • Han Zhang

Abstract

Online word‐of‐mouth studies generally assume that a product's average rating is the primary force shaping consumers’ purchase decisions and driving sales. Similarly, practitioners place more emphasis on average ratings by displaying them at more salient places than individual reviews. In contrast, emerging evidence suggests that individual reviews also affect the decision‐making of those consumers who consult both kinds of information. However, because average ratings and individual reviews are often correlated and confounded empirically, little research has attempted to disentangle their effects. To address this empirical challenge, we construct trade‐off situations in which the average ratings and top‐ranked reviews of different product options do not align with each other. We then investigate consumers’ preferences that can indirectly reveal the relative impact of average ratings versus top reviews. Through an archival analysis of a panel dataset and two laboratory experiments, we find consistent evidence for a swaying effect of individual reviews and reveal their textual content as a likely reason. These findings challenge the commonly accepted assumption of average ratings being the primary driver of consumers’ purchase decisions and suggest that consumers may not be as rational as previous literature assumed. In addition, this paper is the first to disentangle the effects of average ratings and individual reviews on consumer decision‐making and explore a possible reason for the swaying effect of individual reviews. Our paper illustrates the importance of information accessibility in consumers’ purchase decisions, and our findings offer valuable insights for product manufacturers, online retailers, and review platforms.

Suggested Citation

  • Zhanfei Lei & Dezhi Yin & Sabyasachi Mitra & Han Zhang, 2022. "Swayed by the reviews: Disentangling the effects of average ratings and individual reviews in online word‐of‐mouth," Production and Operations Management, Production and Operations Management Society, vol. 31(6), pages 2393-2411, June.
    • Handle: RePEc:bla:popmgt:v:31:y:2022:i:6:p:2393-2411
    DOI: 10.1111/poms.13695
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/poms.13695
    Download Restriction: no
    File URL: https://libkey.io/10.1111/poms.13695?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Kisielius, Jolita & Sternthal, Brian, 1986. "Examining the Vividness Controversy: An Availability-Valence Interpretation," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 12(4), pages 418-431, March.
    2. Sulin Ba & Yuan Jin & Xinxin Li & Xianghua Lu, 2020. "One Size Fits All? The Differential Impact of Online Reviews and Coupons," Production and Operations Management, Production and Operations Management Society, vol. 29(10), pages 2403-2424, October.
    3. Monic Sun, 2012. "How Does the Variance of Product Ratings Matter?," Management Science, INFORMS, vol. 58(4), pages 696-707, April.
    4. Iacus, Stefano & King, Gary & Porro, Giuseppe, 2009. "cem: Software for Coarsened Exact Matching," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 30(i09).
    5. Matthew Blackwell & Stefano Iacus & Gary King & Giuseppe Porro, 2009. "cem: Coarsened exact matching in Stata," Stata Journal, StataCorp LP, vol. 9(4), pages 524-546, December.
    6. Lu (Lucy) Yan & Xiangbin Yan & Yong Tan & Sherry X. Sun, 2019. "Shared Minds: How Patients Use Collaborative Information Sharing via Social Media Platforms," Production and Operations Management, Production and Operations Management Society, vol. 28(1), pages 9-26, January.
    7. Keller, Punam Anand & Block, Lauren G, 1997. "Vividness Effects: A Resource-Matching Perspective," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 24(3), pages 295-304, December.
    8. Yasin Ceran & Harpreet Singh & Vijay Mookerjee, 2016. "Knowing What Your Customer Wants: Improving Inventory Allocation Decisions in Online Movie Rental Systems," Production and Operations Management, Production and Operations Management Society, vol. 25(10), pages 1673-1688, October.
    9. Shiv, Baba & Fedorikhin, Alexander, 1999. "Heart and Mind in Conflict: The Interplay of Affect and Cognition in Consumer Decision Making," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 26(3), pages 278-292, December.
    10. Xu Guan & Yulan Wang & Zelong Yi & Ying‐Ju Chen, 2020. "Inducing Consumer Online Reviews Via Disclosure," Production and Operations Management, Production and Operations Management Society, vol. 29(8), pages 1956-1971, August.
    11. Hongbin Cai & Yuyu Chen & Hanming Fang, 2009. "Observational Learning: Evidence from a Randomized Natural Field Experiment," American Economic Review, American Economic Association, vol. 99(3), pages 864-882, June.
    12. Chris Forman & Anindya Ghose & Batia Wiesenfeld, 2008. "Examining the Relationship Between Reviews and Sales: The Role of Reviewer Identity Disclosure in Electronic Markets," Information Systems Research, INFORMS, vol. 19(3), pages 291-313, September.
    13. Bikhchandani, Sushil & Hirshleifer, David & Welch, Ivo, 1992. "A Theory of Fads, Fashion, Custom, and Cultural Change in Informational Cascades," Journal of Political Economy, University of Chicago Press, vol. 100(5), pages 992-1026, October.
    14. Iacus, Stefano M. & King, Gary & Porro, Giuseppe, 2012. "Causal Inference without Balance Checking: Coarsened Exact Matching," Political Analysis, Cambridge University Press, vol. 20(1), pages 1-24, January.
    15. Haoying Sun & Lizhen Xu, 2018. "Online Reviews and Collaborative Service Provision: A Signal‐Jamming Model," Production and Operations Management, Production and Operations Management Society, vol. 27(11), pages 1960-1977, November.
    16. Floyd, Kristopher & Freling, Ryan & Alhoqail, Saad & Cho, Hyun Young & Freling, Traci, 2014. "How Online Product Reviews Affect Retail Sales: A Meta-analysis," Journal of Retailing, Elsevier, vol. 90(2), pages 217-232.
    17. Goldberg, Marvin E & Gorn, Gerald J, 1987. "Happy and Sad TV Programs: How They Affect Reactions to Commercials," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 14(3), pages 387-403, December.
    18. Dezhi Yin & Sabyasachi Mitra & Han Zhang, 2016. "Research Note—When Do Consumers Value Positive vs. Negative Reviews? An Empirical Investigation of Confirmation Bias in Online Word of Mouth," Information Systems Research, INFORMS, vol. 27(1), pages 131-144, March.
    19. Yang Wang & Paulo Goes & Zaiyan Wei & Daniel Zeng, 2019. "Production of Online Word‐of‐Mouth: Peer Effects and the Moderation of User Characteristics," Production and Operations Management, Production and Operations Management Society, vol. 28(7), pages 1621-1640, July.
    20. Raymond Yiu Keung Lau & Wenping Zhang & Wei Xu, 2018. "Parallel Aspect‐Oriented Sentiment Analysis for Sales Forecasting with Big Data," Production and Operations Management, Production and Operations Management Society, vol. 27(10), pages 1775-1794, October.
    21. Abhijit V. Banerjee, 1992. "A Simple Model of Herd Behavior," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 107(3), pages 797-817.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Numminen, Emil & Sällberg, Henrik & Wang, Shujun, 2022. "The impact of app revenue model choices for app revenues: A study of apps since their initial App Store launch," Economic Analysis and Policy, Elsevier, vol. 76(C), pages 325-336.
    2. Dezhi Yin & Triparna de Vreede & Logan M. Steele & Gert-Jan de Vreede, 2023. "Decide Now or Later: Making Sense of Incoherence Across Online Reviews," Information Systems Research, INFORMS, vol. 34(3), pages 1211-1227, September.
    3. Jalili, Monire & Çil, Eren B. & Pangburn, Michael S., 2024. "Pricing and structuring product trials: Separate versus mixed wine tastings," European Journal of Operational Research, Elsevier, vol. 312(2), pages 668-683.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Philipp B. Cornelius & Bilal Gokpinar, 2020. "The Role of Customer Investor Involvement in Crowdfunding Success," Management Science, INFORMS, vol. 66(1), pages 452-472, January.
    2. Sulin Ba & Yuan Jin & Xinxin Li & Xianghua Lu, 2020. "One Size Fits All? The Differential Impact of Online Reviews and Coupons," Production and Operations Management, Production and Operations Management Society, vol. 29(10), pages 2403-2424, October.
    3. Dezhi Yin & Sabyasachi Mitra & Han Zhang, 2016. "Research Note—When Do Consumers Value Positive vs. Negative Reviews? An Empirical Investigation of Confirmation Bias in Online Word of Mouth," Information Systems Research, INFORMS, vol. 27(1), pages 131-144, March.
    4. Dominik Gutt & Jürgen Neumann & Steffen Zimmermann & Dennis Kundisch & Jianqing Chen, 2018. "Design of Review Systems - A Strategic Instrument to shape Online Review Behavior and Economic Outcomes," Working Papers Dissertations 42, Paderborn University, Faculty of Business Administration and Economics.
    5. Jin Huang, 2017. "To Glance or to Peruse: Observational and Active Learning from Peer Consumers," Working Papers wp2018_1716, CEMFI.
    6. Marchand, André & Hennig-Thurau, Thorsten & Wiertz, Caroline, 2017. "Not all digital word of mouth is created equal: Understanding the respective impact of consumer reviews and microblogs on new product success," International Journal of Research in Marketing, Elsevier, vol. 34(2), pages 336-354.
    7. Jin Huang, 2017. "To Glance or to Peruse: Observational and Active Learning from Peer Consumers," Working Papers wp2017_1716, CEMFI.
    8. Liangfei Qiu & Zhan (Michael) Shi & Andrew B. Whinston, 2018. "Learning from Your Friends’ Check-Ins: An Empirical Study of Location-Based Social Networks," Information Systems Research, INFORMS, vol. 29(4), pages 1044-1061, December.
    9. Tommaso Bondi, 2019. "Alone, Together. Product Discovery Through Consumer Ratings," Working Papers 19-09, NET Institute.
    10. S. Cicognani & P. Figini & M. Magnani, 2016. "Social Influence Bias in Online Ratings: A Field Experiment," Working Papers wp1060, Dipartimento Scienze Economiche, Universita' di Bologna.
    11. Arvind K. Tripathi & Young-Jin Lee & Amit Basu, 2022. "Analyzing the Impact of Public Buyer–Seller Engagement During Online Auctions," Information Systems Research, INFORMS, vol. 33(4), pages 1264-1286, December.
    12. Ni Huang & Tianshu Sun & Peiyu Chen & Joseph M. Golden, 2019. "Word-of-Mouth System Implementation and Customer Conversion: A Randomized Field Experiment," Information Systems Research, INFORMS, vol. 30(3), pages 805-818, September.
    13. Li, Yiming & Li, Gang & Tayi, Giri Kumar & Cheng, T.C.E., 2019. "Omni-channel retailing: Do offline retailers benefit from online reviews?," International Journal of Production Economics, Elsevier, vol. 218(C), pages 43-61.
    14. Bingsheng Liu & Wenwen Zhu & Yinghua Shen & Yuan Chen & Tao Wang & Fengwen Chen & Maggie Wenjing Liu & Shi‐Hao Zhou, 2022. "A study about return policies in the presence of consumer social learning," Production and Operations Management, Production and Operations Management Society, vol. 31(6), pages 2571-2587, June.
    15. Marios Kokkodis & Theodoros Lappas & Gerald C. Kane, 2022. "Optional purchase verification in e‐commerce platforms: More representative product ratings and higher quality reviews," Production and Operations Management, Production and Operations Management Society, vol. 31(7), pages 2943-2961, July.
    16. Chong (Alex) Wang & Xiaoquan (Michael) Zhang & Il-Horn Hann, 2018. "Socially Nudged: A Quasi-Experimental Study of Friends’ Social Influence in Online Product Ratings," Information Systems Research, INFORMS, vol. 29(3), pages 641-655, September.
    17. Ruomeng Cui & Dennis J. Zhang & Achal Bassamboo, 2019. "Learning from Inventory Availability Information: Evidence from Field Experiments on Amazon," Management Science, INFORMS, vol. 65(3), pages 1216-1235, March.
    18. Fishman, Arthur & Fishman, Ram & Gneezy, Uri, 2019. "A tale of two food stands: Observational learning in the field," Journal of Economic Behavior & Organization, Elsevier, vol. 159(C), pages 101-108.
    19. Sergio Afcha & Jose García-Quevedo, 2016. "The impact of R&D subsidies on R&D employment composition," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 25(6), pages 955-975.
    20. Jing Wang & Gen Li & Kai-Lung Hui, 2022. "Monetary Incentives and Knowledge Spillover: Evidence from a Natural Experiment," Management Science, INFORMS, vol. 68(5), pages 3549-3572, May.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:popmgt:v:31:y:2022:i:6:p:2393-2411. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://onlinelibrary.wiley.com/journal/10.1111/(ISSN)1937-5956 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.