IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v67y2021i12p7472-7492.html
   My bibliography  Save this article

Reviews and Self-Selection Bias with Operational Implications

Author

Listed:
  • Ningyuan Chen

    (Department of Management, University of Toronto Mississauga, Mississauga, Ontario L5L 1C6, Canada; Rotman School of Management, University of Toronto, Toronto, Ontario M5S 3E6, Canada)

  • Anran Li

    (Department of Management, The London School of Economics and Political Science, London WC2A 2AE, United Kingdom)

  • Kalyan Talluri

    (Imperial College Business School, Imperial College London, London SW7 2BU, United Kingdom)

Abstract

Reviews for products and services written by previous consumers have become an influential input to the purchase decision of customers. Many service businesses monitor the reviews closely for feedback as well as detecting service flaws, and they have become part of the performance review for service managers with rewards tied to improvement in the aggregate rating. Many empirical papers have documented a bias in the aggregate ratings, arising because of customers’ inherent self-selection in their choices and bounded rationality in evaluating previous reviews. Although there is a vast empirical literature analyzing reviews, theoretical models that try to isolate and explain the bias in ratings are relatively few. Assuming consumers simply substitute the average rating that they see as a proxy for quality, we give a precise characterization of the self-selection bias on ratings of an assortment of products when consumers confound ex ante innate preferences for a product or service with ex post experience and service quality and do not separate the two. We develop a parsimonious choice model for consumer purchase decisions and show that the mechanism leads to an upward bias, which is more pronounced for niche products. Based on our theoretical characterization, we study the effect on pricing and assortment decisions of the firm when potential customers purchase based on the biased ratings. Our results give insights into how quality, prices, and customer feedback are intricately tied together for service firms.

Suggested Citation

  • Ningyuan Chen & Anran Li & Kalyan Talluri, 2021. "Reviews and Self-Selection Bias with Operational Implications," Management Science, INFORMS, vol. 67(12), pages 7472-7492, December.
  • Handle: RePEc:inm:ormnsc:v:67:y:2021:i:12:p:7472-7492
    DOI: 10.1287/mnsc.2020.3892
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mnsc.2020.3892
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mnsc.2020.3892?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Maldonado, Felipe & Van Hentenryck, Pascal & Berbeglia, Gerardo & Berbeglia, Franco, 2018. "Popularity signals in trial-offer markets with social influence and position bias," European Journal of Operational Research, Elsevier, vol. 266(2), pages 775-793.
    2. Thaler, Richard H, 1988. "Anomalies: The Winner's Curse," Journal of Economic Perspectives, American Economic Association, vol. 2(1), pages 191-202, Winter.
    3. Anderson, Simon P & de Palma, Andre, 1992. "Multiproduct Firms: A Nested Logit Approach," Journal of Industrial Economics, Wiley Blackwell, vol. 40(3), pages 261-276, September.
    4. Kalyan Talluri & Garrett van Ryzin, 2004. "Revenue Management Under a General Discrete Choice Model of Consumer Behavior," Management Science, INFORMS, vol. 50(1), pages 15-33, January.
    5. Daron Acemoglu & Munther A. Dahleh & Ilan Lobel & Asuman Ozdaglar, 2011. "Bayesian Learning in Social Networks," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 78(4), pages 1201-1236.
    6. Bikhchandani, Sushil & Hirshleifer, David & Welch, Ivo, 1992. "A Theory of Fads, Fashion, Custom, and Cultural Change in Informational Cascades," Journal of Political Economy, University of Chicago Press, vol. 100(5), pages 992-1026, October.
    7. Peter M. DeMarzo & Dimitri Vayanos & Jeffrey Zwiebel, 2003. "Persuasion Bias, Social Influence, and Unidimensional Opinions," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(3), pages 909-968.
    8. Elchanan Mossel & Allan Sly & Omer Tamuz, 2015. "Strategic Learning and the Topology of Social Networks," Econometrica, Econometric Society, vol. 83(5), pages 1755-1794, September.
    9. Dennis E. Smallwood & John Conlisk, 1979. "Product Quality in Markets Where Consumers are Imperfectly Informed," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 93(1), pages 1-23.
    10. Xinxin Li & Lorin M. Hitt, 2008. "Self-Selection and Information Role of Online Product Reviews," Information Systems Research, INFORMS, vol. 19(4), pages 456-474, December.
    11. Abhijit V. Banerjee, 1992. "A Simple Model of Herd Behavior," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 107(3), pages 797-817.
    12. Engler, Tobias H. & Winter, Patrick & Schulz, Michael, 2015. "Understanding online product ratings: A customer satisfaction model," Journal of Retailing and Consumer Services, Elsevier, vol. 27(C), pages 113-120.
    13. Lones Smith & Peter Sorensen, 2000. "Pathological Outcomes of Observational Learning," Econometrica, Econometric Society, vol. 68(2), pages 371-398, March.
    14. Andrés Abeliuk & Gerardo Berbeglia & Manuel Cebrian & Pascal Van Hentenryck, 2015. "The Benefits of Social Influence in Optimized Cultural Markets," PLOS ONE, Public Library of Science, vol. 10(4), pages 1-20, April.
    15. James E. Smith & Robert L. Winkler, 2006. "The Optimizer's Curse: Skepticism and Postdecision Surprise in Decision Analysis," Management Science, INFORMS, vol. 52(3), pages 311-322, March.
    16. Daniel Kahneman, 2003. "Maps of Bounded Rationality: Psychology for Behavioral Economics," American Economic Review, American Economic Association, vol. 93(5), pages 1449-1475, December.
    17. Guillermo Gallego & Ruxian Wang, 2014. "Multiproduct Price Optimization and Competition Under the Nested Logit Model with Product-Differentiated Price Sensitivities," Operations Research, INFORMS, vol. 62(2), pages 450-461, April.
    18. Paat Rusmevichientong & Zuo-Jun Max Shen & David B. Shmoys, 2010. "Dynamic Assortment Optimization with a Multinomial Logit Choice Model and Capacity Constraint," Operations Research, INFORMS, vol. 58(6), pages 1666-1680, December.
    19. Chrysanthos Dellarocas & Charles A. Wood, 2008. "The Sound of Silence in Online Feedback: Estimating Trading Risks in the Presence of Reporting Bias," Management Science, INFORMS, vol. 54(3), pages 460-476, March.
    20. David Godes & José C. Silva, 2012. "Sequential and Temporal Dynamics of Online Opinion," Marketing Science, INFORMS, vol. 31(3), pages 448-473, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dasaratha, Krishna & He, Kevin, 2020. "Network structure and naive sequential learning," Theoretical Economics, Econometric Society, vol. 15(2), May.
    2. Daron Acemoglu & Ali Makhdoumi & Azarakhsh Malekian & Asuman Ozdaglar, 2017. "Fast and Slow Learning From Reviews," NBER Working Papers 24046, National Bureau of Economic Research, Inc.
    3. Buechel, Berno & Hellmann, Tim & Klößner, Stefan, 2015. "Opinion dynamics and wisdom under conformity," Journal of Economic Dynamics and Control, Elsevier, vol. 52(C), pages 240-257.
    4. Rusinowska, Agnieszka & Taalaibekova, Akylai, 2019. "Opinion formation and targeting when persuaders have extreme and centrist opinions," Journal of Mathematical Economics, Elsevier, vol. 84(C), pages 9-27.
    5. Davide Crapis & Bar Ifrach & Costis Maglaras & Marco Scarsini, 2017. "Monopoly Pricing in the Presence of Social Learning," Management Science, INFORMS, vol. 63(11), pages 3586-3608, November.
    6. Corazzini, Luca & Pavesi, Filippo & Petrovich, Beatrice & Stanca, Luca, 2012. "Influential listeners: An experiment on persuasion bias in social networks," European Economic Review, Elsevier, vol. 56(6), pages 1276-1288.
    7. Jadbabaie, Ali & Molavi, Pooya & Sandroni, Alvaro & Tahbaz-Salehi, Alireza, 2012. "Non-Bayesian social learning," Games and Economic Behavior, Elsevier, vol. 76(1), pages 210-225.
    8. Battiston, Pietro & Stanca, Luca, 2015. "Boundedly rational opinion dynamics in social networks: Does indegree matter?," Journal of Economic Behavior & Organization, Elsevier, vol. 119(C), pages 400-421.
    9. Larson, Nathan, 2015. "Inertia in social learning from a summary statistic," Journal of Economic Theory, Elsevier, vol. 159(PA), pages 596-626.
    10. Aislinn Bohren, 2014. "Informational Herding with Model Misspecification, Second Version," PIER Working Paper Archive 15-022, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 01 Nov 2014.
    11. Mira Frick & Ryota Iijima & Yuhta Ishii, 2020. "Misinterpreting Others and the Fragility of Social Learning," Econometrica, Econometric Society, vol. 88(6), pages 2281-2328, November.
    12. Abhijit Banerjee & Olivier Compte, 2022. "Consensus and Disagreement: Information Aggregation under (not so) Naive Learning," NBER Working Papers 29897, National Bureau of Economic Research, Inc.
    13. Jakob Grazzini & Domenico Massaro, 2021. "Dispersed information, social networks, and aggregate behavior," Economic Inquiry, Western Economic Association International, vol. 59(3), pages 1129-1148, July.
    14. Hirshleifer, David & Teoh, Siew Hong, 2008. "Thought and Behavior Contagion in Capital Markets," MPRA Paper 9164, University Library of Munich, Germany.
    15. Krishna Dasaratha & Benjamin Golub & Nir Hak, 2018. "Learning from Neighbors about a Changing State," Papers 1801.02042, arXiv.org, revised Nov 2022.
    16. Ding, Huihui & Pivato, Marcus, 2021. "Deliberation and epistemic democracy," Journal of Economic Behavior & Organization, Elsevier, vol. 185(C), pages 138-167.
    17. Bohren, J. Aislinn, 2016. "Informational herding with model misspecification," Journal of Economic Theory, Elsevier, vol. 163(C), pages 222-247.
    18. Bogaçhan Çelen & Sen Geng & Huihui Li, 2018. "Belief Error and Non-Bayesian Social Learning: An Experimental Evidence," GRU Working Paper Series GRU_2018_022, City University of Hong Kong, Department of Economics and Finance, Global Research Unit.
    19. Jakob Grazzini & Domenico Massaro, 2016. "Dispersed Information and the Origins of Aggregate Fluctuations," CESifo Working Paper Series 5957, CESifo.
    20. Jan Hązła & Ali Jadbabaie & Elchanan Mossel & M. Amin Rahimian, 2021. "Bayesian Decision Making in Groups is Hard," Operations Research, INFORMS, vol. 69(2), pages 632-654, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:67:y:2021:i:12:p:7472-7492. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.