IDEAS home Printed from https://ideas.repec.org/p/bon/boncrc/crctr224_2024_594.html

Ratings with Heterogeneous Preferences

Author

Listed:
  • Jonathan Lafky
  • Robin Ng

Abstract

We examine how product ratings are interpreted in the presence of heterogeneous preferences among both raters and consumers. Raters with altruistic motives should rate for the benefit of future consumers, however an ambiguity arises when preferences are heterogeneous. Multiple equilibria exist in which ratings may reflect the preferences of raters or the preferences of future consumers. In an online experiment, we examine how ratings are selected by raters and interpreted by consumers, and how information about rater preferences or product attributes can influence equilibrium selection. We show how both raters and consumers update their evaluation of what a rating represents in each environment, doing so in similar ways.

Suggested Citation

  • Jonathan Lafky & Robin Ng, 2024. "Ratings with Heterogeneous Preferences," CRC TR 224 Discussion Paper Series crctr224_2024_594, University of Bonn and University of Mannheim, Germany.
  • Handle: RePEc:bon:boncrc:crctr224_2024_594
    as

    Download full text from publisher

    File URL: https://www.crctr224.de/research/discussion-papers/archive/dp594
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Steven Tadelis, 1999. "What's in a Name? Reputation as a Tradeable Asset," American Economic Review, American Economic Association, vol. 89(3), pages 548-563, June.
    2. Hui, Xiang & Klein, Tobias & Stahl, Konrad, 2022. "Learning from Online Ratings," CEPR Discussion Papers 17006, Centre for Economic Policy Research.
    3. Tobias Gesche, 2022. "Reference‐price shifts and customer antagonism: Evidence from reviews for online auctions," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 31(3), pages 558-578, August.
    4. Luis M.B. Cabral, 2000. "Stretching Firm and Brand Reputation," RAND Journal of Economics, The RAND Corporation, vol. 31(4), pages 658-673, Winter.
    5. Garvin, Susan & Kagel, John H., 1994. "Learning in common value auctions: Some initial observations," Journal of Economic Behavior & Organization, Elsevier, vol. 25(3), pages 351-372, December.
    6. Jeffrey A. Livingston, 2005. "How Valuable Is a Good Reputation? A Sample Selection Model of Internet Auctions," The Review of Economics and Statistics, MIT Press, vol. 87(3), pages 453-465, August.
    7. Gao, Baojun & Li, Xiangge & Liu, Shan & Fang, Debin, 2018. "How power distance affects online hotel ratings: The positive moderating roles of hotel chain and reviewers’ travel experience," Tourism Management, Elsevier, vol. 65(C), pages 176-186.
    8. Ginger Zhe Jin & Andrew Kato, 2006. "Price, quality, and reputation: evidence from an online field experiment," RAND Journal of Economics, RAND Corporation, vol. 37(4), pages 983-1005, December.
    9. Gary Bolton & Ben Greiner & Axel Ockenfels, 2013. "Engineering Trust: Reciprocity in the Production of Reputation Information," Management Science, INFORMS, vol. 59(2), pages 265-285, January.
    10. Lingfang (Ivy) Li & Erte Xiao, 2014. "Money Talks: Rebate Mechanisms in Reputation System Design," Management Science, INFORMS, vol. 60(8), pages 2054-2072, August.
    11. Andrey Fradkin & Elena Grewal & David Holtz, 2021. "Reciprocity and Unveiling in Two-Sided Reputation Systems: Evidence from an Experiment on Airbnb," Marketing Science, INFORMS, vol. 40(6), pages 1013-1029, November.
    12. Pei-Yu Chen & Yili Hong & Ying Liu, 2018. "The Value of Multidimensional Rating Systems: Evidence from a Natural Experiment and Randomized Experiments," Management Science, INFORMS, vol. 64(10), pages 4629-4647, October.
    13. Christoph Schneider & Markus Weinmann & Peter N.C. Mohr & Jan vom Brocke, 2021. "When the Stars Shine Too Bright: The Influence of Multidimensional Ratings on Online Consumer Ratings," Management Science, INFORMS, vol. 67(6), pages 3871-3898, June.
    14. Andreas Bayerl & Yaniv Dover & Hila Riemer & Daniel Shapira, 2025. "Gender rating gap in online reviews," Nature Human Behaviour, Nature, vol. 9(3), pages 507-520, March.
    15. Hoyer, B. & van Straaten, D., 2022. "Anonymity and self-expression in online rating systems—An experimental analysis," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 98(C).
    16. Halliday, Simon D. & Lafky, Jonathan, 2019. "Reciprocity through ratings: An experimental study of bias in evaluations," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 83(C).
    17. Chris Forman & Anindya Ghose & Batia Wiesenfeld, 2008. "Examining the Relationship Between Reviews and Sales: The Role of Reviewer Identity Disclosure in Electronic Markets," Information Systems Research, INFORMS, vol. 19(3), pages 291-313, September.
    18. Ginger Zhe Jin & Andrew Kato, 2006. "Price, quality, and reputation: evidence from an online field experiment," RAND Journal of Economics, The RAND Corporation, vol. 37(4), pages 983-1005, December.
    19. Gary E. Bolton & Elena Katok & Axel Ockenfels, 2004. "How Effective Are Electronic Reputation Mechanisms? An Experimental Investigation," Management Science, INFORMS, vol. 50(11), pages 1587-1602, November.
    20. Davide Proserpio & Wendy Xu & Georgios Zervas, 2018. "You get what you give: theory and evidence of reciprocity in the sharing economy," Quantitative Marketing and Economics (QME), Springer, vol. 16(4), pages 371-407, December.
    21. Luís Cabral & Lingfang (Ivy) Li, 2015. "A Dollar for Your Thoughts: Feedback-Conditional Rebates on eBay," Management Science, INFORMS, vol. 61(9), pages 2052-2063, September.
    22. Luís Cabral & Ali Hortaçsu, 2010. "The Dynamics Of Seller Reputation: Evidence From Ebay," Journal of Industrial Economics, Wiley Blackwell, vol. 58(1), pages 54-78, March.
    23. Peiyu Chen & Lorin M. Hitt & Yili Hong & Shinyi Wu, 2021. "Measuring Product Type and Purchase Uncertainty with Online Product Ratings: A Theoretical Model and Empirical Application," Information Systems Research, INFORMS, vol. 32(4), pages 1470-1489, December.
    24. Floyd, Kristopher & Freling, Ryan & Alhoqail, Saad & Cho, Hyun Young & Freling, Traci, 2014. "How Online Product Reviews Affect Retail Sales: A Meta-analysis," Journal of Retailing, Elsevier, vol. 90(2), pages 217-232.
    25. Chrysanthos Dellarocas & Charles A. Wood, 2008. "The Sound of Silence in Online Feedback: Estimating Trading Risks in the Presence of Reporting Bias," Management Science, INFORMS, vol. 54(3), pages 460-476, March.
    26. Cai, Hongbin & Jin, Ginger Zhe & Liu, Chong & Zhou, Li-an, 2014. "Seller reputation: From word-of-mouth to centralized feedback," International Journal of Industrial Organization, Elsevier, vol. 34(C), pages 51-65.
    27. Michael Luca, 2011. "Reviews, Reputation, and Revenue: The Case of Yelp.com," Harvard Business School Working Papers 12-016, Harvard Business School, revised Mar 2016.
    28. Andrey Fradkin & David Holtz, 2023. "Do Incentives to Review Help the Market? Evidence from a Field Experiment on Airbnb," Marketing Science, INFORMS, vol. 42(5), pages 853-865, September.
    29. Yan Chen & F. Maxwell Harper & Joseph Konstan & Sherry Xin Li, 2010. "Social Comparisons and Contributions to Online Communities: A Field Experiment on MovieLens," American Economic Review, American Economic Association, vol. 100(4), pages 1358-1398, September.
    30. Lingfang (Ivy) Li & Steven Tadelis & Xiaolan Zhou, 2020. "Buying reputation as a signal of quality: Evidence from an online marketplace," RAND Journal of Economics, RAND Corporation, vol. 51(4), pages 965-988, December.
    31. Dina Mayzlin & Yaniv Dover & Judith Chevalier, 2014. "Promotional Reviews: An Empirical Investigation of Online Review Manipulation," American Economic Review, American Economic Association, vol. 104(8), pages 2421-2455, August.
    32. Christoph Carnehl & André Stenzel & Peter Schmidt, 2024. "Pricing for the Stars: Dynamic Pricing in the Presence of Rating Systems," Management Science, INFORMS, vol. 70(3), pages 1755-1772, March.
    33. Michael Luca & Oren Reshef, 2021. "The Effect of Price on Firm Reputation," Management Science, INFORMS, vol. 67(7), pages 4408-4419, July.
    34. Xiang Hui & Maryam Saeedi & Giancarlo Spagnolo & Steven Tadelis, 2023. "Raising the Bar: Certification Thresholds and Market Outcomes," American Economic Journal: Microeconomics, American Economic Association, vol. 15(2), pages 599-626, May.
    35. Chris Nosko & Steven Tadelis, 2015. "The Limits of Reputation in Platform Markets: An Empirical Analysis and Field Experiment," NBER Working Papers 20830, National Bureau of Economic Research, Inc.
    36. Lafky, Jonathan, 2014. "Why do people rate? Theory and evidence on online ratings," Games and Economic Behavior, Elsevier, vol. 87(C), pages 554-570.
    37. Arslan Aziz & Hui Li & Rahul Telang, 2023. "The Consequences of Rating Inflation on Platforms: Evidence from a Quasi-Experiment," Information Systems Research, INFORMS, vol. 34(2), pages 590-608, June.
    38. Bennett Chiles, 2021. "Shrouded Prices and Firm Reputation: Evidence from the U.S. Hotel Industry," Management Science, INFORMS, vol. 67(2), pages 964-983, February.
    39. Florian Englmaier & Arno Schmöller & Till Stowasser, 2018. "Price Discontinuities in an Online Market for Used Cars," Management Science, INFORMS, vol. 64(6), pages 2754-2766, June.
    40. Samuel Bowles & Sandra Polania-Reyes, 2012. "Economic Incentives and Social Preferences: Substitutes or Complements?," Journal of Economic Literature, American Economic Association, vol. 50(2), pages 368-425, June.
    41. Dandan Qiao & Shun-Yang Lee & Andrew B. Whinston & Qiang Wei, 2020. "Financial Incentives Dampen Altruism in Online Prosocial Contributions: A Study of Online Reviews," Information Systems Research, INFORMS, vol. 31(4), pages 1361-1375, December.
    42. Dimitri,Nicola & Piga,Gustavo & Spagnolo,Giancarlo (ed.), 2006. "Handbook of Procurement," Cambridge Books, Cambridge University Press, number 9780521870733.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. repec:bon:boncrc:crctr224_2024_509v3 is not listed on IDEAS
    2. repec:bon:boncrc:crctr224_2024_509v5 is not listed on IDEAS
    3. Johnen, Johannes & Ng, Robin, 2023. "Harvesting Ratings," CEPR Discussion Papers 18021, Centre for Economic Policy Research.
    4. repec:bon:boncrc:crctr224_2024_509v4 is not listed on IDEAS

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pocchiari, Martina & Proserpio, Davide & Dover, Yaniv, 2025. "Online reviews: A literature review and roadmap for future research," International Journal of Research in Marketing, Elsevier, vol. 42(2), pages 275-297.
    2. Foster, Joshua, 2022. "How rating mechanisms shape user search, quality inference and engagement in online platforms: Experimental evidence," Journal of Business Research, Elsevier, vol. 142(C), pages 791-807.
    3. repec:bon:boncrc:crctr224_2024_509v3 is not listed on IDEAS
    4. Gesche, Tobias, 2018. "Reference Price Shifts and Customer Antagonism: Evidence from Reviews for Online Auctions," VfS Annual Conference 2018 (Freiburg, Breisgau): Digital Economy 181650, Verein für Socialpolitik / German Economic Association.
    5. Michael Luca & Oren Reshef, 2020. "The Effect of Price on Firm Reputation," NBER Working Papers 27405, National Bureau of Economic Research, Inc.
    6. Paul Belleflamme & Martin Peitz, 2018. "Inside the engine room of digital platforms: Reviews, ratings, and recommendations," CRC TR 224 Discussion Paper Series crctr224_2018_004, University of Bonn and University of Mannheim, Germany.
    7. repec:bon:boncrc:crctr224_2024_509v5 is not listed on IDEAS
    8. Johnen, Johannes & Ng, Robin, 2023. "Harvesting Ratings," CEPR Discussion Papers 18021, Centre for Economic Policy Research.
    9. Yan Chen & Peter Cramton & John A. List & Axel Ockenfels, 2021. "Market Design, Human Behavior, and Management," Management Science, INFORMS, vol. 67(9), pages 5317-5348, September.
    10. Michael Luca & Oren Reshef, 2021. "The Effect of Price on Firm Reputation," Management Science, INFORMS, vol. 67(7), pages 4408-4419, July.
    11. Dominik Gutt & Jürgen Neumann & Steffen Zimmermann & Dennis Kundisch & Jianqing Chen, 2018. "Design of Review Systems - A Strategic Instrument to shape Online Review Behavior and Economic Outcomes," Working Papers Dissertations 42, Paderborn University, Faculty of Business Administration and Economics.
    12. Johnen, Johannes & Ng, Robin, 2023. "Harvesting Ratings," CEPR Discussion Papers 18021, Centre for Economic Policy Research.
    13. Hui, Xiang & Klein, Tobias & Stahl, Konrad, 2022. "Learning from Online Ratings," CEPR Discussion Papers 17006, Centre for Economic Policy Research.
    14. Tobias Gesche, 2022. "Reference‐price shifts and customer antagonism: Evidence from reviews for online auctions," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 31(3), pages 558-578, August.
    15. Erfan Rezvani & Christian Rojas, 2022. "Firm responsiveness to consumers' reviews: The effect on online reputation," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 31(4), pages 898-922, November.
    16. Lingfang (Ivy) Li & Steven Tadelis & Xiaolan Zhou, 2020. "Buying reputation as a signal of quality: Evidence from an online marketplace," RAND Journal of Economics, RAND Corporation, vol. 51(4), pages 965-988, December.
    17. Gary Bolton & Ben Greiner & Axel Ockenfels, 2013. "Engineering Trust: Reciprocity in the Production of Reputation Information," Management Science, INFORMS, vol. 59(2), pages 265-285, January.
    18. Georgios Zervas & Davide Proserpio & John W. Byers, 2021. "A first look at online reputation on Airbnb, where every stay is above average," Marketing Letters, Springer, vol. 32(1), pages 1-16, March.
    19. Arslan Aziz & Hui Li & Rahul Telang, 2023. "The Consequences of Rating Inflation on Platforms: Evidence from a Quasi-Experiment," Information Systems Research, INFORMS, vol. 34(2), pages 590-608, June.
    20. Kusterer, David & Bolton, Gary & Mans, Johannes, 2016. "Inflated Reputations Uncertainty, Leniency & Moral Wiggle Room in Trader Feedback Systems," VfS Annual Conference 2016 (Augsburg): Demographic Change 145794, Verein für Socialpolitik / German Economic Association.
    21. Christoph Carnehl & Maximilian Schaefer & André Stenzel & Kevin Ducbao Tran, 2022. "Value for Money and Selection: How Pricing Affects Airbnb Ratings," Bristol Economics Discussion Papers 22/771, School of Economics, University of Bristol, UK.
    22. Jesper Akesson & Robert W. Hahn & Robert D. Metcalfe & Manuel Monti-Nussbaum, 2023. "The Impact of Fake Reviews on Demand and Welfare," NBER Working Papers 31836, National Bureau of Economic Research, Inc.

    More about this item

    Keywords

    ;
    ;

    JEL classification:

    • C91 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Individual Behavior
    • D64 - Microeconomics - - Welfare Economics - - - Altruism; Philanthropy; Intergenerational Transfers
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness
    • L86 - Industrial Organization - - Industry Studies: Services - - - Information and Internet Services; Computer Software

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bon:boncrc:crctr224_2024_594. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: CRC Office (email available below). General contact details of provider: https://www.crctr224.de .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.