IDEAS home Printed from https://ideas.repec.org/p/cir/cirwor/2020s-22.html
   My bibliography  Save this paper

The Value of Bad Ratings: An Experiment on the Impact of Distortions in Reputation Systems

Author

Listed:
  • Claudia Keser
  • Maximilian Späth

Abstract

We study the robustness of reputation management systems against distortions in rating behavior. In a laboratory trust experiment with reputation management, we mimic a positive bias by exclusively offering the option to rate positively or to give no rating. As predicted by theoretical considerations, this bias leads to significantly less trust than a system that additionally offers a negative rating option. A system relying solely on negative ratings does not have such an adverse effect. This highlights the importance of negative ratings for the effectiveness of reputation systems.

Suggested Citation

  • Claudia Keser & Maximilian Späth, 2020. "The Value of Bad Ratings: An Experiment on the Impact of Distortions in Reputation Systems," CIRANO Working Papers 2020s-22, CIRANO.
    • Handle: RePEc:cir:cirwor:2020s-22
    as

    Download full text from publisher

    File URL: https://cirano.qc.ca/files/publications/2020s-22.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Thomas Dohmen & Armin Falk & David Huffman & Uwe Sunde & Jürgen Schupp & Gert G. Wagner, 2011. "Individual Risk Attitudes: Measurement, Determinants, And Behavioral Consequences," Journal of the European Economic Association, European Economic Association, vol. 9(3), pages 522-550, June.
    2. Dina Mayzlin & Yaniv Dover & Judith Chevalier, 2014. "Promotional Reviews: An Empirical Investigation of Online Review Manipulation," American Economic Review, American Economic Association, vol. 104(8), pages 2421-2455, August.
    3. Camerer, Colin & Weigelt, Keith, 1988. "Experimental Tests of a Sequential Equilibrium Reputation Model," Econometrica, Econometric Society, vol. 56(1), pages 1-36, January.
    4. Rockenbach, Bettina & Sadrieh, Abdolkarim, 2012. "Sharing information," Journal of Economic Behavior & Organization, Elsevier, vol. 81(2), pages 689-698.
    5. Ben Greiner, 2015. "Subject pool recruitment procedures: organizing experiments with ORSEE," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 1(1), pages 114-125, July.
    6. Houser, Daniel & Schunk, Daniel & Winter, Joachim, 2010. "Distinguishing trust from risk: An anatomy of the investment game," Journal of Economic Behavior & Organization, Elsevier, vol. 74(1-2), pages 72-81, May.
    7. Gary E. Bolton & Elena Katok & Axel Ockenfels, 2004. "How Effective Are Electronic Reputation Mechanisms? An Experimental Investigation," Management Science, INFORMS, vol. 50(11), pages 1587-1602, November.
    8. McCabe, Kevin A. & Rigdon, Mary L. & Smith, Vernon L., 2003. "Positive reciprocity and intentions in trust games," Journal of Economic Behavior & Organization, Elsevier, vol. 52(2), pages 267-275, October.
    9. R. Todd Jewell & Michael A. McPherson & Margie A. Tieslau, 2013. "Whose fault is it? Assigning blame for grade inflation in higher education," Applied Economics, Taylor & Francis Journals, vol. 45(9), pages 1185-1200, March.
    10. Brandts, Jordi & Figueras, Neus, 2003. "An exploration of reputation formation in experimental games," Journal of Economic Behavior & Organization, Elsevier, vol. 50(1), pages 89-115, January.
    11. Kreps, David M. & Wilson, Robert, 1982. "Reputation and imperfect information," Journal of Economic Theory, Elsevier, vol. 27(2), pages 253-279, August.
    12. David Masclet & Thierry P鮡rd, 2012. "Do reputation feedback systems really improve trust among anonymous traders? An experimental study," Applied Economics, Taylor & Francis Journals, vol. 44(35), pages 4553-4573, December.
    13. Lingfang (Ivy) Li & Steven Tadelis & Xiaolan Zhou, 2020. "Buying reputation as a signal of quality: Evidence from an online marketplace," RAND Journal of Economics, RAND Corporation, vol. 51(4), pages 965-988, December.
    14. Neral, John & Ochs, Jack, 1992. "The Sequential Equilibrium Theory of Reputation Building: A Further Test," Econometrica, Econometric Society, vol. 60(5), pages 1151-1169, September.
    15. E. Ostrom, 2010. "A Behavioral Approach to the Rational Choice Theory of Collective Action Presidential Address, American political Science Association, 1997," Public administration issues, Higher School of Economics, issue 1, pages 5-52.
    16. David Lucking‐Reiley & Doug Bryan & Naghi Prasad & Daniel Reeves, 2007. "Pennies From Ebay: The Determinants Of Price In Online Auctions," Journal of Industrial Economics, Wiley Blackwell, vol. 55(2), pages 223-233, June.
    17. Chrysanthos Dellarocas & Charles A. Wood, 2008. "The Sound of Silence in Online Feedback: Estimating Trading Risks in the Presence of Reporting Bias," Management Science, INFORMS, vol. 54(3), pages 460-476, March.
    18. Bar-Isaac, Heski & Tadelis, Steven, 2008. "Seller Reputation," Foundations and Trends(R) in Microeconomics, now publishers, vol. 4(4), pages 273-351, August.
    19. Brit Grosskopf & Rajiv Sarin, 2010. "Is Reputation Good or Bad? An Experiment," American Economic Review, American Economic Association, vol. 100(5), pages 2187-2204, December.
    20. Chris Nosko & Steven Tadelis, 2015. "The Limits of Reputation in Platform Markets: An Empirical Analysis and Field Experiment," NBER Working Papers 20830, National Bureau of Economic Research, Inc.
    21. Eric J. Friedman* & Paul Resnick, 2001. "The Social Cost of Cheap Pseudonyms," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 10(2), pages 173-199, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Solimine, Philip & Isaac, R. Mark, 2023. "Reputation and market structure in experimental platforms," Journal of Economic Behavior & Organization, Elsevier, vol. 205(C), pages 528-559.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Keser, Claudia & Späth, Maximilian, 2021. "The value of bad ratings: An experiment on the impact of distortions in reputation systems," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 95(C).
    2. Keser, Claudia & Späth, Maximilian, 2020. "The value of bad ratings: An experiment on the impact of distortions in reputation systems," University of Göttingen Working Papers in Economics 389, University of Goettingen, Department of Economics.
    3. Gary Bolton & Ben Greiner & Axel Ockenfels, 2013. "Engineering Trust: Reciprocity in the Production of Reputation Information," Management Science, INFORMS, vol. 59(2), pages 265-285, January.
    4. Butler, Jeffrey V. & Carbone, Enrica & Conzo, Pierluigi & Spagnolo, Giancarlo, 2020. "Past performance and entry in procurement: An experimental investigation," Journal of Economic Behavior & Organization, Elsevier, vol. 173(C), pages 179-195.
    5. Gary E. Bolton & David J. Kusterer & Johannes Mans, 2019. "Inflated Reputations: Uncertainty, Leniency, and Moral Wiggle Room in Trader Feedback Systems," Management Science, INFORMS, vol. 65(11), pages 5371-5391, November.
    6. Li, Lingfang (Ivy) & Xiao, Erte, 2010. "Money Talks? An Experimental Study of Rebate in Reputation System Design," MPRA Paper 22401, University Library of Munich, Germany.
    7. Yan Chen & Peter Cramton & John A. List & Axel Ockenfels, 2021. "Market Design, Human Behavior, and Management," Management Science, INFORMS, vol. 67(9), pages 5317-5348, September.
    8. Matthias Wibral, 2015. "Identity changes and the efficiency of reputation systems," Experimental Economics, Springer;Economic Science Association, vol. 18(3), pages 408-431, September.
    9. Lingfang (Ivy) Li & Steven Tadelis & Xiaolan Zhou, 2020. "Buying reputation as a signal of quality: Evidence from an online marketplace," RAND Journal of Economics, RAND Corporation, vol. 51(4), pages 965-988, December.
    10. Kartal, Melis & Müller, Wieland & Tremewan, James, 2021. "Building trust: The costs and benefits of gradualism," Games and Economic Behavior, Elsevier, vol. 130(C), pages 258-275.
    11. Lingfang (Ivy) Li & Erte Xiao, 2014. "Money Talks: Rebate Mechanisms in Reputation System Design," Management Science, INFORMS, vol. 60(8), pages 2054-2072, August.
    12. Möllers, Claudia, 2016. "Reputation and foreclosure with vertical integration: Experimental evidence," DICE Discussion Papers 232, Heinrich Heine University Düsseldorf, Düsseldorf Institute for Competition Economics (DICE).
    13. Gary E. Bolton & David J. Kusterer & Johannes Mans, 2015. "Inflated reputations: Uncertainty, leniency & moral wiggle room in trader feedback systems," Cologne Graduate School Working Paper Series 06-04, Cologne Graduate School in Management, Economics and Social Sciences, revised 29 Jul 2016.
    14. Janas, Moritz & Oljemark, Emilia, 2020. "Trust and Reputation under Asymmetric Information," VfS Annual Conference 2020 (Virtual Conference): Gender Economics 224518, Verein für Socialpolitik / German Economic Association.
    15. Bolton, Gary E. & Ockenfels, Axel & Ebeling, Felix, 2011. "Information value and externalities in reputation building," International Journal of Industrial Organization, Elsevier, vol. 29(1), pages 23-33, January.
    16. Prateik Dalmia & Allan Drazen & Erkut Y. Ozbay, 2020. "Reciprocity versus Reelection," NBER Working Papers 27301, National Bureau of Economic Research, Inc.
    17. Janas, Moritz & Oljemark, Emilia, 2021. "Trust and reputation under asymmetric information," Journal of Economic Behavior & Organization, Elsevier, vol. 185(C), pages 97-124.
    18. Brown, M. & Serra Garcia, M., 2010. "Relational Contracting Under the Threat of Expropriation – Experimental Evidence," Other publications TiSEM 2a3179b3-7300-4aee-a62f-7, Tilburg University, School of Economics and Management.
    19. Gesche, Tobias, 2018. "Reference Price Shifts and Customer Antagonism: Evidence from Reviews for Online Auctions," VfS Annual Conference 2018 (Freiburg, Breisgau): Digital Economy 181650, Verein für Socialpolitik / German Economic Association.
    20. Andreas J. Steur & Mischa Seiter, 2021. "Properties of feedback mechanisms on digital platforms: an exploratory study," Journal of Business Economics, Springer, vol. 91(4), pages 479-526, May.

    More about this item

    Keywords

    Trust; Trustworthiness; Reputation System; Experiment;
    All these keywords.

    JEL classification:

    • C91 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Individual Behavior
    • L14 - Industrial Organization - - Market Structure, Firm Strategy, and Market Performance - - - Transactional Relationships; Contracts and Reputation
    • C73 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Stochastic and Dynamic Games; Evolutionary Games

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cir:cirwor:2020s-22. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Webmaster (email available below). General contact details of provider: https://edirc.repec.org/data/ciranca.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.