IDEAS home Printed from https://ideas.repec.org/a/eee/soceco/v95y2021ics2214804321001221.html
   My bibliography  Save this article

The value of bad ratings: An experiment on the impact of distortions in reputation systems

Author

Listed:
  • Keser, Claudia
  • Späth, Maximilian

Abstract

We study the robustness of reputation management systems against positive and negative distortions. In a laboratory trust experiment with reputation management, we mimic a positive bias by exclusively offering the option to rate positively or to give no rating. As predicted by theoretical considerations, this bias leads to significantly less trust than a system that additionally offers a negative rating option. A system relying solely on negative ratings does not have such an adverse effect. This highlights the importance of negative ratings options for the effectiveness of reputation systems.

Suggested Citation

  • Keser, Claudia & Späth, Maximilian, 2021. "The value of bad ratings: An experiment on the impact of distortions in reputation systems," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 95(C).
  • Handle: RePEc:eee:soceco:v:95:y:2021:i:c:s2214804321001221
    DOI: 10.1016/j.socec.2021.101782
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S2214804321001221
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.socec.2021.101782?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Rockenbach, Bettina & Sadrieh, Abdolkarim, 2012. "Sharing information," Journal of Economic Behavior & Organization, Elsevier, vol. 81(2), pages 689-698.
    2. Anderhub, Vital & Engelmann, Dirk & Guth, Werner, 2002. "An experimental study of the repeated trust game with incomplete information," Journal of Economic Behavior & Organization, Elsevier, vol. 48(2), pages 197-216, June.
    3. Ben Greiner, 2015. "Subject pool recruitment procedures: organizing experiments with ORSEE," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 1(1), pages 114-125, July.
    4. Thomas Dohmen & Armin Falk & David Huffman & Uwe Sunde & Jürgen Schupp & Gert G. Wagner, 2011. "Individual Risk Attitudes: Measurement, Determinants, And Behavioral Consequences," Journal of the European Economic Association, European Economic Association, vol. 9(3), pages 522-550, June.
    5. Houser, Daniel & Schunk, Daniel & Winter, Joachim, 2010. "Distinguishing trust from risk: An anatomy of the investment game," Journal of Economic Behavior & Organization, Elsevier, vol. 74(1-2), pages 72-81, May.
    6. Johnson, Noel D. & Mislin, Alexandra A., 2011. "Trust games: A meta-analysis," Journal of Economic Psychology, Elsevier, vol. 32(5), pages 865-889.
    7. Lumeau, Marianne & Masclet, David & Penard, Thierry, 2015. "Reputation and social (dis)approval in feedback mechanisms: An experimental study," Journal of Economic Behavior & Organization, Elsevier, vol. 112(C), pages 127-140.
    8. Gary Bolton & Ben Greiner & Axel Ockenfels, 2013. "Engineering Trust: Reciprocity in the Production of Reputation Information," Management Science, INFORMS, vol. 59(2), pages 265-285, January.
    9. Tobias J. Klein & Christian Lambertz & Konrad O. Stahl, 2016. "Market Transparency, Adverse Selection, and Moral Hazard," Journal of Political Economy, University of Chicago Press, vol. 124(6), pages 1677-1713.
    10. Kreps, David M. & Wilson, Robert, 1982. "Reputation and imperfect information," Journal of Economic Theory, Elsevier, vol. 27(2), pages 253-279, August.
    11. Chris Nosko & Steven Tadelis, 2015. "The Limits of Reputation in Platform Markets: An Empirical Analysis and Field Experiment," NBER Working Papers 20830, National Bureau of Economic Research, Inc.
    12. Manapat, Michael L. & Nowak, Martin A. & Rand, David G., 2013. "Information, irrationality, and the evolution of trust," Journal of Economic Behavior & Organization, Elsevier, vol. 90(S), pages 57-75.
    13. Urs Fischbacher, 2007. "z-Tree: Zurich toolbox for ready-made economic experiments," Experimental Economics, Springer;Economic Science Association, vol. 10(2), pages 171-178, June.
    14. Abraham, Martin & Grimm, Veronika & Neeß, Christina & Seebauer, Michael, 2016. "Reputation formation in economic transactions," Journal of Economic Behavior & Organization, Elsevier, vol. 121(C), pages 1-14.
    15. Milgrom, Paul & Roberts, John, 1982. "Predation, reputation, and entry deterrence," Journal of Economic Theory, Elsevier, vol. 27(2), pages 280-312, August.
    16. Chrysanthos Dellarocas & Charles A. Wood, 2008. "The Sound of Silence in Online Feedback: Estimating Trading Risks in the Presence of Reporting Bias," Management Science, INFORMS, vol. 54(3), pages 460-476, March.
    17. Brandts, Jordi & Figueras, Neus, 2003. "An exploration of reputation formation in experimental games," Journal of Economic Behavior & Organization, Elsevier, vol. 50(1), pages 89-115, January.
    18. Boero, Riccardo & Bravo, Giangiacomo & Castellani, Marco & Squazzoni, Flaminio, 2009. "Reputational cues in repeated trust games," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 38(6), pages 871-877, December.
    19. Berg Joyce & Dickhaut John & McCabe Kevin, 1995. "Trust, Reciprocity, and Social History," Games and Economic Behavior, Elsevier, vol. 10(1), pages 122-142, July.
    20. repec:cup:judgdm:v:11:y:2016:i:6:p:589-600 is not listed on IDEAS
    21. Xiang Hui & Tobias J. Klein & Konrad Stahl, 2021. "When and Why Do Buyers Rate in Online Markets?," CRC TR 224 Discussion Paper Series crctr224_2021_267, University of Bonn and University of Mannheim, Germany.
    22. Bohnet, Iris & Zeckhauser, Richard, 2004. "Trust, risk and betrayal," Journal of Economic Behavior & Organization, Elsevier, vol. 55(4), pages 467-484, December.
    23. David Lucking‐Reiley & Doug Bryan & Naghi Prasad & Daniel Reeves, 2007. "Pennies From Ebay: The Determinants Of Price In Online Auctions," Journal of Industrial Economics, Wiley Blackwell, vol. 55(2), pages 223-233, June.
    24. Bolton, Gary E. & Katok, Elena & Ockenfels, Axel, 2005. "Cooperation among strangers with limited information about reputation," Journal of Public Economics, Elsevier, vol. 89(8), pages 1457-1468, August.
    25. David Masclet & Thierry P鮡rd, 2012. "Do reputation feedback systems really improve trust among anonymous traders? An experimental study," Applied Economics, Taylor & Francis Journals, vol. 44(35), pages 4553-4573, December.
    26. Camerer, Colin & Weigelt, Keith, 1988. "Experimental Tests of a Sequential Equilibrium Reputation Model," Econometrica, Econometric Society, vol. 56(1), pages 1-36, January.
    27. McCabe, Kevin A. & Rigdon, Mary L. & Smith, Vernon L., 2003. "Positive reciprocity and intentions in trust games," Journal of Economic Behavior & Organization, Elsevier, vol. 52(2), pages 267-275, October.
    28. R. Todd Jewell & Michael A. McPherson & Margie A. Tieslau, 2013. "Whose fault is it? Assigning blame for grade inflation in higher education," Applied Economics, Taylor & Francis Journals, vol. 45(9), pages 1185-1200, March.
    29. Neral, John & Ochs, Jack, 1992. "The Sequential Equilibrium Theory of Reputation Building: A Further Test," Econometrica, Econometric Society, vol. 60(5), pages 1151-1169, September.
    30. Brit Grosskopf & Rajiv Sarin, 2010. "Is Reputation Good or Bad? An Experiment," American Economic Review, American Economic Association, vol. 100(5), pages 2187-2204, December.
    31. Steven Tadelis, 2016. "Reputation and Feedback Systems in Online Platform Markets," Annual Review of Economics, Annual Reviews, vol. 8(1), pages 321-340, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Solimine, Philip & Isaac, R. Mark, 2023. "Reputation and market structure in experimental platforms," Journal of Economic Behavior & Organization, Elsevier, vol. 205(C), pages 528-559.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Keser, Claudia & Späth, Maximilian, 2020. "The value of bad ratings: An experiment on the impact of distortions in reputation systems," University of Göttingen Working Papers in Economics 389, University of Goettingen, Department of Economics.
    2. Claudia Keser & Maximilian Späth, 2020. "The Value of Bad Ratings: An Experiment on the Impact of Distortions in Reputation Systems," CIRANO Working Papers 2020s-22, CIRANO.
    3. Gary E. Bolton & David J. Kusterer & Johannes Mans, 2019. "Inflated Reputations: Uncertainty, Leniency, and Moral Wiggle Room in Trader Feedback Systems," Management Science, INFORMS, vol. 65(11), pages 5371-5391, November.
    4. Kartal, Melis & Müller, Wieland & Tremewan, James, 2021. "Building trust: The costs and benefits of gradualism," Games and Economic Behavior, Elsevier, vol. 130(C), pages 258-275.
    5. Butler, Jeffrey V. & Carbone, Enrica & Conzo, Pierluigi & Spagnolo, Giancarlo, 2020. "Past performance and entry in procurement: An experimental investigation," Journal of Economic Behavior & Organization, Elsevier, vol. 173(C), pages 179-195.
    6. Fonseca, Miguel A. & Peters, Kim, 2018. "Will any gossip do? Gossip does not need to be perfectly accurate to promote trust," Games and Economic Behavior, Elsevier, vol. 107(C), pages 253-281.
    7. Gary Bolton & Ben Greiner & Axel Ockenfels, 2013. "Engineering Trust: Reciprocity in the Production of Reputation Information," Management Science, INFORMS, vol. 59(2), pages 265-285, January.
    8. Roman Hoffmann & Bernhard Kittel & Mattias Larsen, 2021. "Information exchange in laboratory markets: competition, transfer costs, and the emergence of reputation," Experimental Economics, Springer;Economic Science Association, vol. 24(1), pages 118-142, March.
    9. Greiff, Matthias & Paetzel, Fabian, 2020. "Information about average evaluations spurs cooperation: An experiment on noisy reputation systems," Journal of Economic Behavior & Organization, Elsevier, vol. 180(C), pages 334-356.
    10. Abraham, Martin & Grimm, Veronika & Neeß, Christina & Seebauer, Michael, 2016. "Reputation formation in economic transactions," Journal of Economic Behavior & Organization, Elsevier, vol. 121(C), pages 1-14.
    11. Janas, Moritz & Oljemark, Emilia, 2020. "Trust and Reputation under Asymmetric Information," VfS Annual Conference 2020 (Virtual Conference): Gender Economics 224518, Verein für Socialpolitik / German Economic Association.
    12. Matthias Wibral, 2015. "Identity changes and the efficiency of reputation systems," Experimental Economics, Springer;Economic Science Association, vol. 18(3), pages 408-431, September.
    13. Janas, Moritz & Oljemark, Emilia, 2021. "Trust and reputation under asymmetric information," Journal of Economic Behavior & Organization, Elsevier, vol. 185(C), pages 97-124.
    14. Brown, M. & Serra Garcia, M., 2010. "Relational Contracting Under the Threat of Expropriation – Experimental Evidence," Other publications TiSEM 2a3179b3-7300-4aee-a62f-7, Tilburg University, School of Economics and Management.
    15. Goeschl, Timo & Jarke, Johannes, 2014. "Trust, but verify? When trustworthiness is observable only through (costly) monitoring," WiSo-HH Working Paper Series 20, University of Hamburg, Faculty of Business, Economics and Social Sciences, WISO Research Laboratory.
    16. Gary E. Bolton & David J. Kusterer & Johannes Mans, 2015. "Inflated reputations: Uncertainty, leniency & moral wiggle room in trader feedback systems," Cologne Graduate School Working Paper Series 06-04, Cologne Graduate School in Management, Economics and Social Sciences, revised 29 Jul 2016.
    17. Yan Chen & Peter Cramton & John A. List & Axel Ockenfels, 2021. "Market Design, Human Behavior, and Management," Management Science, INFORMS, vol. 67(9), pages 5317-5348, September.
    18. Lumeau, Marianne & Masclet, David & Penard, Thierry, 2015. "Reputation and social (dis)approval in feedback mechanisms: An experimental study," Journal of Economic Behavior & Organization, Elsevier, vol. 112(C), pages 127-140.
    19. Fehr, Dietmar & Sutter, Matthias, 2019. "Gossip and the efficiency of interactions," Games and Economic Behavior, Elsevier, vol. 113(C), pages 448-460.
    20. Sofianos, Andis, 2022. "Self-reported & revealed trust: Experimental evidence," Journal of Economic Psychology, Elsevier, vol. 88(C).

    More about this item

    Keywords

    Trust; Trustworthiness; Reputation System; Experiment;
    All these keywords.

    JEL classification:

    • C91 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Individual Behavior
    • L14 - Industrial Organization - - Market Structure, Firm Strategy, and Market Performance - - - Transactional Relationships; Contracts and Reputation
    • C73 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Stochastic and Dynamic Games; Evolutionary Games

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:soceco:v:95:y:2021:i:c:s2214804321001221. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/620175 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.