IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v70y2024i1p567-588.html

Rate This Transaction: Coordinating Mappings in Market Feedback Systems

Author

Listed:
  • Gary E. Bolton

    (Naveen Jindal School of Management, University of Texas at Dallas, Richardson, Texas 75080)

  • Alina Ferecatu

    (Rotterdam School of Management, Erasmus University, 3062PA Rotterdam, Netherlands)

  • David J. Kusterer

    (Department of Economics, University of Cologne, 50923 Köln, Germany)

Abstract

Reputation feedback systems assign feedback scores to traders with the aim of separating them according to reliability. There is now a substantial amount of literature on what these mechanisms do well and not so well. Conspicuously absent is a theoretical framework to guide thinking on improving these systems. Here we construct a prototype market, stylized and conceptual in nature, but also suitable for laboratory testing. We use the prototype to examine competing approaches to eliciting feedback from traders. Using entropy to benchmark informativeness, we show that the informativeness of feedback elicitation approaches depends on the ability to solve a coordination problem such that traders use a common mapping to turn experiences into ratings. In theory, different approaches can be about equally informative although the map to coordinate on is more ambiguous in some cases. We then test the approaches in the laboratory. The resulting data find that the most informative feedback is associated with the elicitation methods where the solution to the coordination problem is least ambiguous.

Suggested Citation

  • Gary E. Bolton & Alina Ferecatu & David J. Kusterer, 2024. "Rate This Transaction: Coordinating Mappings in Market Feedback Systems," Management Science, INFORMS, vol. 70(1), pages 567-588, January.
  • Handle: RePEc:inm:ormnsc:v:70:y:2024:i:1:p:567-588
    DOI: 10.1287/mnsc.2023.4694
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mnsc.2023.4694
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mnsc.2023.4694?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Dominik Gutt & Jürgen Neumann & Steffen Zimmermann & Dennis Kundisch & Jianqing Chen, 2018. "Design of Review Systems - A Strategic Instrument to shape Online Review Behavior and Economic Outcomes," Working Papers Dissertations 42, Paderborn University, Faculty of Business Administration and Economics.
    2. Attila Ambrus & Ben Greiner, 2012. "Imperfect Public Monitoring with Costly Punishment: An Experimental Study," American Economic Review, American Economic Association, vol. 102(7), pages 3317-3332, December.
    3. Jeffrey S. Banks & John O. Ledyard & David P. Porter, 1989. "Allocating Uncertain and Unresponsive Resources: An Experimental Approach," RAND Journal of Economics, The RAND Corporation, vol. 20(1), pages 1-25, Spring.
    4. Xiang Hui & Maryam Saeedi & Neel Sundaresan, 2018. "Adverse Selection or Moral Hazard, An Empirical Study," Journal of Industrial Economics, Wiley Blackwell, vol. 66(3), pages 610-649, September.
    5. Chen, Yan & Jiang, Ming & Kesten, Onur & Robin, Stéphane & Zhu, Min, 2018. "Matching in the large: An experimental study," Games and Economic Behavior, Elsevier, vol. 110(C), pages 295-317.
    6. Yan Chen & Ming Jiang & Onur Kesten & Stéphane Robin & Min Zhu, 2018. "Matching in the large: An experimental study," Post-Print halshs-01973298, HAL.
    7. Paul Resnick & Richard Zeckhauser & John Swanson & Kate Lockwood, 2006. "The value of reputation on eBay: A controlled experiment," Experimental Economics, Springer;Economic Science Association, vol. 9(2), pages 79-101, June.
    8. Maryam Saeedi, 2019. "Reputation and adverse selection: theory and evidence from eBay," RAND Journal of Economics, RAND Corporation, vol. 50(4), pages 822-853, December.
    9. Rudolf Kerschbamer & Daniel Neururer & Matthias Sutter, 2019. "Credence Goods Markets and the Informational Value of New Media: A Natural Field Experiment," CESifo Working Paper Series 7932, CESifo.
    10. Lingfang (Ivy) Li & Erte Xiao, 2014. "Money Talks: Rebate Mechanisms in Reputation System Design," Management Science, INFORMS, vol. 60(8), pages 2054-2072, August.
    11. Anthony M. Kwasnica & John O. Ledyard & Dave Porter & Christine DeMartini, 2005. "A New and Improved Design for Multiobject Iterative Auctions," Management Science, INFORMS, vol. 51(3), pages 419-434, March.
    12. Greif, Avner, 1993. "Contract Enforceability and Economic Institutions in Early Trade: the Maghribi Traders' Coalition," American Economic Review, American Economic Association, vol. 83(3), pages 525-548, June.
    13. Plott, Charles R, 1994. "Market Architectures, Institutional Landscapes and Testbed Experiments," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 4(1), pages 3-10, January.
    14. John Duffy & Huan Xie & Yong-Ju Lee, 2013. "Social norms, information, and trust among strangers: theory and evidence," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 52(2), pages 669-708, March.
    15. Lehrer, Ehud & Smorodinsky, Rann, 2000. "Relative entropy in sequential decision problems1," Journal of Mathematical Economics, Elsevier, vol. 33(4), pages 425-439, May.
    16. Asim Ansari & Ricardo Montoya & Oded Netzer, 2012. "Dynamic learning in behavioral games: A hidden Markov mixture of experts approach," Quantitative Marketing and Economics (QME), Springer, vol. 10(4), pages 475-503, December.
    17. Robertson, John C & Tallman, Ellis W & Whiteman, Charles H, 2005. "Forecasting Using Relative Entropy," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 37(3), pages 383-401, June.
    18. Ben Greiner, 2015. "Subject pool recruitment procedures: organizing experiments with ORSEE," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 1(1), pages 114-125, July.
    19. Martin Brown & Christian Zehnder, 2007. "Credit Reporting, Relationship Banking, and Loan Repayment," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(8), pages 1883-1918, December.
    20. Weijia (Daisy) Dai & Ginger Jin & Jungmin Lee & Michael Luca, 2018. "Aggregation of consumer ratings: an application to Yelp.com," Quantitative Marketing and Economics (QME), Springer, vol. 16(3), pages 289-339, September.
    21. Iris Bohnet & Steffen Huck, 2004. "Repetition and Reputation: Implications for Trust and Trustworthiness When Institutions Change," American Economic Review, American Economic Association, vol. 94(2), pages 362-366, May.
    22. Gregory Lewis, 2011. "Asymmetric Information, Adverse Selection and Online Disclosure: The Case of eBay Motors," American Economic Review, American Economic Association, vol. 101(4), pages 1535-1546, June.
    23. Stahl, Dale O., 2001. "Population rule learning in symmetric normal-form games: theory and evidence," Journal of Economic Behavior & Organization, Elsevier, vol. 45(1), pages 19-35, May.
    24. Fehr, Dietmar & Sutter, Matthias, 2019. "Gossip and the efficiency of interactions," Games and Economic Behavior, Elsevier, vol. 113(C), pages 448-460.
    25. John Duffy & Nick Feltovich, 2006. "Words, Deeds, and Lies: Strategic Behaviour in Games with Multiple Signals," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 73(3), pages 669-688.
    26. Monic Sun, 2012. "How Does the Variance of Product Ratings Matter?," Management Science, INFORMS, vol. 58(4), pages 696-707, April.
    27. Yan Chen & F. Maxwell Harper & Joseph Konstan & Sherry Xin Li, 2010. "Social Comparisons and Contributions to Online Communities: A Field Experiment on MovieLens," American Economic Review, American Economic Association, vol. 100(4), pages 1358-1398, September.
    28. Charness, Gary & Du, Ninghua & Yang, Chun-Lei, 2011. "Trust and trustworthiness reputations in an investment game," Games and Economic Behavior, Elsevier, vol. 72(2), pages 361-375, June.
    29. Fehr, Dietmar & Hakimov, Rustamdjan & Kübler, Dorothea, 2015. "The willingness to pay–willingness to accept gap: A failed replication of Plott and Zeiler," European Economic Review, Elsevier, vol. 78(C), pages 120-128.
    30. Cason, Timothy N. & Gangadharan, Lata, 2011. "Price discovery and intermediation in linked emissions trading markets: A laboratory study," Ecological Economics, Elsevier, vol. 70(7), pages 1424-1433, May.
    31. Tobias J. Klein & Christian Lambertz & Konrad O. Stahl, 2016. "Market Transparency, Adverse Selection, and Moral Hazard," Journal of Political Economy, University of Chicago Press, vol. 124(6), pages 1677-1713.
    32. Paul J. Healy & John Conlon & Yeochang Yoon, 2016. "Information Cascades with Informative Ratings: An Experimental Test," Working Papers 16-05, Ohio State University, Department of Economics.
    33. Lafky, Jonathan, 2014. "Why do people rate? Theory and evidence on online ratings," Games and Economic Behavior, Elsevier, vol. 87(C), pages 554-570.
    34. Ruomeng Cui & Jun Li & Dennis J. Zhang, 2020. "Reducing Discrimination with Reviews in the Sharing Economy: Evidence from Field Experiments on Airbnb," Management Science, INFORMS, vol. 66(3), pages 1071-1094, March.
    35. Michael Luca, 2017. "Designing Online Marketplaces: Trust and Reputation Mechanisms," Innovation Policy and the Economy, University of Chicago Press, vol. 17(1), pages 77-93.
    36. Charles R. Plott & Kathryn Zeiler, 2005. "The Willingness to Pay–Willingness to Accept Gap, the "Endowment Effect," Subject Misconceptions, and Experimental Procedures for Eliciting Valuations," American Economic Review, American Economic Association, vol. 95(3), pages 530-545, June.
    37. Susan Athey & Michael Luca, 2019. "Economists (and Economics) in Tech Companies," Journal of Economic Perspectives, American Economic Association, vol. 33(1), pages 209-230, Winter.
    38. Fonseca, Miguel A. & Peters, Kim, 2018. "Will any gossip do? Gossip does not need to be perfectly accurate to promote trust," Games and Economic Behavior, Elsevier, vol. 107(C), pages 253-281.
    39. Timothy Salmon, 2004. "Evidence for Learning to Learn Behavior in Normal Form Games," Theory and Decision, Springer, vol. 56(4), pages 367-404, April.
    40. Bracht, Juergen & Feltovich, Nick, 2009. "Whatever you say, your reputation precedes you: Observation and cheap talk in the trust game," Journal of Public Economics, Elsevier, vol. 93(9-10), pages 1036-1044, October.
    41. Keehyung Kim & Kevin Chung & Noah Lim, 2019. "Third-Party Reviews and Quality Provision," Management Science, INFORMS, vol. 67(6), pages 2695-2716, June.
    42. Laura L. Veldkamp, 2011. "Information Choice in Macroeconomics and Finance," Economics Books, Princeton University Press, edition 1, number 9621, December.
    43. Huck, Steffen & Lünser, Gabriele K. & Tyran, Jean-Robert, 2012. "Competition fosters trust," Games and Economic Behavior, Elsevier, vol. 76(1), pages 195-209.
    44. Cokely, Edward T. & Galesic, Mirta & Schulz, Eric & Ghazal, Saima & Garcia-Retamero, Rocio, 2012. "Measuring Risk Literacy: The Berlin Numeracy Test," Judgment and Decision Making, Cambridge University Press, vol. 7(1), pages 25-47, January.
    45. Uwe Dulleck & Rudolf Kerschbamer & Matthias Sutter, 2011. "The Economics of Credence Goods: An Experiment on the Role of Liability, Verifiability, Reputation, and Competition," American Economic Review, American Economic Association, vol. 101(2), pages 526-555, April.
    46. Edward T. Cokely & Mirta Galesic & Eric Schulz & Saima Ghazal & Rocio Garcia-Retamero, 2012. "Measuring risk literacy: The Berlin Numeracy Test," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 7(1), pages 25-47, January.
    47. Sarah C. Rice, 2012. "Reputation and Uncertainty in Online Markets: An Experimental Study," Information Systems Research, INFORMS, vol. 23(2), pages 436-452, June.
    48. Huck, Steffen & Lünser, Gabriele K. & Tyran, Jean-Robert, 2010. "Consumer networks and firm reputation: A first experimental investigation," Economics Letters, Elsevier, vol. 108(2), pages 242-244, August.
    49. Chrysanthos Dellarocas & Charles A. Wood, 2008. "The Sound of Silence in Online Feedback: Estimating Trading Risks in the Presence of Reporting Bias," Management Science, INFORMS, vol. 54(3), pages 460-476, March.
    50. Duffy, John & Feltovich, Nick, 2002. "Do Actions Speak Louder Than Words? An Experimental Comparison of Observation and Cheap Talk," Games and Economic Behavior, Elsevier, vol. 39(1), pages 1-27, April.
    51. Sanjeev Dewan & Vernon Hsu, 2004. "Adverse Selection In Electronic Markets: Evidence From Online Stamp Auctions," Journal of Industrial Economics, Wiley Blackwell, vol. 52(4), pages 497-516, December.
    52. Yan Chen & Sherry Xin Li, 2009. "Group Identity and Social Preferences," American Economic Review, American Economic Association, vol. 99(1), pages 431-457, March.
    53. Gary E. Bolton & David J. Kusterer & Johannes Mans, 2019. "Inflated Reputations: Uncertainty, Leniency, and Moral Wiggle Room in Trader Feedback Systems," Management Science, INFORMS, vol. 65(11), pages 5371-5391, November.
    54. Golman, Russell & Bhatia, Sudeep, 2012. "Performance evaluation inflation and compression," Accounting, Organizations and Society, Elsevier, vol. 37(8), pages 534-543.
    55. Chris Nosko & Steven Tadelis, 2015. "The Limits of Reputation in Platform Markets: An Empirical Analysis and Field Experiment," NBER Working Papers 20830, National Bureau of Economic Research, Inc.
    56. Steven Tadelis, 2016. "Reputation and Feedback Systems in Online Platform Markets," Annual Review of Economics, Annual Reviews, vol. 8(1), pages 321-340, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Gustavo Bergantiños & Juan D. Moreno-Ternero, 2025. "Revenue Sharing at Music Streaming Platforms," Management Science, INFORMS, vol. 71(10), pages 8319-8335, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yan Chen & Peter Cramton & John A. List & Axel Ockenfels, 2021. "Market Design, Human Behavior, and Management," Management Science, INFORMS, vol. 67(9), pages 5317-5348, September.
    2. Gary E. Bolton & David J. Kusterer & Johannes Mans, 2019. "Inflated Reputations: Uncertainty, Leniency, and Moral Wiggle Room in Trader Feedback Systems," Management Science, INFORMS, vol. 65(11), pages 5371-5391, November.
    3. Greiff, Matthias & Paetzel, Fabian, 2020. "Information about average evaluations spurs cooperation: An experiment on noisy reputation systems," Journal of Economic Behavior & Organization, Elsevier, vol. 180(C), pages 334-356.
    4. Gary Bolton & Kevin Breuer & Ben Greiner & Axel Ockenfels, 2023. "Fixing feedback revision rules in online markets," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 32(2), pages 247-256, April.
    5. Fehr, Dietmar & Sutter, Matthias, 2019. "Gossip and the efficiency of interactions," Games and Economic Behavior, Elsevier, vol. 113(C), pages 448-460.
    6. Kusterer, David & Bolton, Gary & Mans, Johannes, 2016. "Inflated Reputations Uncertainty, Leniency & Moral Wiggle Room in Trader Feedback Systems," VfS Annual Conference 2016 (Augsburg): Demographic Change 145794, Verein für Socialpolitik / German Economic Association.
    7. Gary Bolton & Ben Greiner & Axel Ockenfels, 2013. "Engineering Trust: Reciprocity in the Production of Reputation Information," Management Science, INFORMS, vol. 59(2), pages 265-285, January.
    8. Xiang Hui & Zekun Liu & Weiqing Zhang, 2023. "From High Bar to Uneven Bars: The Impact of Information Granularity in Quality Certification," Management Science, INFORMS, vol. 69(10), pages 6109-6127, October.
    9. Zou, Wenbo & Wang, Jinjie & Yan, Jubo, 2022. "Online markets and trust," Journal of Economic Behavior & Organization, Elsevier, vol. 201(C), pages 395-412.
    10. Goeschl, Timo & Jarke, Johannes, 2014. "Trust, but verify? When trustworthiness is observable only through (costly) monitoring," WiSo-HH Working Paper Series 20, University of Hamburg, Faculty of Business, Economics and Social Sciences, WISO Research Laboratory.
    11. Pocchiari, Martina & Proserpio, Davide & Dover, Yaniv, 2025. "Online reviews: A literature review and roadmap for future research," International Journal of Research in Marketing, Elsevier, vol. 42(2), pages 275-297.
    12. Foster, Joshua, 2022. "How rating mechanisms shape user search, quality inference and engagement in online platforms: Experimental evidence," Journal of Business Research, Elsevier, vol. 142(C), pages 791-807.
    13. Goeschl, Timo & Jarke, Johannes, 2017. "Trust, but verify? Monitoring, inspection costs, and opportunism under limited observability," Journal of Economic Behavior & Organization, Elsevier, vol. 142(C), pages 320-330.
    14. Knutsen, Magnus Våge, 2025. "Verification and reputational concerns: An experiment," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 119(C).
    15. Raszap Skorbiansky, Sharon, 2018. "Investing in communication: An experimental study of communication in a relational contract setting," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 74(C), pages 85-96.
    16. Zakaria Babutsidze & Nobuyuki Hanaki & Adam Zylbersztejn, 2019. "Digital Communication and Swift Trust," Post-Print halshs-02409314, HAL.
    17. Hui, Xiang & Klein, Tobias & Stahl, Konrad, 2022. "Learning from Online Ratings," CEPR Discussion Papers 17006, Centre for Economic Policy Research.
    18. Zakaria Babutsidze & Nobuyuki Hanaki & Adam Zylbersztejn, 2021. "Nonverbal content and trust: An experiment on digital communication," Economic Inquiry, Western Economic Association International, vol. 59(4), pages 1517-1532, October.
    19. Lingfang (Ivy) Li & Steven Tadelis & Xiaolan Zhou, 2020. "Buying reputation as a signal of quality: Evidence from an online marketplace," RAND Journal of Economics, RAND Corporation, vol. 51(4), pages 965-988, December.
    20. Keser, Claudia & Späth, Maximilian, 2021. "The value of bad ratings: An experiment on the impact of distortions in reputation systems," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 95(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:70:y:2024:i:1:p:567-588. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.