IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1904.06722.html
   My bibliography  Save this paper

Boomerang: Rebounding the Consequences of Reputation Feedback on Crowdsourcing Platforms

Author

Listed:
  • Snehalkumar

    (Neil)

  • S. Gaikwad
  • Durim Morina
  • Adam Ginzberg
  • Catherine Mullings
  • Shirish Goyal
  • Dilrukshi Gamage
  • Christopher Diemert
  • Mathias Burton
  • Sharon Zhou
  • Mark Whiting
  • Karolina Ziulkoski
  • Alipta Ballav
  • Aaron Gilbee
  • Senadhipathige S. Niranga
  • Vibhor Sehgal
  • Jasmine Lin
  • Leonardy Kristianto
  • Angela Richmond-Fuller
  • Jeff Regino
  • Nalin Chhibber
  • Dinesh Majeti
  • Sachin Sharma
  • Kamila Mananova
  • Dinesh Dhakal
  • William Dai
  • Victoria Purynova
  • Samarth Sandeep
  • Varshine Chandrakanthan
  • Tejas Sarma
  • Sekandar Matin
  • Ahmed Nasser
  • Rohit Nistala
  • Alexander Stolzoff
  • Kristy Milland
  • Vinayak Mathur
  • Rajan Vaish
  • Michael S. Bernstein

Abstract

Paid crowdsourcing platforms suffer from low-quality work and unfair rejections, but paradoxically, most workers and requesters have high reputation scores. These inflated scores, which make high-quality work and workers difficult to find, stem from social pressure to avoid giving negative feedback. We introduce Boomerang, a reputation system for crowdsourcing that elicits more accurate feedback by rebounding the consequences of feedback directly back onto the person who gave it. With Boomerang, requesters find that their highly-rated workers gain earliest access to their future tasks, and workers find tasks from their highly-rated requesters at the top of their task feed. Field experiments verify that Boomerang causes both workers and requesters to provide feedback that is more closely aligned with their private opinions. Inspired by a game-theoretic notion of incentive-compatibility, Boomerang opens opportunities for interaction design to incentivize honest reporting over strategic dishonesty.

Suggested Citation

  • Snehalkumar & S. Gaikwad & Durim Morina & Adam Ginzberg & Catherine Mullings & Shirish Goyal & Dilrukshi Gamage & Christopher Diemert & Mathias Burton & Sharon Zhou & Mark Whiting & Karolina Ziulkoski, 2019. "Boomerang: Rebounding the Consequences of Reputation Feedback on Crowdsourcing Platforms," Papers 1904.06722, arXiv.org.
  • Handle: RePEc:arx:papers:1904.06722
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/1904.06722
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Nisan,Noam & Roughgarden,Tim & Tardos,Eva & Vazirani,Vijay V. (ed.), 2007. "Algorithmic Game Theory," Cambridge Books, Cambridge University Press, number 9780521872829, February.
    2. Benjamin Edelman & Michael Ostrovsky & Michael Schwarz, 2007. "Internet Advertising and the Generalized Second-Price Auction: Selling Billions of Dollars Worth of Keywords," American Economic Review, American Economic Association, vol. 97(1), pages 242-259, March.
    3. George A. Akerlof, 1970. "The Market for "Lemons": Quality Uncertainty and the Market Mechanism," The Quarterly Journal of Economics, Oxford University Press, vol. 84(3), pages 488-500.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Scott Duke Kominers & Alexander Teytelboym & Vincent P Crawford, 2017. "An invitation to market design," Oxford Review of Economic Policy, Oxford University Press, vol. 33(4), pages 541-571.
    2. Avi Goldfarb, 2014. "What is Different About Online Advertising?," Review of Industrial Organization, Springer;The Industrial Organization Society, vol. 44(2), pages 115-129, March.
    3. Eric Bax, 2019. "Computing a Data Dividend," Papers 1905.01805, arXiv.org, revised Jun 2019.
    4. Chu-Shiu Li, 2005. "Risk Signaling in the Health Insurance Market," International Journal of Business and Economics, School of Management Development, Feng Chia University, Taichung, Taiwan, vol. 4(1), pages 45-52, April.
    5. Tisdell, Clem, 2014. "Information Technology's Impacts on Productivity, Welfare and Social Change: Second Version," Economic Theory, Applications and Issues Working Papers 195701, University of Queensland, School of Economics.
    6. Michael R. CARTER & Alain de JANVRY & Elisabeth SADOULET & Alexandros SARRIS, 2014. "Index-based weather insurance for developing countries: A review of evidence and a set of propositions for up-scaling," Working Papers P111, FERDI.
    7. Susan Athey & Michael Luca, 2019. "Economists (and Economics) in Tech Companies," Journal of Economic Perspectives, American Economic Association, vol. 33(1), pages 209-230, Winter.
    8. König, Philipp J. & Pothier, David, 2018. "Safe but fragile: Information acquisition, sponsor support and shadow bank runs," Discussion Papers 15/2018, Deutsche Bundesbank.
    9. Reynolds, Travis & Kolodinsky, Jane & Murray, Byron, 2012. "Consumer preferences and willingness to pay for compact fluorescent lighting: Policy implications for energy efficiency promotion in Saint Lucia," Energy Policy, Elsevier, vol. 41(C), pages 712-722.
    10. Ginger Zhe Jin & Andrew Kato & John A. List, 2010. "That’S News To Me! Information Revelation In Professional Certification Markets," Economic Inquiry, Western Economic Association International, vol. 48(1), pages 104-122, January.
    11. Luigino Bruni & Pier Luigi Porta, 2016. "Happiness and quality of life reconciled," Chapters, in: Luigino Bruni & Pier Luigi Porta (ed.), Handbook of Research Methods and Applications in Happiness and Quality of Life, chapter 1, pages 1-19, Edward Elgar Publishing.
    12. Loncarski, I. & Ter Horst, J.R. & Veld, C.H., 2006. "Why do Companies issue Convertible Bond Loans? An Empirical Analysis for the Canadian Market," Other publications TiSEM 6036423f-db13-4e07-b9d1-7, Tilburg University, School of Economics and Management.
    13. Abou Nabout, Nadia & Skiera, Bernd, 2012. "Return on Quality Improvements in Search Engine Marketing," Journal of Interactive Marketing, Elsevier, vol. 26(3), pages 141-154.
    14. Michael A. Arnold & Joshua M. Duke & Kent D. Messer, 2013. "Adverse Selection in Reverse Auctions for Ecosystem Services," Land Economics, University of Wisconsin Press, vol. 89(3), pages 387-412.
    15. Ritu Agarwal & Michelle Dugas & Guodong (Gordon) Gao & P. K. Kannan, 2020. "Emerging technologies and analytics for a new era of value-centered marketing in healthcare," Journal of the Academy of Marketing Science, Springer, vol. 48(1), pages 9-23, January.
    16. Villas-Boas, Sofia B, 2020. "Reduced Form Evidence on Belief Updating Under Asymmetric Information," Department of Agricultural & Resource Economics, UC Berkeley, Working Paper Series qt08c456vk, Department of Agricultural & Resource Economics, UC Berkeley.
    17. Yaofeng Fu & Ruokun Huang & Yiran Sheng, 2017. "Labor Contract Law -An Economic View," Papers 1702.03977, arXiv.org.
    18. Villas-Boas, Sofia B & Carrera, Mariana, 2016. "Generic aversion and observational learning in the over-the-counter drug market," Department of Agricultural & Resource Economics, UC Berkeley, Working Paper Series qt0q03b5f2, Department of Agricultural & Resource Economics, UC Berkeley.
    19. Vesa Kanniainen & Panu Poutvaara, 2007. "Imperfect Transmission of Tacit Knowledge and other Barriers to Entrepreneurship," CESifo Working Paper Series 2053, CESifo.
    20. Feser, Daniel & Runst, Petrik, 2015. "Energy efficiency consultants as change agents? Examining the reasons for EECs’ limited success," ifh Working Papers 1 (2015), Volkswirtschaftliches Institut für Mittelstand und Handwerk an der Universität Göttingen (ifh).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1904.06722. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: http://arxiv.org/ .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.