IDEAS home Printed from https://ideas.repec.org/a/spr/soinre/v173y2024i1d10.1007_s11205-020-02581-8.html
   My bibliography  Save this article

Evaluating Rank-Coherence of Crowd Rating in Customer Satisfaction

Author

Listed:
  • Venera Tomaselli

    (University of Catania)

  • Giulio Giacomo Cantone

    (University of Catania)

Abstract

Crowd rating is a continuous and public process of data gathering that allows the display of general quantitative opinions on a topic from online anonymous networks as they are crowds. Online platforms leveraged these technologies to improve predictive tasks in marketing. However, we argue for a different employment of crowd rating as a tool of public utility to support social contexts suffering to adverse selection, like tourism. This aim needs to deal with issues in both method of measurement and analysis of data, and with common biases associated to public disclosure of rating information. We propose an evaluative method to investigate fairness of common measures of rating procedures with the peculiar perspective of assessing linearity of the ranked outcomes. This is tested on a longitudinal observational case of 7 years of customer satisfaction ratings, for a total amount of 26.888 reviews. According to the results obtained from the sampled dataset, analysed with the proposed evaluative method, there is a trade-off between loss of (potentially) biased information on ratings and fairness of the resulting rankings. However, computing an ad hoc unbiased ranking case, the ranking outcome through the time-weighted measure is not significantly different from the ad hoc unbiased case.

Suggested Citation

  • Venera Tomaselli & Giulio Giacomo Cantone, 2024. "Evaluating Rank-Coherence of Crowd Rating in Customer Satisfaction," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 173(1), pages 283-303, May.
    • Handle: RePEc:spr:soinre:v:173:y:2024:i:1:d:10.1007_s11205-020-02581-8
    DOI: 10.1007/s11205-020-02581-8
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11205-020-02581-8
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11205-020-02581-8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Johannes Müller-Trede & Shoham Choshen-Hillel & Meir Barneron & Ilan Yaniv, 2018. "The Wisdom of Crowds in Matters of Taste," Management Science, INFORMS, vol. 64(4), pages 1779-1803, April.
    2. Jeacle, Ingrid & Carter, Chris, 2011. "In TripAdvisor we trust: Rankings, calculative regimes and abstract systems," Accounting, Organizations and Society, Elsevier, vol. 36(4), pages 293-309.
    3. Tommaso Proietti, 2019. "Discussion of The class of CUB models: statistical foundations, inferential issues and empirical evidence," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 28(3), pages 451-456, September.
    4. Joseph K. Goodman & Gabriele Paolacci, 2017. "Crowdsourcing Consumer Research," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 44(1), pages 196-210.
    5. Domenico Piccolo & Rosaria Simone, 2019. "Rejoinder to the discussion of “The class of cub models: statistical foundations, inferential issues and empirical evidence”," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 28(3), pages 477-493, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rosaria Simone & Marcella Corduas & Domenico Piccolo, 2023. "Dynamic modelling of price expectations and judgments," METRON, Springer;Sapienza Università di Roma, vol. 81(3), pages 323-342, December.
    2. repec:hal:spmain:info:hdl:2441/1q24hpq2919to8ct061g8p33kn is not listed on IDEAS
    3. Kareklas, Ioannis & Muehling, Darrel D. & King, Skyler, 2019. "The effect of color and self-view priming in persuasive communications," Journal of Business Research, Elsevier, vol. 98(C), pages 33-49.
    4. Karunakaran, Arvind & Orlikowski, Wanda J. & Scott, Susan V., 2022. "Crowd-based accountability: examining how social media commentary reconfigures organizational accountability," LSE Research Online Documents on Economics 114401, London School of Economics and Political Science, LSE Library.
    5. Julie Bayle-Cordier & Loïc Berger & Rayan Elatmani & Massimo Tavoni, 2023. "Breath, Love, Walk? The Impact of Mindfulness Interventions on Climate Policy Support and Environmental Attitudes," Sustainability, MDPI, vol. 15(13), pages 1-29, July.
    6. Fortin, Mélissa & Pimentel, Erica, 2024. "Bitcoin: An accounting regime," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 99(C).
    7. Azer, Jaylan & Anker, Thomas & Taheri, Babak & Tinsley, Ross, 2023. "Consumer-Driven racial stigmatization: The moderating role of race in online consumer-to-consumer reviews," Journal of Business Research, Elsevier, vol. 157(C).
    8. Neil Brigden, 2024. "Participant multitasking in online studies," Marketing Letters, Springer, vol. 35(4), pages 603-615, December.
    9. John Hulland & Jeff Miller, 2018. "“Keep on Turkin’”?," Journal of the Academy of Marketing Science, Springer, vol. 46(5), pages 789-794, September.
    10. Isabelle Bouty & Marie-Léandre Gomez & Carole Drucker-Godard, 2013. "Maintaining an Institution : The Institutional Work of Michelin in Haute Cuisine around the World," Working Papers hal-00782455, HAL.
    11. Benedikt Berger & Martin Adam & Alexander Rühr & Alexander Benlian, 2021. "Watch Me Improve—Algorithm Aversion and Demonstrating the Ability to Learn," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 63(1), pages 55-68, February.
    12. repec:spo:wpmain:info:hdl:2441/1q24hpq2919to8ct061g8p33kn is not listed on IDEAS
    13. Robert Cialdini & Yexin Jessica Li & Adriana Samper & Ned Wellman, 2021. "How Bad Apples Promote Bad Barrels: Unethical Leader Behavior and the Selective Attrition Effect," Journal of Business Ethics, Springer, vol. 168(4), pages 861-880, February.
    14. Josef Zelenka & Tracy Azubuike & Martina Pásková, 2021. "Trust Model for Online Reviews of Tourism Services and Evaluation of Destinations," Administrative Sciences, MDPI, vol. 11(2), pages 1-21, March.
    15. Cook, Nikolai & Heyes, Anthony, 2022. "Pollution pictures: Psychological exposure to pollution impacts worker productivity in a large-scale field experiment," Journal of Environmental Economics and Management, Elsevier, vol. 114(C).
    16. Jerome K. Vanclay, 2012. "Impact factor: outdated artefact or stepping-stone to journal certification?," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 211-238, August.
    17. Yao, Qiongrui (Missy) & Baker, LaKami T. & Lohrke, Franz T., 2022. "Building and sustaining trust in remote work by platform-dependent entrepreneurs on digital labor platforms: Toward an integrative framework," Journal of Business Research, Elsevier, vol. 149(C), pages 327-339.
    18. Pollock, Neil & D’Adderio, Luciana, 2012. "Give me a two-by-two matrix and I will create the market: Rankings, graphic visualisations and sociomateriality," Accounting, Organizations and Society, Elsevier, vol. 37(8), pages 565-586.
    19. Kutaula, Smirti & Gillani, Alvina & Leonidou, Leonidas C. & Christodoulides, Paul, 2022. "Integrating fair trade with circular economy: Personality traits, consumer engagement, and ethically-minded behavior," Journal of Business Research, Elsevier, vol. 144(C), pages 1087-1102.
    20. Boedker, Christina & Chong, Kar-Ming & Mouritsen, Jan, 2020. "The counter-performativity of calculative practices: Mobilising rankings of intellectual capital," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 72(C).
    21. Gendron, Yves, 2015. "Accounting academia and the threat of the paying-off mentality," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 26(C), pages 168-176.
    22. Sophie Cockcroft & Mark Russell, 2018. "Big Data Opportunities for Accounting and Finance Practice and Research," Australian Accounting Review, CPA Australia, vol. 28(3), pages 323-333, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:soinre:v:173:y:2024:i:1:d:10.1007_s11205-020-02581-8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.