IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2602.05542.html

Trimming of extreme votes and favoritism: Evidence from the field

Author

Listed:
  • Alex Krumer
  • Felix Otto
  • Tim Pawlowski

Abstract

Despite a large body of theoretical literature on voting mechanisms, there is no documented evidence from real-world panel evaluations about the effect of trimming the extreme votes on sincere voting. We provide the first such evidence by comparing subjective evaluations of experts from different countries in competitive settings with and without a trimming mechanism. In these evaluations, some of the evaluated subjects are experts' compatriots. Using data on 29,383 subjective evaluations, we find that experts assign significantly higher scores to their compatriots in panels without trimming. However, in panels with trimming, this favoritism is generally insignificant.

Suggested Citation

  • Alex Krumer & Felix Otto & Tim Pawlowski, 2026. "Trimming of extreme votes and favoritism: Evidence from the field," Papers 2602.05542, arXiv.org.
  • Handle: RePEc:arx:papers:2602.05542
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2602.05542
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Alexander Eisl & Rainer Jankowitsch & Marti G. Subrahmanyam, 2017. "The Manipulation Potential of Libor and Euribor," European Financial Management, European Financial Management Association, vol. 23(4), pages 604-647, September.
    2. Puppe, Clemens & Rollmann, Jana, 2021. "Mean versus median voting in multi-dimensional budget allocation problems. A laboratory experiment," Games and Economic Behavior, Elsevier, vol. 130(C), pages 309-330.
    3. Miceli, Thomas J. & Cosgel, Metin M., 1994. "Reputation and judicial decision-making," Journal of Economic Behavior & Organization, Elsevier, vol. 23(1), pages 31-51, January.
    4. Laura Spierdijk & Michel Vellekoop, 2009. "The structure of bias in peer voting systems: lessons from the Eurovision Song Contest," Empirical Economics, Springer, vol. 36(2), pages 403-425, May.
    5. Joseph Price & Justin Wolfers, 2010. "Racial Discrimination Among NBA Referees," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(4), pages 1859-1887.
    6. Ginsburgh, Victor & Noury, Abdul G., 2008. "The Eurovision Song Contest. Is voting political or cultural?," European Journal of Political Economy, Elsevier, vol. 24(1), pages 41-52, March.
    7. Gruner, Hans Peter & Kiel, Alexandra, 2004. "Collective decisions with interdependent valuations," European Economic Review, Elsevier, vol. 48(5), pages 1147-1168, October.
    8. Sergiu Hart, 2005. "An Interview with Robert Aumann," Discussion Paper Series dp386, The Federmann Center for the Study of Rationality, the Hebrew University, Jerusalem.
    9. Justin Wolfers, 2006. "Point Shaving: Corruption in NCAA Basketball," American Economic Review, American Economic Association, vol. 96(2), pages 279-283, May.
    10. Alex Krumer & Felix Otto & Tim Pawlowski, 2022. "Nationalistic bias among international experts: evidence from professional ski jumping," Scandinavian Journal of Economics, Wiley Blackwell, vol. 124(1), pages 278-300, January.
    11. Diana Kwon, 2021. "Prestigious European grants might be biased, study suggests," Nature, Nature, vol. 593(7860), pages 490-491, May.
    12. Sanne J. Joustra & Ruud H. Koning & Alex Krumer, 2021. "Order Effects in Elite Gymnastics," De Economist, Springer, vol. 169(1), pages 21-35, February.
    13. Toygar T. Kerman & P. Jean‐Jacques Herings & Dominik Karos, 2024. "Persuading sincere and strategic voters," Journal of Public Economic Theory, Association for Public Economic Theory, vol. 26(1), February.
    14. Richard Faltings & Alex Krumer & Michael Lechner, 2023. "Rot‐Jaune‐Verde: On linguistic bias of referees in Swiss soccer," Kyklos, Wiley Blackwell, vol. 76(3), pages 380-406, August.
    15. Louis, Philippos & Núñez, Matías & Xefteris, Dimitrios, 2023. "Trimming extreme reports in preference aggregation," Games and Economic Behavior, Elsevier, vol. 137(C), pages 116-151.
    16. H. Moulin, 1980. "On strategy-proofness and single peakedness," Public Choice, Springer, vol. 35(4), pages 437-455, January.
    17. Eric Zitzewitz, 2006. "Nationalism in Winter Sports Judging and Its Lessons for Organizational Decision Making," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 15(1), pages 67-99, March.
    18. Bar-Eli, Michael & Krumer, Alex & Morgulev, Elia, 2020. "Ask not what economics can do for sports - Ask what sports can do for economics," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 89(C).
    19. Moses Shayo & Asaf Zussman, 2011. "Judicial Ingroup Bias in the Shadow of Terrorism," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(3), pages 1447-1484.
    20. Ignacio Palacios-Huerta, 2025. "The Beautiful Dataset," Journal of Economic Literature, American Economic Association, vol. 63(4), pages 1363-1423, December.
    21. Rosar, Frank, 2015. "Continuous decisions by a committee: Median versus average mechanisms," Journal of Economic Theory, Elsevier, vol. 159(PA), pages 15-65.
    22. Anna Sandberg, 2018. "Competing Identities: A Field Study of In‐group Bias Among Professional Evaluators," Economic Journal, Royal Economic Society, vol. 128(613), pages 2131-2159, August.
    23. Andreas Kleiner & Benny Moldovanu, 2017. "Content-Based Agendas and Qualified Majorities in Sequential Voting," American Economic Review, American Economic Association, vol. 107(6), pages 1477-1506, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chowdhury, Subhasish M. & Jewell, Sarah & Singleton, Carl, 2024. "Can awareness reduce (and reverse) identity-driven bias in judgement? Evidence from international cricket," Journal of Economic Behavior & Organization, Elsevier, vol. 226(C).
    2. Louis, Philippos & Núñez, Matías & Xefteris, Dimitrios, 2023. "Trimming extreme reports in preference aggregation," Games and Economic Behavior, Elsevier, vol. 137(C), pages 116-151.
    3. Callegaro, Giulio & Lackner, Mario & Sonnabend, Hendrik, 2025. "The Napoleon complex revisited: New evidence from professional soccer," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 116(C).
    4. Alex Krumer & Felix Otto & Tim Pawlowski, 2022. "Nationalistic bias among international experts: evidence from professional ski jumping," Scandinavian Journal of Economics, Wiley Blackwell, vol. 124(1), pages 278-300, January.
    5. Richard Faltings & Alex Krumer & Michael Lechner, 2023. "Rot‐Jaune‐Verde: On linguistic bias of referees in Swiss soccer," Kyklos, Wiley Blackwell, vol. 76(3), pages 380-406, August.
    6. Dmitry Dagaev & Sofia Paklina & J. James Reade & Carl Singleton, 2024. "The Iron Curtain and Referee Bias in International Football," Journal of Sports Economics, , vol. 25(1), pages 126-151, January.
    7. António Osório, 2020. "Performance Evaluation: Subjectivity, Bias and Judgment Style in Sport," Group Decision and Negotiation, Springer, vol. 29(4), pages 655-678, August.
    8. Bar-Eli, Michael & Krumer, Alex & Morgulev, Elia, 2020. "Ask not what economics can do for sports - Ask what sports can do for economics," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 89(C).
    9. Mario Lackner, 2024. "The Napoleon complex revisited," Economics working papers 2024-06, Department of Economics, Johannes Kepler University Linz, Austria.
    10. Thrane, Christer, 2025. "Nationalistic bias in experts’ player ratings in football," Economics Letters, Elsevier, vol. 247(C).
    11. Alex Gershkov & Andreas Kleiner & Benny Moldovanu & Xianwen Shi, 2019. "The Art of Compromising: Voting with Interdependent Values and the Flag of the Weimar Republic," Working Papers tecipa-645, University of Toronto, Department of Economics.
    12. Kenneth Colombe & Alex Krumer & Rosa Lavelle-Hill & Tim Pawlowski, 2025. "Racial bias, colorism, and overcorrection," Papers 2508.10585, arXiv.org, revised Jan 2026.
    13. Philippos Louis & Matías Núñez & Dimitrios Xefteris, 2019. "Trimming Extreme Opinions in Preference Aggregation," University of Cyprus Working Papers in Economics 12-2019, University of Cyprus Department of Economics.
    14. Ignacio Palacios-Huerta, 2025. "The Beautiful Dataset," Journal of Economic Literature, American Economic Association, vol. 63(4), pages 1363-1423, December.
    15. Alex Krumer & Felix Otto & Tim Pawlowski, 2025. "Varying reference-point salience," Papers 2506.13382, arXiv.org, revised Oct 2025.
    16. Sandra Schneemann & Hendrik Scholten & Christian Deutscher, 2018. "The Impact of Age on Nationality Bias: Evidence from Ski Jumping," Papers 1808.03804, arXiv.org.
    17. Chen, Shuoyu & Collins, Clay & Collins, Ivy, 2025. "Discrimination and subjective player ratings: Evidence from China," The Quarterly Review of Economics and Finance, Elsevier, vol. 103(C).
    18. Gershkov, Alex & Kleiner, Andreas & Moldovanu, Benny & Shi, Xianwen, 2023. "Voting with interdependent values: The Condorcet winner," Games and Economic Behavior, Elsevier, vol. 142(C), pages 193-208.
    19. Faltings, Richard & Krumer, Alex & Lechner, Michael, 2019. "Rot-Jaune-Verde. Language and Favoritism: Evidence from Swiss Soccer," Economics Working Paper Series 1915, University of St. Gallen, School of Economics and Political Science.
    20. Budzinski, Oliver & Gänßle, Sophia & Weimar, Daniel, 2023. "Disentangling individual biases in jury voting: An empirical analysis of voting behavior in the Eurovision Song Contest," Ilmenau Economics Discussion Papers 171, Ilmenau University of Technology, Institute of Economics.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2602.05542. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.