IDEAS home Printed from https://ideas.repec.org/a/bla/ecinqu/v52y2014i3p1014-1026.html
   My bibliography  Save this article

The Harder The Task, The Higher The Score: Findings Of A Difficulty Bias

Author

Listed:
  • HILLARY N. MORGAN
  • KURT W. ROTTHOFF

Abstract

type="main" xml:lang="en"> Studies have found that going first or last in a sequential order contest leads to a biased outcome, commonly called order bias (or primacy and recency). Studies have also found that judges have a tendency to reward contestants they recognize with additional points, called reference bias. Controlling for known biases, we test for a new type of bias we refer to as “difficulty bias,” which reveals that athletes attempting more difficult routines receive higher execution scores, even when difficulty and execution are judged separately. Despite some identification challenges, we add to the literature by finding strong evidence of a difficulty bias in gymnastics. We also provide generalizations beyond athletics. (JEL L10, L83, D81, J70, Z1)

Suggested Citation

  • Hillary N. Morgan & Kurt W. Rotthoff, 2014. "The Harder The Task, The Higher The Score: Findings Of A Difficulty Bias," Economic Inquiry, Western Economic Association International, vol. 52(3), pages 1014-1026, July.
    • Handle: RePEc:bla:ecinqu:v:52:y:2014:i:3:p:1014-1026
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1111/ecin.12074
    Download Restriction: Access to full text is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Nathan Novemsky & Ravi Dhar, 2005. "Goal Fulfillment and Goal Targets in Sequential Choice," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 32(3), pages 396-404, December.
    2. Luis Garicano & Ignacio Palacios-Huerta & Canice Prendergast, 2005. "Favoritism Under Social Pressure," The Review of Economics and Statistics, MIT Press, vol. 87(2), pages 208-216, May.
    3. Page, Lionel & Page, Katie, 2010. "Last shall be first: A field study of biases in sequential performance evaluation on the Idol series," Journal of Economic Behavior & Organization, Elsevier, vol. 73(2), pages 186-198, February.
    4. Christopher A. Parsons & Johan Sulaeman & Michael C. Yates & Daniel S. Hamermesh, 2011. "Strike Three: Discrimination, Incentives, and Evaluation," American Economic Review, American Economic Association, vol. 101(4), pages 1410-1435, June.
    5. Joseph Price & Justin Wolfers, 2010. "Racial Discrimination Among NBA Referees," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(4), pages 1859-1887.
    6. Victor Ginsburgh & Renato Flores Galvao, 1996. "The Queen Elisabeth Musical Competition: how fair is the final ranking," ULB Institutional Repository 2013/1713, ULB -- Universite Libre de Bruxelles.
    7. Segrest Purkiss, Sharon L. & Perrewe, Pamela L. & Gillespie, Treena L. & Mayes, Bronston T. & Ferris, Gerald R., 2006. "Implicit sources of bias in employment interview judgments and decisions," Organizational Behavior and Human Decision Processes, Elsevier, vol. 101(2), pages 152-167, November.
    8. Cecilia Rouse & Claudia Goldin, 2000. "Orchestrating Impartiality: The Impact of "Blind" Auditions on Female Musicians," American Economic Review, American Economic Association, vol. 90(4), pages 715-741, September.
    9. Emerson, John W. & Seltzer, Miki & Lin, David, 2009. "Assessing Judging Bias: An Example From the 2000 Olympic Games," The American Statistician, American Statistical Association, vol. 63(2), pages 124-131.
    10. Neilson, William S, 1998. "Reference Wealth Effects in Sequential Choice," Journal of Risk and Uncertainty, Springer, vol. 17(1), pages 27-47, October.
    11. Yianis Sarafidis, 2007. "What Have you Done for me Lately? Release of Information and Strategic Manipulation of Memories," Economic Journal, Royal Economic Society, vol. 117(518), pages 307-326, March.
    12. Eric Zitzewitz, 2006. "Nationalism in Winter Sports Judging and Its Lessons for Organizational Decision Making," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 15(1), pages 67-99, March.
    13. Herbert Glejser & Bruno Heyndels, 2001. "Efficiency and Inefficiency in the Ranking in Competitions: the Case of the Queen Elisabeth Music Contest," Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 25(2), pages 109-129, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kurt W. Rotthoff, 2015. "(Not Finding a) Sequential Order Bias in Elite Level Gymnastics," Southern Economic Journal, Southern Economic Association, vol. 81(3), pages 724-741, January.
    2. repec:wly:soecon:v:81:3:y:2015:p:724-741 is not listed on IDEAS
    3. Rhett Brymer & Ryan M. Rodenberg & Huimiao Zheng & Tim R. Holcomb, 2021. "College Football Referee Bias and Sports Betting Impact," Eastern Economic Journal, Palgrave Macmillan;Eastern Economic Association, vol. 47(1), pages 91-106, January.
    4. Paul Gift, 2018. "Performance Evaluation and Favoritism," Journal of Sports Economics, , vol. 19(8), pages 1147-1173, December.
    5. Kurt W. Rotthoff, 2015. "(Not Finding a) Sequential Order Bias in Elite Level Gymnastics," Southern Economic Journal, John Wiley & Sons, vol. 81(3), pages 724-741, January.
    6. Sanne J. Joustra & Ruud H. Koning & Alex Krumer, 2021. "Order Effects in Elite Gymnastics," De Economist, Springer, vol. 169(1), pages 21-35, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Paul Gift, 2018. "Performance Evaluation and Favoritism," Journal of Sports Economics, , vol. 19(8), pages 1147-1173, December.
    2. Kurt W. Rotthoff, 2015. "(Not Finding a) Sequential Order Bias in Elite Level Gymnastics," Southern Economic Journal, John Wiley & Sons, vol. 81(3), pages 724-741, January.
    3. Kurt W. Rotthoff, 2015. "(Not Finding a) Sequential Order Bias in Elite Level Gymnastics," Southern Economic Journal, Southern Economic Association, vol. 81(3), pages 724-741, January.
    4. Page, Lionel & Page, Katie, 2010. "Last shall be first: A field study of biases in sequential performance evaluation on the Idol series," Journal of Economic Behavior & Organization, Elsevier, vol. 73(2), pages 186-198, February.
    5. repec:wly:soecon:v:81:3:y:2015:p:724-741 is not listed on IDEAS
    6. António Osório, 2020. "Performance Evaluation: Subjectivity, Bias and Judgment Style in Sport," Group Decision and Negotiation, Springer, vol. 29(4), pages 655-678, August.
    7. Ryan Rodenberg, 2013. "Employee Discipline And Basketball Referees: A Prediction Market Approach," Journal of Prediction Markets, University of Buckingham Press, vol. 7(2), pages 43-54.
    8. Thomas Dohmen & Jan Sauermann, 2016. "Referee Bias," Journal of Economic Surveys, Wiley Blackwell, vol. 30(4), pages 679-695, September.
    9. Sandra Schneemann & Hendrik Scholten & Christian Deutscher, 2018. "The Impact of Age on Nationality Bias: Evidence from Ski Jumping," Papers 1808.03804, arXiv.org.
    10. Eric Zitzewitz, 2014. "Does Transparency Reduce Favoritism and Corruption? Evidence From the Reform of Figure Skating Judging," Journal of Sports Economics, , vol. 15(1), pages 3-30, February.
    11. Paul Gift & Ryan M. Rodenberg, 2014. "Napoleon Complex," Journal of Sports Economics, , vol. 15(5), pages 541-558, October.
    12. Paul Bose & Eberhard Feess & Helge Mueller, 2022. "Favoritism towards High-Status Clubs: Evidence from German Soccer," The Journal of Law, Economics, and Organization, Oxford University Press, vol. 38(2), pages 422-478.
    13. David M. Waguespack & Robert Salomon, 2016. "Quality, Subjectivity, and Sustained Superior Performance at the Olympic Games," Management Science, INFORMS, vol. 62(1), pages 286-300, January.
    14. Sanne J. Joustra & Ruud H. Koning & Alex Krumer, 2021. "Order Effects in Elite Gymnastics," De Economist, Springer, vol. 169(1), pages 21-35, February.
    15. Raymond Fisman & Daniel Paravisini & Vikrant Vig, 2017. "Cultural Proximity and Loan Outcomes," American Economic Review, American Economic Association, vol. 107(2), pages 457-492, February.
    16. David Neumark, 2016. "Experimental Research on Labor Market Discrimination," NBER Working Papers 22022, National Bureau of Economic Research, Inc.
    17. Bar-Eli, Michael & Krumer, Alex & Morgulev, Elia, 2020. "Ask not what economics can do for sports - Ask what sports can do for economics," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 89(C).
    18. Christopher A. Parsons & Johan Sulaeman & Michael C. Yates & Daniel S. Hamermesh, 2007. "Strike Three: Umpires' Demand for Discrimination," NBER Working Papers 13665, National Bureau of Economic Research, Inc.
    19. Devin G. Pope & Joseph Price & Justin Wolfers, 2018. "Awareness Reduces Racial Bias," Management Science, INFORMS, vol. 64(11), pages 4988-4995, November.
    20. J. Aislinn Bohren & Alex Imas & Michael Rosenberg, 2019. "The Dynamics of Discrimination: Theory and Evidence," American Economic Review, American Economic Association, vol. 109(10), pages 3395-3436, October.
    21. Darren Grant, 2023. "Uncovering bias in order assignment," Economic Inquiry, Western Economic Association International, vol. 61(1), pages 82-98, January.

    More about this item

    JEL classification:

    • L10 - Industrial Organization - - Market Structure, Firm Strategy, and Market Performance - - - General
    • L83 - Industrial Organization - - Industry Studies: Services - - - Sports; Gambling; Restaurants; Recreation; Tourism
    • D81 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Criteria for Decision-Making under Risk and Uncertainty
    • J70 - Labor and Demographic Economics - - Labor Discrimination - - - General
    • Z1 - Other Special Topics - - Cultural Economics

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:ecinqu:v:52:y:2014:i:3:p:1014-1026. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/weaaaea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.