IDEAS home Printed from https://ideas.repec.org/a/eee/jeborg/v73y2010i2p186-198.html
   My bibliography  Save this article

Last shall be first: A field study of biases in sequential performance evaluation on the Idol series

Author

Listed:
  • Page, Lionel
  • Page, Katie

Abstract

When performances are evaluated they are very often presented in a sequential order. Previous research suggests that the sequential presentation of alternatives may induce systematic biases in the way performances are evaluated. Such a phenomenon has been scarcely studied in economics. Using a large dataset of performance evaluation in the Idol series (N=1522), this paper presents new evidence about the systematic biases in sequential evaluation of performances and the psychological phenomena at the origin of these biases.

Suggested Citation

  • Page, Lionel & Page, Katie, 2010. "Last shall be first: A field study of biases in sequential performance evaluation on the Idol series," Journal of Economic Behavior & Organization, Elsevier, vol. 73(2), pages 186-198, February.
  • Handle: RePEc:eee:jeborg:v:73:y:2010:i:2:p:186-198
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167-2681(09)00211-X
    Download Restriction: Full text for ScienceDirect subscribers only

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Piccione, Michele & Rubinstein, Ariel, 1997. "On the Interpretation of Decision Problems with Imperfect Recall," Games and Economic Behavior, Elsevier, vol. 20(1), pages 3-24, July.
    2. B. Douglas Bernheim & Raphael Thomadsen, 2005. "Memory and Anticipation," Economic Journal, Royal Economic Society, vol. 115(503), pages 271-304, April.
    3. Pieters, R. & Bijmolt, T.H.A., 1997. "Consumer memory for television advertising : A field study of duration, serial position and competition effects," Other publications TiSEM 1ae20014-8470-4056-8e3d-6, Tilburg University, School of Economics and Management.
    4. Devetag, Giovanna & Warglien, Massimo, 2003. "Games and phone numbers: Do short-term memory bounds affect strategic behavior?," Journal of Economic Psychology, Elsevier, vol. 24(2), pages 189-202, April.
    5. Devetag, Giovanna & Warglien, Massimo, 2008. "Playing the wrong game: An experimental analysis of relational complexity and strategic misrepresentation," Games and Economic Behavior, Elsevier, vol. 62(2), pages 364-382, March.
    6. Sofronis Clerides & Thanasis Stengos, 2012. "Love thy Neighbour, Love Thy Kin: Strategy and Bias in the Eurovision Song Contest," Ekonomia, Cyprus Economic Society and University of Cyprus, vol. 15(1), pages 22-44, Summer.
    7. Victor Ginsburgh & Renato Flores Galvao, 1996. "The Queen Elisabeth Musical Competition: how fair is the final ranking," ULB Institutional Repository 2013/1713, ULB -- Universite Libre de Bruxelles.
    8. James Dow, 1991. "Search Decisions with Limited Memory," Review of Economic Studies, Oxford University Press, vol. 58(1), pages 1-14.
    9. Jeffrey M Wooldridge, 2010. "Econometric Analysis of Cross Section and Panel Data," MIT Press Books, The MIT Press, edition 2, volume 1, number 0262232588, January.
    10. Segrest Purkiss, Sharon L. & Perrewe, Pamela L. & Gillespie, Treena L. & Mayes, Bronston T. & Ferris, Gerald R., 2006. "Implicit sources of bias in employment interview judgments and decisions," Organizational Behavior and Human Decision Processes, Elsevier, vol. 101(2), pages 152-167, November.
    11. Luigino Bruni & Robert Sugden, 2007. "The road not taken: how psychology was removed from economics, and how it might be brought back," Economic Journal, Royal Economic Society, vol. 117(516), pages 146-173, January.
    12. Neilson, William S, 1998. "Reference Wealth Effects in Sequential Choice," Journal of Risk and Uncertainty, Springer, vol. 17(1), pages 27-47, October.
    13. Yianis Sarafidis, 2007. "What Have you Done for me Lately? Release of Information and Strategic Manipulation of Memories," Economic Journal, Royal Economic Society, vol. 117(518), pages 307-326, March.
    14. Prendergast, Canice & Topel, Robert, 1993. "Discretion and bias in performance evaluation," European Economic Review, Elsevier, vol. 37(2-3), pages 355-365, April.
    15. Pieters, Rik G M & Bijmolt, Tammo H A, 1997. " Consumer Memory for Television Advertising: A Field Study of Duration, Serial Position, and Competition Effects," Journal of Consumer Research, Oxford University Press, vol. 23(4), pages 362-372, March.
    16. Sendhil Mullainathan, 2002. "A Memory-Based Model of Bounded Rationality," The Quarterly Journal of Economics, Oxford University Press, vol. 117(3), pages 735-774.
    17. Roland Bénabou & Jean Tirole, 2002. "Self-Confidence and Personal Motivation," The Quarterly Journal of Economics, Oxford University Press, vol. 117(3), pages 871-915.
    18. Herbert Glejser & Bruno Heyndels, 2001. "Efficiency and Inefficiency in the Ranking in Competitions: the Case of the Queen Elisabeth Music Contest," Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 25(2), pages 109-129, May.
    19. Bruine de Bruin, Wandi & Keren, Gideon, 2003. "Order effects in sequentially judged options due to the direction of comparison," Organizational Behavior and Human Decision Processes, Elsevier, vol. 92(1-2), pages 91-101.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mueller-Langer Frank & Andreoli-Versbach Patrick, 2017. "Leading-Effect, Risk-Taking and Sabotage in Two-Stage Tournaments: Evidence from a Natural Experiment," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 237(1), pages 1-28, February.
    2. Kurt W. Rotthoff, 2015. "(Not Finding a) Sequential Order Bias in Elite Level Gymnastics," Southern Economic Journal, Southern Economic Association, vol. 81(3), pages 724-741, January.
    3. Stefan D. Haigner & Stefan Jenewein & Hans-Christian Müller & Florian Wakolbinger, 2010. "The first shall be last: Serial position effects in the case contestants evaluate each other," Economics Bulletin, AccessEcon, vol. 30(4), pages 3170-3176.
    4. repec:eee:jeborg:v:146:y:2018:i:c:p:106-115 is not listed on IDEAS
    5. Schüller, David & Tauchmann, Harald & Upmann, Thorsten & Weimar, Daniel, 2014. "Pro-social behavior in the TV show “Come Dine With Me”: An empirical investigation," Journal of Economic Psychology, Elsevier, vol. 45(C), pages 44-55.
    6. Krumer, Alex & Lechner, Michael, 2016. "Midweek Effect on Performance: Evidence from the German Soccer Bundesliga," Economics Working Paper Series 1609, University of St. Gallen, School of Economics and Political Science.
    7. Jürgen Rösch, 2014. "More Surf, Less Bias: The Influence of Advertising in Two-Sided Sport Markets," International Journal of Sport Finance, Fitness Information Technology, vol. 9(4), pages 331-345, November.
    8. David Schüller & Thorsten Upmann, 2013. "When Focal Points are Out of Focus: A Game-Theoretic Analysis of Come Dine with Me," CESifo Working Paper Series 4138, CESifo Group Munich.
    9. repec:taf:applec:v:49:y:2017:i:37:p:3751-3757 is not listed on IDEAS
    10. Méon, Pierre-Guillaume & Szafarz, Ariane, 2011. "The modern corporation as a safe haven for taste-based discrimination: An agency model of hiring decisions," Labour Economics, Elsevier, vol. 18(4), pages 487-497, August.
    11. Paul Gift, 2015. "Sequential Judgment Effects In The Workplace: Evidence From The National Basketball Association," Economic Inquiry, Western Economic Association International, vol. 53(2), pages 1259-1274, April.
    12. Cohen-Zada, Danny & Krumer, Alex & Shapir, Offer Moshe, 2017. "Take a Chance on ABBA," IZA Discussion Papers 10878, Institute for the Study of Labor (IZA).
    13. repec:eee:eecrev:v:100:y:2017:i:c:p:412-427 is not listed on IDEAS
    14. Ahn, Heinz & Vazquez Novoa, Nadia, 2016. "The decoy effect in relative performance evaluation and the debiasing role of DEA," European Journal of Operational Research, Elsevier, vol. 249(3), pages 959-967.
    15. Krumer, Alex & Lechner, Michael, 2016. "First In First Win: Evidence on Unfairness of Round-Robin Tournaments in Mega-Events," Economics Working Paper Series 1611, University of St. Gallen, School of Economics and Political Science.
    16. Hillary N. Morgan & Kurt W. Rotthoff, 2014. "The Harder The Task, The Higher The Score: Findings Of A Difficulty Bias," Economic Inquiry, Western Economic Association International, vol. 52(3), pages 1014-1026, July.

    More about this item

    Keywords

    Order effects Memory Television show;

    JEL classification:

    • D81 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Criteria for Decision-Making under Risk and Uncertainty
    • Z1 - Other Special Topics - - Cultural Economics

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jeborg:v:73:y:2010:i:2:p:186-198. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Dana Niculescu). General contact details of provider: http://www.elsevier.com/locate/jebo .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.