IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v59y2013i1p54-68.html
   My bibliography  Save this article

Performance Appraisals and the Impact of Forced Distribution--An Experimental Investigation

Author

Listed:
  • Johannes Berger

    (University of Cologne, 50931 Cologne, Germany)

  • Christine Harbring

    (RWTH Aachen University, 52056 Aachen, Germany; and IZA-Institute for the Study of Labor, 53113 Bonn, Germany)

  • Dirk Sliwka

    (University of Cologne, 50931 Cologne, Germany; IZA-Institute for the Study of Labor, 53113 Bonn, Germany; and CESifo, 81679 Munich, Germany)

Abstract

A real-effort experiment is investigated in which supervisors have to rate the performance of individual workers who in turn receive a bonus payment based on these ratings. We compare a baseline treatment in which supervisors are not restricted in their rating behavior to a forced distribution system in which they have to assign differentiated grades. We find that productivity is significantly higher under a forced distribution by about 6% to 12%. However, the productivity effects are less clear cut when participants have prior experience with the baseline condition. Moreover, a forced distribution becomes detrimental when workers have access to a simple option to sabotage each other. This paper was accepted by Peter Wakker, decision analysis.

Suggested Citation

  • Johannes Berger & Christine Harbring & Dirk Sliwka, 2013. "Performance Appraisals and the Impact of Forced Distribution--An Experimental Investigation," Management Science, INFORMS, vol. 59(1), pages 54-68, June.
    • Handle: RePEc:inm:ormnsc:v:59:y:2013:i:1:p:54-68
    DOI: 10.1287/mnsc.1120.1624
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mnsc.1120.1624
    Download Restriction: no
    File URL: https://libkey.io/10.1287/mnsc.1120.1624?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Gary Charness & Matthew Rabin, 2002. "Understanding Social Preferences with Simple Tests," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 117(3), pages 817-869.
    2. Lazear, Edward P & Rosen, Sherwin, 1981. "Rank-Order Tournaments as Optimum Labor Contracts," Journal of Political Economy, University of Chicago Press, vol. 89(5), pages 841-864, October.
    3. Gary Charness, 2004. "Attribution and Reciprocity in an Experimental Labor Market," Journal of Labor Economics, University of Chicago Press, vol. 22(3), pages 665-688, July.
    4. Ernst Fehr & Klaus M. Schmidt, 1999. "A Theory of Fairness, Competition, and Cooperation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(3), pages 817-868.
    5. Ernst Fehr & Georg Kirchsteiger & Arno Riedl, 1993. "Does Fairness Prevent Market Clearing? An Experimental Investigation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 108(2), pages 437-459.
    6. Ernst Fehr & Simon Gachter & Georg Kirchsteiger, 1997. "Reciprocity as a Contract Enforcement Device: Experimental Evidence," Econometrica, Econometric Society, vol. 65(4), pages 833-860, July.
    7. Axel Engellandt & Regina T. Riphahn, 2011. "Evidence on Incentive Effects of Subjective Performance Evaluations," ILR Review, Cornell University, ILR School, vol. 64(2), pages 241-257, January.
    8. Heike Hennig-Schmidt & Bettina Rockenbach & Abdolkarim Sadrieh, 2010. "In Search Of Workers' Real Effort Reciprocity-A Field and a Laboratory Experiment," Journal of the European Economic Association, MIT Press, vol. 8(4), pages 817-837, June.
    9. Axel Ockenfels & Dirk Sliwka & Peter Werner, 2015. "Bonus Payments and Reference Point Violations," Management Science, INFORMS, vol. 61(7), pages 1496-1513, July.
    10. Andrew Schotter & Keith Weigelt, 1992. "Asymmetric Tournaments, Equal Opportunity Laws, and Affirmative Action: Some Experimental Results," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 107(2), pages 511-539.
    11. Andrew E. Clark & David Masclet & Marie Claire Villeval, 2010. "Effort and Comparison Income: Experimental and Survey Evidence," ILR Review, Cornell University, ILR School, vol. 63(3), pages 407-426, April.
    12. Lazear, Edward P, 1989. "Pay Equality and Industrial Politics," Journal of Political Economy, University of Chicago Press, vol. 97(3), pages 561-580, June.
    13. Canice Prendergast, 1999. "The Provision of Incentives in Firms," Journal of Economic Literature, American Economic Association, vol. 37(1), pages 7-63, March.
    14. Alannah Orrison & Andrew Schotter & Keith Weigelt, 2004. "Multiperson Tournaments: An Experimental Examination," Management Science, INFORMS, vol. 50(2), pages 268-279, February.
    15. Ben Greiner, 2004. "The Online Recruitment System ORSEE 2.0 - A Guide for the Organization of Experiments in Economics," Working Paper Series in Economics 10, University of Cologne, Department of Economics.
    16. Ben Greiner, 2004. "The Online Recruitment System ORSEE - A Guide for the Organization of Experiments in Economics," Papers on Strategic Interaction 2003-10, Max Planck Institute of Economics, Strategic Interaction Group.
    17. Uri Gneezy & John A List, 2006. "Putting Behavioral Economics to Work: Testing for Gift Exchange in Labor Markets Using Field Experiments," Econometrica, Econometric Society, vol. 74(5), pages 1365-1384, September.
    18. Johannes Abeler & Steffen Altmann & Sebastian Kube & Matthias Wibral, 2010. "Gift Exchange and Workers' Fairness Concerns: When Equality is Unfair," Journal of the European Economic Association, MIT Press, vol. 8(6), pages 1299-1324, December.
    19. Dannenberg, Astrid & Riechmann, Thomas & Sturm, Bodo & Vogt, Carsten, 2007. "Inequity Aversion and Individual Behavior in Public Good Games: An Experimental Investigation," ZEW Discussion Papers 07-034, ZEW - Leibniz Centre for European Economic Research.
    20. Christine Harbring & Bernd Irlenbusch, 2011. "Sabotage in Tournaments: Evidence from a Laboratory Experiment," Management Science, INFORMS, vol. 57(4), pages 611-627, April.
    21. Bellemare, Charles & Shearer, Bruce, 2009. "Gift giving and worker productivity: Evidence from a firm-level experiment," Games and Economic Behavior, Elsevier, vol. 67(1), pages 233-244, September.
    22. Blanco, Mariana & Engelmann, Dirk & Normann, Hans Theo, 2011. "A within-subject analysis of other-regarding preferences," Games and Economic Behavior, Elsevier, vol. 72(2), pages 321-338, June.
    23. Kampkötter, Patrick & Sliwka, Dirk, 2011. "Differentiation and Performance: An Empirical Investigation on the Incentive Effects of Bonus Plans," IZA Discussion Papers 6070, Institute of Labor Economics (IZA).
    24. Prendergast, Canice & Topel, Robert, 1993. "Discretion and bias in performance evaluation," European Economic Review, Elsevier, vol. 37(2-3), pages 355-365, April.
    25. Axel Ockenfels & Gary E. Bolton, 2000. "ERC: A Theory of Equity, Reciprocity, and Competition," American Economic Review, American Economic Association, vol. 90(1), pages 166-193, March.
    26. Prendergast, Canice & Topel, Robert H, 1996. "Favoritism in Organizations," Journal of Political Economy, University of Chicago Press, vol. 104(5), pages 958-978, October.
    27. Moers, Frank, 2005. "Discretion and bias in performance evaluation: the impact of diversity and subjectivity," Accounting, Organizations and Society, Elsevier, vol. 30(1), pages 67-80, January.
    28. R. Lynn Hannan & John H. Kagel & Donald V. Moser, 2002. "Partial Gift Exchange in an Experimental Labor Market: Impact of Subject Population Differences, Productivity Differences, and Effort Requests on Behavior," Journal of Labor Economics, University of Chicago Press, vol. 20(4), pages 923-951, October.
    29. Urs Fischbacher, 2007. "z-Tree: Zurich toolbox for ready-made economic experiments," Experimental Economics, Springer;Economic Science Association, vol. 10(2), pages 171-178, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Charness, Gary & Kuhn, Peter, 2011. "Lab Labor: What Can Labor Economists Learn from the Lab?," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 3, pages 229-330, Elsevier.
    2. Simon Gächter & Daniele Nosenzo & Martin Sefton, 2012. "The Impact of Social Comparisons on Reciprocity," Scandinavian Journal of Economics, Wiley Blackwell, vol. 114(4), pages 1346-1367, December.
    3. Boosey, Luke & Goerg, Sebastian, 2020. "The timing of discretionary bonuses – effort, signals, and reciprocity," Games and Economic Behavior, Elsevier, vol. 124(C), pages 254-280.
    4. Valeria Maggian & Natalia Montinari & Antonio Nicol�, 2018. "Backscratching in Hierarchical Organizations," The Journal of Law, Economics, and Organization, Oxford University Press, vol. 34(2), pages 133-161.
    5. Patrick Kampkötter & Dirk Sliwka, 2016. "The Complementary Use of Experiments and Field Data to Evaluate Management Practices: The Case of Subjective Performance Evaluations," Journal of Institutional and Theoretical Economics (JITE), Mohr Siebeck, Tübingen, vol. 172(2), pages 364-389, June.
    6. Gary Bolton & Peter Werner, 2016. "The influence of potential on wages and effort," Experimental Economics, Springer;Economic Science Association, vol. 19(3), pages 535-561, September.
    7. Kocher, Martin G. & Luhan, Wolfgang J. & Sutter, Matthias, 2012. "Testing a forgotten aspect of Akerlof’s gift exchange hypothesis: Relational contracts with individual and uniform wages," Discussion Papers in Economics 12816, University of Munich, Department of Economics.
    8. Johannes Becker & Daniel Hopp & Karolin Süß, 2020. "How Altruistic Is Indirect Reciprocity? - Evidence from Gift-Exchange Games in the Lab," CESifo Working Paper Series 8423, CESifo.
    9. Cao, Cangjian & Li, Sherry Xin & Liu, Tracy Xiao, 2020. "A gift with thoughtfulness: A field experiment on work incentives," Games and Economic Behavior, Elsevier, vol. 124(C), pages 17-42.
    10. Marco Kleine & Sebastian Kube, 2015. "Communication and Trust in Principal-Team Relationships: Experimental Evidence," Discussion Paper Series of the Max Planck Institute for Research on Collective Goods 2015_06, Max Planck Institute for Research on Collective Goods.
    11. Axel Ockenfels & Dirk Sliwka & Peter Werner, 2015. "Bonus Payments and Reference Point Violations," Management Science, INFORMS, vol. 61(7), pages 1496-1513, July.
    12. Fortuna Casoria & Arno Riedl, 2013. "Experimental Labor Markets And Policy Considerations: Incomplete Contracts And Macroeconomic Aspects," Journal of Economic Surveys, Wiley Blackwell, vol. 27(3), pages 398-420, July.
    13. Judd Kessler & Judd B. Kessler, 2013. "When will there be Gift Exchange? Addressing the Lab-Field Debate with Laboratory Gift Exchange Experiments," CESifo Working Paper Series 4161, CESifo.
    14. Englmaier, Florian & Strasser, Sebastian & Winter, Joachim, 2014. "Worker characteristics and wage differentials: Evidence from a gift-exchange experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 97(C), pages 185-203.
    15. Aurélie BONEIN, 2014. "Social Comparison and Peer effects with Heterogeneous Ability," Economics Working Paper Archive (University of Rennes & University of Caen) 201411, Center for Research in Economics and Management (CREM), University of Rennes, University of Caen and CNRS.
    16. Nickolas Gagnon & Charles N. Noussair, 2020. "Reciprocity Under Brief And Long‐Time Delays," Economic Inquiry, Western Economic Association International, vol. 58(3), pages 1517-1530, July.
    17. Cardella, Eric & Roomets, Alex, 2022. "Pay distribution preferences and productivity effects: An experiment," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 96(C).
    18. Sliwka, Dirk & Werner, Peter, 2016. "How Do Agents React to Dynamic Wage Increases? An Experimental Study," IZA Discussion Papers 9855, Institute of Labor Economics (IZA).
    19. Duersch, Peter & Oechssler, Jörg & Vadovic, Radovan, 2012. "Sick pay provision in experimental labor markets," European Economic Review, Elsevier, vol. 56(1), pages 1-19.
    20. Gächter, Simon & Thöni, Christian, 2010. "Social comparison and performance: Experimental evidence on the fair wage-effort hypothesis," Journal of Economic Behavior & Organization, Elsevier, vol. 76(3), pages 531-543, December.

    More about this item

    Keywords

    performance measurement; forced distribution; forced ranking; motivation; experiment;
    All these keywords.

    JEL classification:

    • C91 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Individual Behavior
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness
    • J33 - Labor and Demographic Economics - - Wages, Compensation, and Labor Costs - - - Compensation Packages; Payment Methods
    • M52 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Personnel Economics - - - Compensation and Compensation Methods and Their Effects

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:59:y:2013:i:1:p:54-68. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.