IDEAS home Printed from https://ideas.repec.org/a/bla/joares/v59y2021i5p1573-1607.html
   My bibliography  Save this article

Forced Rating Systems from Employee and Supervisor Perspectives

Author

Listed:
  • EDDY CARDINAELS
  • CHRISTOPH FEICHTER

Abstract

Many firms use forced rating systems in which supervisors must evaluate employees according to a predefined distribution. We develop new theory suggesting that forced ratings are less likely to enhance performance when supervisors assess subjective dimensions of employee performance (e.g., creativity), but can have some harmful side effects. In a laboratory experiment, employees work on a creative task, and supervisors rate their performance. We do not find any difference in the employees’ performance or effort in a creative task setting between forced and free ratings. We do, however, find that forced ratings create higher stress for employees (ex post stress scales and biomarkers). Higher stress in turn mitigates the positive effect of effort on creativity. Furthermore, we find that actual creativity explains less of supervisors’ ratings of employees’ performance under forced ratings. Instead, factors that are unrelated to actual creativity, such as eloquent writing and strategic gaming behavior, matter more. Results of an additional online experiment confirm that forced ratings work differently in tasks where performance needs to be evaluated subjectively compared to tasks where objective measures are available.

Suggested Citation

  • Eddy Cardinaels & Christoph Feichter, 2021. "Forced Rating Systems from Employee and Supervisor Perspectives," Journal of Accounting Research, Wiley Blackwell, vol. 59(5), pages 1573-1607, December.
  • Handle: RePEc:bla:joares:v:59:y:2021:i:5:p:1573-1607
    DOI: 10.1111/1475-679X.12388
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/1475-679X.12388
    Download Restriction: no

    File URL: https://libkey.io/10.1111/1475-679X.12388?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Lazear, Edward P & Rosen, Sherwin, 1981. "Rank-Order Tournaments as Optimum Labor Contracts," Journal of Political Economy, University of Chicago Press, vol. 89(5), pages 841-864, October.
    2. Johannes Berger & Christine Harbring & Dirk Sliwka, 2013. "Performance Appraisals and the Impact of Forced Distribution--An Experimental Investigation," Management Science, INFORMS, vol. 59(1), pages 54-68, June.
    3. Camerer, Colin F & Hogarth, Robin M, 1999. "The Effects of Financial Incentives in Experiments: A Review and Capital-Labor-Production Framework," Journal of Risk and Uncertainty, Springer, vol. 19(1-3), pages 7-42, December.
    4. Hans K. Hvide, 2002. "Tournament Rewards and Risk Taking," Journal of Labor Economics, University of Chicago Press, vol. 20(4), pages 877-898, October.
    5. Canice Prendergast, 1999. "The Provision of Incentives in Firms," Journal of Economic Literature, American Economic Association, vol. 37(1), pages 7-63, March.
    6. Johannes Abeler & Steffen Altmann & Sebastian Kube & Matthias Wibral, 2010. "Gift Exchange and Workers' Fairness Concerns: When Equality is Unfair," Journal of the European Economic Association, MIT Press, vol. 8(6), pages 1299-1324, December.
    7. Sanjiv Erat & Uri Gneezy, 2017. "Erratum to: Incentives for creativity," Experimental Economics, Springer;Economic Science Association, vol. 20(1), pages 274-275, March.
    8. Kenneth Benoit & Kevin Munger & Arthur Spirling, 2019. "Measuring and Explaining Political Sophistication through Textual Complexity," American Journal of Political Science, John Wiley & Sons, vol. 63(2), pages 491-508, April.
    9. Paul J. Zak & Amos Nadler, 2010. "Using Brains to Create Trust: A Manager’s Toolbox," Chapters, in: Angela A. Stanton & Mellani Day & Isabell M. Welpe (ed.), Neuroeconomics and the Firm, chapter 4, Edward Elgar Publishing.
    10. Steven J. Kachelmeier & Bernhard E. Reichert & Michael G. Williamson, 2008. "Measuring and Motivating Quantity, Creativity, or Both," Journal of Accounting Research, Wiley Blackwell, vol. 46(2), pages 341-373, May.
    11. Kristina Rennekamp, 2012. "Processing Fluency and Investors’ Reactions to Disclosure Readability," Journal of Accounting Research, Wiley Blackwell, vol. 50(5), pages 1319-1354, December.
    12. Niamh Brennan & Encarna Guillamon-Saorin & Aileen Pierce, 2009. "Impression management : developing and illustrating a scheme of analysis for narrative disclosures – a methodological note," Open Access publications 10197/2905, Research Repository, University College Dublin.
    13. Dennis Campbell, 2012. "Employee Selection as a Control System," Journal of Accounting Research, Wiley Blackwell, vol. 50(4), pages 931-966, September.
    14. Stewart, Susan M & Gruys, Melissa L & Storm, Maria, 2010. "Forced distribution performance evaluation systems: Advantages, disadvantages and keys to implementation," Journal of Management & Organization, Cambridge University Press, vol. 16(1), pages 168-179, March.
    15. Joshua D. Angrist & Jörn-Steffen Pischke, 2009. "Mostly Harmless Econometrics: An Empiricist's Companion," Economics Books, Princeton University Press, edition 1, number 8769.
    16. Bol, Jasmijn C. & Kramer, Stephan & Maas, Victor S., 2016. "How control system design affects performance evaluation compression: The role of information accuracy and outcome transparency," Accounting, Organizations and Society, Elsevier, vol. 51(C), pages 64-73.
    17. Kampkötter, Patrick & Sliwka, Dirk, 2011. "Differentiation and Performance: An Empirical Investigation on the Incentive Effects of Bonus Plans," IZA Discussion Papers 6070, Institute of Labor Economics (IZA).
    18. Moers, Frank, 2005. "Discretion and bias in performance evaluation: the impact of diversity and subjectivity," Accounting, Organizations and Society, Elsevier, vol. 30(1), pages 67-80, January.
    19. Borodin A. D., 2016. "World experience of state influence on the economy," Visnyk of National University of Civil Protection of Ukraine. Public Administration series., National University of Civil Protection of Ukraine, vol. 4(1), pages 37-43, January.
    20. Christine Harbring & Bernd Irlenbusch & Matthias Krakel & Reinhard Selten, 2007. "Sabotage in Corporate Contests - An Experimental Analysis," International Journal of the Economics of Business, Taylor & Francis Journals, vol. 14(3), pages 367-392.
    21. A. Colin Cameron & Douglas L. Miller, 2015. "A Practitioner’s Guide to Cluster-Robust Inference," Journal of Human Resources, University of Wisconsin Press, vol. 50(2), pages 317-372.
    22. Doris M. Merkl-Davies & Niamh Brennan, 2007. "Discretionary disclosure strategies in corporate narratives : incremental information or impression management?," Open Access publications 10197/2907, Research Repository, University College Dublin.
    23. Niamh M. Brennan & Encarna Guillamon‐Saorin & Aileen Pierce, 2009. "Methodological Insights," Accounting, Auditing & Accountability Journal, Emerald Group Publishing Limited, vol. 22(5), pages 789-832, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Cardinaels, Eddy & Feichter, Christoph, 2023. "Forced Ranking: Fluch oder Segen?," Other publications TiSEM fbf9daf8-8658-4307-a733-c, Tilburg University, School of Economics and Management.
    2. Eric Floyd & Michael Hallsworth & John List & Robert Metcalfe & Kristian Rotaru & Ivo Vlaev, 2022. "What motivates people to pay their taxes? Evidence from four experiments on tax compliance," Natural Field Experiments 00750, The Field Experiments Website.
    3. Choi, Bong-Geun & Choi, Jung Ho & Malik, Sara, 2023. "Not just for investors: The role of earnings announcements in guiding job seekers," Journal of Accounting and Economics, Elsevier, vol. 76(1).
    4. Wang, Laura W. & Yin, Huaxiang, 2023. "The effects of emotion-understanding ability and tournament incentives on supervisors’ propensity to acquire subordinate-type information to use in control decisions," Accounting, Organizations and Society, Elsevier, vol. 107(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Johannes Berger & Christine Harbring & Dirk Sliwka, 2013. "Performance Appraisals and the Impact of Forced Distribution--An Experimental Investigation," Management Science, INFORMS, vol. 59(1), pages 54-68, June.
    2. Drago, Carlo & Ginesti, Gianluca & Pongelli, Claudia & Sciascia, Salvatore, 2018. "Reporting strategies: What makes family firms beat around the bush? Family-related antecedents of annual report readability," Journal of Family Business Strategy, Elsevier, vol. 9(2), pages 142-150.
    3. Charness, Gary & Kuhn, Peter, 2011. "Lab Labor: What Can Labor Economists Learn from the Lab?," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 3, pages 229-330, Elsevier.
    4. Bradler, Christiane & Neckermann, Susanne & Warnke, Arne Jonas, 2016. "Incentivizing creativity: A large-scale experiment with tournaments and gifts," ZEW Discussion Papers 16-040, ZEW - Leibniz Centre for European Economic Research.
    5. Irene Trapp & Rouven Trapp, 2019. "The psychological effects of centrality bias: an experimental analysis," Journal of Business Economics, Springer, vol. 89(2), pages 155-189, March.
    6. Christoph Feichter & Isabella Grabner, 2020. "Empirische Forschung zu Management Control – Ein Überblick und neue Trends [Empirical Management Control Reserach—An Overview and Future Directions]," Schmalenbach Journal of Business Research, Springer, vol. 72(2), pages 149-181, June.
    7. Loberg, Linda & Nüesch, Stephan & Foege, Johann Nils, 2021. "Forced distribution rating systems and team collaboration," Journal of Economic Behavior & Organization, Elsevier, vol. 188(C), pages 18-35.
    8. Emmanuel Dechenaux & Dan Kovenock & Roman Sheremeta, 2015. "A survey of experimental research on contests, all-pay auctions and tournaments," Experimental Economics, Springer;Economic Science Association, vol. 18(4), pages 609-669, December.
    9. Ku, Hyejin, 2019. "The effect of wage subsidies on piece rate workers: Evidence from the Penny Per Pound program in Florida," Journal of Development Economics, Elsevier, vol. 139(C), pages 122-134.
    10. Letina, Igor & Liu, Shuo & Netzer, Nick, 2020. "Delegating performance evaluation," Theoretical Economics, Econometric Society, vol. 15(2), May.
    11. Simon Gächter & Lingbo Huang & Martin Sefton, 2016. "Combining “real effort” with induced effort costs: the ball-catching task," Experimental Economics, Springer;Economic Science Association, vol. 19(4), pages 687-712, December.
    12. Maria-Silvia Sandulescu, 2017. "Impression management – an international perspective," The Audit Financiar journal, Chamber of Financial Auditors of Romania, vol. 15(148), pages 605-605.
    13. Marco Kleine & Sebastian Kube, 2015. "Communication and Trust in Principal-Team Relationships: Experimental Evidence," Discussion Paper Series of the Max Planck Institute for Research on Collective Goods 2015_06, Max Planck Institute for Research on Collective Goods.
    14. Brennan, Niamh M. & Daly, Caroline A. & Harrington, Claire S., 2010. "Rhetoric, argument and impression management in hostile takeover defence documents," The British Accounting Review, Elsevier, vol. 42(4), pages 253-268.
    15. Leung, Sidney & Parker, Lee & Courtis, John, 2015. "Impression management through minimal narrative disclosure in annual reports," The British Accounting Review, Elsevier, vol. 47(3), pages 275-289.
    16. Chaidali, Panagioula (Penny) & Jones, Michael John, 2017. "It’s a matter of trust: Exploring the perceptions of Integrated Reporting preparers," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 48(C), pages 1-20.
    17. Yifei Huang & Matt Shum & Xi Wu & Jason Zezhong Xiao, 2019. "Discovery of Bias and Strategic Behavior in Crowdsourced Performance Assessment," Papers 1908.01718, arXiv.org, revised Oct 2019.
    18. Patrick Kampkötter & Dirk Sliwka, 2016. "The Complementary Use of Experiments and Field Data to Evaluate Management Practices: The Case of Subjective Performance Evaluations," Journal of Institutional and Theoretical Economics (JITE), Mohr Siebeck, Tübingen, vol. 172(2), pages 364-389, June.
    19. Gürtler, Oliver & Harbring, Christine, 2007. "Feedback in Tournaments under Commitment Problems: The-ory and Experimental Evidence," Discussion Paper Series of SFB/TR 15 Governance and the Efficiency of Economic Systems 219, Free University of Berlin, Humboldt University of Berlin, University of Bonn, University of Mannheim, University of Munich.
    20. Victor S. Maas & Niels Verdoorn, 2017. "The effects of performance report layout on managers’ subjective evaluation judgments," Accounting and Business Research, Taylor & Francis Journals, vol. 47(7), pages 731-751, November.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:joares:v:59:y:2021:i:5:p:1573-1607. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0021-8456 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.