IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp9285.html

The Complementary Use of Experiments and Field Data to Evaluate Management Practices: The Case of Subjective Performance Evaluations

Author

Listed:
  • Kampkötter, Patrick

    (University of Tübingen)

  • Sliwka, Dirk

    (University of Cologne)

Abstract

Most firms rely on subjective evaluations by supervisors to assess their employees' performance. This article discusses the implementation of such appraisal processes, exploring the use of multiple research methods such as the analysis of personnel records, survey data, and lab and field experiments to study them in detail. We argue that the complementary use of these methods helps to build a better understanding of how subjective evaluations are conducted and appraisal systems should be designed.

Suggested Citation

  • Kampkötter, Patrick & Sliwka, Dirk, 2015. "The Complementary Use of Experiments and Field Data to Evaluate Management Practices: The Case of Subjective Performance Evaluations," IZA Discussion Papers 9285, IZA Network @ LISER.
    • Handle: RePEc:iza:izadps:dp9285
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp9285.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Frederiksen, Anders & Lange, Fabian & Kriechel, Ben, 2017. "Subjective performance evaluations and employee careers," Journal of Economic Behavior & Organization, Elsevier, vol. 134(C), pages 408-429.
    2. Angus Deaton, 2010. "Instruments, Randomization, and Learning about Development," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 424-455, June.
    3. Ernst Fehr & Georg Kirchsteiger & Arno Riedl, 1993. "Does Fairness Prevent Market Clearing? An Experimental Investigation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 108(2), pages 437-459.
    4. Johannes Berger & Christine Harbring & Dirk Sliwka, 2013. "Performance Appraisals and the Impact of Forced Distribution--An Experimental Investigation," Management Science, INFORMS, vol. 59(1), pages 54-68, June.
    5. Ernst Fehr & Simon Gachter & Georg Kirchsteiger, 1997. "Reciprocity as a Contract Enforcement Device: Experimental Evidence," Econometrica, Econometric Society, vol. 65(4), pages 833-860, July.
    6. Axel Engellandt & Regina T. Riphahn, 2011. "Evidence on Incentive Effects of Subjective Performance Evaluations," ILR Review, Cornell University, ILR School, vol. 64(2), pages 241-257, January.
    7. Armin Falk & James J. Heckman, 2009. "Lab Experiments are a Major Source of Knowledge in the Social Sciences," Working Papers 200935, Geary Institute, University College Dublin.
    8. Sunde, Uwe & Roider, Andreas & Englmaier, Florian, 2012. "The Role of Salience in Performance Schemes: Evidence from a Field Experiment," CEPR Discussion Papers 8921, C.E.P.R. Discussion Papers.
    9. Axel Ockenfels & Dirk Sliwka & Peter Werner, 2015. "Bonus Payments and Reference Point Violations," Management Science, INFORMS, vol. 61(7), pages 1496-1513, July.
    10. Canice Prendergast, 1999. "The Provision of Incentives in Firms," Journal of Economic Literature, American Economic Association, vol. 37(1), pages 7-63, March.
    11. George Baker & Michael Gibbs & Bengt Holmstrom, 1994. "The Wage Policy of a Firm," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 109(4), pages 921-955.
    12. Daniel Kahneman & Amos Tversky, 2013. "Prospect Theory: An Analysis of Decision Under Risk," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 6, pages 99-127, World Scientific Publishing Co. Pte. Ltd..
    13. Guido W. Imbens, 2010. "Better LATE Than Nothing: Some Comments on Deaton (2009) and Heckman and Urzua (2009)," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 399-423, June.
    14. Tanjim Hossain & John A. List, 2012. "The Behavioralist Visits the Factory: Increasing Productivity Using Simple Framing Manipulations," Management Science, INFORMS, vol. 58(12), pages 2151-2167, December.
    15. Nicholas Bloom & John Van Reenen, 2007. "Measuring and Explaining Management Practices Across Firms and Countries," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(4), pages 1351-1408.
    16. Nicholas Bloom & John Van Reenen, 2010. "Why Do Management Practices Differ across Firms and Countries?," Journal of Economic Perspectives, American Economic Association, vol. 24(1), pages 203-224, Winter.
    17. repec:iab:iabfme:201505(en is not listed on IDEAS
    18. Oriana Bandiera & Iwan Barankay & Imran Rasul, 2011. "Field Experiments with Firms," Journal of Economic Perspectives, American Economic Association, vol. 25(3), pages 63-82, Summer.
    19. Florian Englmaier & Katharina Schüßler, 2015. "Complementarities of HRM Practices - A Case for Employing Multiple Methods and Integrating Multiple Fields," CESifo Working Paper Series 5249, CESifo.
    20. Bellmann, Lutz & Bender, Stefan & Bossler, Mario & Broszeit, Sandra & Dickmann, Christian & Gensicke, Miriam & Gilberg, Reiner & Grunau, Philipp & Kampkötter, Patrick & Laske, Katharina & Mohrenweiser, 2015. "LPP - Linked Personnel Panel : quality of work and economic success: longitudinal study in German establishments (data collection on the first wave)," FDZ Methodenreport 201505_en, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    21. Flabbi, Luca & Ichino, Andrea, 2001. "Productivity, seniority and wages: new evidence from personnel data," Labour Economics, Elsevier, vol. 8(3), pages 359-387, June.
    22. Breuer, Kathrin & Nieken, Petra & Sliwka, Dirk, 2010. "Social Ties and Subjective Performance Evaluations: An Empirical Investigation," IZA Discussion Papers 4913, IZA Network @ LISER.
    23. Bolton, Gary E, 1991. "A Comparative Model of Bargaining: Theory and Evidence," American Economic Review, American Economic Association, vol. 81(5), pages 1096-1136, December.
    24. Abbink, Klaus & Sadrieh, Abdolkarim, 2009. "The pleasure of being nasty," Economics Letters, Elsevier, vol. 105(3), pages 306-308, December.
    25. Ernst Fehr & Klaus M. Schmidt, 1999. "A Theory of Fairness, Competition, and Cooperation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(3), pages 817-868.
    26. Broszeit, Sandra & Wolter, Stefanie, 2015. "LPP - Linked Personnel Panel : quality of work and economic success: longitudinal study in German establishments (data documentation on the first wave)," FDZ Datenreport. Documentation on Labour Market Data 201501_en, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    27. repec:pri:rpdevs:deaton_instruments_randomization_learning_all_04april_2010 is not listed on IDEAS
    28. Halse, Nikolaj & Smeets, Valérie & Warzynski, Frédèric, 2011. "International Differences in Subjective Performance Evaluation,Compensation and Career Dynamics in a Global Company," Working Papers 11-15, University of Aarhus, Aarhus School of Business, Department of Economics.
    29. George Baker & Michael Gibbs & Bengt Holmstrom, 1994. "The Internal Economics of the Firm: Evidence from Personnel Data," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 109(4), pages 881-919.
    30. Thomas J. Dohmen & Ben Kriechel & Gerard A. Pfann, 2004. "Monkey bars and ladders: The importance of lateral and vertical job mobility in internal labor market careers," Journal of Population Economics, Springer;European Society for Population Economics, vol. 17(2), pages 193-228, June.
    31. Bellemare, Charles & Shearer, Bruce, 2009. "Gift giving and worker productivity: Evidence from a firm-level experiment," Games and Economic Behavior, Elsevier, vol. 67(1), pages 233-244, September.
    32. repec:adr:anecst:y:2001:i:63-64:p:03 is not listed on IDEAS
    33. Alexander Sebald & Markus Walzl, 2014. "Subjective Performance Evaluations and Reciprocity in Principal–Agent Relations," Scandinavian Journal of Economics, Wiley Blackwell, vol. 116(2), pages 570-590, April.
    34. Nicholas Bloom & Christos Genakos & Raffaella Sadun & John Van Reenen, 2011. "Management Practices Across Firms and Countries," CEP Discussion Papers dp1109, Centre for Economic Performance, LSE.
    35. Botond Kőszegi & Matthew Rabin, 2006. "A Model of Reference-Dependent Preferences," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 121(4), pages 1133-1165.
    36. Casey Ichniowski & Kathryn Shaw, 2004. "Using "Insider Econometrics" to Study Productivity," American Economic Review, American Economic Association, vol. 94(2), pages 217-223, May.
    37. Sandra E. Black & Lisa M. Lynch, 2004. "What's driving the new economy?: the benefits of workplace innovation," Economic Journal, Royal Economic Society, vol. 114(493), pages 97-116, February.
    38. Josse Delfgaauw & Robert Dur & Joeri Sol & Willem Verbeke, 2013. "Tournament Incentives in the Field: Gender Differences in the Workplace," Journal of Labor Economics, University of Chicago Press, vol. 31(2), pages 305-326.
    39. Prendergast, Canice & Topel, Robert, 1993. "Discretion and bias in performance evaluation," European Economic Review, Elsevier, vol. 37(2-3), pages 355-365, April.
    40. repec:iab:iabfda:201501(en is not listed on IDEAS
    41. Axel Ockenfels & Gary E. Bolton, 2000. "ERC: A Theory of Equity, Reciprocity, and Competition," American Economic Review, American Economic Association, vol. 90(1), pages 166-193, March.
    42. Prendergast, Canice & Topel, Robert H, 1996. "Favoritism in Organizations," Journal of Political Economy, University of Chicago Press, vol. 104(5), pages 958-978, October.
    43. David E. Bell, 1985. "Disappointment in Decision Making Under Uncertainty," Operations Research, INFORMS, vol. 33(1), pages 1-27, February.
    44. Moers, Frank, 2005. "Discretion and bias in performance evaluation: the impact of diversity and subjectivity," Accounting, Organizations and Society, Elsevier, vol. 30(1), pages 67-80, January.
    45. Takahashi, Shingo & Owan, Hideo & Tsuru, Tsuyoshi & Uehara, Katsuhito, 2014. "Multitasking Incentives and Biases in Subjective Performance Evaluation," Discussion Paper Series 614, Institute of Economic Research, Hitotsubashi University.
    46. Guido Friebel & Matthias Heinz & Miriam Krueger & Nikolay Zubanov, 2017. "Team Incentives and Performance: Evidence from a Retail Chain," American Economic Review, American Economic Association, vol. 107(8), pages 2168-2203, August.
    47. Steven D. Levitt & John A. List, 2007. "What Do Laboratory Experiments Measuring Social Preferences Reveal About the Real World?," Journal of Economic Perspectives, American Economic Association, vol. 21(2), pages 153-174, Spring.
    48. Fehr, Ernst & Schmidt, Klaus M., 2006. "The Economics of Fairness, Reciprocity and Altruism - Experimental Evidence and New Theories," Handbook on the Economics of Giving, Reciprocity and Altruism, in: S. Kolm & Jean Mercier Ythier (ed.), Handbook of the Economics of Giving, Altruism and Reciprocity, edition 1, volume 1, chapter 8, pages 615-691, Elsevier.
    49. Giebe, Thomas & Gürtler, Oliver, 2012. "Optimal contracts for lenient supervisors," Journal of Economic Behavior & Organization, Elsevier, vol. 81(2), pages 403-420.
    50. Christian Grund & Judith Przemeck, 2012. "Subjective performance appraisal and inequality aversion," Applied Economics, Taylor & Francis Journals, vol. 44(17), pages 2149-2155, June.
    51. Daniel J. Zizzo & Andrew J. Oswald, 2001. "Are People Willing to Pay to Reduce Others'Incomes?," Annals of Economics and Statistics, GENES, issue 63-64, pages 39-65.
    52. Graham Loomes & Robert Sugden, 1986. "Disappointment and Dynamic Consistency in Choice under Uncertainty," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 53(2), pages 271-282.
    53. Bloom, Nicholas & Van Reenen, John, 2011. "Human Resource Management and Productivity," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 19, pages 1697-1767, Elsevier.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Brändle, Tobias & Grunau, Philipp & Haylock, Michael & Kampkötter, Patrick, 2020. "Recruitment strategies and match quality - New evidence from representative linked employer-employee data," University of Tübingen Working Papers in Business and Economics 134, University of Tuebingen, Faculty of Economics and Social Sciences, School of Business and Economics.
    2. Uwe Jirjahn & Jens Mohrenweiser, 2019. "Performance Pay and Applicant Screening," British Journal of Industrial Relations, London School of Economics, vol. 57(3), pages 540-575, September.
    3. Englmaier, Florian & Schüßler, Katharina, 2015. "Complementarities of HRM Practices," Discussion Paper Series of SFB/TR 15 Governance and the Efficiency of Economic Systems 503, Free University of Berlin, Humboldt University of Berlin, University of Bonn, University of Mannheim, University of Munich.
    4. Florian Englmaier & Katharina Schüßler, 2015. "Complementarities of HRM Practices - A Case for Employing Multiple Methods and Integrating Multiple Fields," CESifo Working Paper Series 5249, CESifo.
    5. Matthias Fahn & Giorgio Zanarone, 2021. "Pay Transparency Under Subjective Performance Evaluation," CESifo Working Paper Series 8849, CESifo.
    6. Florian Englmaier & Guido Friebel & Gerd Muehlheusser & Andreas Roider, 2016. "Symposium on Evidence-Based Management," Journal of Institutional and Theoretical Economics (JITE), Mohr Siebeck, Tübingen, vol. 172(2), pages 305-311, June.
    7. Enzo Brox & Michael Lechner, 2024. "Teamwork and Spillover Effects in Performance Evaluations," Papers 2403.15200, arXiv.org.
    8. Frederiksen, Anders & Lange, Fabian & Kriechel, Ben, 2017. "Subjective performance evaluations and employee careers," Journal of Economic Behavior & Organization, Elsevier, vol. 134(C), pages 408-429.
    9. Ahammer, Alexander & Fahn, Matthias & Stiftinger, Flora, 2023. "Outside Options and Worker Motivation," IZA Discussion Papers 16333, Institute of Labor Economics (IZA).
    10. Axel Ockenfels & Dirk Sliwka & Peter Werner, 2025. "Multirater Performance Evaluations and Incentives," Journal of Labor Economics, University of Chicago Press, vol. 43(4), pages 985-1004.
    11. Fahn, Matthias, 2019. "Reciprocity in Dynamic Employment Relationships," Rationality and Competition Discussion Paper Series 198, CRC TRR 190 Rationality and Competition.
    12. Werner, Peter, 2024. "On common evaluation standards and the acceptance of wage inequality," Games and Economic Behavior, Elsevier, vol. 145(C), pages 137-156.
    13. Irene Trapp & Rouven Trapp, 2019. "The psychological effects of centrality bias: an experimental analysis," Journal of Business Economics, Springer, vol. 89(2), pages 155-189, March.
    14. Pohlan, Laura & Steffes, Susanne, 2022. "Performance feedback and job search behavior: Empirical evidence from linked employer-employee data," ZEW Discussion Papers 22-048, ZEW - Leibniz Centre for European Economic Research.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marchegiani, Lucia & Reggiani, Tommaso & Rizzolli, Matteo, 2016. "Loss averse agents and lenient supervisors in performance appraisal," Journal of Economic Behavior & Organization, Elsevier, vol. 131(PA), pages 183-197.
    2. Johannes Berger & Christine Harbring & Dirk Sliwka, 2013. "Performance Appraisals and the Impact of Forced Distribution--An Experimental Investigation," Management Science, INFORMS, vol. 59(1), pages 54-68, June.
    3. Dohmen, Thomas, 2014. "Behavioral labor economics: Advances and future directions," Labour Economics, Elsevier, vol. 30(C), pages 71-85.
    4. Frederiksen, Anders & Lange, Fabian & Kriechel, Ben, 2017. "Subjective performance evaluations and employee careers," Journal of Economic Behavior & Organization, Elsevier, vol. 134(C), pages 408-429.
    5. Axel Ockenfels & Dirk Sliwka & Peter Werner, 2015. "Bonus Payments and Reference Point Violations," Management Science, INFORMS, vol. 61(7), pages 1496-1513, July.
    6. Yan Chen & Peter Cramton & John A. List & Axel Ockenfels, 2021. "Market Design, Human Behavior, and Management," Management Science, INFORMS, vol. 67(9), pages 5317-5348, September.
    7. Lucia Marchegiani & Tommaso Reggiani & Matteo Rizzolli, 2013. "Severity vs. Leniency Bias in Performance Appraisal: Experimental evidence," BEMPS - Bozen Economics & Management Paper Series BEMPS01, Faculty of Economics and Management at the Free University of Bozen.
    8. Sliwka, Dirk & Werner, Peter, 2016. "How Do Agents React to Dynamic Wage Increases? An Experimental Study," IZA Discussion Papers 9855, IZA Network @ LISER.
    9. Werner, Peter, 2024. "On common evaluation standards and the acceptance of wage inequality," Games and Economic Behavior, Elsevier, vol. 145(C), pages 137-156.
    10. Kathrin Manthei & Dirk Sliwka, 2019. "Multitasking and Subjective Performance Evaluations: Theory and Evidence from a Field Experiment in a Bank," Management Science, INFORMS, vol. 65(12), pages 5861-5883, December.
    11. Axel Ockenfels & Dirk Sliwka & Peter Werner, 2025. "Multirater Performance Evaluations and Incentives," Journal of Labor Economics, University of Chicago Press, vol. 43(4), pages 985-1004.
    12. Golman, Russell & Bhatia, Sudeep, 2012. "Performance evaluation inflation and compression," Accounting, Organizations and Society, Elsevier, vol. 37(8), pages 534-543.
    13. Charness, Gary & Kuhn, Peter, 2011. "Lab Labor: What Can Labor Economists Learn from the Lab?," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 3, pages 229-330, Elsevier.
    14. Marco Kleine & Sebastian Kube, 2015. "Communication and Trust in Principal-Team Relationships: Experimental Evidence," Discussion Paper Series of the Max Planck Institute for Behavioral Economics 2015_06, Max Planck Institute for Behavioral Economics.
    15. Gill, David & Stone, Rebecca, 2010. "Fairness and desert in tournaments," Games and Economic Behavior, Elsevier, vol. 69(2), pages 346-364, July.
    16. Greer K. Gosnell & John A. List & Robert Metcalfe, 2016. "A New Approach to an Age-Old Problem: Solving Externalities by Incenting Workers Directly," NBER Working Papers 22316, National Bureau of Economic Research, Inc.
    17. Gill, David & Stone, Rebecca, 2009. "Fairness and desert in tournaments," Discussion Paper Series In Economics And Econometrics 903, Economics Division, School of Social Sciences, University of Southampton.
    18. Rainer Michael Rilke & Dirk Sliwka, 2026. "When Algorithms Rate Performance: Do Large Language Models Replicate Human Evaluation Biases?," ECONtribute Discussion Papers Series 384, University of Bonn and University of Cologne, Germany.
    19. Boosey, Luke & Goerg, Sebastian, 2020. "The timing of discretionary bonuses – effort, signals, and reciprocity," Games and Economic Behavior, Elsevier, vol. 124(C), pages 254-280.
    20. Kampkötter, Patrick & Mohrenweiser, Jens & Sliwka, Dirk & Steffes, Susanne & Wolter, Stefanie, 2015. "Measuring the use of human resources practices and employee attitudes : the linked personnel panel," IAB-Discussion Paper 201535, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • D22 - Microeconomics - - Production and Organizations - - - Firm Behavior: Empirical Analysis
    • J33 - Labor and Demographic Economics - - Wages, Compensation, and Labor Costs - - - Compensation Packages; Payment Methods
    • M12 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Business Administration - - - Personnel Management; Executives; Executive Compensation
    • M52 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Personnel Economics - - - Compensation and Compensation Methods and Their Effects

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp9285. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Mark Fallak (email available below). General contact details of provider: https://edirc.repec.org/data/izaaalu.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.