IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v69y2023i4p2198-2216.html
   My bibliography  Save this article

Talking About Performance or Paying for It? A Field Experiment on Performance Reviews and Incentives

Author

Listed:
  • Kathrin Manthei

    (Rheinische Fachhochschule Cologne, University of Applied Sciences, D-50676 Köln, Germany)

  • Dirk Sliwka

    (University of Cologne, Department of Personnel Economics and Human Resource Management, D-50923 Köln, Germany)

  • Timo Vogelsang

    (Frankfurt School of Finance & Management, Department of Accounting, D-60322 Frankfurt, Germany)

Abstract

We investigate the causal effect of performance pay and conversations about performance in 224 stores of a retail chain implementing a field experiment with a 2x2 factorial design. In the performance pay treatments, managers receive a bonus, which is a simple linear function of the profits achieved above a threshold value. In the performance review treatments, managers have to report their activities undertaken to increase profits in regular meetings. We find that whereas performance pay did not yield significant profit increases, performance review conversations increased profits by about 7%. However, when additionally receiving performance pay, the positive effect of performance reviews vanished. We provide evidence from surveys and meeting protocols that performance pay changes the nature of conversations, leading to a stronger self-reliance of store managers, which undermines the value of the performance reviews.

Suggested Citation

  • Kathrin Manthei & Dirk Sliwka & Timo Vogelsang, 2023. "Talking About Performance or Paying for It? A Field Experiment on Performance Reviews and Incentives," Management Science, INFORMS, vol. 69(4), pages 2198-2216, April.
    • Handle: RePEc:inm:ormnsc:v:69:y:2023:i:4:p:2198-2216
    DOI: 10.1287/mnsc.2022.4431
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mnsc.2022.4431
    Download Restriction: no
    File URL: https://libkey.io/10.1287/mnsc.2022.4431?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jing Cai & Shing-Yi Wang, 2020. "Improving Management through Worker Evaluations: Evidence from Auto Manufacturing," NBER Working Papers 27680, National Bureau of Economic Research, Inc.
    2. Nicholas Bloom & Benn Eifert & Aprajit Mahajan & David McKenzie & John Roberts, 2013. "Does Management Matter? Evidence from India," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 128(1), pages 1-51.
    3. Josse Delfgaauw & Robert Dur & Joeri Sol & Willem Verbeke, 2013. "Tournament Incentives in the Field: Gender Differences in the Workplace," Journal of Labor Economics, University of Chicago Press, vol. 31(2), pages 305-326.
    4. Dan Ariely & Anat Bracha & Stephan Meier, 2009. "Doing Good or Doing Well? Image Motivation and Monetary Incentives in Behaving Prosocially," American Economic Review, American Economic Association, vol. 99(1), pages 544-555, March.
    5. Henry Eyring & Patrick J. Ferguson & Sebastian Koppers, 2021. "Less Information, More Comparison, and Better Performance: Evidence from a Field Experiment," Journal of Accounting Research, Wiley Blackwell, vol. 59(2), pages 657-711, May.
    6. Nicholas Bloom & John Van Reenen, 2007. "Measuring and Explaining Management Practices Across Firms and Countries," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(4), pages 1351-1408.
    7. Jean Tirole & Roland Bénabou, 2006. "Incentives and Prosocial Behavior," American Economic Review, American Economic Association, vol. 96(5), pages 1652-1678, December.
    8. Guido Friebel & Matthias Heinz & Miriam Krueger & Nikolay Zubanov, 2017. "Team Incentives and Performance: Evidence from a Retail Chain," American Economic Review, American Economic Association, vol. 107(8), pages 2168-2203, August.
    9. Lea Cassar & Stephan Meier, 2018. "Nonmonetary Incentives and the Implications of Work as a Source of Meaning," Journal of Economic Perspectives, American Economic Association, vol. 32(3), pages 215-238, Summer.
    10. Canice Prendergast, 1999. "The Provision of Incentives in Firms," Journal of Economic Literature, American Economic Association, vol. 37(1), pages 7-63, March.
    11. Tanjim Hossain & John A. List, 2012. "The Behavioralist Visits the Factory: Increasing Productivity Using Simple Framing Manipulations," Management Science, INFORMS, vol. 58(12), pages 2151-2167, December.
    12. Stefan Bender & Nicholas Bloom & David Card & John Van Reenen & Stefanie Wolter, 2018. "Management Practices, Workforce Selection, and Productivity," Journal of Labor Economics, University of Chicago Press, vol. 36(S1), pages 371-409.
    13. Jason J Sandvik & Richard E Saouma & Nathan T Seegert & Christopher T Stanton, 2020. "Workplace Knowledge Flows," The Quarterly Journal of Economics, Oxford University Press, vol. 135(3), pages 1635-1680.
    14. S. Nageeb Ali & Roland Bénabou, 2020. "Image versus Information: Changing Societal Norms and Optimal Privacy," American Economic Journal: Microeconomics, American Economic Association, vol. 12(3), pages 116-164, August.
    15. Henry Eyring & V. G. Narayanan, 2018. "Performance Effects of Setting a High Reference Point for Peer‐Performance Comparison," Journal of Accounting Research, Wiley Blackwell, vol. 56(2), pages 581-615, May.
    16. Marianne Bertrand & Antoinette Schoar, 2003. "Managing with Style: The Effect of Managers on Firm Policies," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(4), pages 1169-1208.
    17. Oriana Bandiera & Iwan Barankay & Imran Rasul, 2011. "Field Experiments with Firms," Journal of Economic Perspectives, American Economic Association, vol. 25(3), pages 63-82, Summer.
    18. Peter Cappelli & Martin J. Conyon, 2018. "What Do Performance Appraisals Do?," ILR Review, Cornell University, ILR School, vol. 71(1), pages 88-116, January.
    19. Ichino, Andrea & Muehlheusser, Gerd, 2008. "How often should you open the door?: Optimal monitoring to screen heterogeneous agents," Journal of Economic Behavior & Organization, Elsevier, vol. 67(3-4), pages 820-831, September.
    20. Tran, Anh & Zeckhauser, Richard, 2012. "Rank as an inherent incentive: Evidence from a field experiment," Journal of Public Economics, Elsevier, vol. 96(9-10), pages 645-650.
    21. Eyring, Henry & Narayanan, V.G., 2018. "Performance effects of setting a high reference point for peer-performance comparison," LSE Research Online Documents on Economics 86732, London School of Economics and Political Science, LSE Library.
    22. Dirk Sliwka, 2007. "Trust as a Signal of a Social Norm and the Hidden Costs of Incentive Schemes," American Economic Review, American Economic Association, vol. 97(3), pages 999-1012, June.
    23. Eyring, Henry & Ferguson, Patrick J. & Koppers, Sebastian, 2021. "Less information, more comparison, and better performance: evidence from a field experiment," LSE Research Online Documents on Economics 109789, London School of Economics and Political Science, LSE Library.
    24. Oriana Bandiera & Andrea Prat & Stephen Hansen & Raffaella Sadun, 2020. "CEO Behavior and Firm Performance," Journal of Political Economy, University of Chicago Press, vol. 128(4), pages 1325-1369.
    25. Jordi Blanes i Vidal & Mareike Nossol, 2011. "Tournaments Without Prizes: Evidence from Personnel Records," Management Science, INFORMS, vol. 57(10), pages 1721-1736, October.
    26. Edward P. Lazear & Kathryn L. Shaw & Christopher T. Stanton, 2015. "The Value of Bosses," Journal of Labor Economics, University of Chicago Press, vol. 33(4), pages 823-861.
    27. Ernst Fehr & Bettina Rockenbach, 2003. "Detrimental effects of sanctions on human altruism," Nature, Nature, vol. 422(6928), pages 137-140, March.
    28. Eyring, Henry & Ferguson, Patrick J. & Koppers, Sebastian, 2021. "Less information, more comparison, and better performance: evidence from a field experiment," LSE Research Online Documents on Economics 111032, London School of Economics and Political Science, LSE Library.
    29. Greer K. Gosnell & John A. List & Robert D. Metcalfe, 2020. "The Impact of Management Practices on Employee Productivity: A Field Experiment with Airline Captains," Journal of Political Economy, University of Chicago Press, vol. 128(4), pages 1195-1233.
    30. Gibbons, Robert & Murphy, Kevin J, 1992. "Optimal Incentive Contracts in the Presence of Career Concerns: Theory and Evidence," Journal of Political Economy, University of Chicago Press, vol. 100(3), pages 468-505, June.
    31. Oriana Bandiera & Iwan Barankay & Imran Rasul, 2007. "Incentives for Managers and Inequality among Workers: Evidence from a Firm-Level Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(2), pages 729-773.
    32. Amadou Boly, 2011. "On the incentive effects of monitoring: evidence from the lab and the field," Experimental Economics, Springer;Economic Science Association, vol. 14(2), pages 241-253, May.
    33. Steven Blader & Claudine Gartenberg & Andrea Prat, 2020. "The Contingent Effect of Management Practices," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 87(2), pages 721-749.
    34. Ashraf, Nava & Bandiera, Oriana & Jack, B. Kelsey, 2014. "No margin, no mission? A field experiment on incentives for public service delivery," Journal of Public Economics, Elsevier, vol. 120(C), pages 1-17.
    35. Jakob Alfitian & Dirk Sliwka & Timo Vogelsang, 2021. "When Bonuses Backfire: Evidence from the Workplace," Natural Field Experiments 00725, The Field Experiments Website.
    36. Eric Floyd & John A. List, 2016. "Using Field Experiments in Accounting and Finance," Journal of Accounting Research, Wiley Blackwell, vol. 54(2), pages 437-475, May.
    37. Michèle Belot & Marina Schröder, 2016. "The Spillover Effects of Monitoring: A Field Experiment," Management Science, INFORMS, vol. 62(1), pages 37-45, January.
    38. Grabner, Isabella & Moers, Frank, 2013. "Management control as a system or a package? Conceptual and empirical issues," Accounting, Organizations and Society, Elsevier, vol. 38(6), pages 407-419.
    39. Milgrom, Paul & Roberts, John, 1995. "Complementarities and fit strategy, structure, and organizational change in manufacturing," Journal of Accounting and Economics, Elsevier, vol. 19(2-3), pages 179-208, April.
    40. Mitchell Hoffman & Steven Tadelis, 2021. "People Management Skills, Employee Attrition, and Manager Rewards: An Empirical Analysis," Journal of Political Economy, University of Chicago Press, vol. 129(1), pages 243-285.
    41. Leonardo Bursztyn & Robert Jensen, 2015. "How Does Peer Pressure Affect Educational Investments?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 130(3), pages 1329-1367.
    42. Ichniowski, Casey & Shaw, Kathryn & Prennushi, Giovanna, 1997. "The Effects of Human Resource Management Practices on Productivity: A Study of Steel Finishing Lines," American Economic Review, American Economic Association, vol. 87(3), pages 291-313, June.
    43. Robert Gibbons & John Roberts, 2012. "The Handbook of Organizational Economics," Economics Books, Princeton University Press, edition 1, volume 1, number 9889.
    44. Daniel S. Nagin & James B. Rebitzer & Seth Sanders & Lowell J. Taylor, 2002. "Monitoring, Motivation, and Management: The Determinants of Opportunistic Behavior in a Field Experiment," American Economic Review, American Economic Association, vol. 92(4), pages 850-873, September.
    45. Tore Ellingsen & Magnus Johannesson, 2008. "Pride and Prejudice: The Human Side of Incentive Theory," American Economic Review, American Economic Association, vol. 98(3), pages 990-1008, June.
    46. Rema Hanna & Sendhil Mullainathan & Joshua Schwartzstein, 2014. "Learning Through Noticing: Theory and Evidence from a Field Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 129(3), pages 1311-1353.
    47. Edward P. Lazear, 2018. "Compensation and Incentives in the Workplace," Journal of Economic Perspectives, American Economic Association, vol. 32(3), pages 195-214, Summer.
    48. Roland Bénabou & Jean Tirole, 2003. "Intrinsic and Extrinsic Motivation," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 70(3), pages 489-520.
    49. Milgrom, Paul & Roberts, John, 1990. "The Economics of Modern Manufacturing: Technology, Strategy, and Organization," American Economic Review, American Economic Association, vol. 80(3), pages 511-528, June.
    50. Fama, Eugene F, 1980. "Agency Problems and the Theory of the Firm," Journal of Political Economy, University of Chicago Press, vol. 88(2), pages 288-307, April.
    51. Michael Kosfeld & Armin Falk, 2006. "The Hidden Costs of Control," American Economic Review, American Economic Association, vol. 96(5), pages 1611-1630, December.
    52. Eddy Cardinaels & Huaxiang Yin, 2015. "Think Twice Before Going for Incentives: Social Norms and the Principal's Decision on Compensation Contracts," Journal of Accounting Research, Wiley Blackwell, vol. 53(5), pages 985-1015, December.
    53. Banker, Rajiv D. & Lee, S.-Y.Seok-Young & Potter, Gordon & Srinivasan, Dhinu, 2000. "An empirical analysis of continuing improvements following the implementation of a performance-based compensation plan," Journal of Accounting and Economics, Elsevier, vol. 30(3), pages 315-350, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Manthei, Kathrin & Sliwka, Dirk & Vogelsang, Timo, 2019. "Talking about Performance or Paying for it? Evidence from a Field Experiment," IZA Discussion Papers 12446, Institute of Labor Economics (IZA).
    2. Manthei, Kathrin & Sliwka, Dirk & Vogelsang, Timo, 2021. "Information Provision, Incentives, and Attention: A Field Experiment on Facilitating and Influencing Managers' Decisions," IZA Discussion Papers 14199, Institute of Labor Economics (IZA).
    3. Gosnell, Greer & Metcalfe, Robert & List, John A, 2016. "A new approach to an age-old problem: solving externalities by incenting workers directly," LSE Research Online Documents on Economics 84331, London School of Economics and Political Science, LSE Library.
    4. Jakob Alfitian & Dirk Sliwka & Timo Vogelsang, 2021. "When Bonuses Backfire: Evidence from the Workplace," Natural Field Experiments 00725, The Field Experiments Website.
    5. Saskia Opitz & Dirk Sliwka & Timo Vogelsang & Tom Zimmermann, 2022. "The Targeted Assignment of Incentive Schemes," ECONtribute Discussion Papers Series 187, University of Bonn and University of Cologne, Germany.
    6. Kathrin Manthei & Dirk Sliwka & Timo Vogelsang, 2021. "Performance Pay and Prior Learning—Evidence from a Retail Chain," Management Science, INFORMS, vol. 67(11), pages 6998-7022, November.
    7. Margaret A. Abernethy & Chung-Yu Hung & Laurence van Lent, 2020. "Expertise and Discretionary Bonus Decisions," Management Science, INFORMS, vol. 66(1), pages 415-432, January.
    8. Guido Friebel & Matthias Heinz & Mitchell Hoffman & Nick Zubanov, 2023. "What Do Employee Referral Programs Do? Measuring the Direct and Overall Effects of a Management Practice," Journal of Political Economy, University of Chicago Press, vol. 131(3), pages 633-686.
    9. Bjorn Bartling & Ernst Fehr & Klaus M. Schmidt, 2012. "Screening, Competition, and Job Design: Economic Origins of Good Jobs," American Economic Review, American Economic Association, vol. 102(2), pages 834-864, April.
    10. Kajackaite, Agne & Werner, Peter, 2015. "The incentive effects of performance requirements – A real effort experiment," Journal of Economic Psychology, Elsevier, vol. 49(C), pages 84-94.
    11. Guido Friebel & Matthias Heinz & Nikolay Zubanov, 2022. "Middle Managers, Personnel Turnover, and Performance: A Long‐Term Field Experiment in a Retail Chain," Management Science, INFORMS, vol. 68(1), pages 211-229, January.
    12. Florian Englmaier & Stefan Grimm & Dominik Grothe & David Schindler & Simeon Schudy, 2018. "The Effect of Incentives in Non-Routine Analytical Team Tasks," CESifo Working Paper Series 6903, CESifo.
    13. Edward P. Lazear, 1995. "Personnel Economics," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262121883, December.
    14. Katarzyna Bilicka & Daniela Scur, 2021. "Organizational capacity and profit shifting," CEP Discussion Papers dp1795, Centre for Economic Performance, LSE.
    15. Baltrunaite, Audinga & Bovini, Giulia & Mocetti, Sauro, 2023. "Managerial talent and managerial practices: Are they complements?," Journal of Corporate Finance, Elsevier, vol. 79(C).
    16. Kirsten Bregn, 2013. "Detrimental Effects of Performance-Related Pay in the Public Sector? On the Need for a Broader Theoretical Perspective," Public Organization Review, Springer, vol. 13(1), pages 21-35, March.
    17. Christiane Bradler & Robert Dur & Susanne Neckermann & Arjan Non, 2013. "Employee Recognition and Performance: A Field Experiment," Tinbergen Institute Discussion Papers 13-038/VII, Tinbergen Institute.
    18. Josse Delfgaauw & Robert Dur & Oke Onemu & Joeri Sol, 2022. "Team Incentives, Social Cohesion, and Performance: A Natural Field Experiment," Management Science, INFORMS, vol. 68(1), pages 230-256, January.
    19. Caliendo, Marco & Cobb-Clark, Deborah A. & Pfeifer, Harald & Uhlendorff, Arne & Wehner, Caroline, 2024. "Managers’ risk preferences and firm training investments," European Economic Review, Elsevier, vol. 161(C).
    20. Manthei, Kathrin & Sliwka, Dirk & Vogelsang, Timo, 2018. "Performance Pay and Prior Learning: Evidence from a Retail Chain," IZA Discussion Papers 11859, Institute of Labor Economics (IZA).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:69:y:2023:i:4:p:2198-2216. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.