IDEAS home Printed from https://ideas.repec.org/p/cpr/ceprdp/17680.html
   My bibliography  Save this paper

Financial Incentives and Performance: A Meta-Analysis of Economics Evidence

Author

Listed:
  • Havranek, Tomas
  • Cala, Petr
  • Irsova, Zuzana
  • Matousek, Jindrich
  • Novak, Jiri

Abstract

Standard economics models require that financial incentives improve performance, while leading theories in psychology allow for the opposite. Experimental results are mixed, and so far have not been corrected for publication bias and model uncertainty. We collect 1,568 economics estimates together with 46 factors capturing the context in which the estimates were obtained. We use novel nonlinear techniques to correct for publication bias and employ Bayesian model averaging to account for model uncertainty. The corrected estimates are zero or tiny across contexts of field experiments, including differences in performance measurement, task definition, reward size and framing, motivation beyond money, subject pool, and estimation technique. Laboratory experiments produce statistically significant estimates on average after correction for publication bias, but even there the effect is weak. Experimental economics evidence is inconsistent with standard economics models.

Suggested Citation

  • Havranek, Tomas & Cala, Petr & Irsova, Zuzana & Matousek, Jindrich & Novak, Jiri, 2022. "Financial Incentives and Performance: A Meta-Analysis of Economics Evidence," CEPR Discussion Papers 17680, C.E.P.R. Discussion Papers.
  • Handle: RePEc:cpr:ceprdp:17680
    as

    Download full text from publisher

    File URL: https://cepr.org/publications/DP17680
    Download Restriction: CEPR Discussion Papers are free to download for our researchers, subscribers and members. If you fall into one of these categories but have trouble downloading our papers, please contact us at subscribers@cepr.org
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Jonathan de Quidt, 2018. "Your Loss Is My Gain: A Recruitment Experiment with Framed Incentives," Journal of the European Economic Association, European Economic Association, vol. 16(2), pages 522-559.
    2. Martin Feldkircher & Stefan Zeugner, 2012. "The impact of data revisions on the robustness of growth determinants—a note on ‘determinants of economic growth: Will data tell?’," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(4), pages 686-694, June.
    3. Felipe Barrera-Osorio & Leigh L. Linden & Juan E. Saavedra, 2019. "Medium- and Long-Term Educational Consequences of Alternative Conditional Cash Transfer Designs: Experimental Evidence from Colombia," American Economic Journal: Applied Economics, American Economic Association, vol. 11(3), pages 54-91, July.
    4. Ugur, Mehmet & Churchill, Sefa Awaworyi & Luong, Hoang M., 2020. "What do we know about R&D spillovers and productivity? Meta-analysis evidence on heterogeneity and statistical power," Research Policy, Elsevier, vol. 49(1).
    5. Friedl, Andreas & Neyse, Levent & Schmidt, Ulrich, 2018. "Payment scheme changes and effort Adjustment: The role of 2D:4D digit ratio," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 72(C), pages 86-94.
    6. Iwasaki, Ichiro, 2022. "The finance-growth nexus in Latin America and the Caribbean: A meta-analytic perspective," World Development, Elsevier, vol. 149(C).
    7. Carl Mellström & Magnus Johannesson, 2008. "Crowding Out in Blood Donation: Was Titmuss Right?," Journal of the European Economic Association, MIT Press, vol. 6(4), pages 845-863, June.
    8. David Card & Jochen Kluve & Andrea Weber, 2018. "What Works? A Meta Analysis of Recent Active Labor Market Program Evaluations," Journal of the European Economic Association, European Economic Association, vol. 16(3), pages 894-931.
    9. Dan Ariely & Anat Bracha & Stephan Meier, 2009. "Doing Good or Doing Well? Image Motivation and Monetary Incentives in Behaving Prosocially," American Economic Review, American Economic Association, vol. 99(1), pages 544-555, March.
    10. Stephan Meier, 2007. "Do Subsidies Increase Charitable Giving in the Long Run? Matching Donations in a Field Experiment," Journal of the European Economic Association, MIT Press, vol. 5(6), pages 1203-1222, December.
    11. Ernst Fehr & Klaus M. Schmidt, 2007. "Adding a Stick to the Carrot? The Interaction of Bonuses and Fines," American Economic Review, American Economic Association, vol. 97(2), pages 177-181, May.
    12. Nicola Lacetera & Mario Macis & Robert Slonim, 2012. "Will There Be Blood? Incentives and Displacement Effects in Pro-social Behavior," American Economic Journal: Economic Policy, American Economic Association, vol. 4(1), pages 186-223, February.
    13. Deirdre Nansen McCloskey & Stephen T. Ziliak, 2019. "What quantitative methods should we teach to graduate students? A comment on Swann’s “Is precise econometrics an illusion?”," The Journal of Economic Education, Taylor & Francis Journals, vol. 50(4), pages 356-361, October.
    14. Esther Duflo & Rema Hanna & Stephen P. Ryan, 2012. "Incentives Work: Getting Teachers to Come to School," American Economic Review, American Economic Association, vol. 102(4), pages 1241-1278, June.
    15. Joshua Angrist & Victor Lavy, 2009. "The Effects of High Stakes High School Achievement Awards: Evidence from a Randomized Trial," American Economic Review, American Economic Association, vol. 99(4), pages 1384-1414, September.
    16. Takahashi, Hiromasa & Shen, Junyi & Ogawa, Kazuhito, 2016. "An experimental examination of compensation schemes and level of effort in differentiated tasks," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 61(C), pages 12-19.
    17. Nadja Dwenger & Henrik Kleven & Imran Rasul & Johannes Rincke, 2016. "Extrinsic and Intrinsic Motivations for Tax Compliance: Evidence from a Field Experiment in Germany," American Economic Journal: Economic Policy, American Economic Association, vol. 8(3), pages 203-232, August.
    18. Steven D. Levitt & John A. List & Susanne Neckermann & Sally Sadoff, 2016. "The Behavioralist Goes to School: Leveraging Behavioral Economics to Improve Educational Performance," American Economic Journal: Economic Policy, American Economic Association, vol. 8(4), pages 183-219, November.
    19. Thomas Dohmen & Armin Falk, 2011. "Performance Pay and Multidimensional Sorting: Productivity, Preferences, and Gender," American Economic Review, American Economic Association, vol. 101(2), pages 556-590, April.
    20. Dean Karlan & John A. List, 2007. "Does Price Matter in Charitable Giving? Evidence from a Large-Scale Natural Field Experiment," American Economic Review, American Economic Association, vol. 97(5), pages 1774-1793, December.
    21. Oswald, Yvonne & Backes-Gellner, Uschi, 2014. "Learning for a bonus: How financial incentives interact with preferences," Journal of Public Economics, Elsevier, vol. 118(C), pages 52-61.
    22. Michael Kirchler & Stefan Palan, 2018. "Immaterial and monetary gifts in economic transactions: evidence from the field," Experimental Economics, Springer;Economic Science Association, vol. 21(1), pages 205-230, March.
    23. Boyer, Pierre C. & Dwenger, Nadja & Rincke, Johannes, 2016. "Do norms on contribution behavior affect intrinsic motivation? Field-experimental evidence from Germany," Journal of Public Economics, Elsevier, vol. 144(C), pages 140-153.
    24. Ernst Fehr & Lorenz Goette, 2007. "Do Workers Work More if Wages Are High? Evidence from a Randomized Field Experiment," American Economic Review, American Economic Association, vol. 97(1), pages 298-317, March.
    25. Doucouliagos, Hristos (Chris), 2011. "How large is large? Preliminary and relative guidelines for interpreting partial correlations in economics," Working Papers eco_2011_5, Deakin University, Department of Economics.
    26. Sudarshan, Anant, 2017. "Nudges in the marketplace: The response of household electricity consumption to information and monetary incentives," Journal of Economic Behavior & Organization, Elsevier, vol. 134(C), pages 320-335.
    27. Abel Brodeur & Nikolai Cook & Anthony Heyes, 2020. "Methods Matter: p-Hacking and Publication Bias in Causal Analysis in Economics," American Economic Review, American Economic Association, vol. 110(11), pages 3634-3660, November.
    28. Schall, Dominik L. & Wolf, Menas & Mohnen, Alwine, 2016. "Do effects of theoretical training and rewards for energy-efficient behavior persist over time and interact? A natural field experiment on eco-driving in a company fleet," Energy Policy, Elsevier, vol. 97(C), pages 291-300.
    29. Ernst Fehr & John A. List, 2004. "The Hidden Costs and Returns of Incentives-Trust and Trustworthiness Among CEOs," Journal of the European Economic Association, MIT Press, vol. 2(5), pages 743-771, September.
    30. Gerber, Alan & Malhotra, Neil, 2008. "Do Statistical Reporting Standards Affect What Is Published? Publication Bias in Two Leading Political Science Journals," Quarterly Journal of Political Science, now publishers, vol. 3(3), pages 313-326, October.
    31. Stanley, T. D. & Jarrell, Stephen B. & Doucouliagos, Hristos, 2010. "Could It Be Better to Discard 90% of the Data? A Statistical Paradox," The American Statistician, American Statistical Association, vol. 64(1), pages 70-77.
    32. Zeugner, Stefan & Feldkircher, Martin, 2015. "Bayesian Model Averaging Employing Fixed and Flexible Priors: The BMS Package for R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 68(i04).
    33. Ashraf, Nava & Bandiera, Oriana & Jack, B. Kelsey, 2014. "No margin, no mission? A field experiment on incentives for public service delivery," Journal of Public Economics, Elsevier, vol. 120(C), pages 1-17.
    34. Edward P. Lazear, 2000. "Performance Pay and Productivity," American Economic Review, American Economic Association, vol. 90(5), pages 1346-1361, December.
    35. Li, Tao & Han, Li & Zhang, Linxiu & Rozelle, Scott, 2014. "Encouraging classroom peer interactions: Evidence from Chinese migrant schools," Journal of Public Economics, Elsevier, vol. 111(C), pages 29-45.
    36. Gary Charness & Daniela Grieco, 2019. "Creativity and Incentives," Journal of the European Economic Association, European Economic Association, vol. 17(2), pages 454-496.
    37. Tatiana A. Homonoff, 2018. "Can Small Incentives Have Large Effects? The Impact of Taxes versus Bonuses on Disposable Bag Use," American Economic Journal: Economic Policy, American Economic Association, vol. 10(4), pages 177-210, November.
    38. Theo S. Eicher & Chris Papageorgiou & Adrian E. Raftery, 2011. "Default priors and predictive performance in Bayesian model averaging, with application to growth determinants," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 26(1), pages 30-55, January/F.
    39. Chaim Fershtman & Uri Gneezy, 2011. "The Tradeoff Between Performance And Quitting In High Power Tournaments," Journal of the European Economic Association, European Economic Association, vol. 9(2), pages 318-336, April.
    40. Lucas C. Coffman, 2011. "Intermediation Reduces Punishment (and Reward)," American Economic Journal: Microeconomics, American Economic Association, vol. 3(4), pages 77-106, November.
    41. Christiane Bradler & Susanne Neckermann & Arne Jonas Warnke, 2019. "Incentivizing Creativity: A Large-Scale Experiment with Performance Bonuses and Gifts," Journal of Labor Economics, University of Chicago Press, vol. 37(3), pages 793-851.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dominika Ehrenbergerova & Josef Bajzik & Tomas Havranek, 2023. "When Does Monetary Policy Sway House Prices? A Meta-Analysis," IMF Economic Review, Palgrave Macmillan;International Monetary Fund, vol. 71(2), pages 538-573, June.
    2. Tomas Havranek & Zuzana Irsova & Lubica Laslopova & Olesia Zeynalova, 2020. "Skilled and Unskilled Labor Are Less Substitutable than Commonly Thought," Working Papers IES 2020/29, Charles University Prague, Faculty of Social Sciences, Institute of Economic Studies, revised Sep 2020.
    3. Ashraf, Nava & Bandiera, Oriana & Jack, B. Kelsey, 2014. "No margin, no mission? A field experiment on incentives for public service delivery," Journal of Public Economics, Elsevier, vol. 120(C), pages 1-17.
    4. Samuel Bowles & Sandra Polania-Reyes, 2011. "Economic incentives and social preferences: substitutes or complements?," Department of Economics University of Siena 617, Department of Economics, University of Siena.
    5. Florian Englmaier & Stefan Grimm & Dominik Grothe & David Schindler & Simeon Schudy, 2018. "The Effect of Incentives in Non-Routine Analytical Team Tasks," CESifo Working Paper Series 6903, CESifo.
    6. Roman Horvath & Ali Elminejad & Tomas Havranek, 2020. "Publication and Identification Biases in Measuring the Intertemporal Substitution of Labor Supply," Working Papers IES 2020/32, Charles University Prague, Faculty of Social Sciences, Institute of Economic Studies, revised Sep 2020.
    7. Havranek, Tomas & Irsova, Zuzana & Laslopova, Lubica & Zeynalova, Olesia, 2020. "The Elasticity of Substitution between Skilled and Unskilled Labor: A Meta-Analysis," MPRA Paper 102598, University Library of Munich, Germany.
    8. Samuel Bowles & Sandra Polania-Reyes, 2012. "Economic Incentives and Social Preferences: Substitutes or Complements?," Journal of Economic Literature, American Economic Association, vol. 50(2), pages 368-425, June.
    9. Ali Elminejad & Tomas Havranek & Roman Horvath & Zuzana Irsova, 2023. "Intertemporal Substitution in Labor Supply: A Meta-Analysis," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 51, pages 1095-1113, December.
    10. Bajzik, Josef & Havranek, Tomas & Irsova, Zuzana & Schwarz, Jiri, 2020. "Estimating the Armington elasticity: The importance of study design and publication bias," Journal of International Economics, Elsevier, vol. 127(C).
    11. Uri Gneezy & Stephan Meier & Pedro Rey-Biel, 2011. "When and Why Incentives (Don't) Work to Modify Behavior," Journal of Economic Perspectives, American Economic Association, vol. 25(4), pages 191-210, Fall.
    12. Jindrich Matousek & Tomas Havranek & Zuzana Irsova, 2022. "Individual discount rates: a meta-analysis of experimental evidence," Experimental Economics, Springer;Economic Science Association, vol. 25(1), pages 318-358, February.
    13. Zigraiova, Diana & Havranek, Tomas & Irsova, Zuzana & Novak, Jiri, 2021. "How puzzling is the forward premium puzzle? A meta-analysis," European Economic Review, Elsevier, vol. 134(C).
    14. Simona Malovana & Martin Hodula & Zuzana Gric & Josef Bajzik, 2022. "Borrower-Based Macroprudential Measures and Credit Growth: How Biased is the Existing Literature?," Working Papers 2022/8, Czech National Bank.
    15. Havranek, Tomas & Kroupova, Katerina & Irsova, Zuzana, 2021. "Student Employment and Education: A Meta-Analysis," CEPR Discussion Papers 16550, C.E.P.R. Discussion Papers.
    16. Bauhoff,Sebastian Peter Alexander & Kandpal,Eeshani, 2021. "Information, Loss Framing, and Spillovers in Pay-for-Performance Contracts," Policy Research Working Paper Series 9687, The World Bank.
    17. Bajzik, Jozef & Havranek, Tomas & Irsova, Zuzana & Schwarz, Jiri, 2019. "Estimating the Armington Elasticity: The Importance of Data Choice and Publication Bias," MPRA Paper 95031, University Library of Munich, Germany.
    18. Matej Opatrny & Tomas Havranek & Zuzana Irsova & Milan Scasny, 2023. "Publication Bias and Model Uncertainty in Measuring the Effect of Class Size on Achievement," Working Papers IES 2023/19, Charles University Prague, Faculty of Social Sciences, Institute of Economic Studies, revised May 2023.
    19. Boyer, Pierre C. & Dwenger, Nadja & Rincke, Johannes, 2016. "Do norms on contribution behavior affect intrinsic motivation? Field-experimental evidence from Germany," Journal of Public Economics, Elsevier, vol. 144(C), pages 140-153.
    20. Bajzik, Josef, 2021. "Trading volume and stock returns: A meta-analysis," International Review of Financial Analysis, Elsevier, vol. 78(C).

    More about this item

    Keywords

    Incentives;

    JEL classification:

    • C90 - Mathematical and Quantitative Methods - - Design of Experiments - - - General
    • D91 - Microeconomics - - Micro-Based Behavioral Economics - - - Role and Effects of Psychological, Emotional, Social, and Cognitive Factors on Decision Making
    • M52 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Personnel Economics - - - Compensation and Compensation Methods and Their Effects

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cpr:ceprdp:17680. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://www.cepr.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.