IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/28650.html
   My bibliography  Save this paper

Cognitive Biases: Mistakes or Missing Stakes?

Author

Listed:
  • Benjamin Enke
  • Uri Gneezy
  • Brian Hall
  • David C. Martin
  • Vadim Nelidov
  • Theo Offerman
  • Jeroen van de Ven

Abstract

Despite decades of research on heuristics and biases, empirical evidence on the effect of large incentives – as present in relevant economic decisions – on cognitive biases is scant. This paper tests the effect of incentives on four widely documented biases: base rate neglect, anchoring, failure of contingent thinking, and intuitive reasoning in the Cognitive Reflection Test. In laboratory experiments with 1,236 college students in Nairobi, we implement three incentive levels: no incentives, standard lab payments, and very high incentives that increase the stakes by a factor of 100 to more than a monthly income. We find that response times – a proxy for cognitive effort – increase by 40% with very high stakes. Performance, on the other hand, improves very mildly or not at all as incentives increase, with the largest improvements due to a reduced reliance on intuitions. In none of the tasks are very high stakes sufficient to de-bias participants, or come even close to doing so.

Suggested Citation

  • Benjamin Enke & Uri Gneezy & Brian Hall & David C. Martin & Vadim Nelidov & Theo Offerman & Jeroen van de Ven, 2021. "Cognitive Biases: Mistakes or Missing Stakes?," NBER Working Papers 28650, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:28650
    Note: DEV LE LS
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w28650.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Wright, William F. & Anderson, Urton, 1989. "Effects of situation familiarity and financial incentives on use of the anchoring and adjustment heuristic for probability assessment," Organizational Behavior and Human Decision Processes, Elsevier, vol. 44(1), pages 68-82, August.
    2. Stefano DellaVigna & Devin Pope, 2018. "Predicting Experimental Results: Who Knows What?," Journal of Political Economy, University of Chicago Press, vol. 126(6), pages 2410-2456.
    3. Roland G. Fryer, 2011. "Financial Incentives and Student Achievement: Evidence from Randomized Trials," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(4), pages 1755-1798.
    4. Drew Fudenberg & David K. Levine & Zacharias Maniadis, 2012. "On the Robustness of Anchoring Effects in WTP and WTA Experiments," American Economic Journal: Microeconomics, American Economic Association, vol. 4(2), pages 131-145, May.
    5. Hans P. Binswanger, 1980. "Attitudes Toward Risk: Experimental Measurement in Rural India," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 62(3), pages 395-407.
    6. Jetter, Michael & Walker, Jay K., 2017. "Anchoring in financial decision-making: Evidence from Jeopardy!," Journal of Economic Behavior & Organization, Elsevier, vol. 141(C), pages 164-176.
    7. Camerer, Colin F & Hogarth, Robin M, 1999. "The Effects of Financial Incentives in Experiments: A Review and Capital-Labor-Production Framework," Journal of Risk and Uncertainty, Springer, vol. 19(1-3), pages 7-42, December.
    8. Levitt, Steven D, 2004. "Testing Theories of Discrimination: Evidence from Weakest Link," Journal of Law and Economics, University of Chicago Press, vol. 47(2), pages 431-452, October.
    9. Brañas-Garza, Pablo & Kujal, Praveen & Lenkei, Balint, 2019. "Cognitive reflection test: Whom, how, when," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 82(C).
    10. Kathryn Graddy & Lara Loewenstein & Jianping Mei & Mike Moses & Rachel A J Pownall, 2014. "Anchoring or Loss Aversion? Empirical Evidence from Art Auctions," ACEI Working Paper Series AWP-04-2014, Association for Cultural Economics International, revised Jun 2014.
    11. Alan Beggs & Kathryn Graddy, 2009. "Anchoring Effects: Evidence from Art Auctions," American Economic Review, American Economic Association, vol. 99(3), pages 1027-1039, June.
    12. Eric P. Bettinger, 2012. "Paying to Learn: The Effect of Financial Incentives on Elementary School Test Scores," The Review of Economics and Statistics, MIT Press, vol. 94(3), pages 686-698, August.
    13. Berk, Jonathan B & Hughson, Eric & Vandezande, Kirk, 1996. "The Price Is Right, but Are the Bids? An Investigation of Rational Decision Theory," American Economic Review, American Economic Association, vol. 86(4), pages 954-970, September.
    14. Arkes, Hal R. & Dawes, Robyn M. & Christensen, Caryn, 1986. "Factors influencing the use of a decision rule in a probabilistic task," Organizational Behavior and Human Decision Processes, Elsevier, vol. 37(1), pages 93-110, February.
    15. David M. Grether, 1980. "Bayes Rule as a Descriptive Model: The Representativeness Heuristic," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 95(3), pages 537-557.
    16. Charles A. Holt & Susan K. Laury, 2002. "Risk Aversion and Incentive Effects," American Economic Review, American Economic Association, vol. 92(5), pages 1644-1655, December.
    17. Friedman, Daniel, 1998. "Monty Hall's Three Doors: Construction and Deconstruction of a Choice Anomaly," American Economic Review, American Economic Association, vol. 88(4), pages 933-946, September.
    18. Grether, David M., 1992. "Testing bayes rule and the representativeness heuristic: Some experimental evidence," Journal of Economic Behavior & Organization, Elsevier, vol. 17(1), pages 31-57, January.
    19. Benjamin Handel & Joshua Schwartzstein, 2018. "Frictions or Mental Gaps: What's Behind the Information We (Don't) Use and When Do We Care?," Journal of Economic Perspectives, American Economic Association, vol. 32(1), pages 155-178, Winter.
    20. Chen, Daniel L. & Moskowitz, Tobias J. & Shue, Kelly, 2016. "Decision-Making Under the Gambler’s Fallacy: Evidence From Asylum Courts, Loan Officers, and Baseball Umpires," IAST Working Papers 16-43, Institute for Advanced Study in Toulouse (IAST).
    21. Konstantinos Ioannidis & Theo Offerman & Randolph Sloof, 2020. "On the effect of anchoring on valuations when the anchor is transparently uninformative," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 6(1), pages 77-94, June.
    22. Oechssler, Jörg & Roider, Andreas & Schmitz, Patrick W., 2009. "Cognitive abilities and behavioral biases," Journal of Economic Behavior & Organization, Elsevier, vol. 72(1), pages 147-152, October.
    23. Leonidas Spiliopoulos & Andreas Ortmann, 2018. "The BCD of response time analysis in experimental economics," Experimental Economics, Springer;Economic Science Association, vol. 21(2), pages 383-433, June.
    24. Dan Ariely & George Loewenstein & Drazen Prelec, 2003. ""Coherent Arbitrariness": Stable Demand Curves Without Stable Preferences," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(1), pages 73-106.
    25. Lex Borghans & Huub Meijers & Bas Ter Weel, 2008. "The Role Of Noncognitive Skills In Explaining Cognitive Test Scores," Economic Inquiry, Western Economic Association International, vol. 46(1), pages 2-12, January.
    26. David J. Cooper, 1999. "Gaming against Managers in Incentive Systems: Experimental Results with Chinese Students and Chinese Managers," American Economic Review, American Economic Association, vol. 89(4), pages 781-804, September.
    27. David Danz & Lise Vesterlund & Alistair J. Wilson, 2020. "Belief Elicitation: Limiting Truth Telling with Information on Incentives," NBER Working Papers 27327, National Bureau of Economic Research, Inc.
    28. Steffen Andersen & Seda Ertac & Uri Gneezy & Moshe Hoffman & John A. List, 2011. "Stakes Matter in Ultimatum Games," American Economic Review, American Economic Association, vol. 101(7), pages 3427-3439, December.
    29. Alejandro Martínez-Marquina & Muriel Niederle & Emanuel Vespa, 2019. "Failures in Contingent Reasoning: The Role of Uncertainty," American Economic Review, American Economic Association, vol. 109(10), pages 3437-3474, October.
    30. Barron, Kai & Huck, Steffen & Jehiel, Philippe, 2019. "Everyday econometricians: Selection neglect and overoptimism when learning from others," Discussion Papers, Research Unit: Economics of Change SP II 2019-301, WZB Berlin Social Science Center.
    31. Ariel Rubinstein, 2007. "Instinctive and Cognitive Reasoning: A Study of Response Times," Economic Journal, Royal Economic Society, vol. 117(523), pages 1243-1259, October.
    32. Martin Jones & Robert Sugden, 2001. "Positive confirmation bias in the acquisition of information," Theory and Decision, Springer, vol. 50(1), pages 59-99, February.
    33. Roland Bénabou & Jean Tirole, 2003. "Intrinsic and Extrinsic Motivation," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 70(3), pages 489-520.
    34. Parravano, Melanie & Poulsen, Odile, 2015. "Stake size and the power of focal points in coordination games: Experimental evidence," Games and Economic Behavior, Elsevier, vol. 94(C), pages 191-199.
    35. Hoppe, Eva I. & Kusterer, David J., 2011. "Behavioral biases and cognitive reflection," Economics Letters, Elsevier, vol. 110(2), pages 97-100, February.
    36. Daniel L. Chen & Tobias J. Moskowitz & Kelly Shue, 2016. "Decision Making Under the Gambler’s Fallacy: Evidence from Asylum Judges, Loan Officers, and Baseball Umpires," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(3), pages 1181-1242.
    37. Zacharias Maniadis & Fabio Tufano & John A. List, 2014. "One Swallow Doesn't Make a Summer: New Evidence on Anchoring Effects," American Economic Review, American Economic Association, vol. 104(1), pages 277-290, January.
    38. Dan Ariely & Uri Gneezy & George Loewenstein & Nina Mazar, 2009. "Large Stakes and Big Mistakes," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(2), pages 451-469.
    39. Sandefur, Justin, 2018. "Internationally comparable mathematics scores for fourteen african countries," Economics of Education Review, Elsevier, vol. 62(C), pages 267-286.
    40. Smith, Vernon L & Walker, James M, 1993. "Monetary Rewards and Decision Cost in Experimental Economics," Economic Inquiry, Western Economic Association International, vol. 31(2), pages 245-261, April.
    41. Thaler, Richard H, 1986. "The Psychology and Economics Conference Handbook: Comments," The Journal of Business, University of Chicago Press, vol. 59(4), pages 279-284, October.
    42. Klein, Barbara D., 2001. "Detecting errors in data: clarification of the impact of base rate expectations and incentives," Omega, Elsevier, vol. 29(5), pages 391-404, October.
    43. Martijn J. van den Assem & Dennie van Dolder & Richard H. Thaler, 2012. "Split or Steal? Cooperative Behavior When the Stakes Are Large," Management Science, INFORMS, vol. 58(1), pages 2-20, January.
    44. Metrick, Andrew, 1995. "A Natural Experiment in "Jeopardy!"," American Economic Review, American Economic Association, vol. 85(1), pages 240-253, March.
    45. Devin G. Pope & Maurice E. Schweitzer, 2011. "Is Tiger Woods Loss Averse? Persistent Bias in the Face of Experience, Competition, and High Stakes," American Economic Review, American Economic Association, vol. 101(1), pages 129-157, February.
    46. Camerer, Colin F, 1987. "Do Biases in Probability Judgment Matter in Markets? Experimental Evidence," American Economic Review, American Economic Association, vol. 77(5), pages 981-997, December.
    47. Rapoport, Amnon & Stein, William E. & Parco, James E. & Nicholas, Thomas E., 2003. "Equilibrium play and adaptive learning in a three-person centipede game," Games and Economic Behavior, Elsevier, vol. 43(2), pages 239-265, May.
    48. Belot, Michèle & Bhaskar, V. & van de Ven, Jeroen, 2010. "Promises and cooperation: Evidence from a TV game show," Journal of Economic Behavior & Organization, Elsevier, vol. 73(3), pages 396-405, March.
    49. Robert Slonim & Alvin E. Roth, 1998. "Learning in High Stakes Ultimatum Games: An Experiment in the Slovak Republic," Econometrica, Econometric Society, vol. 66(3), pages 569-596, May.
    50. repec:feb:framed:0088 is not listed on IDEAS
    51. Shane Frederick, 2005. "Cognitive Reflection and Decision Making," Journal of Economic Perspectives, American Economic Association, vol. 19(4), pages 25-42, Fall.
    52. Cameron, Lisa A, 1999. "Raising the Stakes in the Ultimatum Game: Experimental Evidence from Indonesia," Economic Inquiry, Western Economic Association International, vol. 37(1), pages 47-59, January.
    53. Stefano Giglio & Kelly Shue, 2014. "Editor's Choice No News Is News: Do Markets Underreact to Nothing?," The Review of Financial Studies, Society for Financial Studies, vol. 27(12), pages 3389-3440.
    54. Ignacio Esponda Jr. & Emanuel Vespa Jr., 2014. "Hypothetical Thinking and Information Extraction in the Laboratory," American Economic Journal: Microeconomics, American Economic Association, vol. 6(4), pages 180-202, November.
    55. repec:cup:judgdm:v:14:y:2019:i:4:p:470-487 is not listed on IDEAS
    56. Ariel Rubinstein, 2007. "Instinctive and Cognitive Reasoning: Response Times Study," Levine's Bibliography 321307000000001011, UCLA Department of Economics.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Benjamin Balzer & Benjamin Young, 2020. "A Theory of Intuition and Contemplation," Working Paper Series 2020/01, Economics Discipline Group, UTS Business School, University of Technology, Sydney.
    2. Shukla, Pallavi & Pullabhotla, Hemant K. & Baylis, Kathy, 2022. "Trouble with zero: The limits of subsidizing technology adoption," Journal of Development Economics, Elsevier, vol. 158(C).
    3. Cockx, B. & Declercq, Koen & Dejemeppe, Muriel, 2022. "Losing prospective entitlement to unemployment benefits. Impact on educational attainment," ROA Research Memorandum 003, Maastricht University, Research Centre for Education and the Labour Market (ROA).
    4. M. Asher Lawson & Richard P. Larrick & Jack B. Soll, 2020. "Comparing fast thinking and slow thinking: The relative benefits of interventions, individual differences, and inferential rules," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 15(5), pages 660-684, September.
    5. Lata Gangadharan & Philip J. Grossman & Nina Xue, 2021. "Identifying self-image concerns from motivated beliefs: Does it matter how and whom you ask?," Monash Economics Working Papers 2021-17, Monash University, Department of Economics.
    6. repec:cup:judgdm:v:15:y:2020:i:5:p:660-684 is not listed on IDEAS
    7. Chen, Xiaomeng Charlene & Hellmann, Andreas & Sood, Suresh, 2022. "A framework for analyst economic incentives and cognitive biases: Origination of the walk-down in earnings forecasts," Journal of Behavioral and Experimental Finance, Elsevier, vol. 36(C).
    8. Andreas Hackethal & Michael Kirchler & Christine Laudenbach & Michael Razen & Annika Weber, 2023. "On the role of monetary incentives in risk preference elicitation experiments," Journal of Risk and Uncertainty, Springer, vol. 66(2), pages 189-213, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Benjamin Enke & Uri Gneezy & Brian Hall & David Martin & Vadim Nelidov & Theo Offerman & Jeroen van de Ven, 2023. "Cognitive Biases: Mistakes or Missing Stakes?," The Review of Economics and Statistics, MIT Press, vol. 105(4), pages 818-832, July.
    2. Alós-Ferrer, Carlos & Hügelschäfer, Sabine, 2012. "Faith in intuition and behavioral biases," Journal of Economic Behavior & Organization, Elsevier, vol. 84(1), pages 182-192.
    3. Glenn W. Harrison & John A. List, 2004. "Field Experiments," Journal of Economic Literature, American Economic Association, vol. 42(4), pages 1009-1055, December.
    4. James C. Cox & Vjollca Sadiraj, 2018. "Incentives," Experimental Economics Center Working Paper Series 2018-01, Experimental Economics Center, Andrew Young School of Policy Studies, Georgia State University.
    5. Chen, Chia-Ching & Chiu, I-Ming & Smith, John & Yamada, Tetsuji, 2013. "Too smart to be selfish? Measures of cognitive ability, social preferences, and consistency," Journal of Economic Behavior & Organization, Elsevier, vol. 90(C), pages 112-122.
    6. Martijn J. van den Assem & Dennie van Dolder & Richard H. Thaler, 2012. "Split or Steal? Cooperative Behavior When the Stakes Are Large," Management Science, INFORMS, vol. 58(1), pages 2-20, January.
    7. Jinkwon Lee, 2007. "Repetition And Financial Incentives In Economics Experiments," Journal of Economic Surveys, Wiley Blackwell, vol. 21(3), pages 628-681, July.
    8. Piotr Evdokimov & Umberto Garfagnini, 2023. "Cognitive Ability and Perceived Disagreement in Learning," Rationality and Competition Discussion Paper Series 381, CRC TRR 190 Rationality and Competition.
    9. Jetter, Michael & Walker, Jay K., 2017. "Anchoring in financial decision-making: Evidence from Jeopardy!," Journal of Economic Behavior & Organization, Elsevier, vol. 141(C), pages 164-176.
    10. Carlos Alós-Ferrer & Johannes Buckenmaier, 2021. "Cognitive sophistication and deliberation times," Experimental Economics, Springer;Economic Science Association, vol. 24(2), pages 558-592, June.
    11. Jörg Oechssler & Andreas Roider & Patrick W. Schmitz, 2015. "Cooling Off in Negotiations: Does it Work?," Journal of Institutional and Theoretical Economics (JITE), Mohr Siebeck, Tübingen, vol. 171(4), pages 565-588, December.
    12. Nicolas Eber & Patrick Roger & Tristan Roger, 2024. "Finance and intelligence: An overview of the literature," Journal of Economic Surveys, Wiley Blackwell, vol. 38(2), pages 503-554, April.
    13. John A. List, 2006. "Friend or Foe? A Natural Experiment of the Prisoner's Dilemma," The Review of Economics and Statistics, MIT Press, vol. 88(3), pages 463-471, August.
    14. Anja Achtziger & Carlos Alós-Ferrer, 2014. "Fast or Rational? A Response-Times Study of Bayesian Updating," Management Science, INFORMS, vol. 60(4), pages 923-938, April.
    15. Julie Novakova & Jaroslav Flegr, 2013. "How Much Is Our Fairness Worth? The Effect of Raising Stakes on Offers by Proposers and Minimum Acceptable Offers in Dictator and Ultimatum Games," PLOS ONE, Public Library of Science, vol. 8(4), pages 1-9, April.
    16. Felix Oberholzer-Gee & Joel Waldfogel & Matthew White, 2003. "Social Learning and Coordination in High-Stakes Games: Evidence from Friend or Foe," NBER Working Papers 9805, National Bureau of Economic Research, Inc.
    17. Emin Karagözoğlu & Ümit Barış Urhan, 2017. "The Effect of Stake Size in Experimental Bargaining and Distribution Games: A Survey," Group Decision and Negotiation, Springer, vol. 26(2), pages 285-325, March.
    18. Nicolas Eber & Patrick Roger & Tristan Roger, 2024. "Finance and intelligence: An overview of the literature," Journal of Economic Surveys, Wiley Blackwell, vol. 38(2), pages 503-554, April.
    19. Charness, Gary & Gneezy, Uri & Kuhn, Michael A., 2013. "Experimental methods: Extra-laboratory experiments-extending the reach of experimental economics," Journal of Economic Behavior & Organization, Elsevier, vol. 91(C), pages 93-100.
    20. Larney, Andrea & Rotella, Amanda & Barclay, Pat, 2019. "Stake size effects in ultimatum game and dictator game offers: A meta-analysis," Organizational Behavior and Human Decision Processes, Elsevier, vol. 151(C), pages 61-72.

    More about this item

    JEL classification:

    • D01 - Microeconomics - - General - - - Microeconomic Behavior: Underlying Principles
    • D03 - Microeconomics - - General - - - Behavioral Microeconomics: Underlying Principles

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:28650. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.