IDEAS home Printed from https://ideas.repec.org/a/tpr/restat/v105y2023i4p818-832.html

Cognitive Biases: Mistakes or Missing Stakes?

Author

Listed:
  • Benjamin Enke

    (Harvard University and NBER)

  • Uri Gneezy

    (UC San Diego Rady School of Management)

  • Brian Hall

    (Harvard Business School)

  • David Martin

    (Harvard University)

  • Vadim Nelidov

    (University of Amsterdam and Tinbergen Institute)

  • Theo Offerman

    (University of Amsterdam and Tinbergen Institute)

  • Jeroen van de Ven

    (University of Amsterdam and Tinbergen Institute)

Abstract

Despite decades of research on heuristics and biases, evidence on the effect of large incentives on cognitive biases is scant. We test the effect of incentives on four widely documented biases: base-rate neglect, anchoring, failure of contingent thinking, and intuitive reasoning. In laboratory experiments with 1,236 college students in Nairobi, we implement three incentive levels: no incentives, standard lab payments, and very high incentives. We find that very high stakes increase response times by 40% but improve performance only very mildly or not at all. In none of the tasks do very high stakes come close to debiasing participants.

Suggested Citation

  • Benjamin Enke & Uri Gneezy & Brian Hall & David Martin & Vadim Nelidov & Theo Offerman & Jeroen van de Ven, 2023. "Cognitive Biases: Mistakes or Missing Stakes?," The Review of Economics and Statistics, MIT Press, vol. 105(4), pages 818-832, July.
    • Handle: RePEc:tpr:restat:v:105:y:2023:i:4:p:818-832
    DOI: 10.1162/rest_a_01093
    as

    Download full text from publisher

    File URL: https://doi.org/10.1162/rest_a_01093
    Download Restriction: Access to PDF is restricted to subscribers.
    File URL: https://libkey.io/10.1162/rest_a_01093?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Oechssler, Jörg & Roider, Andreas & Schmitz, Patrick W., 2009. "Cognitive abilities and behavioral biases," Journal of Economic Behavior & Organization, Elsevier, vol. 72(1), pages 147-152, October.
    2. Dan Ariely & George Loewenstein & Drazen Prelec, 2003. ""Coherent Arbitrariness": Stable Demand Curves Without Stable Preferences," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(1), pages 73-106.
    3. repec:feb:framed:0088 is not listed on IDEAS
    4. Grether, David M., 1992. "Testing bayes rule and the representativeness heuristic: Some experimental evidence," Journal of Economic Behavior & Organization, Elsevier, vol. 17(1), pages 31-57, January.
    5. Ariel Rubinstein, 2007. "Instinctive and Cognitive Reasoning: A Study of Response Times," Economic Journal, Royal Economic Society, vol. 117(523), pages 1243-1259, October.
    6. David J. Cooper, 1999. "Gaming against Managers in Incentive Systems: Experimental Results with Chinese Students and Chinese Managers," American Economic Review, American Economic Association, vol. 89(4), pages 781-804, September.
    7. Hans P. Binswanger, 1980. "Attitudes Toward Risk: Experimental Measurement in Rural India," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 62(3), pages 395-407.
    8. Jetter, Michael & Walker, Jay K., 2017. "Anchoring in financial decision-making: Evidence from Jeopardy!," Journal of Economic Behavior & Organization, Elsevier, vol. 141(C), pages 164-176.
    9. Camerer, Colin F & Hogarth, Robin M, 1999. "The Effects of Financial Incentives in Experiments: A Review and Capital-Labor-Production Framework," Journal of Risk and Uncertainty, Springer, vol. 19(1-3), pages 7-42, December.
    10. Shane Frederick, 2005. "Cognitive Reflection and Decision Making," Journal of Economic Perspectives, American Economic Association, vol. 19(4), pages 25-42, Fall.
    11. Steffen Andersen & Seda Ertac & Uri Gneezy & Moshe Hoffman & John A. List, 2011. "Stakes Matter in Ultimatum Games," American Economic Review, American Economic Association, vol. 101(7), pages 3427-3439, December.
    12. Brañas-Garza, Pablo & Kujal, Praveen & Lenkei, Balint, 2019. "Cognitive reflection test: Whom, how, when," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 82(C).
    13. Alekseev, Aleksandr & Charness, Gary & Gneezy, Uri, 2017. "Experimental methods: When and why contextual instructions are important," Journal of Economic Behavior & Organization, Elsevier, vol. 134(C), pages 48-59.
    14. Levitt, Steven D, 2004. "Testing Theories of Discrimination: Evidence from Weakest Link," Journal of Law and Economics, University of Chicago Press, vol. 47(2), pages 431-452, October.
    15. Alan Beggs & Kathryn Graddy, 2009. "Anchoring Effects: Evidence from Art Auctions," American Economic Review, American Economic Association, vol. 99(3), pages 1027-1039, June.
    16. Alejandro Martínez-Marquina & Muriel Niederle & Emanuel Vespa, 2019. "Failures in Contingent Reasoning: The Role of Uncertainty," American Economic Review, American Economic Association, vol. 109(10), pages 3437-3474, October.
    17. Eric P. Bettinger, 2012. "Paying to Learn: The Effect of Financial Incentives on Elementary School Test Scores," The Review of Economics and Statistics, MIT Press, vol. 94(3), pages 686-698, August.
    18. Berk, Jonathan B & Hughson, Eric & Vandezande, Kirk, 1996. "The Price Is Right, but Are the Bids? An Investigation of Rational Decision Theory," American Economic Review, American Economic Association, vol. 86(4), pages 954-970, September.
    19. Grether, David M & Plott, Charles R, 1979. "Economic Theory of Choice and the Preference Reversal Phenomenon," American Economic Review, American Economic Association, vol. 69(4), pages 623-638, September.
    20. Dan Ariely & Uri Gneezy & George Loewenstein & Nina Mazar, 2009. "Large Stakes and Big Mistakes," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(2), pages 451-469.
    21. Cameron, Lisa A, 1999. "Raising the Stakes in the Ultimatum Game: Experimental Evidence from Indonesia," Economic Inquiry, Western Economic Association International, vol. 37(1), pages 47-59, January.
    22. Roland Bénabou & Jean Tirole, 2003. "Intrinsic and Extrinsic Motivation," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 70(3), pages 489-520.
    23. David M. Grether, 1980. "Bayes Rule as a Descriptive Model: The Representativeness Heuristic," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 95(3), pages 537-557.
    24. Charles A. Holt & Susan K. Laury, 2002. "Risk Aversion and Incentive Effects," American Economic Review, American Economic Association, vol. 92(5), pages 1644-1655, December.
    25. Hoppe, Eva I. & Kusterer, David J., 2011. "Behavioral biases and cognitive reflection," Economics Letters, Elsevier, vol. 110(2), pages 97-100, February.
    26. Camerer, Colin F, 1987. "Do Biases in Probability Judgment Matter in Markets? Experimental Evidence," American Economic Review, American Economic Association, vol. 77(5), pages 981-997, December.
    27. Parravano, Melanie & Poulsen, Odile, 2015. "Stake size and the power of focal points in coordination games: Experimental evidence," Games and Economic Behavior, Elsevier, vol. 94(C), pages 191-199.
    28. Daniel L. Chen & Tobias J. Moskowitz & Kelly Shue, 2016. "Decision Making Under the Gambler’s Fallacy: Evidence from Asylum Judges, Loan Officers, and Baseball Umpires," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(3), pages 1181-1242.
    29. Rapoport, Amnon & Stein, William E. & Parco, James E. & Nicholas, Thomas E., 2003. "Equilibrium play and adaptive learning in a three-person centipede game," Games and Economic Behavior, Elsevier, vol. 43(2), pages 239-265, May.
    30. Steven D. Levitt & John A. List & Susanne Neckermann & Sally Sadoff, 2016. "The Behavioralist Goes to School: Leveraging Behavioral Economics to Improve Educational Performance," American Economic Journal: Economic Policy, American Economic Association, vol. 8(4), pages 183-219, November.
    31. Ignacio Esponda Jr. & Emanuel Vespa Jr., 2014. "Hypothetical Thinking and Information Extraction in the Laboratory," American Economic Journal: Microeconomics, American Economic Association, vol. 6(4), pages 180-202, November.
    32. Ariel Rubinstein, 2007. "Instinctive and Cognitive Reasoning: Response Times Study," Levine's Bibliography 321307000000001011, UCLA Department of Economics.
    33. Robert Slonim & Alvin E. Roth, 1998. "Learning in High Stakes Ultimatum Games: An Experiment in the Slovak Republic," Econometrica, Econometric Society, vol. 66(3), pages 569-596, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Drichoutis, Andreas C. & Palma, Marco & Feldman, Paul, 2024. "Incentives and Payment Mechanisms in Preference Elicitation," MPRA Paper 120898, University Library of Munich, Germany.
    2. Mackenzie Alston & Tatyana Deryugina & Olga Shurchkov, 2025. "Leaving Money on the Table," NBER Working Papers 33657, National Bureau of Economic Research, Inc.
    3. Sandro Ambuehl & Rahul Bhui & Heidi C. Thysen, 2026. "Mental Models of Causal Structure in Economics and Psychology," Papers 2603.29070, arXiv.org, revised Apr 2026.
    4. Benjamin Patrick Evans & Sumitra Ganesh, 2024. "Learning and Calibrating Heterogeneous Bounded Rational Market Behaviour with Multi-Agent Reinforcement Learning," Papers 2402.00787, arXiv.org.
    5. Abel, Martin & Robbett, Andrea & Stone, Daniel F., 2024. "Partisan Discrimination in Hiring," IZA Discussion Papers 17540, IZA Network @ LISER.
    6. Pablo Brañas-Garza & Antonio M. Espín & Diego Jorrat, 2025. "£1(£5) or Nothing in Dictator Games: Unexpected Differences," Working Papers 376, Red Nacional de Investigadores en Economía (RedNIE).
    7. Uri Gneezy & Yoram Halevy & Brian Hall & Theo Offerman & Jeroen van de Ven, 2024. "How Real is Hypothetical? A High-Stakes Test of the Allais Paradox," Working Papers tecipa-783, University of Toronto, Department of Economics.
    8. Anwesha Banerjee & Katharina Momsen, 2025. "(Un-)scientifically Spun: Narratives, Belief Updating, and Pro-Environmental Behavior," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 88(12), pages 3873-3903, December.
    9. Vranka, Marek & Houdek, Petr, 2024. "Moral hypocrisy and the dichotomy of hypothetical versus real choices in prosocial behavior," Journal of Economic Psychology, Elsevier, vol. 105(C).
    10. Khatun Mst Asma & Md Rony Masud & Koji Kotani, 2024. "How do climate concerns and value orientation among bankers influence agricultural financing?," Working Papers SDES-2024-6, Kochi University of Technology, School of Economics and Management, revised Dec 2024.
    11. Pedro Gonzalez-Fernandez, 2024. "Belief Bias Identification," Papers 2404.09297, arXiv.org, revised Mar 2026.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Benjamin Enke & Uri Gneezy & Brian Hall & David Martin & Vadim Nelidov & Theo Offerman & Jeroen van de Ven, 2020. "Cognitive Biases: Mistakes or Missing Stakes?," CESifo Working Paper Series 8168, CESifo.
    2. Sui, Pengfei & Wang, Baolian, 2025. "Stakes and investor behaviors," Journal of Financial Economics, Elsevier, vol. 172(C).
    3. James C. Cox & Vjollca Sadiraj, 2018. "Incentives," Experimental Economics Center Working Paper Series 2018-01, Experimental Economics Center, Andrew Young School of Policy Studies, Georgia State University.
    4. Glenn W. Harrison & John A. List, 2004. "Field Experiments," Journal of Economic Literature, American Economic Association, vol. 42(4), pages 1009-1055, December.
    5. Alós-Ferrer, Carlos & Hügelschäfer, Sabine, 2012. "Faith in intuition and behavioral biases," Journal of Economic Behavior & Organization, Elsevier, vol. 84(1), pages 182-192.
    6. Jinkwon Lee, 2007. "Repetition And Financial Incentives In Economics Experiments," Journal of Economic Surveys, Wiley Blackwell, vol. 21(3), pages 628-681, July.
    7. Julie Novakova & Jaroslav Flegr, 2013. "How Much Is Our Fairness Worth? The Effect of Raising Stakes on Offers by Proposers and Minimum Acceptable Offers in Dictator and Ultimatum Games," PLOS ONE, Public Library of Science, vol. 8(4), pages 1-9, April.
    8. Jörg Oechssler & Andreas Roider & Patrick W. Schmitz, 2015. "Cooling Off in Negotiations: Does it Work?," Journal of Institutional and Theoretical Economics (JITE), Mohr Siebeck, Tübingen, vol. 171(4), pages 565-588, December.
    9. Piotr Evdokimov & Umberto Garfagnini, 2023. "Cognitive Ability and Perceived Disagreement in Learning," Rationality and Competition Discussion Paper Series 381, CRC TRR 190 Rationality and Competition.
    10. Chen, Chia-Ching & Chiu, I-Ming & Smith, John & Yamada, Tetsuji, 2013. "Too smart to be selfish? Measures of cognitive ability, social preferences, and consistency," Journal of Economic Behavior & Organization, Elsevier, vol. 90(C), pages 112-122.
    11. Anja Achtziger & Carlos Alós-Ferrer, 2014. "Fast or Rational? A Response-Times Study of Bayesian Updating," Management Science, INFORMS, vol. 60(4), pages 923-938, April.
    12. Nicolas Eber & Patrick Roger & Tristan Roger, 2024. "Finance and intelligence: An overview of the literature," Journal of Economic Surveys, Wiley Blackwell, vol. 38(2), pages 503-554, April.
    13. Alós-Ferrer, Carlos & Hügelschäfer, Sabine, 2016. "Faith in intuition and cognitive reflection," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 64(C), pages 61-70.
    14. Charness, Gary & Gneezy, Uri & Kuhn, Michael A., 2013. "Experimental methods: Extra-laboratory experiments-extending the reach of experimental economics," Journal of Economic Behavior & Organization, Elsevier, vol. 91(C), pages 93-100.
    15. Falk, Armin & Fehr, Ernst, 2003. "Why labour market experiments?," Labour Economics, Elsevier, vol. 10(4), pages 399-406, August.
    16. Larney, Andrea & Rotella, Amanda & Barclay, Pat, 2019. "Stake size effects in ultimatum game and dictator game offers: A meta-analysis," Organizational Behavior and Human Decision Processes, Elsevier, vol. 151(C), pages 61-72.
    17. Taylor, Matthew P., 2020. "Heterogeneous motivation and cognitive ability in the lab," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 85(C).
    18. Felix Oberholzer-Gee & Joel Waldfogel & Matthew White, 2003. "Social Learning and Coordination in High-Stakes Games: Evidence from Friend or Foe," NBER Working Papers 9805, National Bureau of Economic Research, Inc.
    19. Emin Karagözoğlu & Ümit Barış Urhan, 2017. "The Effect of Stake Size in Experimental Bargaining and Distribution Games: A Survey," Group Decision and Negotiation, Springer, vol. 26(2), pages 285-325, March.
    20. Parravano, Melanie & Poulsen, Odile, 2015. "Stake size and the power of focal points in coordination games: Experimental evidence," Games and Economic Behavior, Elsevier, vol. 94(C), pages 191-199.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tpr:restat:v:105:y:2023:i:4:p:818-832. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: The MIT Press (email available below). General contact details of provider: https://direct.mit.edu/journals .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.