IDEAS home Printed from https://ideas.repec.org/p/ivi/wpasad/2015-02.html
   My bibliography  Save this paper

Cognitive (Ir)reflection: New Experimental Evidence

Author

Listed:
  • Carlos Cueva Herrero

    (Dpto. Análisis Económico Aplicado)

  • Iñigo Iturbe-Ormaetxe Kortajarene

    (Universidad de Alicante)

  • Esther Mata-Pérez

    (Dpto. Fundamentos del Análisis Económico)

  • Giovanni Ponti

    (Universidad de Alicante)

  • Marcello Sartarelli

    (Dpto. Fundamentos del Análisis Económico)

  • Haihan Yu

    (Dpto. Fundamentos del Análisis Económico)

  • Zhukova Vita

    (Dpto. Fundamentos del Análisis Económico)

Abstract

We study whether cognitive ability explains choices in a wide variety of behavioral tasks, including riskand social preferences, by collecting evidence from almost 1,200 subjects across eight experimentalprojects. Since Frederick (2005)'s Cognitive Reflection Test (CRT) has been administered to allsubjects, our dataset is one of the largest in the literature. We divide the subjects pool into three groupsdepending on their CRT performance. Reflective subjects are those answering at least two of the threeCRT questions correctly. Impulsive ones are those who are unable to suppress the instinctive impulseto follow the intuitive although incorrect answer in at least two 2 questions, and the remaining subjectsform a residual group. We find that females score significantly worse than males in the CRT, and intheir wrong answers impulsive ones are observed more frequently. The 2D-4D ratio, which is higherfor females, is correlated negatively with subject's CRT score. In addition, we find that differencesbetween CRT groups in risk aversion depend on the elicitation method used. Finally, impulsive subjectshave higher social preferences, while reflective subjects are more likely to satisfy basic consistencyconditions in lottery choices.

Suggested Citation

  • Carlos Cueva Herrero & Iñigo Iturbe-Ormaetxe Kortajarene & Esther Mata-Pérez & Giovanni Ponti & Marcello Sartarelli & Haihan Yu & Zhukova Vita, 2015. "Cognitive (Ir)reflection: New Experimental Evidence," Working Papers. Serie AD 2015-02, Instituto Valenciano de Investigaciones Económicas, S.A. (Ivie).
  • Handle: RePEc:ivi:wpasad:2015-02
    as

    Download full text from publisher

    File URL: http://www.ivie.es/downloads/docs/wpasad/wpasad-2015-02.pdf
    File Function: Fisrt version / Primera version, 2015
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Chen, Chia-Ching & Chiu, I-Ming & Smith, John & Yamada, Tetsuji, 2013. "Too smart to be selfish? Measures of cognitive ability, social preferences, and consistency," Journal of Economic Behavior & Organization, Elsevier, vol. 90(C), pages 112-122.
    2. Filippin, Antonio & Crosetto, Paolo, 2014. "A Reconsideration of Gender Differences in Risk Attitudes," IZA Discussion Papers 8184, Institute of Labor Economics (IZA).
    3. Thomas Dohmen & Armin Falk & David Huffman & Uwe Sunde, 2010. "Are Risk Aversion and Impatience Related to Cognitive Ability?," American Economic Review, American Economic Association, vol. 100(3), pages 1238-1260, June.
    4. Ernst Fehr & Klaus M. Schmidt, 1999. "A Theory of Fairness, Competition, and Cooperation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(3), pages 817-868.
    5. Donkers, Bas & Melenberg, Bertrand & Van Soest, Arthur, 2001. "Estimating Risk Attitudes Using Lotteries: A Large Sample Approach," Journal of Risk and Uncertainty, Springer, vol. 22(2), pages 165-195, March.
    6. Andersson, Ola & Tyran, Jean-Robert & Wengström, Erik & Holm, Håkan J., 2013. "Risk Aversion Relates to Cognitive Ability: Fact or Fiction?," Working Paper Series 964, Research Institute of Industrial Economics.
    7. Lex Borghans & Bart H. H. Golsteyn & James J. Heckman & Huub Meijers, 2009. "Gender Differences in Risk Aversion and Ambiguity Aversion," Journal of the European Economic Association, MIT Press, vol. 7(2-3), pages 649-658, 04-05.
    8. Brañas-Garza, Pablo & García-Muñoz, Teresa & González, Roberto Hernán, 2012. "Cognitive effort in the Beauty Contest Game," Journal of Economic Behavior & Organization, Elsevier, vol. 83(2), pages 254-260.
    9. Steffen Andersen & Glenn W. Harrison & Morten I. Lau & E. Elisabet Rutström, 2008. "Eliciting Risk and Time Preferences," Econometrica, Econometric Society, vol. 76(3), pages 583-618, May.
    10. Oechssler, Jörg & Roider, Andreas & Schmitz, Patrick W., 2009. "Cognitive abilities and behavioral biases," Journal of Economic Behavior & Organization, Elsevier, vol. 72(1), pages 147-152, October.
    11. Annamaria Lusardi & Olivia S. Mitchell, 2014. "The Economic Importance of Financial Literacy: Theory and Evidence," Journal of Economic Literature, American Economic Association, vol. 52(1), pages 5-44, March.
    12. Hoppe, Eva I. & Kusterer, David J., 2011. "Behavioral biases and cognitive reflection," Economics Letters, Elsevier, vol. 110(2), pages 97-100, February.
    13. Lex Borghans & Angela Lee Duckworth & James J. Heckman & Bas ter Weel, 2008. "The Economics and Psychology of Personality Traits," Journal of Human Resources, University of Wisconsin Press, vol. 43(4).
    14. John D. Hey & Chris Orme, 2018. "Investigating Generalizations Of Expected Utility Theory Using Experimental Data," World Scientific Book Chapters, in: Experiments in Economics Decision Making and Markets, chapter 3, pages 63-98, World Scientific Publishing Co. Pte. Ltd..
    15. Michael Daly & Liam Delaney & Colm P. Harmon, 2009. "Psychological and Biological Foundations of Time Preference," Journal of the European Economic Association, MIT Press, vol. 7(2-3), pages 659-669, 04-05.
    16. Insler, Michael & Compton, James & Schmitt, Pamela, 2016. "The investment decisions of young adults under relaxed borrowing constraints," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 64(C), pages 106-121.
    17. repec:awi:wpaper:0578 is not listed on IDEAS
    18. Wilcox, Nathaniel T., 2011. "'Stochastically more risk averse:' A contextual theory of stochastic discrete choice under risk," Journal of Econometrics, Elsevier, vol. 162(1), pages 89-104, May.
    19. Matthew Pearson & Burkhard Schipper, 2012. "The visible hand: finger ratio (2D:4D) and competitive bidding," Experimental Economics, Springer;Economic Science Association, vol. 15(3), pages 510-529, September.
    20. James J. Heckman & Paul A. LaFontaine, 2010. "The American High School Graduation Rate: Trends and Levels," The Review of Economics and Statistics, MIT Press, vol. 92(2), pages 244-262, May.
    21. David Gill & Victoria Prowse, 2016. "Cognitive Ability, Character Skills, and Learning to Play Equilibrium: A Level-k Analysis," Journal of Political Economy, University of Chicago Press, vol. 124(6), pages 1619-1676.
    22. Noussair, C.N. & Tucker, S. & Xu, Yilong, 2014. "A Future Market Reduces Bubbles but Allows Greater Profit for More Sophisticated Traders," Discussion Paper 2014-051, Tilburg University, Center for Economic Research.
    23. James J. Heckman & Jora Stixrud & Sergio Urzua, 2006. "The Effects of Cognitive and Noncognitive Abilities on Labor Market Outcomes and Social Behavior," Journal of Labor Economics, University of Chicago Press, vol. 24(3), pages 411-482, July.
    24. Ben-Ner, Avner & Kong, Fanmin & Putterman, Louis, 2004. "Share and share alike? Gender-pairing, personality, and cognitive ability as determinants of giving," Journal of Economic Psychology, Elsevier, vol. 25(5), pages 581-589, October.
    25. Christelis, Dimitris & Jappelli, Tullio & Padula, Mario, 2010. "Cognitive abilities and portfolio choice," European Economic Review, Elsevier, vol. 54(1), pages 18-38, January.
    26. Al-Ubaydli, Omar & Jones, Garett & Weel, Jaap, 2016. "Average player traits as predictors of cooperation in a repeated prisoner's dilemma," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 64(C), pages 50-60.
    27. Charles A. Holt & Susan K. Laury, 2002. "Risk Aversion and Incentive Effects," American Economic Review, American Economic Association, vol. 92(5), pages 1644-1655, December.
    28. Pablo Brañas-Garza & Jaromír Kovářík & Levent Neyse, 2013. "Second-to-Fourth Digit Ratio Has a Non-Monotonic Impact on Altruism," PLOS ONE, Public Library of Science, vol. 8(4), pages 1-10, April.
    29. Neyse, Levent & Brañas-Garza, Pablo, 2014. "Digit ratio measurement guide," Kiel Working Papers 1914, Kiel Institute for the World Economy (IfW Kiel).
    30. Giovanni Ponti & Ismael Rodríguez Lara & Daniela Di Cagno, 2014. "Doing it now or later with payoff externalities: Experimental evidence on social time preferences," Working Papers. Serie AD 2014-05, Instituto Valenciano de Investigaciones Económicas, S.A. (Ivie).
    31. Antonio Cabrales & Raffaele Miniaci & Marco Piovesan & Giovanni Ponti, 2010. "Social Preferences and Strategic Uncertainty: An Experiment on Markets and Contracts," American Economic Review, American Economic Association, vol. 100(5), pages 2261-2278, December.
    32. Hauge, Karen Evelyn & Brekke, Kjell Arne & Johansson, Lars-Olof & Johansson-Stenman, Olof & Svedsäter, Henrik, 2009. "Are Social Preferences Skin Deep? Dictators under Cognitive Load," Working Papers in Economics 371, University of Gothenburg, Department of Economics.
    33. Grimm, Veronika & Mengel, Friederike, 2012. "An experiment on learning in a multiple games environment," Journal of Economic Theory, Elsevier, vol. 147(6), pages 2220-2259.
    34. Alós-Ferrer, Carlos & Hügelschäfer, Sabine, 2016. "Faith in intuition and cognitive reflection," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 64(C), pages 61-70.
    35. Urs Fischbacher, 2007. "z-Tree: Zurich toolbox for ready-made economic experiments," Experimental Economics, Springer;Economic Science Association, vol. 10(2), pages 171-178, June.
    36. Ponti, Giovanni & Carbone, Enrica, 2009. "Positional learning with noise," Research in Economics, Elsevier, vol. 63(4), pages 225-241, December.
    37. Lex Borghans & Huub Meijers & Bas Ter Weel, 2008. "The Role Of Noncognitive Skills In Explaining Cognitive Test Scores," Economic Inquiry, Western Economic Association International, vol. 46(1), pages 2-12, January.
    38. Shane Frederick, 2005. "Cognitive Reflection and Decision Making," Journal of Economic Perspectives, American Economic Association, vol. 19(4), pages 25-42, Fall.
    39. Carlos Cueva Herrero & Iñigo Iturbe-Ormaetxe Kortajarene & Giovanni Ponti & Josefa Tomás Lucas, 2016. "The disposition effect: who and when?," Working Papers. Serie AD 2016-01, Instituto Valenciano de Investigaciones Económicas, S.A. (Ivie).
    40. Daniel J. Benjamin & Sebastian A. Brown & Jesse M. Shapiro, 2013. "Who Is ‘Behavioral’? Cognitive Ability And Anomalous Preferences," Journal of the European Economic Association, European Economic Association, vol. 11(6), pages 1231-1255, December.
    41. repec:awi:wpaper:0465 is not listed on IDEAS
    42. Lex Borghans & Bart H.H. Golsteyn & James J. Heckman & Huub Meijers, 2009. "Gender Differences in Risk Aversion and Ambiguity," Working Papers 200903, Geary Institute, University College Dublin.
    43. Kiss, H.J. & Rodriguez-Lara, I. & Rosa-García, A., 2016. "Think twice before running! Bank runs and cognitive abilities," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 64(C), pages 12-19.
    44. Baghestanian, Sascha & Frey, Seth, 2016. "GO figure: Analytic and strategic skills are separable," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 64(C), pages 71-80.
    45. Bergman, Oscar & Ellingsen, Tore & Johannesson, Magnus & Svensson, Cicek, 2010. "Anchoring and cognitive ability," Economics Letters, Elsevier, vol. 107(1), pages 66-68, April.
    46. Glenn W. Harrison & Tanga McDaniel, 2008. "Voting games and computational complexity," Oxford Economic Papers, Oxford University Press, vol. 60(3), pages 546-565, July.
    47. Juan M. Benito-Ostolaza & Penélope Hernández & Juan A. Sanchis-Llopis, 2015. "Are individuals with higher cognitive ability expected to play more strategically?," Working Papers 1507, Department of Applied Economics II, Universidad de Valencia.
    48. Michele Ferrara & Anna Bottasso & Daniela Tempesta & Marika Carrieri & Luigi De Gennaro & Giovanni Ponti, 2015. "Gender Differences in Sleep Deprivation Effects on Risk and Inequality Aversion: Evidence from an Economic Experiment," PLOS ONE, Public Library of Science, vol. 10(3), pages 1-15, March.
    49. Charness, Gary & Gneezy, Uri & Imas, Alex, 2013. "Experimental methods: Eliciting risk preferences," Journal of Economic Behavior & Organization, Elsevier, vol. 87(C), pages 43-51.
    50. Yona Rubinstein & James J. Heckman, 2001. "The Importance of Noncognitive Skills: Lessons from the GED Testing Program," American Economic Review, American Economic Association, vol. 91(2), pages 145-149, May.
    51. Pablo Brañas-Garza & Aldo Rustichini, 2011. "Organizing Effects of Testosterone and Economic Behavior: Not Just Risk Taking," PLOS ONE, Public Library of Science, vol. 6(12), pages 1-8, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Allred, Sarah & Duffy, Sean & Smith, John, 2016. "Cognitive load and strategic sophistication," Journal of Economic Behavior & Organization, Elsevier, vol. 125(C), pages 162-178.
    2. repec:cup:judgdm:v:14:y:2019:i:3:p:234-279 is not listed on IDEAS
    3. Kiss, H.J. & Rodriguez-Lara, I. & Rosa-García, A., 2016. "Think twice before running! Bank runs and cognitive abilities," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 64(C), pages 12-19.
    4. Lau Lilleholt, 2019. "Cognitive ability and risk aversion: A systematic review and meta analysis," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 14(3), pages 234-279, May.
    5. Ji Yong Lee & Rodolfo M. Nayga & Cary Deck & Andreas C. Drichoutis, 2020. "Cognitive Ability and Bidding Behavior in Second Price Auctions: An Experimental Study," American Journal of Agricultural Economics, John Wiley & Sons, vol. 102(5), pages 1494-1510, October.
    6. Gill, David & Prowse, Victoria, 2012. "Cognitive ability and learning to play equilibrium: A level-k analysis," MPRA Paper 38317, University Library of Munich, Germany, revised 23 Apr 2012.
    7. Zuzana Brokesova & Cary Deck & Jana Peliova, 2016. "Bringing a Natural Experiment into the Laboratory: the Measurement of Individual Risk Attitudes," Working Papers 16-06, Chapman University, Economic Science Institute.
    8. Judit Alonso & Roberto Di Paolo & Giovanni Ponti & Marcello Sartarelli, 2017. "Some (Mis)facts about 2D:4D, Preferences and Personality," Working Papers. Serie AD 2017-08, Instituto Valenciano de Investigaciones Económicas, S.A. (Ivie).
    9. Dietmar Fehr & Steffen Huck, 2016. "Who knows it is a game? On strategic awareness and cognitive ability," Experimental Economics, Springer;Economic Science Association, vol. 19(4), pages 713-726, December.
    10. Daniel J. Benjamin & Sebastian A. Brown & Jesse M. Shapiro, 2013. "Who Is ‘Behavioral’? Cognitive Ability And Anomalous Preferences," Journal of the European Economic Association, European Economic Association, vol. 11(6), pages 1231-1255, December.
    11. Lee, Ji Yong & Nayga, Rodolfo M. & Deck, Cary & Drichoutis, Andreas, 2017. "Cognitive Ability and Bidding Behavior in Experimental Auction," 2017 Annual Meeting, July 30-August 1, Chicago, Illinois 258347, Agricultural and Applied Economics Association.
    12. Ola Andersson & Håkan J. Holm & Jean-Robert Tyran & Erik Wengström, 2020. "Robust inference in risk elicitation tasks," Journal of Risk and Uncertainty, Springer, vol. 61(3), pages 195-209, December.
    13. Duffy, Sean & Smith, John, 2014. "Cognitive load in the multi-player prisoner's dilemma game: Are there brains in games?," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 51(C), pages 47-56.
    14. Chen, Chia-Ching & Chiu, I-Ming & Smith, John & Yamada, Tetsuji, 2013. "Too smart to be selfish? Measures of cognitive ability, social preferences, and consistency," Journal of Economic Behavior & Organization, Elsevier, vol. 90(C), pages 112-122.
    15. Chiara Felli & Werner Güth & Esther Mata-Pérez & Giovanni Ponti, 2015. "Ultimatum Concession Bargaining: an Experimental Study," Working Papers CESARE 7/2015, Dipartimento di Economia e Finanza, LUISS Guido Carli.
    16. Fehr, Dietmar & Huck, Steffen, 2013. "Who knows It is a game? On rule understanding, strategic awareness and cognitive ability," Discussion Papers, Research Unit: Economics of Change SP II 2013-306, WZB Berlin Social Science Center.
    17. Brañas-Garza, Pablo & Smith, John, 2016. "Cognitive abilities and economic behavior," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 64(C), pages 1-4.
    18. Andreas C. Drichoutis & Rodolfo M. Nayga, 2015. "Do risk and time preferences have biological roots?," Southern Economic Journal, John Wiley & Sons, vol. 82(1), pages 235-256, July.
    19. Rodriguez-Lara, Ismael & Ponti, Giovanni, 2017. "Social motives vs social influence: An experiment on interdependent time preferences," Games and Economic Behavior, Elsevier, vol. 105(C), pages 177-194.
    20. Brice Corgnet & Cary Deck & Mark DeSantis & David Porter, 2022. "Forecasting Skills in Experimental Markets: Illusion or Reality?," Management Science, INFORMS, vol. 68(7), pages 5216-5232, July.
    21. Mariam Raheem & Ain ul Momina, 2021. "Do Underlying Risk Preferences explain Individuals’ Cognitive Ability? Evidence from a Sample of Pakistani Students," Lahore Journal of Economics, Department of Economics, The Lahore School of Economics, vol. 26(1), pages 85-122, Jan-June.

    More about this item

    Keywords

    behavioral economics; cognitive reflection; gender; laboratory experiment; personality;
    All these keywords.

    JEL classification:

    • C91 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Individual Behavior
    • D81 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Criteria for Decision-Making under Risk and Uncertainty
    • J16 - Labor and Demographic Economics - - Demographic Economics - - - Economics of Gender; Non-labor Discrimination

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ivi:wpasad:2015-02. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Departamento de Edición (email available below). General contact details of provider: https://edirc.repec.org/data/ievages.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.