IDEAS home Printed from https://ideas.repec.org/a/eee/intell/v90y2022ics0160289621000982.html

Cognitive reflection, cognitive intelligence, and cognitive abilities: A meta-analysis

Author

Listed:
  • Otero, Inmaculada
  • Salgado, Jesús F.
  • Moscoso, Silvia

Abstract

This paper presents a series of psychometric meta-analysis on the relationship between cognitive reflection (CR) and several cognitive abilities (i.e., cognitive intelligence, numerical ability, verbal ability, mechanical-spatial ability, and working memory), and skills (i.e., numeracy skills). Also, the paper presents a bifactor analysis carried out to determine whether CR is a related but independent factor or a second-stratum factor in a hierarchical model of cognitive intelligence. Finally, the study also tested a path meta-analytic model of the CR-cognitive ability relationships. The results showed that CR correlated substantially with all the cognitive abilities and skills (K ranged from 3 to 44 and N ranged from 624 to 20,307). The bifactor analysis showed that CR variance was mainly accounted for by a general factor of cognitive intelligence plus a second-stratum factor of numerical ability. The results of the bifactor analysis were similar for numerical-CRT and verbal-CRT. It was not found evidence supporting the existence of a cognitive reflection factor. Finally, the path meta-analytic model showed that the combination of cognitive intelligence and numerical ability accounted for 69% of CR variance. The path model showed that cognitive intelligence and numerical ability have direct and indirect (through numeracy skills) effects on CR. Theoretical and practical implications are discussed, and future research is suggested.

Suggested Citation

  • Otero, Inmaculada & Salgado, Jesús F. & Moscoso, Silvia, 2022. "Cognitive reflection, cognitive intelligence, and cognitive abilities: A meta-analysis," Intelligence, Elsevier, vol. 90(C).
    • Handle: RePEc:eee:intell:v:90:y:2022:i:c:s0160289621000982
    DOI: 10.1016/j.intell.2021.101614
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0160289621000982
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.intell.2021.101614?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Michael N. Stagnaro & Gordon Pennycook & David G. Rand, 2018. "Performance on the Cognitive Reflection Test is stable across time," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 13(3), pages 260-267, May.
    2. Skagerlund, Kenny & Lind, Thérèse & Strömbäck, Camilla & Tinghög, Gustav & Västfjäll, Daniel, 2018. "Financial literacy and the role of numeracy–How individuals’ attitude and affinity with numbers influence financial literacy," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 74(C), pages 18-25.
    3. Kristen D. Deppe & Frank J. Gonzalez & Jayme L. Neiman & Carly Jacobs & Jackson Pahlke & Kevin B. Smith & John R. Hibbing, 2015. "Reflective liberals and intuitive conservatives: A look at the Cognitive Reflection Test and ideology," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 10(4), pages 314-331, July.
    4. Saima Ghazal & Edward T. Cokely & Rocio Garcia-Retamero, 2014. "Predicting biases in very highly educated samples: Numeracy and metacognition," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 9(1), pages 15-34, January.
    5. Shane Frederick, 2005. "Cognitive Reflection and Decision Making," Journal of Economic Perspectives, American Economic Association, vol. 19(4), pages 25-42, Fall.
    6. Karl Halvor Teigen & Erik Løhre & Sigrid Møyner Hohle, 2018. "The boundary effect: Perceived post hoc accuracy of prediction intervals," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 13(4), pages 309-321, July.
    7. Jesús F. Salgado & Inmaculada Otero & Silvia Moscoso, 2019. "Cognitive Reflection and General Mental Ability as Predictors of Job Performance," Sustainability, MDPI, vol. 11(22), pages 1-16, November.
    8. Gignac, Gilles E., 2015. "Estimating the Strength of a General Factor: Coefficient Omega Hierarchical," Industrial and Organizational Psychology, Cambridge University Press, vol. 8(3), pages 434-438, September.
    9. Ellen Peters & Irwin P. Levin, 2008. "Dissecting the risky-choice framing effect: Numeracy as an individual-difference factor in weighting risky and riskless options," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 3(6), pages 435-448, August.
    10. Fosgaard, Toke Reinholt & Hansen, Lars Gaarn & Piovesan, Marco, 2013. "Separating Will from Grace: An experiment on conformity and awareness in cheating," Journal of Economic Behavior & Organization, Elsevier, vol. 93(C), pages 279-284.
    11. Gordon Pennycook & James Allan Cheyne & Nathaniel Barr & Derek J. Koehler & Jonathan A. Fugelsang, 2015. "On the reception and detection of pseudo-profound bullshit," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 10(6), pages 549-563, November.
    12. David Moher & Alessandro Liberati & Jennifer Tetzlaff & Douglas G Altman & The PRISMA Group, 2009. "Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement," PLOS Medicine, Public Library of Science, vol. 6(7), pages 1-6, July.
    13. Bradley J. Ruffle & Yossef Tobol, 2017. "Clever enough to tell the truth," Experimental Economics, Springer;Economic Science Association, vol. 20(1), pages 130-155, March.
    14. Guillermo Campitelli & Martin Labollita, 2010. "Correlations of cognitive reflection with judgments and choices," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 5(3), pages 182-191, June.
    15. John Schmid & John Leiman, 1957. "The development of hierarchical factor solutions," Psychometrika, Springer;The Psychometric Society, vol. 22(1), pages 53-61, March.
    16. Edward T. Cokely & Mirta Galesic & Eric Schulz & Saima Ghazal & Rocio Garcia-Retamero, 2012. "Measuring risk literacy: The Berlin Numeracy Test," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 7(1), pages 25-47, January.
    17. Gregory Hancock, 2001. "Effect size, power, and sample size determination for structured means modeling and mimic approaches to between-groups hypothesis testing of means on a single latent construct," Psychometrika, Springer;The Psychometric Society, vol. 66(3), pages 373-388, September.
    18. Donald D. Bergh & Herman Aguinis & Ciaran Heavey & David J. Ketchen & Brian K. Boyd & Peiran Su & Cubie L. L. Lau & Harry Joo, 2016. "Using meta-analytic structural equation modeling to advance strategic management research: Guidelines and an empirical illustration via the strategic leadership-performance relationship," Strategic Management Journal, Wiley Blackwell, vol. 37(3), pages 477-497, March.
    19. Keela S. Thomson & Daniel M. Oppenheimer, 2016. "Investigating an alternate form of the cognitive reflection test," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 11(1), pages 99-113, January.
    20. Isaac M. Lipkus & Greg Samsa & Barbara K. Rimer, 2001. "General Performance on a Numeracy Scale among Highly Educated Samples," Medical Decision Making, , vol. 21(1), pages 37-44, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Gignac, Gilles E. & Zajenkowski, Marcin, 2025. "Humans peak in midlife: A combined cognitive and personality trait perspective," Intelligence, Elsevier, vol. 113(C).
    2. Mihael A. Jeklic, 2023. "Can you trust your lawyer's call? Legal advisers exhibit myside bias resistant to debiasing interventions," Journal of Empirical Legal Studies, John Wiley & Sons, vol. 20(2), pages 409-433, June.
    3. Jastrzębski, Jan & Chuderski, Adam, 2022. "Analytic thinking outruns fluid reasoning in explaining rejection of pseudoscience, paranormal, and conspiracist beliefs," Intelligence, Elsevier, vol. 95(C).
    4. Willadsen, Helene & Zaccagni, Sarah & Piovesan, Marco & Wengström, Erik, 2024. "Measures of cognitive ability and choice inconsistency," Journal of Economic Behavior & Organization, Elsevier, vol. 220(C), pages 495-506.
    5. Callis, Zoe & Gerrans, Paul & Walker, Dana L. & Gignac, Gilles E., 2023. "The association between intelligence and financial literacy: A conceptual and meta-analytic review," Intelligence, Elsevier, vol. 100(C).
    6. Bates, Timothy C., 2025. "Cognitive rationality is heritable and lies under general cognitive ability," Intelligence, Elsevier, vol. 108(C).
    7. Stefan Voß, 2023. "Bus Bunching and Bus Bridging: What Can We Learn from Generative AI Tools like ChatGPT?," Sustainability, MDPI, vol. 15(12), pages 1-19, June.
    8. Gignac, Gilles E. & Stevens, Elizabeth M., 2024. "Attitude toward numbers: A better predictor of financial literacy and intelligence than need for cognition," Intelligence, Elsevier, vol. 103(C).
    9. Inmaculada Otero & Pamela Alonso, 2023. "Cognitive reflection test: The effects of the items sequence on scores and response time," PLOS ONE, Public Library of Science, vol. 18(1), pages 1-15, January.
    10. Nicolas Eber & Patrick Roger & Tristan Roger, 2024. "Finance and intelligence: An overview of the literature," Journal of Economic Surveys, Wiley Blackwell, vol. 38(2), pages 503-554, April.
    11. Plotkina, Daria & Hoffmann, Arvid O.I. & Roger, Patrick & D’Hondt, Catherine, 2024. "Gender vs. personality: The role of masculinity in explaining cognitive style," Journal of Behavioral and Experimental Finance, Elsevier, vol. 44(C).
    12. Plotkina, Daria & Hoffmann, Arvid O.I. & Roger, Patrick & D’Hondt, Catherine, 2024. "Gender vs. personality: The role of masculinity in explaining cognitive style," LIDAM Reprints LFIN 2024010, Université catholique de Louvain, Louvain Finance (LFIN).
    13. Zakharin, Michael & Bates, Timothy C., 2025. "Higher cognitive ability linked to weaker moral foundations in UK adults," Intelligence, Elsevier, vol. 111(C).
    14. Steffen Ahrens & Ciril Bosch-Rosa & Thomas Meissner, 2022. "Intertemporal consumption and debt aversion: a replication and extension," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 8(1), pages 56-84, December.
    15. Fossen, Frank M. & Neyse, Levent & Schröder, Carsten, 2025. "Does Cognitive Reflection Relate to Preferences and Socioeconomic Outcomes?," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 3(2), pages 303-343.
    16. Daria Plotkina & Arvid O.I. Hoffmann & Patrick Roger & Catherine D’hondt, 2024. "Gender vs. personality: The role of masculinity in explaining cognitive style," Post-Print hal-04758211, HAL.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nicolas Eber & Patrick Roger & Tristan Roger, 2024. "Finance and intelligence: An overview of the literature," Journal of Economic Surveys, Wiley Blackwell, vol. 38(2), pages 503-554, April.
    2. Siddiqi, Umema, 2023. "The Intersection of Financial Literacy, Cognitive Ability, and Numeracy Skills in Pakistani Adults," MPRA Paper 119781, University Library of Munich, Germany.
    3. Erceg, Nikola & Galić, Zvonimir & Bubić, Andreja, 2022. "Normative responding on cognitive bias tasks: Some evidence for a weak rationality factor that is mostly explained by numeracy and actively open-minded thinking," Intelligence, Elsevier, vol. 90(C).
    4. Yigal Attali & Maya Bar-Hillel, 2020. "The False Allure of Fast Lures," Discussion Paper Series dp733, The Federmann Center for the Study of Rationality, the Hebrew University, Jerusalem.
    5. Nikola Erceg & Zvonimir Galić & Mitja RužojÄ ić, 2020. "A reflection on cognitive reflection – testing convergent/divergent validity of two measures of cognitive reflection," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 15(5), pages 741-755, September.
    6. Becky L. Choma & David Sumantry & Yaniv Hanoch, 2019. "Right-wing ideology and numeracy: A perception of greater ability, but poorer performance," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 14(4), pages 412-422, July.
    7. Skagerlund, Kenny & Lind, Thérèse & Strömbäck, Camilla & Tinghög, Gustav & Västfjäll, Daniel, 2018. "Financial literacy and the role of numeracy–How individuals’ attitude and affinity with numbers influence financial literacy," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 74(C), pages 18-25.
    8. Andrew Meyer & Elizabeth Zhou & Shane Frederick, 2018. "The non-effects of repeated exposure to the Cognitive Reflection Test," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 13(3), pages 246-259, May.
    9. Sobkow, Agata & Olszewska, Angelika & Traczyk, Jakub, 2020. "Multiple numeric competencies predict decision outcomes beyond fluid intelligence and cognitive reflection," Intelligence, Elsevier, vol. 80(C).
    10. Muñoz-Murillo, Melisa & Álvarez-Franco, Pilar B. & Restrepo-Tobón, Diego A., 2020. "The role of cognitive abilities on financial literacy: New experimental evidence," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 84(C).
    11. Brañas-Garza, Pablo & Kujal, Praveen & Lenkei, Balint, 2019. "Cognitive reflection test: Whom, how, when," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 82(C).
    12. Yigal Attali & Maya Bar-Hillel, 2020. "The false allure of fast lures," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 15(1), pages 93-111, January.
    13. Inmaculada Otero & Pamela Alonso, 2023. "Cognitive reflection test: The effects of the items sequence on scores and response time," PLOS ONE, Public Library of Science, vol. 18(1), pages 1-15, January.
    14. Takeshi Ojima & Shinsuke Ikeda, 2025. "Commitment To Honesty," TUPD Discussion Papers 76, Graduate School of Economics and Management, Tohoku University.
    15. Prakashan Chellattan Veettil & Yashodha Yashodha & Joseph Vecci, 2025. "Hypothetical bias and cognitive ability: Farmers' preference for crop insurance products†," American Journal of Agricultural Economics, John Wiley & Sons, vol. 107(3), pages 888-924, May.
    16. Ray Saadaoui Mallek & Mohamed Albaity, 2019. "Individual differences and cognitive reflection across gender and nationality the case of the United Arab Emirates," Cogent Economics & Finance, Taylor & Francis Journals, vol. 7(1), pages 1567965-156, January.
    17. Corgnet, Brice & DeSantis, Mark & Porter, David, 2021. "Information aggregation and the cognitive make-up of market participants," European Economic Review, Elsevier, vol. 133(C).
    18. Chavez, Daniel E. & Palma, Marco A. & Nayga, Rodolfo M., "undated". "When does real become consequential in non-hypothetical choice experiments?," 2018 Annual Meeting, August 5-7, Washington, D.C. 274040, Agricultural and Applied Economics Association.
    19. Sven Gruener, 2024. "Determinants of Gullibility to Misinformation: A Study of Climate Change, COVID-19 and Artificial Intelligence," Journal of Interdisciplinary Economics, , vol. 36(1), pages 58-78, January.
    20. Mondal, Supratik & Traczyk, Jakub, 2023. "Conditionality of adaptiveness: Investigating the relationship between numeracy and adaptive behavior," Journal of Economic Psychology, Elsevier, vol. 96(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intell:v:90:y:2022:i:c:s0160289621000982. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/intelligence .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.