IDEAS home Printed from https://ideas.repec.org/a/eee/intell/v92y2022ics0160289622000332.html
   My bibliography  Save this article

Effort impacts IQ test scores in a minor way: A multi-study investigation with healthy adult volunteers

Author

Listed:
  • Bates, Timothy C.
  • Gignac, Gilles E.

Abstract

Test motivation has been suggested to strongly influence low-stakes intelligence scores, with for instance, a recent meta-analysis of monetary incentive effects suggesting an average 9.6 IQ point impact (d = 0.64). Effects of such magnitude would have important implications for the predictive validity of intelligence tests. We report six studies (N = 4208) investigating the association and potential causal link of effort on cognitive performance. In three tests of the association of motivation with cognitive test scores we find a positive, but modest linear association of scores with reported effort (N = 3007: r ~ 0.28). In three randomized control tests of the effects of monetary incentive on test scores (total N = 1201), incentive effects were statistically non-significant in each study, showed no dose dependency, and jointly indicated an effect one quarter the size previously estimated (d = 0.166). These results suggest that, in neurotypical adults, individual differences in test motivation have, on average, a negligible influence on intelligence test performance. (≈ 2.5 IQ points). The association between test motivation and test performance likely partly reflects differences in ability, and subjective effort partly reflects outcome expectations.

Suggested Citation

  • Bates, Timothy C. & Gignac, Gilles E., 2022. "Effort impacts IQ test scores in a minor way: A multi-study investigation with healthy adult volunteers," Intelligence, Elsevier, vol. 92(C).
    • Handle: RePEc:eee:intell:v:92:y:2022:i:c:s0160289622000332
    DOI: 10.1016/j.intell.2022.101652
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0160289622000332
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.intell.2022.101652?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Gignac, Gilles E. & Bartulovich, Asher & Salleo, Emilee, 2019. "Maximum effort may not be required for valid intelligence test score interpretations," Intelligence, Elsevier, vol. 75(C), pages 73-84.
    2. Sommer, Markus & Arendasy, Martin E. & Punter, Joachim Fritz & Feldhammer-Kahr, Martina & Rieder, Anita, 2019. "Do individual differences in test-takers' appraisal of admission testing compromise measurement fairness?," Intelligence, Elsevier, vol. 73(C), pages 16-29.
    3. Bonner, Sarah E. & Sprinkle, Geoffrey B., 2002. "The effects of monetary incentives on effort and task performance: theories, evidence, and a framework for research," Accounting, Organizations and Society, Elsevier, vol. 27(4-5), pages 303-345.
    4. Tim Kautz & James J. Heckman & Ron Diris & Bas ter Weel & Lex Borghans, 2014. "Fostering and Measuring Skills: Improving Cognitive and Non-cognitive Skills to Promote Lifetime Success," OECD Education Working Papers 110, OECD Publishing.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Elizabeth M. Caucutt & Lance Lochner & Youngmin Park, 2017. "Correlation, Consumption, Confusion, or Constraints: Why Do Poor Children Perform so Poorly?," Scandinavian Journal of Economics, Wiley Blackwell, vol. 119(1), pages 102-147, January.
    2. Johannes Abeler & Armin Falk & Fabian Kosse, 2021. "Malleability of Preferences for Honesty," CESifo Working Paper Series 9033, CESifo.
    3. Josten, Cecily & Lordan, Grace, 2019. "Robots at Work: Automatable and Non Automatable Jobs," IZA Discussion Papers 12520, Institute of Labor Economics (IZA).
    4. Damgaard, Mette Trier & Nielsen, Helena Skyt, 2018. "Nudging in education," Economics of Education Review, Elsevier, vol. 64(C), pages 313-342.
    5. Fabian Kosse & Thomas Deckers & Pia Pinger & Hannah Schildberg-Hörisch & Armin Falk, 2020. "The Formation of Prosociality: Causal Evidence on the Role of Social Environment," Journal of Political Economy, University of Chicago Press, vol. 128(2), pages 434-467.
    6. Church, Bryan K. & Kuang, Xi (Jason) & Liu, Yuebing (Sarah), 2019. "The effects of measurement basis and slack benefits on honesty in budget reporting," Accounting, Organizations and Society, Elsevier, vol. 72(C), pages 74-84.
    7. Matthijs J. Verhulst & Anne-Françoise Rutkowski, 2018. "Decision-Making in the Police Work Force: Affordances Explained in Practice," Group Decision and Negotiation, Springer, vol. 27(5), pages 827-852, October.
    8. Thérèse McDonnell, 2016. "Non-cognitive development in infancy: the influence of maternal employment and the mediating role of childcare," Working Papers 201606, Geary Institute, University College Dublin.
    9. Cordero, Jose M. & Gil-Izquierdo, María, 2018. "The effect of teaching strategies on student achievement: An analysis using TALIS-PISA-link," Journal of Policy Modeling, Elsevier, vol. 40(6), pages 1313-1331.
    10. Brancatelli,Calogero & Marguerie,Alicia Charlene & Koettl-Brodmann,Stefanie, 2020. "Job Creation and Demand for Skills in Kosovo : What Can We Learn from Job Portal Data?," Policy Research Working Paper Series 9266, The World Bank.
    11. Lindsey Macmillan & Emma Tominey, 2023. "Parental inputs and socio-economic gaps in early child development," Journal of Population Economics, Springer;European Society for Population Economics, vol. 36(3), pages 1513-1543, July.
    12. Steven Kachelmeier & Kristy Towry, 2005. "The Limitations of Experimental Design: A Case Study Involving Monetary Incentive Effects in Laboratory Markets," Experimental Economics, Springer;Economic Science Association, vol. 8(1), pages 21-33, April.
    13. Jia Wu & Junsen Zhang, 2017. "The Effect of Parental Absence on Child Development in Rural China," Asian Economic Policy Review, Japan Center for Economic Research, vol. 12(1), pages 117-134, January.
    14. Breitkopf, Laura & Chowdhury, Shyamal K. & Priyam, Shambhavi & Schildberg-Hörisch, Hannah & Sutter, Matthias, 2020. "Do economic preferences of children predict behavior?," DICE Discussion Papers 342, Heinrich Heine University Düsseldorf, Düsseldorf Institute for Competition Economics (DICE).
    15. Sarrias, Mauricio & Blanco, Alejandra, 2022. "Bodyweight and human capital development: Assessing the impact of obesity on socioemotional skills during childhood in Chile," Economics & Human Biology, Elsevier, vol. 47(C).
    16. Marcus Adam, 2018. "The Role of Human Resource Management (HRM) for the Implementation of Sustainable Product-Service Systems (PSS)—An Analysis of Fashion Retailers," Sustainability, MDPI, vol. 10(7), pages 1-27, July.
    17. Choi, Jongwoon (Willie) & Presslee, Adam, 2023. "When and why tangible rewards can motivate greater effort than cash rewards: An analysis of four attribute differences," Accounting, Organizations and Society, Elsevier, vol. 104(C).
    18. Pastore, Chiara & Jones, Andrew M., 2023. "Human capital consequences of missing out on a grammar school education," Economic Modelling, Elsevier, vol. 126(C).
    19. Ekaterina Melianova & Suhas Parandekar & Artem Volgin, 2020. "Returns to Education in the Russian Federation," World Bank Publications - Reports 34454, The World Bank Group.
    20. Sun-Moon Jung & Jae Yong Shin, 2022. "Social Performance Incentives in Mission-Driven Firms," Management Science, INFORMS, vol. 68(10), pages 7631-7657, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intell:v:92:y:2022:i:c:s0160289622000332. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/intelligence .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.