IDEAS home Printed from https://ideas.repec.org/a/eee/intell/v73y2019icp88-100.html
   My bibliography  Save this article

A meta-analysis of the worst performance rule

Author

Listed:
  • Schubert, Anna-Lena

Abstract

The worst performance rule (WPR) describes the phenomenon that individuals' slowest responses in a task are more predictive of their intelligence than their fastest or average responses. Because the WPR supposedly amplifies in heavily g-loaded tasks and in samples whose cognitive abilities factor structure is dominated by a strong g-factor, it has been suggested that whatever mechanism is giving rise to the positive manifold may not promote peak performance, but may rather limit performance in a wide range of cognitive tasks. The aim of the present meta-analysis was to provide a meta-analytically determined estimate of the strength, consistency, and generalizability of the WPR. Across 19 studies containing 23 datasets with a total of 3767 participants, there was robust evidence for the WPR. However, the increase in correlations across quantiles of the RT distribution did not follow a linear, but a logarithmic trend, suggesting that those cognitive processes contributing to fast responses in reaction time tasks are less strongly related to cognitive abilities (r = −0.18) than other cognitive processes contributing to average (r = −0.28) and slow responses (r = −0.33). There was no evidence that the strength of the worst performance rule increased with greater mean reaction times, in tests of general intelligence, or in samples with lower or average cognitive abilities. Instead, it was attenuated in less intelligent samples and greater when correlated with speed instead of intelligence or memory tests. Hence, the WPR may not be as characteristic for g and may play a smaller role for theoretical accounts of the positive manifold than previously thought.

Suggested Citation

  • Schubert, Anna-Lena, 2019. "A meta-analysis of the worst performance rule," Intelligence, Elsevier, vol. 73(C), pages 88-100.
  • Handle: RePEc:eee:intell:v:73:y:2019:i:c:p:88-100
    DOI: 10.1016/j.intell.2019.02.003
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0160289618302459
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.intell.2019.02.003?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. David Moher & Alessandro Liberati & Jennifer Tetzlaff & Douglas G Altman & The PRISMA Group, 2009. "Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement," PLOS Medicine, Public Library of Science, vol. 6(7), pages 1-6, July.
    2. Viechtbauer, Wolfgang, 2010. "Conducting Meta-Analyses in R with the metafor Package," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 36(i03).
    3. Wallert, John & Ekman, Urban & Westman, Eric & Madison, Guy, 2017. "The worst performance rule with elderly in abnormal cognitive decline," Intelligence, Elsevier, vol. 64(C), pages 9-17.
    4. Konstantopoulos, Spyros, 2011. "Fixed Effects and Variance Components Estimation in Three-Level Meta-Analysis," IZA Discussion Papers 5678, Institute of Labor Economics (IZA).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hilger, Kirsten & Spinath, Frank M. & Troche, Stefan & Schubert, Anna-Lena, 2022. "The biological basis of intelligence: Benchmark findings," Intelligence, Elsevier, vol. 93(C).
    2. Sorjonen, Kimmo & Madison, Guy & Hemmingsson, Tomas & Melin, Bo & Ullén, Fredrik, 2021. "Further evidence that the worst performance rule is a special case of the correlation of sorted scores rule," Intelligence, Elsevier, vol. 84(C).
    3. Frischkorn, Gidon T. & Wilhelm, Oliver & Oberauer, Klaus, 2022. "Process-oriented intelligence research: A review from the cognitive perspective," Intelligence, Elsevier, vol. 94(C).
    4. Ociepka, Michał & Kałamała, Patrycja & Chuderski, Adam, 2022. "High individual alpha frequency brains run fast, but it does not make them smart," Intelligence, Elsevier, vol. 92(C).
    5. Sorjonen, Kimmo & Madison, Guy & Melin, Bo & Ullén, Fredrik, 2020. "The Correlation of Sorted Scores Rule," Intelligence, Elsevier, vol. 80(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Boris Forthmann & Karin Kaczykowski & Mathias Benedek & Heinz Holling, 2023. "The Manic Idea Creator? A Review and Meta-Analysis of the Relationship between Bipolar Disorder and Creative Cognitive Potential," IJERPH, MDPI, vol. 20(13), pages 1-39, June.
    2. Scharfen, Jana & Peters, Judith Marie & Holling, Heinz, 2018. "Retest effects in cognitive ability tests: A meta-analysis," Intelligence, Elsevier, vol. 67(C), pages 44-66.
    3. Piers Steel & Sjoerd Beugelsdijk & Herman Aguinis, 2021. "The anatomy of an award-winning meta-analysis: Recommendations for authors, reviewers, and readers of meta-analytic reviews," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 52(1), pages 23-44, February.
    4. Mahesh Shumsher Rughooputh & Rui Zeng & Ying Yao, 2015. "Protein Diet Restriction Slows Chronic Kidney Disease Progression in Non-Diabetic and in Type 1 Diabetic Patients, but Not in Type 2 Diabetic Patients: A Meta-Analysis of Randomized Controlled Trials ," PLOS ONE, Public Library of Science, vol. 10(12), pages 1-17, December.
    5. Christopher Winchester & Kelsey E. Medeiros, 2023. "In Bounds but Out of the Box: A Meta-Analysis Clarifying the Effect of Ethicality on Creativity," Journal of Business Ethics, Springer, vol. 183(3), pages 713-743, March.
    6. Kelly R Moran & Sara Y Del Valle, 2016. "A Meta-Analysis of the Association between Gender and Protective Behaviors in Response to Respiratory Epidemics and Pandemics," PLOS ONE, Public Library of Science, vol. 11(10), pages 1-25, October.
    7. Sandra Feijóo & Raquel Rodríguez-Fernández, 2021. "A Meta-Analytical Review of Gender-Based School Bullying in Spain," IJERPH, MDPI, vol. 18(23), pages 1-13, December.
    8. Xizheng Xu & Zhiqiang Liu & Shaoying Gong & Yunpeng Wu, 2022. "The Relationship between Empathy and Attachment in Children and Adolescents: Three-Level Meta-Analyses," IJERPH, MDPI, vol. 19(3), pages 1-18, January.
    9. Kathrin Wunsch & Janis Fiedler & Philip Bachert & Alexander Woll, 2021. "The Tridirectional Relationship among Physical Activity, Stress, and Academic Performance in University Students: A Systematic Review and Meta-Analysis," IJERPH, MDPI, vol. 18(2), pages 1-18, January.
    10. Alan da Silveira Fleck & Margaux L. Sadoine & Stéphane Buteau & Eva Suarthana & Maximilien Debia & Audrey Smargiassi, 2021. "Environmental and Occupational Short-Term Exposure to Airborne Particles and FEV 1 and FVC in Healthy Adults: A Systematic Review and Meta-Analysis," IJERPH, MDPI, vol. 18(20), pages 1-19, October.
    11. Evangelos Danopoulos & Maureen Twiddy & Jeanette M Rotchell, 2020. "Microplastic contamination of drinking water: A systematic review," PLOS ONE, Public Library of Science, vol. 15(7), pages 1-23, July.
    12. Claudia Menne-Lothmann & Wolfgang Viechtbauer & Petra Höhn & Zuzana Kasanova & Simone P Haller & Marjan Drukker & Jim van Os & Marieke Wichers & Jennifer Y F Lau, 2014. "How to Boost Positive Interpretations? A Meta-Analysis of the Effectiveness of Cognitive Bias Modification for Interpretation," PLOS ONE, Public Library of Science, vol. 9(6), pages 1-26, June.
    13. Wei-Cheng Chang & Chin Lin & Cho-Hao Lee & Tzu-Ling Sung & Tao-Hsin Tung & Jorn-Hon Liu, 2017. "Vitrectomy with or without internal limiting membrane peeling for idiopathic epiretinal membrane: A meta-analysis," PLOS ONE, Public Library of Science, vol. 12(6), pages 1-18, June.
    14. Christopher Hansen & Holger Steinmetz & Jörn Block, 2022. "How to conduct a meta-analysis in eight steps: a practical guide," Management Review Quarterly, Springer, vol. 72(1), pages 1-19, February.
    15. Shaylea Badovinac & Jodi Martin & Camille Guérin-Marion & Monica O’Neill & Rebecca Pillai Riddell & Jean-François Bureau & Rebecca Spiegel, 2018. "Associations between mother-preschooler attachment and maternal depression symptoms: A systematic review and meta-analysis," PLOS ONE, Public Library of Science, vol. 13(10), pages 1-27, October.
    16. Fazel, Seena & Burghart, Matthias & Fanshawe, Thomas & Gil, Sharon Danielle & Monahan, John & Yu, Rongqin, 2022. "The predictive performance of criminal risk assessment tools used at sentencing: Systematic review of validation studies," Journal of Criminal Justice, Elsevier, vol. 81(C).
    17. Amro Qaddoura & Payam Yazdan-Ashoori & Conrad Kabali & Lehana Thabane & R Brian Haynes & Stuart J Connolly & Harriette Gillian Christine Van Spall, 2015. "Efficacy of Hospital at Home in Patients with Heart Failure: A Systematic Review and Meta-Analysis," PLOS ONE, Public Library of Science, vol. 10(6), pages 1-15, June.
    18. Sangsuk Yoon & Nathan M. Fong & Angelika Dimoka, 2019. "The robustness of anchoring effects on preferential judgments," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 14(4), pages 470-487, July.
    19. Boshra H. Namin & Torvald Øgaard & Jo Røislien, 2021. "Workplace Incivility and Turnover Intention in Organizations: A Meta-Analytic Review," IJERPH, MDPI, vol. 19(1), pages 1-19, December.
    20. Ruohuang Jiao & Wojtek Przepiorka & Vincent Buskens, 2022. "Moderators of reputation effects in peer-to-peer online markets: a meta-analytic model selection approach," Journal of Computational Social Science, Springer, vol. 5(1), pages 1041-1067, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intell:v:73:y:2019:i:c:p:88-100. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/intelligence .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.