IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0235272.html
   My bibliography  Save this article

The proportion of non-depressed subjects in a study sample strongly affects the results of psychometric analyses of depression symptoms

Author

Listed:
  • Simon Foster
  • Meichun Mohler-Kuo

Abstract

Background: Recent studies have uncovered a peculiar finding: that the strength and dimensionality of depression symptoms’ inter-relationships vary systematically across study samples with different average levels of depression severity. Our aim was to examine whether this phenomenon is driven by the proportion of non-affected subjects in the sample. Methods: Cross-sectional data from the “Cohort Study on Substance Use Risk Factors” was analyzed. Self-reported depression symptoms were assessed via the Major Depressive Inventory. Symptom data were analyzed via polychoric correlations, principal component analysis, confirmatory factor analysis, Mokken scale analysis, and network analysis. Analyses were carried out across 22 subsamples containing increasingly higher proportions of non-depressed participants. Results were examined as a function of the proportion of non-depressed participants. Results: A strong influence of the proportion of non-depressed participants was uncovered: the higher the proportion, the stronger the symptom correlations, higher their tendency towards unidimensionality, better their scalability, and higher the network edge strengths. Comparing the depressed sample with the general population sample, the average symptom correlation increased from 0.29 to 0.51; variance explained by the first eigenvalue increased from 0.36 to 0.56; fit measures from confirmatory one-factor analysis increased from 0.81 to 0.97; the H coefficient of scalability increased from 0.26 to 0.48; and the median network edge increased from 0.00 to 0.07. Conclusions: Results of psychometric analyses vary substantially as a function of the proportion of non-depressed participants in the sample being studied. This provides a possible explanation for the lack of reproducibility of previous psychometric studies.

Suggested Citation

  • Simon Foster & Meichun Mohler-Kuo, 2020. "The proportion of non-depressed subjects in a study sample strongly affects the results of psychometric analyses of depression symptoms," PLOS ONE, Public Library of Science, vol. 15(7), pages 1-13, July.
    • Handle: RePEc:plo:pone00:0235272
    DOI: 10.1371/journal.pone.0235272
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0235272
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0235272&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0235272?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Epskamp, Sacha & Cramer, Angélique O.J. & Waldorp, Lourens J. & Schmittmann, Verena D. & Borsboom, Denny, 2012. "qgraph: Network Visualizations of Relationships in Psychometric Data," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 48(i04).
    2. John Horn, 1965. "A rationale and test for the number of factors in factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 30(2), pages 179-185, June.
    3. Rutger Goekoop & Jaap G Goekoop, 2014. "A Network View on Psychiatric Disorders: Network Clusters of Symptoms as Elementary Syndromes of Psychopathology," PLOS ONE, Public Library of Science, vol. 9(11), pages 1-47, November.
    4. Rosseel, Yves, 2012. "lavaan: An R Package for Structural Equation Modeling," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 48(i02).
    5. van der Ark, L. Andries, 2012. "New Developments in Mokken Scale Analysis in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 48(i05).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wickelmaier, Florian & Strobl, Carolin & Zeileis, Achim, 2012. "Psychoco: Psychometric Computing in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 48(i01).
    2. Golino, Hudson F. & Demetriou, Andreas, 2017. "Estimating the dimensionality of intelligence like data using Exploratory Graph Analysis," Intelligence, Elsevier, vol. 62(C), pages 54-70.
    3. César Merino-Soto & Gina Chávez-Ventura & Verónica López-Fernández & Guillermo M. Chans & Filiberto Toledano-Toledano, 2022. "Learning Self-Regulation Questionnaire (SRQ-L): Psychometric and Measurement Invariance Evidence in Peruvian Undergraduate Students," Sustainability, MDPI, vol. 14(18), pages 1-17, September.
    4. Zaitun Mohd Saman & Ab Hamid Siti-Azrin & Azizah Othman & Yee Cheng Kueh, 2021. "The Validity and Reliability of the Malay Version of the Cyberbullying Scale among Secondary School Adolescents in Malaysia," IJERPH, MDPI, vol. 18(21), pages 1-12, November.
    5. Carlos Miguel Lemos & Ross Joseph Gore & Ivan Puga-Gonzalez & F LeRon Shults, 2019. "Dimensionality and factorial invariance of religiosity among Christians and the religiously unaffiliated: A cross-cultural analysis based on the International Social Survey Programme," PLOS ONE, Public Library of Science, vol. 14(5), pages 1-36, May.
    6. Kan, Kees-Jan & van der Maas, Han L.J. & Levine, Stephen Z., 2019. "Extending psychometric network analysis: Empirical evidence against g in favor of mutualism?," Intelligence, Elsevier, vol. 73(C), pages 52-62.
    7. Attanasio, Orazio & Blundell, Richard & Conti, Gabriella & Mason, Giacomo, 2020. "Inequality in socio-emotional skills: A cross-cohort comparison," Journal of Public Economics, Elsevier, vol. 191(C).
    8. Iván Sánchez-Iglesias & Mónica Bernaldo-de-Quirós & Francisco J. Estupiñá & Ignacio Fernández-Arias & Marta Labrador & Marina Vallejo-Achón & Jesús Saiz & Francisco J. Labrador, 2022. "Maladaptive Cognitions in Adolescents and Young Adults When They Play: The Dysfunctional Cognitions in Gaming Scale (DCG)," Sustainability, MDPI, vol. 14(23), pages 1-15, December.
    9. Angel M. Dzhambov & Peter Lercher & Drozdstoy Stoyanov & Nadezhda Petrova & Stoyan Novakov & Donka D. Dimitrova, 2021. "University Students’ Self-Rated Health in Relation to Perceived Acoustic Environment during the COVID-19 Home Quarantine," IJERPH, MDPI, vol. 18(5), pages 1-21, March.
    10. Silvia Mariela Méndez-Prado & Vanessa Rodriguez & Kevin Peralta-Rizzo & Patricia Everaert & Martin Valcke, 2023. "An Assessment Tool to Identify the Financial Literacy Level of Financial Education Programs Participants’ Executed by Ecuadorian Financial Institutions," Sustainability, MDPI, vol. 15(2), pages 1-24, January.
    11. Klara Malinakova & Lukas Novak & Radek Trnka & Peter Tavel, 2021. "Sensory Processing Sensitivity Questionnaire: A Psychometric Evaluation and Associations with Experiencing the COVID-19 Pandemic," IJERPH, MDPI, vol. 18(24), pages 1-14, December.
    12. Adam P. McGuire & Candice L. Hayden & Rawda Tomoum & A. Solomon Kurz, 2022. "Development and Validation of the State Moral Elevation Scale: Assessing State-Level Elevation Across Nonclinical and Clinical Samples," Journal of Happiness Studies, Springer, vol. 23(6), pages 2923-2946, August.
    13. Elise Barrella & Elisabeth Pyburn Spratto & Eric Pappas & Robert Nagel, 2018. "Developing and Validating an Individual Sustainability Instrument with Engineering Students to Motivate Intentional Change," Sustainability, MDPI, vol. 10(8), pages 1-24, August.
    14. Maren Wittek & Fabian Manke-Reimers & Eric Schmitt, 2022. "Development and Psychometric Properties of the Community Implementation Behaviour Questionnaire (CIBQ) in the Context of Supporting Caring Relatives of People with Dementia," IJERPH, MDPI, vol. 19(23), pages 1-15, December.
    15. César Merino-Soto & Manuel Fernández-Arata & Jaime Fuentes-Balderrama & Guillermo M. Chans & Filiberto Toledano-Toledano, 2022. "Research Perceived Competency Scale: A New Psychometric Adaptation for University Students’ Research Learning," Sustainability, MDPI, vol. 14(19), pages 1-17, September.
    16. Ryan M. K. Chan & Winnie W. S. Mak & Ben C. L. Yu, 2023. "Going beyond Mindfulness: How Concentration and Tranquility Commonly Co-Arising with Mindfulness Account for Mental Health," IJERPH, MDPI, vol. 20(8), pages 1-15, April.
    17. Lukas Novak & Klara Malinakova & Petr Mikoska & Jitse P. van Dijk & Filip Dechterenko & Radek Ptacek & Peter Tavel, 2021. "Psychometric Analysis of the Czech Version of the Toronto Empathy Questionnaire," IJERPH, MDPI, vol. 18(10), pages 1-16, May.
    18. Xijuan Zhang & Ramsha Noor & Victoria Savalei, 2016. "Examining the Effect of Reverse Worded Items on the Factor Structure of the Need for Cognition Scale," PLOS ONE, Public Library of Science, vol. 11(6), pages 1-15, June.
    19. Sarah Herpertz & Sophia Nizielski & Michael Hock & Astrid Schütz, 2016. "The Relevance of Emotional Intelligence in Personnel Selection for High Emotional Labor Jobs," PLOS ONE, Public Library of Science, vol. 11(4), pages 1-11, April.
    20. Artür Manukyan & Erhan Çene & Ahmet Sedef & Ibrahim Demir, 2014. "Dandelion plot: a method for the visualization of R-mode exploratory factor analyses," Computational Statistics, Springer, vol. 29(6), pages 1769-1791, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0235272. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.