IDEAS home Printed from https://ideas.repec.org/a/sae/sagope/v7y2017i1p2158244017700459.html
   My bibliography  Save this article

The Efficacy of Common Fit Indices for Enumerating Classes in Growth Mixture Models When Nested Data Structure Is Ignored

Author

Listed:
  • Qi Chen
  • Wen Luo
  • Gregory J. Palardy
  • Ryan Glaman
  • Amber McEnturff

Abstract

Growth mixture model (GMM) is a flexible statistical technique for analyzing longitudinal data when there are unknown heterogeneous subpopulations with different growth trajectories. When individuals are nested within clusters, multilevel growth mixture model (MGMM) should be used to account for the clustering effect. A review of recent literature shows that a higher level of nesting was described in 43% of articles using GMM, none of which used MGMM to account for the clustered data. We conjecture that researchers sometimes ignore the higher level to reduce analytical complexity, but in other situations, ignoring the nesting is unavoidable. This Monte Carlo study investigated whether the correct number of classes can still be retrieved when a higher level of nesting in MGMM is ignored. We investigated six commonly used model selection indices: Akaike information criterion (AIC), consistent AIC (CAIC), Bayesian information criterion (BIC), sample size–adjusted BIC (SABIC), Vuong–Lo–Mendell–Rubin likelihood ratio test (VLMR), and adjusted Lo–Mendell–Rubin likelihood ratio test (ALMR). Results showed that accuracy of class enumeration decreased for all six indices when the higher level is ignored. BIC, CAIC, and SABIC were the most effective model selection indices under the misspecified model. BIC and CAIC were preferable when sample size was large and/or intraclass correlation (ICC) was small, whereas SABIC performed better when sample size was small and/or ICC was large. In addition, SABIC and VLMR/ALMR tended to overextract the number of classes when there are more than two subpopulations and the sample size is large.

Suggested Citation

  • Qi Chen & Wen Luo & Gregory J. Palardy & Ryan Glaman & Amber McEnturff, 2017. "The Efficacy of Common Fit Indices for Enumerating Classes in Growth Mixture Models When Nested Data Structure Is Ignored," SAGE Open, , vol. 7(1), pages 21582440177, March.
    • Handle: RePEc:sae:sagope:v:7:y:2017:i:1:p:2158244017700459
    DOI: 10.1177/2158244017700459
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/2158244017700459
    Download Restriction: no
    File URL: https://libkey.io/10.1177/2158244017700459?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Morgan, Grant B. & Hodge, Kari J. & Baggett, Aaron R., 2016. "Latent profile analysis with nonnormal mixtures: A Monte Carlo examination of model selection using fit indices," Computational Statistics & Data Analysis, Elsevier, vol. 93(C), pages 146-161.
    2. Francesco Bartolucci & Fulvia Pennoni & Giorgio Vittadini, 2011. "Assessment of School Performance Through a Multilevel Latent Markov Rasch Model," Journal of Educational and Behavioral Statistics, , vol. 36(4), pages 491-522, August.
    3. Yang, Chih-Chien, 2006. "Evaluating latent class analysis models in qualitative phenotype identification," Computational Statistics & Data Analysis, Elsevier, vol. 50(4), pages 1090-1104, February.
    4. S. Bacci & S. Pandolfi & F. Pennoni, 2014. "A comparison of some criteria for states selection in the latent Markov model for longitudinal data," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 8(2), pages 125-145, June.
    5. Vuong, Quang H, 1989. "Likelihood Ratio Tests for Model Selection and Non-nested Hypotheses," Econometrica, Econometric Society, vol. 57(2), pages 307-333, March.
    6. Ng, S.K. & McLachlan, G.J., 2014. "Mixture models for clustering multilevel growth trajectories," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 43-51.
    7. Hamparsum Bozdogan, 1987. "Model selection and Akaike's Information Criterion (AIC): The general theory and its analytical extensions," Psychometrika, Springer;The Psychometric Society, vol. 52(3), pages 345-370, September.
    8. Hirotugu Akaike, 1987. "Factor analysis and AIC," Psychometrika, Springer;The Psychometric Society, vol. 52(3), pages 317-332, September.
    9. Melnykov, Volodymyr & Chen, Wei-Chen & Maitra, Ranjan, 2012. "MixSim: An R Package for Simulating Data to Study Performance of Clustering Algorithms," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 51(i12).
    10. David J. Spiegelhalter & Nicola G. Best & Bradley P. Carlin & Angelika Van Der Linde, 2002. "Bayesian measures of model complexity and fit," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(4), pages 583-639, October.
    11. Neal O. Jeffries, 2003. "A note on 'Testing the number of components in a normal mixture'," Biometrika, Biometrika Trust, vol. 90(4), pages 991-994, December.
    12. Stanley Sclove, 1987. "Application of model-selection criteria to some problems in multivariate analysis," Psychometrika, Springer;The Psychometric Society, vol. 52(3), pages 333-343, September.
    13. Bartolucci Francesco & Murphy Thomas Brendan, 2015. "A finite mixture latent trajectory model for modeling ultrarunners’ behavior in a 24-hour race," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 11(4), pages 193-203, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Otrachshenko, Vladimir & Tyurina, Elena & Nagapetyan, Artur, 2022. "The economic value of the Glass Beach: Contingent valuation and life satisfaction approaches," Ecological Economics, Elsevier, vol. 198(C).
    2. Jun-Hong Chen & Chi-Fang Wu & Minchao Jin, 2023. "How are Income and Assets Associated with Food Insecurity? An Application of the Growth Mixture Modeling," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 165(3), pages 959-973, February.
    3. Roba Elbawab, 2022. "University Rankings and Goals: A Cluster Analysis," Economies, MDPI, vol. 10(9), pages 1-34, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Morgan, Grant B. & Hodge, Kari J. & Baggett, Aaron R., 2016. "Latent profile analysis with nonnormal mixtures: A Monte Carlo examination of model selection using fit indices," Computational Statistics & Data Analysis, Elsevier, vol. 93(C), pages 146-161.
    2. Roy Levy & Gregory R. Hancock, 2011. "An Extended Model Comparison Framework for Covariance and Mean Structure Models, Accommodating Multiple Groups and Latent Mixtures," Sociological Methods & Research, , vol. 40(2), pages 256-278, May.
    3. Terry Elrod & Gerald Häubl & Steven Tipps, 2012. "Parsimonious Structural Equation Models for Repeated Measures Data, with Application to the Study of Consumer Preferences," Psychometrika, Springer;The Psychometric Society, vol. 77(2), pages 358-387, April.
    4. Jiwon Lee & Midam An & Yongku Kim & Jung-In Seo, 2021. "Optimal Allocation for Electric Vehicle Charging Stations," Energies, MDPI, vol. 14(18), pages 1-10, September.
    5. Nicolas Depraetere & Martina Vandebroek, 2014. "Order selection in finite mixtures of linear regressions," Statistical Papers, Springer, vol. 55(3), pages 871-911, August.
    6. repec:jss:jstsof:06:i02 is not listed on IDEAS
    7. Daniel McNeish & Jeffrey R. Harring, 2017. "The Effect of Model Misspecification on Growth Mixture Model Class Enumeration," Journal of Classification, Springer;The Classification Society, vol. 34(2), pages 223-248, July.
    8. Yang, Chih-Chien, 2006. "Evaluating latent class analysis models in qualitative phenotype identification," Computational Statistics & Data Analysis, Elsevier, vol. 50(4), pages 1090-1104, February.
    9. Po-Hsien Huang, 2017. "Asymptotics of AIC, BIC, and RMSEA for Model Selection in Structural Equation Modeling," Psychometrika, Springer;The Psychometric Society, vol. 82(2), pages 407-426, June.
    10. Lu, Zhenqiu (Laura) & Zhang, Zhiyong, 2014. "Robust growth mixture models with non-ignorable missingness: Models, estimation, selection, and application," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 220-240.
    11. Imami, Drini & Zhllima, Edvin & Merkaj, Elvina & Chan-Halbrendt, Catherine & Canavar, Maurizio, 2016. "Albanian consumer preferences for the use of dry milk in cheese-making: A conjoint choice experiment," Agricultural Economics Review, Greek Association of Agricultural Economists, vol. 17(1), January.
    12. Chushu FAN, 2017. "Family Education," European Journal of Multidisciplinary Studies Articles, Revistia Research and Publishing, vol. 2, May Augus.
    13. Daniela Andreini & Diego Rinallo & Giuseppe Pedeliento & Mara Bergamaschi, 2017. "Brands and Religion in the Secularized Marketplace and Workplace: Insights from the Case of an Italian Hospital Renamed After a Roman Catholic Pope," Journal of Business Ethics, Springer, vol. 141(3), pages 529-550, March.
    14. Alan Crane & Kevin Crotty, 2020. "How Skilled Are Security Analysts?," Journal of Finance, American Finance Association, vol. 75(3), pages 1629-1675, June.
    15. Mur, Jesús & Angulo, Ana, 2009. "Model selection strategies in a spatial setting: Some additional results," Regional Science and Urban Economics, Elsevier, vol. 39(2), pages 200-213, March.
    16. Byrd, T. A. & Marshall, T. E., 1997. "Relating information technology investment to organizational performance: a causal model analysis," Omega, Elsevier, vol. 25(1), pages 43-56, February.
    17. Silvia Bacci & Francesco Bartolucci & Giulia Bettin & Claudia Pigini, 2017. "A mixture growth model for migrants' remittances: An application to the German Socio-Economic Panel," Mo.Fi.R. Working Papers 145, Money and Finance Research group (Mo.Fi.R.) - Univ. Politecnica Marche - Dept. Economic and Social Sciences.
    18. Aline Riboli Marasca & Maurício Scopel Hoffmann & Anelise Reis Gaya & Denise Ruschel Bandeira, 2021. "Subjective Well-Being and Psychopathology Symptoms: Mental Health Profiles and their Relations with Academic Achievement in Brazilian Children," Child Indicators Research, Springer;The International Society of Child Indicators (ISCI), vol. 14(3), pages 1121-1137, June.
    19. Hamparsum Bozdogan, 1987. "Model selection and Akaike's Information Criterion (AIC): The general theory and its analytical extensions," Psychometrika, Springer;The Psychometric Society, vol. 52(3), pages 345-370, September.
    20. Golob, Thomas F. & Regan, A C, 2002. "Trucking Industry Preferences for Driver Traveler Information Using Wireless Internet-enabled Devices," University of California Transportation Center, Working Papers qt40q8h6sf, University of California Transportation Center.
    21. Schreier, Alayna & Stenersen, Madeline R. & Strambler, Michael J. & Marshall, Tim & Bracey, Jeana & Kaufman, Joy S., 2023. "Needs of caregivers of youth enrolled in a statewide system of care: A latent class analysis," Children and Youth Services Review, Elsevier, vol. 147(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:sagope:v:7:y:2017:i:1:p:2158244017700459. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.