IDEAS home Printed from https://ideas.repec.org/a/sae/jedbes/v42y2017i4p432-466.html
   My bibliography  Save this article

A Comparison of Joint Model and Fully Conditional Specification Imputation for Multilevel Missing Data

Author

Listed:
  • Stephen A. Mistler

    (SAS Institute)

  • Craig K. Enders

    (University of California, Los Angeles)

Abstract

Multiple imputation methods can generally be divided into two broad frameworks: joint model (JM) imputation and fully conditional specification (FCS) imputation. JM draws missing values simultaneously for all incomplete variables using a multivariate distribution, whereas FCS imputes variables one at a time from a series of univariate conditional distributions. In single-level multivariate normal data, these two approaches have been shown to be equivalent, but less is known about their similarities and differences with multilevel data. This study examined four multilevel multiple imputation approaches: JM approaches proposed by Schafer and Yucel and Asparouhov and Muthén and FCS methods described by van Buuren and Carpenter and Kenward. Analytic work and computer simulations showed that Asparouhov and Muthén and Carpenter and Kenward methods are most flexible, as they produce imputations that preserve distinct within- and between-cluster covariance structures. As such, these approaches are applicable to random intercept models that posit level-specific relations among variables (e.g., contextual effects analyses, multilevel structural equation models). In contrast, methods from Schafer and Yucel and van Buuren are more restrictive and impose implicit equality constraints on functions of the within- and between-cluster covariance matrices. The analytic work and simulations underscore the conclusion that researchers should not expect to obtain the same results from alternative imputation routines. Rather, it is important to choose an imputation method that partitions variation in a manner that is consistent with the analysis model of interest. A real data analysis example illustrates the various approaches.

Suggested Citation

  • Stephen A. Mistler & Craig K. Enders, 2017. "A Comparison of Joint Model and Fully Conditional Specification Imputation for Multilevel Missing Data," Journal of Educational and Behavioral Statistics, , vol. 42(4), pages 432-466, August.
  • Handle: RePEc:sae:jedbes:v:42:y:2017:i:4:p:432-466
    DOI: 10.3102/1076998617690869
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.3102/1076998617690869
    Download Restriction: no

    File URL: https://libkey.io/10.3102/1076998617690869?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Joseph L. Schafer, 2003. "Multiple Imputation in Multivariate Problems When the Imputation and Analysis Models Differ," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 57(1), pages 19-35, February.
    2. Carpenter, James R. & Goldstein, Harvey & Kenward, Michael G., 2011. "REALCOM-IMPUTE Software for Multilevel Multiple Imputation with Mixed Response Types," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 45(i05).
    3. Yongyun Shin & Stephen W. Raudenbush, 2010. "A Latent Cluster-Mean Approach to the Contextual Effects Model With Missing Data," Journal of Educational and Behavioral Statistics, , vol. 35(1), pages 26-53, February.
    4. Yongyun Shin & Stephen W. Raudenbush, 2007. "Just-Identified Versus Overidentified Two-Level Hierarchical Linear Models with Missing Data," Biometrics, The International Biometric Society, vol. 63(4), pages 1262-1268, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Simon Grund & Oliver Lüdtke & Alexander Robitzsch, 2016. "Multiple Imputation of Multilevel Missing Data," SAGE Open, , vol. 6(4), pages 21582440166, October.
    2. Marquez, Jose & Qualter, Pamela & Petersen, Kimberly & Humphrey, Neil & Black, Louise, 2022. "In a lonely place: Neighbourhood effects on loneliness among adolescents," SocArXiv hzer5, Center for Open Science.
    3. Simon Grund & Oliver Lüdtke & Alexander Robitzsch, 2018. "Multiple Imputation of Missing Data at Level 2: A Comparison of Fully Conditional and Joint Modeling in Multilevel Designs," Journal of Educational and Behavioral Statistics, , vol. 43(3), pages 316-353, June.
    4. H. Christoph Steinhardt & Jan Delhey, 2020. "Socio-Economic Modernization and the “Crisis of Trust” in China: A Multi-level Analysis of General and Particular Trust," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 152(3), pages 923-949, December.
    5. Sarah Mustillo, 2012. "The Effects of Auxiliary Variables on Coefficient Bias and Efficiency in Multiple Imputation," Sociological Methods & Research, , vol. 41(2), pages 335-361, May.
    6. Juan Aparicio & Jose M. Cordero & Lidia Ortiz, 2021. "Efficiency Analysis with Educational Data: How to Deal with Plausible Values from International Large-Scale Assessments," Mathematics, MDPI, vol. 9(13), pages 1-16, July.
    7. Yongyun Shin & Stephen Raudenbush, 2012. "Confidence Bounds and Power for the Reliability of Observational Measures on the Quality of a Social Setting," Psychometrika, Springer;The Psychometric Society, vol. 77(3), pages 543-560, July.
    8. Thelma Dede Baddoo & Zhijia Li & Samuel Nii Odai & Kenneth Rodolphe Chabi Boni & Isaac Kwesi Nooni & Samuel Ato Andam-Akorful, 2021. "Comparison of Missing Data Infilling Mechanisms for Recovering a Real-World Single Station Streamflow Observation," IJERPH, MDPI, vol. 18(16), pages 1-26, August.
    9. Oya Kalaycioglu & Andrew Copas & Michael King & Rumana Z. Omar, 2016. "A comparison of multiple-imputation methods for handling missing data in repeated measurements observational studies," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 179(3), pages 683-706, June.
    10. Shaun R. Seaman & Ian R. White & Andrew J. Copas & Leah Li, 2012. "Combining Multiple Imputation and Inverse-Probability Weighting," Biometrics, The International Biometric Society, vol. 68(1), pages 129-137, March.
    11. Leckie, George & Charlton, Chris, 2013. "runmlwin: A Program to Run the MLwiN Multilevel Modeling Software from within Stata," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 52(i11).
    12. Andrew Bell & Malcolm Fairbrother & Kelvyn Jones, 2019. "Fixed and random effects models: making an informed choice," Quality & Quantity: International Journal of Methodology, Springer, vol. 53(2), pages 1051-1074, March.
    13. Joonmo Son & Qiushi Feng, 2019. "In Social Capital We Trust?," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 144(1), pages 167-189, July.
    14. repec:jss:jstsof:45:i01 is not listed on IDEAS
    15. Nicholas J. Rockwood, 2020. "Maximum Likelihood Estimation of Multilevel Structural Equation Models with Random Slopes for Latent Covariates," Psychometrika, Springer;The Psychometric Society, vol. 85(2), pages 275-300, June.
    16. Bell, Andrew & Jones, Kelvyn, 2015. "Explaining Fixed Effects: Random Effects Modeling of Time-Series Cross-Sectional and Panel Data," Political Science Research and Methods, Cambridge University Press, vol. 3(1), pages 133-153, January.
    17. Shane A Kavanagh & Julia M Shelley & Christopher Stevenson, 2018. "Is gender inequity a risk factor for men reporting poorer self-rated health in the United States?," PLOS ONE, Public Library of Science, vol. 13(7), pages 1-15, July.
    18. Anna Ivanova & Geert Molenberghs & Geert Verbeke, 2017. "Mechanism for missing data incorporated in joint modelling of ordinal responses," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 66(5), pages 1049-1064, November.
    19. Keenan A. Pituch & Laura M. Stapleton, 2012. "Distinguishing Between Cross- and Cluster-Level Mediation Processes in the Cluster Randomized Trial," Sociological Methods & Research, , vol. 41(4), pages 630-670, November.
    20. Manuel Gomes & Nils Gutacker & Chris Bojke & Andrew Street, 2016. "Addressing Missing Data in Patient‐Reported Outcome Measures (PROMS): Implications for the Use of PROMS for Comparing Provider Performance," Health Economics, John Wiley & Sons, Ltd., vol. 25(5), pages 515-528, May.
    21. Beunckens, Caroline & Sotto, Cristina & Molenberghs, Geert, 2008. "A simulation study comparing weighted estimating equations with multiple imputation based estimating equations for longitudinal binary data," Computational Statistics & Data Analysis, Elsevier, vol. 52(3), pages 1533-1548, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jedbes:v:42:y:2017:i:4:p:432-466. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.