IDEAS home Printed from https://ideas.repec.org/a/tsj/stataj/v9y2009i3p388-397.html
   My bibliography  Save this article

Improved degrees of freedom for multivariate significance tests obtained from multiply imputed, small-sample data

Author

Listed:
  • Yulia V. Marchenko

    (StataCorp)

  • Jerome P. Reiter

    (Duke University)

Abstract

We propose improvements to existing degrees of freedom used for significance testing of multivariate hypotheses in small samples when missing data are handled using multiple imputation. The improvements are for 1) tests based on unrestricted fractions of missing information and 2) tests based on equal fractions of missing information with M (p − 1) ≤ 4, where M is the number of imputations and p is the number of tested parameters. Using the mi command available as of Stata 11, we demonstrate via simulation that using these adjustments can result in a more sensible degrees of freedom (and hence closer-to-nominal rejection rates) than existing degrees of freedom. Copyright 2009 by StataCorp LP.

Suggested Citation

  • Yulia V. Marchenko & Jerome P. Reiter, 2009. "Improved degrees of freedom for multivariate significance tests obtained from multiply imputed, small-sample data," Stata Journal, StataCorp LP, vol. 9(3), pages 388-397, September.
    • Handle: RePEc:tsj:stataj:v:9:y:2009:i:3:p:388-397
    as

    Download full text from publisher

    File URL: http://www.stata-journal.com/article.html?article=st0170
    File Function: link to article download
    Download Restriction: no
    File URL: http://www.stata-journal.com/software/sj9-3/st0170/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jerome P. Reiter, 2007. "Small-sample degrees of freedom for multi-component significance tests with multiple imputation for missing data," Biometrika, Biometrika Trust, vol. 94(2), pages 502-508.
    2. Patrick Royston & John B. Carlin & Ian R. White, 2009. "Multiple imputation of missing values: New features for mim," Stata Journal, StataCorp LP, vol. 9(2), pages 252-264, June.
    3. Patrick Royston, 2004. "Multiple imputation of missing values," Stata Journal, StataCorp LP, vol. 4(3), pages 227-241, September.
    4. Reiter, Jerome P. & Raghunathan, Trivellore E., 2007. "The Multiple Adaptations of Multiple Imputation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 1462-1471, December.
    5. John B. Carlin & John C. Galati & Patrick Royston, 2008. "A new framework for managing and analyzing multiply imputed data in Stata," Stata Journal, StataCorp LP, vol. 8(1), pages 49-67, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. David A. Wagstaff & Ofer Harel, 2011. "A closer examination of three small-sample approximations to the multiple-imputation degrees of freedom," Stata Journal, StataCorp LP, vol. 11(3), pages 403-419, September.
    2. Patrick Royston, 2009. "Multiple imputation of missing values: Further update of ice, with an emphasis on categorical variables," Stata Journal, StataCorp LP, vol. 9(3), pages 466-477, September.
    3. Yajuan Si & Jerome P. Reiter, 2013. "Nonparametric Bayesian Multiple Imputation for Incomplete Categorical Variables in Large-Scale Assessment Surveys," Journal of Educational and Behavioral Statistics, , vol. 38(5), pages 499-521, October.
    4. Elke Lüdemann, 2011. "Schooling and the Formation of Cognitive and Non-cognitive Outcomes," ifo Beiträge zur Wirtschaftsforschung, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, number 39.
    5. H. Joseph Newton & Nicholas J. Cox, 2016. "The Stata Journal Editors' Prize 2016: Patrick Royston," Stata Journal, StataCorp LP, vol. 16(4), pages 815-825, December.
    6. Paul Watts & Gemma Phillips & Mark Petticrew & Richard Hayes & Christian Bottomley & Ge Yu & Elena Schmidt & Patrick Tobi & Derek Moore & Caroline Frostick & Karen Lock & Adrian Renton, 2013. "Physical Activity in Deprived Communities in London: Examining Individual and Neighbourhood-Level Factors," PLOS ONE, Public Library of Science, vol. 8(7), pages 1-8, July.
    7. Andrew F Auld & Francisco Mbofana & Ray W Shiraishi & Charity Alfredo & Mauro Sanchez & Tedd V Ellerbrock & Lisa J Nelson, 2013. "Incidence and Determinants of Tuberculosis among Adults Initiating Antiretroviral Therapy – Mozambique, 2004–2008," PLOS ONE, Public Library of Science, vol. 8(1), pages 1-11, January.
    8. Peter A. Lachenbruch, 2010. "Stata tip 89: Estimating means and percentiles following multiple imputation," Stata Journal, StataCorp LP, vol. 10(3), pages 496-499, September.
    9. Wesley Eddings & Yulia Marchenko, 2012. "Diagnostics for multiple imputation in Stata," Stata Journal, StataCorp LP, vol. 12(3), pages 353-367, September.
    10. Simon Grund & Oliver Lüdtke & Alexander Robitzsch, 2016. "Multiple Imputation of Multilevel Missing Data," SAGE Open, , vol. 6(4), pages 21582440166, October.
    11. Mauro Mediavilla Bordalejo, 2010. "Las becas y ayudas al estudio como elemento determinante de la continuidad escolar en el nivel secundario post-obligatorio. Un análisis de sensibilidad a partir de la aplicación del Propensity Score M," Investigaciones de Economía de la Educación volume 5, in: María Jesús Mancebón-Torrubia & Domingo P. Ximénez-de-Embún & José María Gómez-Sancho & Gregorio Gim (ed.), Investigaciones de Economía de la Educación 5, edition 1, volume 5, chapter 29, pages 561-582, Asociación de Economía de la Educación.
    12. Stephen Vaisey, 2010. "What People Want: Rethinking Poverty, Culture, and Educational Attainment," The ANNALS of the American Academy of Political and Social Science, , vol. 629(1), pages 75-101, May.
    13. White, Ian R. & Daniel, Rhian & Royston, Patrick, 2010. "Avoiding bias due to perfect prediction in multiple imputation of incomplete categorical variables," Computational Statistics & Data Analysis, Elsevier, vol. 54(10), pages 2267-2275, October.
    14. Harald Schoen, 2008. "Identity, Instrumental Self-Interest and Institutional Evaluations," European Union Politics, , vol. 9(1), pages 5-29, March.
    15. Julia S. Goldberg, 2011. "Identity Salience and Involvement among Resident and Nonresident Fathers," Working Papers 1323, Princeton University, School of Public and International Affairs, Center for Research on Child Wellbeing..
    16. Hilde Coffe & Catherine Bolzendahl, 2011. "Gender Gaps in Political Participation Across Sub-Saharan African Nations," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 102(2), pages 245-264, June.
    17. Ronald Mincy & Jennifer Hill & Marilyn Sinkewicz, 2009. "Marriage: Cause or mere indicator of future earnings growth?," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 28(3), pages 417-439.
    18. Satkartar K. Kinney & Jerome P. Reiter & Javier Miranda, 2014. "Improving The Synthetic Longitudinal Business Database," Working Papers 14-12, Center for Economic Studies, U.S. Census Bureau.
    19. John Bound & Michael F. Lovenheim & Sarah Turner, 2010. "Why Have College Completion Rates Declined? An Analysis of Changing Student Preparation and Collegiate Resources," American Economic Journal: Applied Economics, American Economic Association, vol. 2(3), pages 129-157, July.
    20. repec:mpr:mprres:7638 is not listed on IDEAS
    21. von Hinke Kessler Scholder S, 2009. "Genetic Markers as Instrumental Variables: An Application to Child Fat Mass and Academic Achievement," Health, Econometrics and Data Group (HEDG) Working Papers 09/25, HEDG, c/o Department of Economics, University of York.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tsj:stataj:v:9:y:2009:i:3:p:388-397. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Christopher F. Baum or Lisa Gilmore (email available below). General contact details of provider: http://www.stata-journal.com/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.