IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v165y2018icp166-179.html
   My bibliography  Save this article

MATS: Inference for potentially singular and heteroscedastic MANOVA

Author

Listed:
  • Friedrich, Sarah
  • Pauly, Markus

Abstract

In many experiments in the life sciences, several endpoints are recorded per subject. The analysis of such multivariate data is usually based on MANOVA models assuming multivariate normality and covariance homogeneity. These assumptions, however, are often not met in practice. Furthermore, test statistics should be invariant under scale transformations of the data, since the endpoints may be measured on different scales. In the context of high-dimensional data, Srivastava and Kubokawa (2013) proposed such a test statistic for a specific one-way model; however, it relies on the assumption of a common non-singular covariance matrix. We modify and extend this test statistic to factorial MANOVA designs, incorporating general heteroscedastic models. In particular, our only distributional assumption is the existence of the group-wise covariance matrices, which may even be singular. We base inference on quantiles of resampling distributions, and derive confidence regions and ellipsoids based on these quantiles. In a simulation study, we extensively analyze the behavior of these procedures. Finally, the methods are applied to a data set containing information on the 2016 presidential elections in the USA with unequal and singular empirical covariance matrices.

Suggested Citation

  • Friedrich, Sarah & Pauly, Markus, 2018. "MATS: Inference for potentially singular and heteroscedastic MANOVA," Journal of Multivariate Analysis, Elsevier, vol. 165(C), pages 166-179.
  • Handle: RePEc:eee:jmvana:v:165:y:2018:i:c:p:166-179
    DOI: 10.1016/j.jmva.2017.12.008
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047259X17302701
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jmva.2017.12.008?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. A. Colin Cameron & Jonah B. Gelbach & Douglas L. Miller, 2008. "Bootstrap-Based Improvements for Inference with Clustered Errors," The Review of Economics and Statistics, MIT Press, vol. 90(3), pages 414-427, August.
    2. Davidson, Russell & Flachaire, Emmanuel, 2008. "The wild bootstrap, tamed at last," Journal of Econometrics, Elsevier, vol. 146(1), pages 162-169, September.
    3. Bathke, Arne C. & Harrar, Solomon W. & Madden, Laurence V., 2008. "How to compare small multivariate samples using nonparametric tests," Computational Statistics & Data Analysis, Elsevier, vol. 52(11), pages 4951-4965, July.
    4. Solomon Harrar & Arne Bathke, 2012. "Erratum to: A modified two-factor multivariate analysis of variance: asymptotics and small sample approximations," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 64(5), pages 1087-1087, October.
    5. Van Aelst, Stefan & Willems, Gert, 2013. "Fast and Robust Bootstrap for Multivariate Inference: The R Package FRB," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 53(i03).
    6. Solomon Harrar & Arne Bathke, 2012. "A modified two-factor multivariate analysis of variance: asymptotics and small sample approximations," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 64(1), pages 135-165, February.
    7. Friedrich, Sarah & Konietschke, Frank & Pauly, Markus, 2017. "A wild bootstrap approach for nonparametric repeated measurements," Computational Statistics & Data Analysis, Elsevier, vol. 113(C), pages 38-52.
    8. Liu, Chunxu & Bathke, Arne C. & Harrar, Solomon W., 2011. "A nonparametric version of Wilks' lambda--Asymptotic results and small sample approximations," Statistics & Probability Letters, Elsevier, vol. 81(10), pages 1502-1506, October.
    9. Edgar Brunner & Frank Konietschke & Markus Pauly & Madan L. Puri, 2017. "Rank-based procedures in factorial designs: hypotheses about non-parametric treatment effects," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(5), pages 1463-1485, November.
    10. A. Colin Cameron & Douglas L. Miller, 2015. "A Practitioner’s Guide to Cluster-Robust Inference," Journal of Human Resources, University of Wisconsin Press, vol. 50(2), pages 317-372.
    11. Chung, EunYi & Romano, Joseph P., 2016. "Multivariate and multiple permutation tests," Journal of Econometrics, Elsevier, vol. 193(1), pages 76-91.
    12. Edgar Brunner & Madan Puri, 2001. "Nonparametric methods in factorial designs," Statistical Papers, Springer, vol. 42(1), pages 1-52, January.
    13. Friedrich, Sarah & Brunner, Edgar & Pauly, Markus, 2017. "Permuting longitudinal data in spite of the dependencies," Journal of Multivariate Analysis, Elsevier, vol. 153(C), pages 255-265.
    14. Van Aelst, Stefan & Willems, Gert, 2011. "Robust and Efficient One-Way MANOVA Tests," Journal of the American Statistical Association, American Statistical Association, vol. 106(494), pages 706-718.
    15. Xu, Li-Wen & Yang, Fang-Qin & Abula, Aji’erguli & Qin, Shuang, 2013. "A parametric bootstrap approach for two-way ANOVA in presence of possible interactions with unequal variances," Journal of Multivariate Analysis, Elsevier, vol. 115(C), pages 172-180.
    16. Brunner, Edgar & Munzel, Ulrich & Puri, Madan L., 1999. "Rank-Score Tests in Factorial Designs with Repeated Measures," Journal of Multivariate Analysis, Elsevier, vol. 70(2), pages 286-317, August.
    17. Konietschke, Frank & Bathke, Arne C. & Harrar, Solomon W. & Pauly, Markus, 2015. "Parametric and nonparametric bootstrap methods for general MANOVA," Journal of Multivariate Analysis, Elsevier, vol. 140(C), pages 291-301.
    18. Srivastava, Muni S. & Kubokawa, Tatsuya, 2013. "Tests for multivariate analysis of variance in high dimension under non-normality," Journal of Multivariate Analysis, Elsevier, vol. 115(C), pages 204-216.
    19. Jan Beyersmann & Susanna Di Termini & Markus Pauly, 2013. "Weak Convergence of the Wild Bootstrap for the Aalen–Johansen Estimator of the Cumulative Incidence Function of a Competing Risk," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 40(3), pages 387-402, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Welz, Thilo & Viechtbauer, Wolfgang & Pauly, Markus, 2023. "Cluster-robust estimators for multivariate mixed-effects meta-regression," Computational Statistics & Data Analysis, Elsevier, vol. 179(C).
    2. Juan Carlos García & Emiliano Díez & Dominika Z. Wojcik & Mónica Santamaría, 2020. "Communication Support Needs in Adults with Intellectual Disabilities and Its Relation to Quality of Life," IJERPH, MDPI, vol. 17(20), pages 1-16, October.
    3. Zimmermann, Georg & Pauly, Markus & Bathke, Arne C., 2020. "Multivariate analysis of covariance with potentially singular covariance matrices and non-normal responses," Journal of Multivariate Analysis, Elsevier, vol. 177(C).
    4. Dennis Dobler & Sarah Friedrich & Markus Pauly, 2020. "Nonparametric MANOVA in meaningful effects," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 72(4), pages 997-1022, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dennis Dobler & Sarah Friedrich & Markus Pauly, 2020. "Nonparametric MANOVA in meaningful effects," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 72(4), pages 997-1022, August.
    2. Konietschke, Frank & Bathke, Arne C. & Harrar, Solomon W. & Pauly, Markus, 2015. "Parametric and nonparametric bootstrap methods for general MANOVA," Journal of Multivariate Analysis, Elsevier, vol. 140(C), pages 291-301.
    3. Friedrich, Sarah & Konietschke, Frank & Pauly, Markus, 2017. "A wild bootstrap approach for nonparametric repeated measurements," Computational Statistics & Data Analysis, Elsevier, vol. 113(C), pages 38-52.
    4. Zimmermann, Georg & Pauly, Markus & Bathke, Arne C., 2020. "Multivariate analysis of covariance with potentially singular covariance matrices and non-normal responses," Journal of Multivariate Analysis, Elsevier, vol. 177(C).
    5. Harrar, Solomon W. & Kong, Xiaoli, 2022. "Recent developments in high-dimensional inference for multivariate data: Parametric, semiparametric and nonparametric approaches," Journal of Multivariate Analysis, Elsevier, vol. 188(C).
    6. Umlauft, Maria & Placzek, Marius & Konietschke, Frank & Pauly, Markus, 2019. "Wild bootstrapping rank-based procedures: Multiple testing in nonparametric factorial repeated measures designs," Journal of Multivariate Analysis, Elsevier, vol. 171(C), pages 176-192.
    7. Xu, Li-Wen, 2015. "Parametric bootstrap approaches for two-way MANOVA with unequal cell sizes and unequal cell covariance matrices," Journal of Multivariate Analysis, Elsevier, vol. 133(C), pages 291-303.
    8. James G. MacKinnon & Matthew D. Webb & Morten Ø. Nielsen, 2017. "Bootstrap And Asymptotic Inference With Multiway Clustering," Working Paper 1386, Economics Department, Queen's University.
    9. James G. MacKinnon & Morten Ørregaard Nielsen & Matthew D. Webb, 2023. "Fast and reliable jackknife and bootstrap methods for cluster‐robust inference," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(5), pages 671-694, August.
    10. Rosa Arboretti & Riccardo Ceccato & Livio Corain & Fabrizio Ronchi & Luigi Salmaso, 2018. "Multivariate small sample tests for two-way designs with applications to industrial statistics," Statistical Papers, Springer, vol. 59(4), pages 1483-1503, December.
    11. MacKinnon, James G. & Nielsen, Morten Ørregaard & Webb, Matthew D., 2023. "Cluster-robust inference: A guide to empirical practice," Journal of Econometrics, Elsevier, vol. 232(2), pages 272-299.
    12. Gunawardana, Asanka & Konietschke, Frank, 2019. "Nonparametric multiple contrast tests for general multivariate factorial designs," Journal of Multivariate Analysis, Elsevier, vol. 173(C), pages 165-180.
    13. MacKinnon, James G. & Nielsen, Morten Ørregaard & Webb, Matthew D., 2023. "Testing for the appropriate level of clustering in linear regression models," Journal of Econometrics, Elsevier, vol. 235(2), pages 2027-2056.
    14. Doko Tchatoka, Firmin & Wang, Wenjie, 2021. "Size-corrected Bootstrap Test after Pretesting for Exogeneity with Heteroskedastic or Clustered Data," MPRA Paper 110899, University Library of Munich, Germany.
    15. Congdon Fors, Heather & Houngbedji, Kenneth & Lindskog, Annika, 2019. "Land certification and schooling in rural Ethiopia," World Development, Elsevier, vol. 115(C), pages 190-208.
    16. Yang He & Otávio Bartalotti, 2020. "Wild bootstrap for fuzzy regression discontinuity designs: obtaining robust bias-corrected confidence intervals [Using Maimonides’ rule to estimate the effect of class size on scholastic achievemen," The Econometrics Journal, Royal Economic Society, vol. 23(2), pages 211-231.
    17. Antoine A. Djogbenou & James G. MacKinnon & Morten Ø. Nielsen, 2017. "Validity Of Wild Bootstrap Inference With Clustered Errors," Working Paper 1383, Economics Department, Queen's University.
    18. James G. MacKinnon & Morten Ørregaard Nielsen & Matthew D. Webb, 2021. "Wild Bootstrap and Asymptotic Inference With Multiway Clustering," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(2), pages 505-519, March.
    19. Debajit Chatterjee & Uttam Bandyopadhyay, 2019. "Testing in nonparametric ANCOVA model based on ridit reliability functional," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 71(2), pages 327-364, April.
    20. James G. MacKinnon & Matthew D. Webb, 2017. "Pitfalls When Estimating Treatment Effects Using Clustered Data," Working Paper 1387, Economics Department, Queen's University.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:165:y:2018:i:c:p:166-179. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.