IDEAS home Printed from https://ideas.repec.org/a/bla/jorssb/v77y2015i2p461-473.html
   My bibliography  Save this article

Asymptotic permutation tests in general factorial designs

Author

Listed:
  • Markus Pauly
  • Edgar Brunner
  • Frank Konietschke

Abstract

type="main" xml:id="rssb12073-abs-0001"> In general factorial designs where no homoscedasticity or a particular error distribution is assumed, the well-known Wald-type statistic is a simple asymptotically valid procedure. However, it is well known that it suffers from a poor finite sample approximation since the convergence to its χ-super-2 limit distribution is quite slow. This becomes even worse with an increasing number of factor levels. The aim of the paper is to improve the small sample behaviour of the Wald-type statistic, maintaining its applicability to general settings as crossed or hierarchically nested designs by applying a modified permutation approach. In particular, it is shown that this approach approximates the null distribution of the Wald-type statistic not only under the null hypothesis but also under the alternative yielding an asymptotically valid permutation test which is even finitely exact under exchangeability. Finally, its small sample behaviour is compared with competing procedures in an extensive simulation study.

Suggested Citation

  • Markus Pauly & Edgar Brunner & Frank Konietschke, 2015. "Asymptotic permutation tests in general factorial designs," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 77(2), pages 461-473, March.
    • Handle: RePEc:bla:jorssb:v:77:y:2015:i:2:p:461-473
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1111/rssb.2015.77.issue-2
    Download Restriction: Access to full text is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mondal, Anjana & Sattler, Paavo & Kumar, Somesh, 2023. "Testing against ordered alternatives in a two-way model without interaction under heteroscedasticity," Journal of Multivariate Analysis, Elsevier, vol. 196(C).
    2. Ditzhaus, Marc & Smaga, Łukasz, 2022. "Permutation test for the multivariate coefficient of variation in factorial designs," Journal of Multivariate Analysis, Elsevier, vol. 187(C).
    3. Meng Yuan & Chunlin Wang & Boxi Lin & Pengfei Li, 2022. "Semiparametric inference on general functionals of two semicontinuous populations," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 74(3), pages 451-472, June.
    4. Tobias Bluhmki & Dennis Dobler & Jan Beyersmann & Markus Pauly, 2019. "The wild bootstrap for multivariate Nelson–Aalen estimators," Lifetime Data Analysis: An International Journal Devoted to Statistical Methods and Applications for Time-to-Event Data, Springer, vol. 25(1), pages 97-127, January.
    5. Dennis Dobler & Markus Pauly, 2018. "Bootstrap- and permutation-based inference for the Mann–Whitney effect for right-censored and tied data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 27(3), pages 639-658, September.
    6. Konietschke, Frank & Bathke, Arne C. & Harrar, Solomon W. & Pauly, Markus, 2015. "Parametric and nonparametric bootstrap methods for general MANOVA," Journal of Multivariate Analysis, Elsevier, vol. 140(C), pages 291-301.
    7. H. V. Kulkarni & S. M. Patil, 2021. "Uniformly implementable small sample integrated likelihood ratio test for one-way and two-way ANOVA under heteroscedasticity and normality," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 105(2), pages 273-305, June.
    8. Friedrich, Sarah & Brunner, Edgar & Pauly, Markus, 2017. "Permuting longitudinal data in spite of the dependencies," Journal of Multivariate Analysis, Elsevier, vol. 153(C), pages 255-265.
    9. Wang, Chunlin & Marriott, Paul & Li, Pengfei, 2017. "Testing homogeneity for multiple nonnegative distributions with excess zero observations," Computational Statistics & Data Analysis, Elsevier, vol. 114(C), pages 146-157.
    10. Smaga, Łukasz, 2015. "Wald-type statistics using {2}-inverses for hypothesis testing in general factorial designs," Statistics & Probability Letters, Elsevier, vol. 107(C), pages 215-220.
    11. Chung, EunYi & Romano, Joseph P., 2016. "Multivariate and multiple permutation tests," Journal of Econometrics, Elsevier, vol. 193(1), pages 76-91.
    12. Ditzhaus, Marc & Pauly, Markus, 2019. "Wild bootstrap logrank tests with broader power functions for testing superiority," Computational Statistics & Data Analysis, Elsevier, vol. 136(C), pages 1-11.
    13. Markus Pauly & Maria Umlauft & Ali Ünlü, 2018. "Resampling-Based Inference Methods for Comparing Two Coefficients Alpha," Psychometrika, Springer;The Psychometric Society, vol. 83(1), pages 203-222, March.
    14. Marc Ditzhaus & Arnold Janssen, 2020. "Bootstrap and permutation rank tests for proportional hazards under right censoring," Lifetime Data Analysis: An International Journal Devoted to Statistical Methods and Applications for Time-to-Event Data, Springer, vol. 26(3), pages 493-517, July.
    15. Wang, Chunlin & Marriott, Paul & Li, Pengfei, 2018. "Semiparametric inference on the means of multiple nonnegative distributions with excess zero observations," Journal of Multivariate Analysis, Elsevier, vol. 166(C), pages 182-197.
    16. Yufan Wang & Xingzhong Xu, 2023. "Homogeneity Test for Multiple Semicontinuous Data with the Density Ratio Model," Mathematics, MDPI, vol. 11(17), pages 1-28, September.
    17. Dickhaus, Thorsten & Sirotko-Sibirskaya, Natalia, 2019. "Simultaneous statistical inference in dynamic factor models: Chi-square approximation and model-based bootstrap," Computational Statistics & Data Analysis, Elsevier, vol. 129(C), pages 30-46.
    18. Marinho Bertanha & Eunyi Chung, 2023. "Permutation Tests at Nonparametric Rates," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 118(544), pages 2833-2846, October.
    19. Zhao, Anqi & Ding, Peng, 2021. "Covariate-adjusted Fisher randomization tests for the average treatment effect," Journal of Econometrics, Elsevier, vol. 225(2), pages 278-294.
    20. Ingrid Burfurd & Tom Wilkening, 2022. "Cognitive heterogeneity and complex belief elicitation," Experimental Economics, Springer;Economic Science Association, vol. 25(2), pages 557-592, April.
    21. Marc Ditzhaus & Jon Genuneit & Arnold Janssen & Markus Pauly, 2023. "CASANOVA: Permutation inference in factorial survival designs," Biometrics, The International Biometric Society, vol. 79(1), pages 203-215, March.
    22. Tomasz Górecki & Łukasz Smaga, 2019. "fdANOVA: an R software package for analysis of variance for univariate and multivariate functional data," Computational Statistics, Springer, vol. 34(2), pages 571-597, June.
    23. Jesse Hemerik & Jelle J. Goeman & Livio Finos, 2020. "Robust testing in generalized linear models by sign flipping score contributions," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 82(3), pages 841-864, July.
    24. Marc Ditzhaus & Roland Fried & Markus Pauly, 2021. "QANOVA: quantile-based permutation methods for general factorial designs," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 30(4), pages 960-979, December.
    25. Hsin‐wen Chang & Ian W. McKeague, 2022. "Empirical likelihood‐based inference for functional means with application to wearable device data," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(5), pages 1947-1968, November.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jorssb:v:77:y:2015:i:2:p:461-473. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/rssssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.