IDEAS home Printed from https://ideas.repec.org/a/spr/stpapr/v62y2021i3d10.1007_s00362-019-01134-7.html
   My bibliography  Save this article

Refined critical boundary with enhanced statistical power for non-directional two-sided tests in group sequential designs with multiple endpoints

Author

Listed:
  • Fengqing Zhang

    (Drexel University)

  • Jiangtao Gou

    (Villanova University)

Abstract

Group sequential designs with multiple endpoints are widely used in clinical trials and medical research. In the literature of group sequential designs with a single primary hypothesis, it was recommended to calculate the critical boundary for a symmetric non-directional two-sided test at the significance level $$\alpha $$ α by constructing a one-sided critical boundary at the significance level $$\alpha /2$$ α / 2 . As a natural but unvalidated extension, researchers may think the same conclusion holds for testing multiple endpoints in group sequential designs, that is, the critical boundary calculated to control the type I error at level $$\alpha /2$$ α / 2 for one-sided test also controls the type I error at level $$\alpha $$ α for non-directional two-sided tests. In this paper, we demonstrate that using one-sided $$\alpha /2$$ α / 2 -level critical boundaries for non-directional two-sided $$\alpha $$ α -level tests leads to notable and unnecessary conservativeness when multiple endpoints are hierarchically tested in group sequential designs. To the best of our knowledge, we are the first to reveal the relationship between the type I error rates of the two-sided and one-sided tests in hierarchical testing of multiple endpoints in group sequential designs. We consider three commonly used hierarchical structures for the primary and secondary endpoints, namely the stagewise hierarchical, overall hierarchical, and partially hierarchical structures. Under all three hierarchical structures, we refine the critical boundary for the secondary hypothesis. In addition, we prove that our boundary refinement methods yield enhanced statistical power. The proposed methodology is illustrated using a randomized clinical trial examining the effect of energy-reduced diets with different macronutrient compositions on body weight.

Suggested Citation

  • Fengqing Zhang & Jiangtao Gou, 2021. "Refined critical boundary with enhanced statistical power for non-directional two-sided tests in group sequential designs with multiple endpoints," Statistical Papers, Springer, vol. 62(3), pages 1265-1290, June.
  • Handle: RePEc:spr:stpapr:v:62:y:2021:i:3:d:10.1007_s00362-019-01134-7
    DOI: 10.1007/s00362-019-01134-7
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00362-019-01134-7
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s00362-019-01134-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Antoine Chambaz & Mark J. Laan, 2014. "Inference in Targeted Group-Sequential Covariate-Adjusted Randomized Clinical Trials," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 41(1), pages 104-140, March.
    2. Sevil Bacanli & Yaprak Demirhan, 2008. "A group sequential test for the inverse Gaussian mean," Statistical Papers, Springer, vol. 49(2), pages 377-386, April.
    3. A. Hussein & H. Muttlak & E. Al-Sawi, 2013. "Group sequential methods based on ranked set samples," Statistical Papers, Springer, vol. 54(3), pages 547-562, August.
    4. H. Finner & M. Roters & K. Strassburger, 2017. "On the Simes test under dependence," Statistical Papers, Springer, vol. 58(3), pages 775-789, September.
    5. Gudrun Bernhard & Markus Klein & Gerhard Hommel, 2004. "Global and multiple test procedures using ordered p-values—a review," Statistical Papers, Springer, vol. 45(1), pages 1-14, January.
    6. Dei-In Tang & Nancy L. Geller, 1999. "Closed Testing Procedures for Group Sequential Clinical Trials with Multiple Endpoints," Biometrics, The International Biometric Society, vol. 55(4), pages 1188-1192, December.
    7. Jiangtao Gou & Ajit C. Tamhane & Dong Xi & Dror Rom, 2014. "A class of improved hybrid Hochberg–Hommel type step-up multiple test procedures," Biometrika, Biometrika Trust, vol. 101(4), pages 899-911.
    8. Jay Bartroff & Jinlin Song, 2016. "A Rejection Principle for Sequential Tests of Multiple Hypotheses Controlling Familywise Error Rates," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 43(1), pages 3-19, March.
    9. Ajit C. Tamhane & Jiangtao Gou & Christopher Jennison & Cyrus R. Mehta & Teresa Curto, 2018. "A gatekeeping procedure to test a primary and a secondary endpoint in a group sequential design with multiple interim looks," Biometrics, The International Biometric Society, vol. 74(1), pages 40-48, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marco Marozzi, 2012. "A combined test for differences in scale based on the interquantile range," Statistical Papers, Springer, vol. 53(1), pages 61-72, February.
    2. Mar Fenoy & Pilar Ibarrola & Juan B. Seoane-Sepúlveda, 2019. "Generalized p value for multivariate Gaussian stochastic processes in continuous time," Statistical Papers, Springer, vol. 60(6), pages 2013-2030, December.
    3. Jay Bartroff & Jinlin Song, 2016. "A Rejection Principle for Sequential Tests of Multiple Hypotheses Controlling Familywise Error Rates," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 43(1), pages 3-19, March.
    4. Liu, Aiyi & Wu, Chengqing & Yu, Kai F. & Yuan, Weishi, 2007. "Completeness and unbiased estimation of mean vector in the multivariate group sequential case," Journal of Multivariate Analysis, Elsevier, vol. 98(3), pages 505-516, March.
    5. Ajit C. Tamhane & Jiangtao Gou & Christopher Jennison & Cyrus R. Mehta & Teresa Curto, 2018. "A gatekeeping procedure to test a primary and a secondary endpoint in a group sequential design with multiple interim looks," Biometrics, The International Biometric Society, vol. 74(1), pages 40-48, March.
    6. Peng Huang & Barbara C. Tilley & Robert F. Woolson & Stuart Lipsitz, 2005. "Adjusting O'Brien's Test to Control Type I Error for the Generalized Nonparametric Behrens–Fisher Problem," Biometrics, The International Biometric Society, vol. 61(2), pages 532-539, June.
    7. Michael A. Proschan & Dean A. Follmann, 2023. "A note on familywise error rate for a primary and secondary endpoint," Biometrics, The International Biometric Society, vol. 79(2), pages 1114-1118, June.
    8. Jesse Frey & Timothy G. Feeman, 2017. "Efficiency comparisons for partially rank-ordered set sampling," Statistical Papers, Springer, vol. 58(4), pages 1149-1163, December.
    9. Xiong, Peihan & Hu, Taizhong, 2022. "On Samuel’s p-value model and the Simes test under dependence," Statistics & Probability Letters, Elsevier, vol. 187(C).
    10. W. Brannath & P. Bauer & W. Maurer & M. Posch, 2003. "Sequential Tests for Noninferiority and Superiority," Biometrics, The International Biometric Society, vol. 59(1), pages 106-114, March.
    11. Cai, Gengqian & Sarkar, Sanat K., 2008. "Modified Simes' critical values under independence," Statistics & Probability Letters, Elsevier, vol. 78(12), pages 1362-1368, September.
    12. Jean Feng & Scott Emerson & Noah Simon, 2021. "Approval policies for modifications to machine learning‐based software as a medical device: A study of bio‐creep," Biometrics, The International Biometric Society, vol. 77(1), pages 31-44, March.
    13. Neal O. Jeffries & James F. Troendle & Nancy L. Geller, 2023. "Evaluating treatment effects in group sequential multivariate longitudinal studies with covariate adjustment," Biometrics, The International Biometric Society, vol. 79(2), pages 1496-1506, June.
    14. Moyé Lemuel A & Lai Dejian & Jing Kaiyan & Baraniuk Mary Sarah & Kwak Minjung & Penn Marc S. & Wu Colon O., 2011. "Combining Censored and Uncensored Data in a U-Statistic: Design and Sample Size Implications for Cell Therapy Research," The International Journal of Biostatistics, De Gruyter, vol. 7(1), pages 1-29, July.
    15. Ningning Xu & Aldo Solari & Jelle J. Goeman, 2023. "Closed testing with Globaltest, with application in metabolomics," Biometrics, The International Biometric Society, vol. 79(2), pages 1103-1113, June.
    16. Taddesse Kassahun & Eshetu Wencheko & Arne C. Bathke, 2023. "Nonparametric directional testing for multivariate problems in conjunction with a closed testing principle," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 32(2), pages 349-363, June.
    17. Ajit C. Tamhane & Cyrus R. Mehta & Lingyun Liu, 2010. "Testing a Primary and a Secondary Endpoint in a Group Sequential Design," Biometrics, The International Biometric Society, vol. 66(4), pages 1174-1184, December.
    18. Hai Zhu & Hongjian Zhu, 2023. "Covariate‐adjusted response‐adaptive designs based on semiparametric approaches," Biometrics, The International Biometric Society, vol. 79(4), pages 2895-2906, December.
    19. Martin Hellmich, 2001. "Monitoring Clinical Trials with Multiple Arms," Biometrics, The International Biometric Society, vol. 57(3), pages 892-898, September.
    20. Djalel-Eddine Meskaldji & Dimitri Van De Ville & Jean-Philippe Thiran & Stephan Morgenthaler, 2020. "A comprehensive error rate for multiple testing," Statistical Papers, Springer, vol. 61(5), pages 1859-1874, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:stpapr:v:62:y:2021:i:3:d:10.1007_s00362-019-01134-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.