IDEAS home Printed from https://ideas.repec.org/a/bpj/sagmbi/v10y2011i1n51.html
   My bibliography  Save this article

Multiple Testing in Candidate Gene Situations: A Comparison of Classical, Discrete, and Resampling-Based Procedures

Author

Listed:
  • Elsäßer Amelie

    (University Medical Center of Johannes Gutenberg University Mainz)

  • Victor Anja

    (Merck KGaA Germany)

  • Hommel Gerhard

    (University Medical Center of Johannes Gutenberg University Mainz)

Abstract

In candidate gene association studies, usually several elementary hypotheses are tested simultaneously using one particular set of data. The data normally consist of partly correlated SNP information. Every SNP can be tested for association with the disease, e.g., using the Cochran-Armitage test for trend. To account for the multiplicity of the test situation, different types of multiple testing procedures have been proposed. The question arises whether procedures taking into account the discreteness of the situation show a benefit especially in case of correlated data. We empirically evaluate several different multiple testing procedures via simulation studies using simulated correlated SNP data. We analyze FDR and FWER controlling procedures, special procedures for discrete situations, and the minP-resampling-based procedure. Within the simulation study, we examine a broad range of different gene data scenarios. We show that the main difference in the varying performance of the procedures is due to sample size. In small sample size scenarios, the minP-resampling procedure though controlling the stricter FWER even had more power than the classical FDR controlling procedures. In contrast, FDR controlling procedures led to more rejections in higher sample size scenarios.

Suggested Citation

  • Elsäßer Amelie & Victor Anja & Hommel Gerhard, 2011. "Multiple Testing in Candidate Gene Situations: A Comparison of Classical, Discrete, and Resampling-Based Procedures," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 10(1), pages 1-21, November.
    • Handle: RePEc:bpj:sagmbi:v:10:y:2011:i:1:n:51
    DOI: 10.2202/1544-6115.1729
    as

    Download full text from publisher

    File URL: https://doi.org/10.2202/1544-6115.1729
    Download Restriction: For access to full text, subscription to the journal or payment for the individual article is required.
    File URL: https://libkey.io/10.2202/1544-6115.1729?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Peter B. Gilbert, 2005. "A modified false discovery rate multiple‐comparisons procedure for discrete data, applied to human immunodeficiency virus genetics," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 54(1), pages 143-158, January.
    2. Neuhauser, Markus & Hothorn, Ludwig A., 1999. "An exact Cochran-Armitage test for trend when dose-response shapes are a priori unknown," Computational Statistics & Data Analysis, Elsevier, vol. 30(4), pages 403-412, June.
    3. Boulesteix Anne-Laure & Strobl Carolin & Weidinger Stefan & Wichmann H.-Erich & Wagenpfeil Stefan, 2007. "Multiple Testing for SNP-SNP Interactions," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 6(1), pages 1-24, December.
    4. Hothorn, Torsten & Hornik, Kurt & van de Wiel, Mark A. & Zeileis, Achim, 2006. "A Lego System for Conditional Inference," The American Statistician, American Statistical Association, vol. 60, pages 257-263, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tomáš Želinský, 2015. "Nekonzistentnosť časových preferencií ľudí z arginalizovaných rómskych komunít [On inconsistency of time preferences of people from the marginalised roma communities]," Politická ekonomie, Prague University of Economics and Business, vol. 2015(2), pages 204-222.
    2. Adler, Werner & Lausen, Berthold, 2009. "Bootstrap estimated true and false positive rates and ROC curve," Computational Statistics & Data Analysis, Elsevier, vol. 53(3), pages 718-729, January.
    3. repec:jss:jstsof:36:i02 is not listed on IDEAS
    4. Georgina Milne & Andrew William Byrne & Emma Campbell & Jordon Graham & John McGrath & Raymond Kirke & Wilma McMaster & Jesko Zimmermann & Adewale Henry Adenuga, 2022. "Quantifying Land Fragmentation in Northern Irish Cattle Enterprises," Land, MDPI, vol. 11(3), pages 1-16, March.
    5. Payton J. Jones & Patrick Mair & Thorsten Simon & Achim Zeileis, 2020. "Network Trees: A Method for Recursively Partitioning Covariance Structures," Psychometrika, Springer;The Psychometric Society, vol. 85(4), pages 926-945, December.
    6. Chen, Xiongzhi, 2019. "Uniformly consistently estimating the proportion of false null hypotheses via Lebesgue–Stieltjes integral equations," Journal of Multivariate Analysis, Elsevier, vol. 173(C), pages 724-744.
    7. Seibold Heidi & Hothorn Torsten & Zeileis Achim, 2016. "Model-Based Recursive Partitioning for Subgroup Analyses," The International Journal of Biostatistics, De Gruyter, vol. 12(1), pages 45-63, May.
    8. Kössler, Wolfgang, 2010. "Max-type rank tests, U-tests, and adaptive tests for the two-sample location problem -- An asymptotic power study," Computational Statistics & Data Analysis, Elsevier, vol. 54(9), pages 2053-2065, September.
    9. McGinlay, James & Parsons, David J. & Morris, Joe & Hubatova, Marie & Graves, Anil & Bradbury, Richard B. & Bullock, James M., 2017. "Do charismatic species groups generate more cultural ecosystem service benefits?," Ecosystem Services, Elsevier, vol. 27(PA), pages 15-24.
    10. Marc Ditzhaus & Arnold Janssen, 2020. "Bootstrap and permutation rank tests for proportional hazards under right censoring," Lifetime Data Analysis: An International Journal Devoted to Statistical Methods and Applications for Time-to-Event Data, Springer, vol. 26(3), pages 493-517, July.
    11. repec:jss:jstsof:28:i08 is not listed on IDEAS
    12. Torsten Hothorn & Achim Zeileis, 2008. "Generalized Maximally Selected Statistics," Biometrics, The International Biometric Society, vol. 64(4), pages 1263-1269, December.
    13. Jorge M. Arevalillo & Hilario Navarro, 2021. "Skewness-Kurtosis Model-Based Projection Pursuit with Application to Summarizing Gene Expression Data," Mathematics, MDPI, vol. 9(9), pages 1-18, April.
    14. Markus Neuhauser, 2006. "An exact test for trend among binomial proportions based on a modified Baumgartner-Weiss-Schindler statistic," Journal of Applied Statistics, Taylor & Francis Journals, vol. 33(1), pages 79-88.
    15. Henning Sommermeyer & Hanna Krauss & Zuzanna Chęcińska-Maciejewska & Marcin Pszczola & Jacek Piątek, 2020. "Infantile Colic—The Perspective of German and Polish Pediatricians in 2020," IJERPH, MDPI, vol. 17(19), pages 1-11, September.
    16. Chavez, Alex K. & Bicchieri, Cristina, 2013. "Third-party sanctioning and compensation behavior: Findings from the ultimatum game," Journal of Economic Psychology, Elsevier, vol. 39(C), pages 268-277.
    17. Raphael Knevels & Alexander Brenning & Simone Gingrich & Gerhard Heiss & Theresia Lechner & Philip Leopold & Christoph Plutzar & Herwig Proske & Helene Petschko, 2021. "Towards the Use of Land Use Legacies in Landslide Modeling: Current Challenges and Future Perspectives in an Austrian Case Study," Land, MDPI, vol. 10(9), pages 1-29, September.
    18. Hothorn, Torsten & Hornik, Kurt & van de Wiel, Mark A. & Zeileis, Achim, 2008. "Implementing a Class of Permutation Tests: The coin Package," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 28(i08).
    19. Döhler, Sebastian, 2018. "A discrete modification of the Benjamini–Yekutieli procedure," Econometrics and Statistics, Elsevier, vol. 5(C), pages 137-147.
    20. repec:jss:jstsof:34:i01 is not listed on IDEAS
    21. Bryan Keller, 2012. "Detecting Treatment Effects with Small Samples: The Power of Some Tests Under the Randomization Model," Psychometrika, Springer;The Psychometric Society, vol. 77(2), pages 324-338, April.
    22. Zeileis, Achim & Croissant, Yves, 2010. "Extended Model Formulas in R: Multiple Parts and Multiple Responses," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 34(i01).
    23. Nordhausen, Klaus & Oja, Hannu, 2011. "Multivariate L1 Statistical Methods: The Package MNM," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 43(i05).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bpj:sagmbi:v:10:y:2011:i:1:n:51. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Peter Golla (email available below). General contact details of provider: https://www.degruyter.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.