IDEAS home Printed from https://ideas.repec.org/a/bla/jorssc/v71y2022i1p219-243.html
   My bibliography  Save this article

Multiple comparison procedures for discrete uniform and homogeneous tests

Author

Listed:
  • Marta Cousido‐Rocha
  • Jacobo de Uña‐Álvarez
  • Sebastian Döhler

Abstract

Discrete uniform and homogeneous p‐values often arise in applications with multiple testing. For example, this occurs in genome wide association studies whenever a non‐parametric one‐sample (or two‐sample) test is applied throughout the gene loci. In this paper, we consider multiple comparison procedures for such scenarios based on several existing estimators for the proportion of true null hypotheses, π0, which take the discreteness of the p‐values into account. The theoretical guarantees of the several approaches with respect to the estimation of π0 and the false discovery rate control are reviewed. The performance of the discrete procedures is investigated through intensive Monte Carlo simulations considering both independent and dependent p‐values. The methods are applied to three real data sets for illustration purposes too. Since the particular estimator of π0 used to compute the q‐values may influence its performance, relative advantages and disadvantages of the reviewed procedures are discussed. Practical recommendations are given.

Suggested Citation

  • Marta Cousido‐Rocha & Jacobo de Uña‐Álvarez & Sebastian Döhler, 2022. "Multiple comparison procedures for discrete uniform and homogeneous tests," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 71(1), pages 219-243, January.
    • Handle: RePEc:bla:jorssc:v:71:y:2022:i:1:p:219-243
    DOI: 10.1111/rssc.12529
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/rssc.12529
    Download Restriction: no
    File URL: https://libkey.io/10.1111/rssc.12529?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Peter B. Gilbert, 2005. "A modified false discovery rate multiple‐comparisons procedure for discrete data, applied to human immunodeficiency virus genetics," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 54(1), pages 143-158, January.
    2. Dickhaus Thorsten & Straßburger Klaus & Schunk Daniel & Morcillo-Suarez Carlos & Illig Thomas & Navarro Arcadi, 2012. "How to analyze many contingency tables simultaneously in genetic association studies," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 11(4), pages 1-33, July.
    3. French, Kenneth R. & Roll, Richard, 1986. "Stock return variances : The arrival of information and the reaction of traders," Journal of Financial Economics, Elsevier, vol. 17(1), pages 5-26, September.
    4. Grossman, Sanford J & Stiglitz, Joseph E, 1980. "On the Impossibility of Informationally Efficient Markets," American Economic Review, American Economic Association, vol. 70(3), pages 393-408, June.
    5. Kun Liang & Dan Nettleton, 2012. "Adaptive and dynamic adaptive procedures for false discovery rate control and estimation," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 74(1), pages 163-182, January.
    6. Fama, Eugene F, 1970. "Efficient Capital Markets: A Review of Theory and Empirical Work," Journal of Finance, American Finance Association, vol. 25(2), pages 383-417, May.
    7. John D. Storey & Jonathan E. Taylor & David Siegmund, 2004. "Strong control, conservative point estimation and simultaneous conservative consistency of false discovery rates: a unified approach," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 66(1), pages 187-205, February.
    8. Kun Liang, 2016. "False discovery rate estimation for large-scale homogeneous discrete p-values," Biometrics, The International Biometric Society, vol. 72(2), pages 639-648, June.
    9. Elena Kulinskaya & Alex Lewin, 2009. "On fuzzy familywise error rate and false discovery rate procedures for discrete distributions," Biometrika, Biometrika Trust, vol. 96(1), pages 201-211.
    10. Yoav Benjamini, 2010. "Discovering the false discovery rate," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(4), pages 405-416, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Georgios Sermpinis & Arman Hassanniakalager & Charalampos Stasinakis & Ioannis Psaradellis, 2018. "Technical Analysis and Discrete False Discovery Rate: Evidence from MSCI Indices," Papers 1811.06766, arXiv.org, revised Jun 2019.
    2. Sermpinis, Georgios & Hassanniakalager, Arman & Stasinakis, Charalampos & Psaradellis, Ioannis, 2021. "Technical analysis profitability and Persistence: A discrete false discovery approach on MSCI indices," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 73(C).
    3. Kin-Boon Tang & Shao-Jye Wong & Shih-Kuei Lin & Szu-Lang Liao, 2020. "Excess volatility and market efficiency in government bond markets: the ASEAN-5 context," Journal of Asset Management, Palgrave Macmillan, vol. 21(2), pages 154-165, March.
    4. Robert Litzenberger & Jeff Castura & Richard Gorelick, 2012. "The Impacts of Automation and High Frequency Trading on Market Quality," Annual Review of Financial Economics, Annual Reviews, vol. 4(1), pages 59-98, October.
    5. Scruggs, John T., 2007. "Noise trader risk: Evidence from the Siamese twins," Journal of Financial Markets, Elsevier, vol. 10(1), pages 76-105, February.
    6. Parthajit Kayal & Sayanti Mondal, 2020. "Speed of Price Adjustment in Indian Stock Market: A Paradox," Asia-Pacific Financial Markets, Springer;Japanese Association of Financial Economics and Engineering, vol. 27(4), pages 453-476, December.
    7. Giovanni Ferri & Doris Neuberger, 2014. "The Banking Regulatory Bubble and How to Get out of It," Rivista di Politica Economica, SIPI Spa, issue 2, pages 39-69, April-Jun.
    8. Thomas Schuster, 2003. "News Events and Price Movements. Price Effects of Economic and Non-Economic Publications in the News Media," Finance 0305009, University Library of Munich, Germany.
    9. Maloney, Michael T. & Mulherin, J. Harold, 2003. "The complexity of price discovery in an efficient market: the stock market reaction to the Challenger crash," Journal of Corporate Finance, Elsevier, vol. 9(4), pages 453-479, September.
    10. Ledenyov, Dimitri O. & Ledenyov, Viktor O., 2015. "Wave function method to forecast foreign currencies exchange rates at ultra high frequency electronic trading in foreign currencies exchange markets," MPRA Paper 67470, University Library of Munich, Germany.
    11. Committee, Nobel Prize, 2013. "Understanding Asset Prices," Nobel Prize in Economics documents 2013-1, Nobel Prize Committee.
    12. Wang, Li, 2022. "New testing procedures with k-FWER control for discrete data," Statistics & Probability Letters, Elsevier, vol. 180(C).
    13. Thanh Huong Nguyen, 2019. "Information and Noise in Stock Markets: Evidence on the Determinants and Effects Using New Empirical Measures," PhD Thesis, Finance Discipline Group, UTS Business School, University of Technology, Sydney, number 7-2019.
    14. Pereira da Silva, Paulo, 2021. "Do managers pay attention to the market? A review of the relationship between stock price informativeness and investment," Journal of Multinational Financial Management, Elsevier, vol. 59(C).
    15. Gary Chen & Bin Wang & Xiaohong Wang, 2021. "Corporate social responsibility and information flow," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 61(2), pages 2759-2807, June.
    16. Oxelheim, Lars & Rafferty, Michael, 2005. "On the static efficiency of secondary bond markets," Journal of Multinational Financial Management, Elsevier, vol. 15(2), pages 117-135, April.
    17. Xianfeng Jiang & Yongdong Shi, 2006. "The Impact of Insider Trading on the Secondary Market with Order-Driven System," Annals of Economics and Finance, Society for AEF, vol. 7(1), pages 129-143, May.
    18. Thomas Delcey, 2019. "Samuelson vs Fama on the Efficient Market Hypothesis: The Point of View of Expertise [Samuelson vs Fama sur l’efficience informationnelle des marchés financiers : le point de vue de l’expertise]," Post-Print hal-01618347, HAL.
    19. Yok-Yong Lee & M. H. Yahya & A. M. Bany-Ariffin & S. Aslam, 2018. "Leverage Effect and Switching of Market Efficiency Post Goods and Services Tax (GST) Imposition," International Business Research, Canadian Center of Science and Education, vol. 11(3), pages 162-178, March.
    20. Tetsushi Homma & Yoshiro Tsutsui & Uri Benzion, 2005. "Exchange rate and stock prices in Japan," Applied Financial Economics, Taylor & Francis Journals, vol. 15(7), pages 469-478.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jorssc:v:71:y:2022:i:1:p:219-243. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/rssssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.