IDEAS home Printed from https://ideas.repec.org/a/tsj/stataj/v10y2010i4p568-584.html
   My bibliography  Save this article

Frequentist q-values for multiple-test procedures

Author

Listed:
  • Roger B. Newson

    (National Heart and Lung Institute, Imperial College London)

Abstract

Multiple-test procedures are increasingly important as technology in- creases scientists’ ability to make large numbers of multiple measurements, as they do in genome scans. Multiple-test procedures were originally defined to input a vector of input p-values and an uncorrected critical p-value, interpreted as a fami- lywise error rate or a false discovery rate, and to output a corrected critical p-value and a discovery set, defined as the subset of input p-values that are at or below the corrected critical p-value. A range of multiple-test procedures is implemented us- ing the smileplot package in Stata (Newson and the ALSPAC Study Team 2003, Stata Journal 3: 109–132; 2010, Stata Journal 10: 691–692). The qqvalue com- mand uses an alternative formulation of multiple-test procedures, which is also used by the R function p.adjust. qqvalue inputs a variable of p-values and out- puts a variable of q-values that are equal in each observation to the minimum familywise error rate or false discovery rate that would result in the inclusion of the corresponding p-value in the discovery set if the specified multiple-test pro- cedure was applied to the full set of input p-values. Formulas and examples are presented. Copyright 2010 by StataCorp LP.

Suggested Citation

  • Roger B. Newson, 2010. "Frequentist q-values for multiple-test procedures," Stata Journal, StataCorp LP, vol. 10(4), pages 568-584, December.
  • Handle: RePEc:tsj:stataj:v:10:y:2010:i:4:p:568-584
    Note: to access software from within Stata, net describe http://www.stata-journal.com/software/sj10-4/st0209/
    as

    Download full text from publisher

    File URL: http://www.stata-journal.com/article.html?article=st0209
    File Function: link to article purchase
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Roger Newson & The ALSPAC Study Team, 2003. "Multiple-test procedures and smile plots," Stata Journal, StataCorp LP, vol. 3(2), pages 109-132, June.
    2. Roger Newson, 2003. "Confidence intervals and p-values for delivery to the end user," Stata Journal, StataCorp LP, vol. 3(3), pages 245-269, September.
    3. Christopher Genovese & Larry Wasserman, 2002. "Operating characteristics and extensions of the false discovery rate procedure," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(3), pages 499-517, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Naci H. Mocan & Samantha Bielen & Wim Marneffe, 2018. "Quality of Judicial Institutions, Crimes, Misdemeanors, and Dishonesty," NBER Working Papers 24396, National Bureau of Economic Research, Inc.
    2. Han Yu & Naci Mocan, 2018. "The Impact of High School Curriculum on Confidence, Academic Success, and Mental and Physical Well-Being of University Students," NBER Working Papers 24573, National Bureau of Economic Research, Inc.
    3. Mocan, Naci & Bielen, Samantha & Marneffe, Wim, 2020. "Quality of judicial institutions, crimes, misdemeanors, and dishonesty," European Journal of Political Economy, Elsevier, vol. 61(C).
    4. Huong Thu Le & Ha Trong Nguyen, 2017. "Parental health and children's cognitive and noncognitive development: New evidence from the longitudinal survey of Australian children," Health Economics, John Wiley & Sons, Ltd., vol. 26(12), pages 1767-1788, December.
    5. Dang, Hai-Anh & Malesky, Edmund & Nguyen, Cuong Viet, 2020. "Inequality and Support for Government Responses to COVID-19," IZA Discussion Papers 13816, Institute of Labor Economics (IZA).
    6. Dannenberg, Astrid & Weingärtner, Eva, 2023. "The effects of observability and an information nudge on food choice," Journal of Environmental Economics and Management, Elsevier, vol. 120(C).
    7. Damian Clarke & Joseph P. Romano & Michael Wolf, 2020. "The Romano–Wolf multiple-hypothesis correction in Stata," Stata Journal, StataCorp LP, vol. 20(4), pages 812-843, December.
    8. Mira Bierbaum & Eleonora E M Nillesen, 2021. "Sustaining the integrity of the threatened self: A cluster-randomised trial among social assistance applicants in the Netherlands," PLOS ONE, Public Library of Science, vol. 16(6), pages 1-21, June.
    9. Leight, Jessica & Awonon, Josué & Pedehombga, Abdoulaye & Ganaba, Rasmané & Gelli, Aulo, 2022. "How light is too light touch: The effect of a short training-based intervention on household poultry production in Burkina Faso," Journal of Development Economics, Elsevier, vol. 155(C).
    10. Akyol, Pelin & Mocan, Naci, 2020. "Education and Consanguineous Marriage," IZA Discussion Papers 13985, Institute of Labor Economics (IZA).
    11. Joseph Flavian Gomes, 2020. "The health costs of ethnic distance: evidence from sub-Saharan Africa," Journal of Economic Growth, Springer, vol. 25(2), pages 195-226, June.
    12. Han Yu & Naci Mocan, 2019. "The Impact of High School Curriculum on Confidence, Academic Success, and Mental and Physical Well-Being of University Students," Journal of Labor Research, Springer, vol. 40(4), pages 428-462, December.
    13. Maite D. Laméris & Pierre-Guillaume Méon & Anne-Marie Prooijen, 2023. "What have we done?! The impact of economics on the beliefs and values of business students," Journal of Business Economics, Springer, vol. 93(3), pages 433-483, April.
    14. Cotet-Grecu, Anca M., 2016. "On the estimation of the effect of stressors on birth outcomes," Economics Letters, Elsevier, vol. 147(C), pages 148-152.
    15. Martine D. Hansen & Therese H. Nøst & Eldbjørg S. Heimstad & Anita Evenset & Alexey A. Dudarev & Arja Rautio & Päivi Myllynen & Eugenia V. Dushkina & Marta Jagodic & Guttorm N. Christensen & Erik E. A, 2017. "The Impact of a Nickel-Copper Smelter on Concentrations of Toxic Elements in Local Wild Food from the Norwegian, Finnish, and Russian Border Regions," IJERPH, MDPI, vol. 14(7), pages 1-16, June.
    16. Dursun, Bahadır & Cesur, Resul & Mocan, Naci, 2018. "The Impact of Education on Health Outcomes and Behaviors in a Middle-Income, Low-Education Country," Economics & Human Biology, Elsevier, vol. 31(C), pages 94-114.
    17. Roger B. Newson, 2013. "Bonferroni and Holm approximations for Sidak and Holland–Copenhaver q-values," Stata Journal, StataCorp LP, vol. 13(2), pages 379-381, June.
    18. Hanson, Andrew & Hawley, Zackary & Martin, Hal & Liu, Bo, 2016. "Discrimination in mortgage lending: Evidence from a correspondence experiment," Journal of Urban Economics, Elsevier, vol. 92(C), pages 48-65.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Roger Newson, 2008. "parmest and extensions," United Kingdom Stata Users' Group Meetings 2008 07, Stata Users Group.
    2. Roger B. Newson, 2013. "Bonferroni and Holm approximations for Sidak and Holland–Copenhaver q-values," Stata Journal, StataCorp LP, vol. 13(2), pages 379-381, June.
    3. A Bottle & P Aylin, 2011. "Predicting the false alarm rate in multi-institution mortality monitoring," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(9), pages 1711-1718, September.
    4. Ebrahimi, Nader, 2008. "Simultaneous control of false positives and false negatives in multiple hypotheses testing," Journal of Multivariate Analysis, Elsevier, vol. 99(3), pages 437-450, March.
    5. B. Moerkerke & E. Goetghebeur & J. De Riek & I. Roldán‐Ruiz, 2006. "Significance and impotence: towards a balanced view of the null and the alternative hypotheses in marker selection for plant breeding," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 169(1), pages 61-79, January.
    6. Felipe A. Dunsch & David K. Evans & Ezinne Eze-Ajoku & Mario Macis, 2017. "Management, Supervision, and Health Care: A Field Experiment," NBER Working Papers 23749, National Bureau of Economic Research, Inc.
    7. Michael J. Kottelenberg & Steven F. Lehrer, 2017. "Targeted or Universal Coverage? Assessing Heterogeneity in the Effects of Universal Child Care," Journal of Labor Economics, University of Chicago Press, vol. 35(3), pages 609-653.
    8. Ruth Heller & Saharon Rosset, 2021. "Optimal control of false discovery criteria in the two‐group model," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 83(1), pages 133-155, February.
    9. Gómez-Villegas Miguel A. & Sanz Luis & Salazar Isabel, 2014. "A Bayesian decision procedure for testing multiple hypotheses in DNA microarray experiments," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 13(1), pages 49-65, February.
    10. Bazillier, Remi & Girard, Victoire, 2020. "The gold digger and the machine. Evidence on the distributive effect of the artisanal and industrial gold rushes in Burkina Faso," Journal of Development Economics, Elsevier, vol. 143(C).
    11. Ben Jann, 2013. "Plotting regression coefficients and other estimates in Stata," University of Bern Social Sciences Working Papers 1, University of Bern, Department of Social Sciences, revised 18 Sep 2017.
    12. Arianna Dondi & Jacopo Lenzi & Egidio Candela & Sugitha Sureshkumar & Francesca Morigi & Carlotta Biagi & Marcello Lanari, 2022. "Social Determinants of Health and Distance Learning in Italy in the Era of the SARS-CoV-2 Pandemic," IJERPH, MDPI, vol. 19(9), pages 1-12, May.
    13. G�nther Fink & Margaret McConnell & Sebastian Vollmer, 2014. "Testing for heterogeneous treatment effects in experimental data: false discovery risks and correction procedures," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 6(1), pages 44-57, January.
    14. Joshua Habiger & David Watts & Michael Anderson, 2017. "Multiple testing with heterogeneous multinomial distributions," Biometrics, The International Biometric Society, vol. 73(2), pages 562-570, June.
    15. Qingyun Cai & Hock Peng Chan, 2017. "A Double Application of the Benjamini-Hochberg Procedure for Testing Batched Hypotheses," Methodology and Computing in Applied Probability, Springer, vol. 19(2), pages 429-443, June.
    16. Mihai C. Giurcanu, 2017. "Oracle M-Estimation for Time Series Models," Journal of Time Series Analysis, Wiley Blackwell, vol. 38(3), pages 479-504, May.
    17. Long Qu & Dan Nettleton & Jack C. M. Dekkers, 2012. "Improved Estimation of the Noncentrality Parameter Distribution from a Large Number of t-Statistics, with Applications to False Discovery Rate Estimation in Microarray Data Analysis," Biometrics, The International Biometric Society, vol. 68(4), pages 1178-1187, December.
    18. Dang, Hai-Anh & Lanjouw, Peter & Luoto, Jill & McKenzie, David, 2014. "Using repeated cross-sections to explore movements into and out of poverty," Journal of Development Economics, Elsevier, vol. 107(C), pages 112-128.
    19. Glueck Deborah H & Mandel Jan & Karimpour-Fard Anis & Hunter Lawrence & Muller Keith E, 2008. "Exact Calculations of Average Power for the Benjamini-Hochberg Procedure," The International Journal of Biostatistics, De Gruyter, vol. 4(1), pages 1-20, June.
    20. E. M. Conlon & B. L. Postier & B. A. Methe & K. P. Nevin & D. R. Lovley, 2009. "Hierarchical Bayesian meta-analysis models for cross-platform microarray studies," Journal of Applied Statistics, Taylor & Francis Journals, vol. 36(10), pages 1067-1085.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tsj:stataj:v:10:y:2010:i:4:p:568-584. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Christopher F. Baum or Lisa Gilmore (email available below). General contact details of provider: http://www.stata-journal.com/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.