Consonance and the closure method in multiple testing
Consider the problem of testing s hypotheses simultaneously. In order to deal with the multiplicity problem, the classical approach is to restrict attention to procedures that control the familywise error rate (FWE). Typically, it is known how to construct tests of the individual hypotheses, and the problem is how to combine them into a multiple testing procedure that controls the FWE. The closure method of Marcus et al. (1976), in fact, reduces the problem of constructing multiple test procedures which control the FWE to the construction of single tests which control the usual probability of a Type 1 error. The purpose of this paper is to examine the closure method with emphasis on the concepts of coherence and consonance. It was shown by Sonnemann and Finner (1988) that any incoherent procedure can be replaced by a coherent one which is at least as good. The main point of this paper is to show a similar result for dissonant and consonant procedures. We illustrate the idea of how a dissonant procedure can be strictly improved by a consonant procedure in the sense of increasing the probability of detecting a false null hypothesis while maintaining control of the FWE. We then show how consonance can be used in the construction of some optimal maximin procedures.
|Date of creation:||Sep 2009|
|Contact details of provider:|| Postal: Schönberggasse 1, CH-8001 Zürich|
Phone: +41-1-634 21 37
Fax: +41-1-634 49 82
Web page: http://www.econ.uzh.ch/
More information through EDIRC
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Richard M. Bittman & Joseph P. Romano & Carlos Vallarino & Michael Wolf, 2009.
"Optimal testing of multiple hypotheses with common effect direction,"
Biometrika Trust, vol. 96(2), pages 399-410.
- Richard M. Bittman & Joseph P. Romano & Carlos Vallarino & Michael Wolf, 2008. "Optimal testing of multiple hypotheses with common effect direction," IEW - Working Papers 307, Institute for Empirical Research in Economics - University of Zurich.
When requesting a correction, please mention this item's handle: RePEc:zur:iewwpx:446. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Marita Kieser)
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.