Consonance and the closure method in multiple testing
Consider the problem of testing s hypotheses simultaneously. In order to deal with the multiplicity problem, the classical approach is to restrict attention to procedures that control the familywise error rate (FWE). Typically, it is known how to construct tests of the individual hypotheses, and the problem is how to combine them into a multiple testing procedure that controls the FWE. The closure method of Marcus et al. (1976), in fact, reduces the problem of constructing multiple test procedures which control the FWE to the construction of single tests which control the usual probability of a Type 1 error. The purpose of this paper is to examine the closure method with emphasis on the concepts of coherence and consonance. It was shown by Sonnemann and Finner (1988) that any incoherent procedure can be replaced by a coherent one which is at least as good. The main point of this paper is to show a similar result for dissonant and consonant procedures. We illustrate the idea of how a dissonant procedure can be strictly improved by a consonant procedure in the sense of increasing the probability of detecting a false null hypothesis while maintaining control of the FWE. We then show how consonance can be used in the construction of some optimal maximin procedures.
|Date of creation:||Sep 2009|
|Contact details of provider:|| Postal: Schönberggasse 1, CH-8001 Zürich|
Phone: +41-1-634 21 37
Fax: +41-1-634 49 82
Web page: http://www.econ.uzh.ch/
More information through EDIRC
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Richard M. Bittman & Joseph P. Romano & Carlos Vallarino & Michael Wolf, 2009.
"Optimal testing of multiple hypotheses with common effect direction,"
Biometrika Trust, vol. 96(2), pages 399-410.
- Richard M. Bittman & Joseph P. Romano & Carlos Vallarino & Michael Wolf, 2008. "Optimal testing of multiple hypotheses with common effect direction," IEW - Working Papers 307, Institute for Empirical Research in Economics - University of Zurich.
When requesting a correction, please mention this item's handle: RePEc:zur:iewwpx:446. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Marita Kieser)
If references are entirely missing, you can add them using this form.