On optimal allocation in binary response trials; is adaptive design really necessary?
AbstractWe consider the classical problem of selecting the best of two treatments in clinical trials with binary response. The target is to find the design that maximizes the power of the relevant test. Many papers use a normal approximation to the power function and claim that Neyman allocation that assigns subjects to treatment groups according to the ratio of the responses’ standard deviations, should be used. As the standard deviations are unknown, an adaptive design is often recommended. The asymptotic justification of this approach is arguable, since it uses the normal approximation in tails where the error in the approximation is larger than the estimated quantity. We consider two different approaches for optimality of designs that are related to Pitman and Bahadur definitions of relative efficiency of tests. We prove that the optimal allocation according to the Pitman criterion is the balanced allocation and that the optimal allocation according to the Bahadur approach depends on the unknown parameters. Exact calculations reveal that the optimal allocation according to Bahadur is often close to the balanced design, and the powers of both are comparable to the Neyman allocation for small sample sizes and are generally better for large experiments. Our findings have important implications to the design of experiments, as the balanced design is proved to be optimal or close to optimal and the need for the complications involved in following an adaptive design for the purpose of increasing the power of tests is therefore questionable.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by The Center for the Study of Rationality, Hebrew University, Jerusalem in its series Discussion Paper Series with number dp568.
Length: 19 pages
Date of creation: Mar 2011
Date of revision:
Neyman allocation; adaptive design; asymptotic power; Normal approximation; Pitman efficiency; Bahadur efficiency; large deviations;
Find related papers by JEL classification:
- K13 - Law and Economics - - Basic Areas of Law - - - Tort Law and Product Liability; Forensic Economics
This paper has been announced in the following NEP Reports:
- NEP-ALL-2011-03-19 (All new papers)
- NEP-ECM-2011-03-19 (Econometrics)
- NEP-EXP-2011-03-19 (Experimental Economics)
- NEP-LAW-2011-03-19 (Law & Economics)
You can help add them by filling out this form.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Ilan Nehama).
If references are entirely missing, you can add them using this form.