Advanced Search
MyIDEAS: Login

Dual P-Values, Evidential Tension and Balanced Tests

Contents:

Author Info

  • D.S. Poskitt

    ()

  • Arivalzahan Sengarapillai

Abstract

In the classical approach to statistical hypothesis testing the role of the null hypothesis H0 and the alternative H1 is very asymmetric. Power, calculated from the distribution of the test statistic under H1, is treated as a theoretical construct that can be used to guide the choice of an appropriate test statistic or sample size, but power calculations do not explicitly enter the testing process in practice. In a significance test a decision to accept or reject H0 is driven solely by an examination of the strength of evidence against H0, summarized in the P-value calculated from the distribution of the test statistic under H0. A small P-value is taken to represent strong evidence against H0, but it need not necessarily indicate strong evidence in favour of H1. More recently, Moerkerke et al. (2006) have suggested that the special status of H0 is often unwarranted or inappropriate, and argue that evidence against H1 can be equally meaningful. They propose a balanced treatment of both H0 and H1 in which the classical P-value is supplemented by the P-value derived under H1. The alternative P-value is the dual of the null P-value and summarizes the evidence against a target alternative. Here we review how the dual P-values are used to assess the evidential tension between H0 and H1, and use decision theoretic arguments to explore a balanced hypothesis testing technique that exploits this evidential tension. The operational characteristics of balanced hypothesis tests is outlined and their relationship to conventional notions of optimal tests is laid bare. The use of balanced hypothesis tests as a conceptual tool is illustrated via model selection in linear regression and their practical implementation is demonstrated by application to the detection of cancer-specific protein markers in mass spectroscopy.

Download Info

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
File URL: http://www.buseco.monash.edu.au/ebs/pubs/wpapers/2010/wp15-10.pdf
Download Restriction: no

Bibliographic Info

Paper provided by Monash University, Department of Econometrics and Business Statistics in its series Monash Econometrics and Business Statistics Working Papers with number 15/10.

as in new window
Length: 24 pages
Date of creation: 23 Jun 2010
Date of revision:
Handle: RePEc:msh:ebswps:2010-15

Contact details of provider:
Postal: PO Box 11E, Monash University, Victoria 3800, Australia
Phone: +61-3-9905-2489
Fax: +61-3-9905-5474
Email:
Web page: http://www.buseco.monash.edu.au/depts/ebs/
More information through EDIRC

Order Information:
Email:
Web: http://www.buseco.monash.edu.au/depts/ebs/pubs/wpapers/

Related research

Keywords: Balanced test; P-value; dual P-values; evidential tension; null hypothesis; alternative hypothesis; operating characteristics; false detection rate;

Find related papers by JEL classification:

This paper has been announced in the following NEP Reports:

References

No references listed on IDEAS
You can help add them by filling out this form.

Citations

Lists

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

Statistics

Access and download statistics

Corrections

When requesting a correction, please mention this item's handle: RePEc:msh:ebswps:2010-15. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Simone Grose).

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.