Misinterpreting a Failure to Disconfirm as a Confirmation: A Recurrent Misreading of Significance Tests
When a significance test fails to disconfirm a hypothesis economist often interpret this as evidence that this hypothesis is valid. Six such examples are cited from recent journals. But this is a misinterpretation of what significance tests show. Presumably this misinterpretation is founded on the valid principle that every failure to disconfirm a hypothesis adds to its credibility. But that principle defines â??failure to disconfirmâ?? in a way that differs sharply from the way that this phrase is used in the context of significance tests. Some ways of ameliorating this problem exist.
|Date of creation:||16 Jan 2003|
|Date of revision:|
|Contact details of provider:|| Postal: |
Phone: (530) 752-0741
Fax: (530) 752-9382
Web page: http://www.econ.ucdavis.edu
More information through EDIRC
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- McCloskey, Donald N, 1983. "The Rhetoric of Economics," Journal of Economic Literature, American Economic Association, vol. 21(2), pages 481-517, June.
- Hans-Martin Krolzig, 2000.
"Computer Automation of General-to-Specific Model Selection Procedures,"
Econometric Society World Congress 2000 Contributed Papers
0411, Econometric Society.
- Krolzig, Hans-Martin & Hendry, David F., 2001. "Computer automation of general-to-specific model selection procedures," Journal of Economic Dynamics and Control, Elsevier, vol. 25(6-7), pages 831-866, June.
- Hans-Martin Krolzig & David Hendry, 1999. "Computer Automation of General-to-Specific Model Selection Procedures," Computing in Economics and Finance 1999 314, Society for Computational Economics.
- David Hendry & Hans-Martin Krolzig, 2000. "Computer Automation of General-to-Specific Model Selection Procedures," Economics Series Working Papers 3, University of Oxford, Department of Economics.
- Susanna Loeb & Marianne E. Page, 2000. "Examining The Link Between Teacher Wages And Student Outcomes: The Importance Of Alternative Labor Market Opportunities And Non-Pecuniary Variation," The Review of Economics and Statistics, MIT Press, vol. 82(3), pages 393-408, August.
- repec:cup:cbooks:9780521497152 is not listed on IDEAS
- Shang-Jin Wei, 1997.
"How Taxing is Corruption on International Investors?,"
William Davidson Institute Working Papers Series
63, William Davidson Institute at the University of Michigan.
- Shang-Jin Wei, 2000. "How Taxing is Corruption on International Investors?," The Review of Economics and Statistics, MIT Press, vol. 82(1), pages 1-11, February.
- Shang-Jin Wei, 1997. "How Taxing is Corruption on International Investors?," NBER Working Papers 6030, National Bureau of Economic Research, Inc.
- Kevin Hoover & Stephen J. Perez, 2003.
"Data Mining Reconsidered: Encompassing And The General-To-Specific Approach To Specification Search,"
9727, University of California, Davis, Department of Economics.
- Kevin D. Hoover & Stephen J. Perez, 1999. "Data mining reconsidered: encompassing and the general-to-specific approach to specification search," Econometrics Journal, Royal Economic Society, vol. 2(2), pages 167-191.
- Kevin D. Hoover & Stephen J. Perez, . "Data Mining Reconsidered: Encompassing And The General-To-Specific Approach To Specification Search," Department of Economics 97-27, California Davis - Department of Economics.
- repec:cup:cbooks:9780521797962 is not listed on IDEAS
- Kevin Hoover & Stephen Perez, 2001. "Three attitudes towards data mining," Journal of Economic Methodology, Taylor & Francis Journals, vol. 7(2), pages 195-210.
When requesting a correction, please mention this item's handle: RePEc:cda:wpaper:01-8. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Scott Dyer)
If references are entirely missing, you can add them using this form.