Misinterpreting a Failure to Disconfirm as a Confirmation: A Recurrent Misreading of Significance Tests
When a significance test fails to disconfirm a hypothesis economist often interpret this as evidence that this hypothesis is valid. Six such examples are cited from recent journals. But this is a misinterpretation of what significance tests show. Presumably this misinterpretation is founded on the valid principle that every failure to disconfirm a hypothesis adds to its credibility. But that principle defines â??failure to disconfirmâ?? in a way that differs sharply from the way that this phrase is used in the context of significance tests. Some ways of ameliorating this problem exist.
|Date of creation:||16 Jan 2003|
|Date of revision:|
|Contact details of provider:|| Postal: One Shields Ave., Davis, CA 95616-8578|
Phone: (530) 752-0741
Fax: (530) 752-9382
Web page: http://www.econ.ucdavis.edu
More information through EDIRC
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Kevin Hoover & Stephen Perez, 2001. "Three attitudes towards data mining," Journal of Economic Methodology, Taylor & Francis Journals, vol. 7(2), pages 195-210.
- Shang-Jin Wei, 2000.
"How Taxing is Corruption on International Investors?,"
The Review of Economics and Statistics,
MIT Press, vol. 82(1), pages 1-11, February.
- Shang-Jin Wei, 1997. "How Taxing is Corruption on International Investors?," NBER Working Papers 6030, National Bureau of Economic Research, Inc.
- Shang-Jin Wei, 1997. "How Taxing is Corruption on International Investors?," William Davidson Institute Working Papers Series 63, William Davidson Institute at the University of Michigan.
- McCloskey, Donald N, 1983. "The Rhetoric of Economics," Journal of Economic Literature, American Economic Association, vol. 21(2), pages 481-517, June.
- Kevin D. Hoover & Stephen J. Perez, .
"Data Mining Reconsidered: Encompassing And The General-To-Specific Approach To Specification Search,"
Department of Economics
97-27, California Davis - Department of Economics.
- Kevin D. Hoover & Stephen J. Perez, 1999. "Data mining reconsidered: encompassing and the general-to-specific approach to specification search," Econometrics Journal, Royal Economic Society, vol. 2(2), pages 167-191.
- Kevin Hoover & Stephen J. Perez, 2003. "Data Mining Reconsidered: Encompassing And The General-To-Specific Approach To Specification Search," Working Papers 9727, University of California, Davis, Department of Economics.
- Deirdre N. McCloskey & Stephen T. Ziliak, 1996. "The Standard Error of Regressions," Journal of Economic Literature, American Economic Association, vol. 34(1), pages 97-114, March.
- James T. Hamilton & W. Kip Viscusi, 1999. "Are Risk Regulators Rational? Evidence from Hazardous Waste Cleanup Decisions," American Economic Review, American Economic Association, vol. 89(4), pages 1010-1027, September.
- Hans-Martin Krolzig & David Hendry, 1999.
"Computer Automation of General-to-Specific Model Selection Procedures,"
Computing in Economics and Finance 1999
314, Society for Computational Economics.
- Krolzig, Hans-Martin & Hendry, David F., 2001. "Computer automation of general-to-specific model selection procedures," Journal of Economic Dynamics and Control, Elsevier, vol. 25(6-7), pages 831-866, June.
- David Hendry & Hans-Martin Krolzig, 2000. "Computer Automation of General-to-Specific Model Selection Procedures," Economics Series Working Papers 3, University of Oxford, Department of Economics.
- Hans-Martin Krolzig, 2000. "Computer Automation of General-to-Specific Model Selection Procedures," Econometric Society World Congress 2000 Contributed Papers 0411, Econometric Society.
- Hands,D. Wade, 2001.
"Reflection without Rules,"
Cambridge University Press, number 9780521497152, November.
- Susanna Loeb & Marianne E. Page, 2000. "Examining The Link Between Teacher Wages And Student Outcomes: The Importance Of Alternative Labor Market Opportunities And Non-Pecuniary Variation," The Review of Economics and Statistics, MIT Press, vol. 82(3), pages 393-408, August.
When requesting a correction, please mention this item's handle: RePEc:cda:wpaper:01-8. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Scott Dyer)
If references are entirely missing, you can add them using this form.