Ziliak and McClosky’s Criticisms of Significance Tests: A Damage Assessment
AbstractD. N. McCloskey and Stephen Ziliak have criticized economists and others for confounding statistical and substantive significance, and for committing the logical error of the transposed conditional. In doing so they sometimes misinterpret the function of significance tests. Nonetheless, economists sometimes make both of these errors – but not nearly as often as Ziliak and McCloskey claim. They also argue –incorrectly – that the existence of an effect, which is what significance tests are about, is not a scientific question. Their complaint that in testing significance economists often do not take the loss function into account is unfounded. But they are right in arguing that confidence intervals should be presented more frequently.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by University of California, Davis, Department of Economics in its series Working Papers with number 126.
Date of creation: 20 Apr 2012
Date of revision:
Significance tests; ts; confidence intervals; Zilliak; McCloskey; oomph;
Find related papers by JEL classification:
- C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
- B4 - Schools of Economic Thought and Methodology - - Economic Methodology
This paper has been announced in the following NEP Reports:
- NEP-ALL-2012-05-02 (All new papers)
- NEP-ECM-2012-05-02 (Econometrics)
- NEP-HME-2012-05-02 (Heterodox Microeconomics)
- NEP-HPE-2012-05-02 (History & Philosophy of Economics)
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Craig Landry & Andreas Lange & John List & Michael Price & Nicholas Rupp, 2010.
"Is a donor in hand better than two in the bush? Evidence from a natural field experiment,"
Artefactual Field Experiments
00077, The Field Experiments Website.
- Craig E. Landry & Andreas Lange & John A. List & Michael K. Price & Nicholas G. Rupp, 2010. "Is a Donor in Hand Better Than Two in the Bush? Evidence from a Natural Field Experiment," American Economic Review, American Economic Association, vol. 100(3), pages 958-83, June.
- Craig E. Landry & Andreas Lange & John A. List & Michael K. Price & Nicholas G. Rupp, 2008. "Is a Donor in Hand Better than Two in the Bush? Evidence from a Natural Field Experiment," NBER Working Papers 14319, National Bureau of Economic Research, Inc.
- Martha J. Bailey, 2009.
""Momma's Got the Pill": How Anthony Comstock and Griswold v. Connecticut Shaped U.S. Childbearing,"
NBER Working Papers
14675, National Bureau of Economic Research, Inc.
- Martha J. Bailey, 2010. ""Momma's Got the Pill": How Anthony Comstock and Griswold v. Connecticut Shaped US Childbearing," American Economic Review, American Economic Association, vol. 100(1), pages 98-129, March.
- Mendelsohn, Robert & Nordhaus, William D & Shaw, Daigee, 1994. "The Impact of Global Warming on Agriculture: A Ricardian Analysis," American Economic Review, American Economic Association, vol. 84(4), pages 753-71, September.
- Kevin Hoover & Mark Siegler, 2008.
"Sound and fury: McCloskey and significance testing in economics,"
Journal of Economic Methodology,
Taylor and Francis Journals, vol. 15(1), pages 1-37.
- Kevin D. Hoover & Mark V. Siegler, 2005. "Sound and Fury: McCloskey and Significance Testing in Economics," Econometrics 0511018, EconWPA.
- Amitabh Chandra & Jonathan Gruber & Robin McKnight, 2010.
"Patient Cost-Sharing and Hospitalization Offsets in the Elderly,"
American Economic Review,
American Economic Association, vol. 100(1), pages 193-213, March.
- Chandra, Amitabh & Gruber, Jonathan & McKnight, Robin, 2009. "Patient Cost-Sharing and Hospitalization Offsets in the Elderly," Scholarly Articles 8058412, Harvard Kennedy School of Government.
- Milton Friedman, 1957. "A Theory of the Consumption Function," NBER Books, National Bureau of Economic Research, Inc, number frie57-1, December.
- Kevin Hoover & Mark Siegler, 2008. "The rhetoric of 'Signifying nothing': a rejoinder to Ziliak and McCloskey," Journal of Economic Methodology, Taylor and Francis Journals, vol. 15(1), pages 57-68.
- Milton Friedman, 1957. "Introduction to "A Theory of the Consumption Function"," NBER Chapters, in: A Theory of the Consumption Function, pages 1-6 National Bureau of Economic Research, Inc.
- Perotti, Roberto & Alesina, Alberto, 1997. "The Welfare State and Competitiveness," Scholarly Articles 4553027, Harvard University Department of Economics.
- Sauer, Raymond D & Leffler, Keith B, 1990. "Did the Federal Trade Commission's Advertising Substantiation Program Promote More Credible Advertising?," American Economic Review, American Economic Association, vol. 80(1), pages 191-203, March.
- repec:feb:artefa:0093 is not listed on IDEAS
- Froyen, Richard T & Waud, Roger N, 1980. "Further International Evidence of Output-Inflation Tradeoffs," American Economic Review, American Economic Association, vol. 70(3), pages 409-21, June.
- Stephen A. Woodbury, 2009. "Unemployment," Book chapters authored by Upjohn Institute researchers, in: Kenneth G. Dau-Schmidt & Seth D. Harris & Orley Lobel (ed.), Labor and Employment Law and Economics, volume 2, pages 480-516 W.E. Upjohn Institute for Employment Research.
- Mayer, Thomas, 1980. "Economics as a Hard Science: Realistic Goal or Wishful Thinking?," Economic Inquiry, Western Economic Association International, vol. 18(2), pages 165-78, April.
- Keuzenkamp, Hugo A. & Magnus, Jan R., 1995. "On tests and significance in econometrics," Journal of Econometrics, Elsevier, vol. 67(1), pages 5-24, May.
- Berg, Nathan, 2004. "No-decision classification: an alternative to testing for statistical significance," The Journal of Socio-Economics, Elsevier, vol. 33(5), pages 631-650, November.
- Ayres, Ian & Siegelman, Peter, 1995. "Race and Gender Discrimination in Bargaining for a New Car," American Economic Review, American Economic Association, vol. 85(3), pages 304-21, June.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Scott Dyer).
If references are entirely missing, you can add them using this form.