IDEAS home Printed from https://ideas.repec.org/p/cyb/wpaper/2014-3.html

Back to Basics: Is Statistical Significance all that Matters?

Author

Listed:
  • Nektarios A. Michail

    (Central Bank of Cyprus)

  • Constantinos I. Massouras

Abstract

We examine whether statistical significance can convey all the information necessary for the econometrician to judge the performance of his models. We find that in some cases, the t-statistic and the R-squared can be biased due to high correlation between the variables and variables can appear significant even though their correlation with the dependent variable is very low. The solution we propose is a back-to-basics approach: examine correlations between variables and variable variances in order for a correct interpretation of the regression outcome.

Suggested Citation

  • Nektarios A. Michail & Constantinos I. Massouras, 2014. "Back to Basics: Is Statistical Significance all that Matters?," Working Papers 2014-3, Central Bank of Cyprus.
    • Handle: RePEc:cyb:wpaper:2014-3
    as

    Download full text from publisher

    File URL: https://www.centralbank.cy/images/media/pdf/WorkingPaper_2014-3.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Wooldridge, Jeffrey M., 2004. "Statistical significance is okay, too: comment on "Size Matters"," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 33(5), pages 577-579, November.
    2. McCloskey, Donald N, 1985. "The Loss Function Has Been Mislaid: The Rhetoric of Significance Tests," American Economic Review, American Economic Association, vol. 75(2), pages 201-205, May.
    3. repec:ejw:journl:v:1:y:2004:i:2:p:331-358 is not listed on IDEAS
    4. Thomas Mayer, 2012. "Ziliak and McClosky?s Criticisms of Significance Tests: A Damage Assessment," Working Papers 61, University of California, Davis, Department of Economics.
    5. Granger, C W J, 1969. "Investigating Causal Relations by Econometric Models and Cross-Spectral Methods," Econometrica, Econometric Society, vol. 37(3), pages 424-438, July.
    6. Thomas Mayer, 2012. "Ziliak and McClosky?s Criticisms of Significance Tests: A Damage Assessment," Working Papers 126, University of California, Davis, Department of Economics.
    7. repec:ejw:journl:v:10:y:2013:i:1:p:97-107 is not listed on IDEAS
    8. Ziliak, Stephen T. & McCloskey, Deirdre N., 2004. "Size matters: the standard error of regressions in the American Economic Review," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 33(5), pages 527-546, November.
    9. Deirdre N. McCloskey & Stephen T. Ziliak, 1996. "The Standard Error of Regressions," Journal of Economic Literature, American Economic Association, vol. 34(1), pages 97-114, March.
    10. repec:ejw:journl:v:9:y:2012:i:3:p:256-297 is not listed on IDEAS
    11. Zellner, Arnold, 2004. "To test or not to test and if so, how?: Comments on "size matters"," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 33(5), pages 581-586, November.
    12. Granger, C. W. J., 1988. "Some recent development in a concept of causality," Journal of Econometrics, Elsevier, vol. 39(1-2), pages 199-211.
    13. Leamer, Edward E., 2004. "Are the roads red? Comments on "Size Matters"," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 33(5), pages 555-557, November.
    14. repec:bla:econom:v:47:y:1980:i:188:p:387-406 is not listed on IDEAS
    15. Sims, Christopher A, 1972. "Money, Income, and Causality," American Economic Review, American Economic Association, vol. 62(4), pages 540-552, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Nektarios A. Michail & George Thucydides, 2019. "The impact of foreign demand on Cyprus house prices," Cyprus Economic Policy Review, University of Cyprus, Economics Research Centre, vol. 13(2), pages 48-71, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. John D. Levendis, 2018. "Time Series Econometrics," Springer Texts in Business and Economics, Springer, number 978-3-319-98282-3, December.
    2. repec:ejw:journl:v:10:y:2013:i:1:p:97-107 is not listed on IDEAS
    3. Kevin Hoover & Mark Siegler, 2008. "Sound and fury: McCloskey and significance testing in economics," Journal of Economic Methodology, Taylor & Francis Journals, vol. 15(1), pages 1-37.
    4. Hector O. Zapata & José M. Gil, 1999. "Cointegration and causality in international agricultural economics research," Agricultural Economics, International Association of Agricultural Economists, vol. 20(1), pages 1-9, January.
    5. Andersson, Björn, 1999. "On the Causality Between Saving and Growth: Long- and Short-Run Dynamics and Country Heterogeneity," Working Paper Series 1999:18, Uppsala University, Department of Economics.
    6. Jonathan B. Hill, 2007. "Efficient tests of long-run causation in trivariate VAR processes with a rolling window study of the money-income relationship," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 22(4), pages 747-765.
    7. Jonathan B. Hill, 2005. "Causation Delays and Causal Neutralization up to Three Steps Ahead: The Money-Output Relationship Revisited," Econometrics 0503016, University Library of Munich, Germany, revised 23 Mar 2005.
    8. Adrian C. Darnell, 1994. "A Dictionary Of Econometrics," Books, Edward Elgar Publishing, number 118.
    9. Abhijit Sharma & Theodore Panagiotidis, 2003. "An Analysis of Exports and Growth in India: Some Empirical Evidence (1971-2001)," Working Papers 2003004, The University of Sheffield, Department of Economics, revised Nov 2003.
    10. Timothy R. Wojan & Jason P. Brown & Dayton M. Lambert, 2014. "What to Do about the "Cult of Statistical Significance"? A Renewable Fuel Application using the Neyman-Pearson Protocol," Applied Economic Perspectives and Policy, Agricultural and Applied Economics Association, vol. 36(4), pages 674-695.
    11. Shu-Ping Shi & Stan Hurn & Peter C. B. Phillips, 2016. "Causal Change Detection in Possibly Integrated Systems: Revisiting the Money-Income Relationship," Cowles Foundation Discussion Papers 2059, Cowles Foundation for Research in Economics, Yale University.
    12. Altman, Morris, 2004. "Statistical significance, path dependency, and the culture of journal publication," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 33(5), pages 651-663, November.
    13. Stephan B. Bruns & David I. Stern, 2019. "Lag length selection and p-hacking in Granger causality testing: prevalence and performance of meta-regression models," Empirical Economics, Springer, vol. 56(3), pages 797-830, March.
    14. Paul, R.K. & Saxena, R. & Bhat, S.A., 2016. "How Price Signals in Pulses are Transmitted across Regions and Value Chain? Examining Horizontal and Vertical Market Price Integration for Major Pulses in India," Agricultural Economics Research Review, Agricultural Economics Research Association (India), vol. 29(Conferenc).
    15. Masih, Abul M. M. & Masih, Rumi, 1997. "Can family-planning programs "cause" a significant fertility decline in countries characterized by very low levels of socioeconomic development? New evidence from Bangladesh based on dynamic multivariate and cointegrated time-series techniq," Journal of Policy Modeling, Elsevier, vol. 19(4), pages 441-468, August.
    16. Masih, Rumi & Masih, Abul M. M., 1996. "Macroeconomic activity dynamics and Granger causality: New evidence from a small developing economy based on a vector error-correction modelling analysis," Economic Modelling, Elsevier, vol. 13(3), pages 407-426, July.
    17. Altman, Morris, 2020. "A more scientific approach to applied economics: Reconstructing statistical, analytical significance, and correlation analysis," Economic Analysis and Policy, Elsevier, vol. 66(C), pages 315-324.
    18. Love, Jim & Chandra, Ramesh, 2005. "Testing export-led growth in Bangladesh in a multivarate VAR framework," Journal of Asian Economics, Elsevier, vol. 15(6), pages 1155-1168, January.
    19. David Greasley & Les Oxley, 2010. "Cliometrics And Time Series Econometrics: Some Theory And Applications," Journal of Economic Surveys, Wiley Blackwell, vol. 24(5), pages 970-1042, December.
    20. Stéphane Goutte & David Guerreiro & Bilel Sanhaji & Sophie Saglio & Julien Chevallier, 2019. "International Financial Markets," Post-Print halshs-02183053, HAL.
    21. Ghassan, Hassan B. & ElHafidi, Miloud, 1999. "Tests de G-causalité et spécification d’un modèle économétrique: Application sur un panel sectoriel marocain [G-causality tests and specification of an econometric model: Evidence form Sectoral Moroccan panel]," MPRA Paper 56433, University Library of Munich, Germany, revised 13 Jan 2000.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
    • C31 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models; Quantile Regressions; Social Interaction Models

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cyb:wpaper:2014-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Anna Markidou (email available below). General contact details of provider: https://edirc.repec.org/data/cbcgvcy.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.