IDEAS home Printed from https://ideas.repec.org/
MyIDEAS: Login to save this paper or follow this series

Credible Granger-Causality Inference with Modest Sample Lengths: A Cross-Sample Validation Approach

  • Richard A. Ashley
  • Kwok Ping Tsang

Credible Granger-causality analysis appears to require post-sample inference, as it is well-known that in-sample fit can be a poor guide to actual forecasting effectiveness. But post-sample model testing requires an often-consequential a priori partitioning of the data into an 'in-sample' period - purportedly utilized only for model specifi- cation/estimation - and a 'post-sample' period, purportedly utilized (only at the end of the analysis) for model validation/testing purposes. This partitioning is usually infeasible, however, with samples of modest length – e.g., T less than 100 - as is common in both quarterly data sets and/or in monthly data sets where institutional arrange- ments vary over time, simply because there is in such cases insufficient data available to credibly accomplish both purposes separately. A cross-sample validation (CSV) testing procedure is proposed below which substantially ameliorates this predicament - preserving most of the power of in-sample testing (by utilizing all of the sample data in the test), while also retaining most of the credibility of post-sample testing (by al- ways basing model forecasts on data not utilized in estimating that particular model's coefficients). Simulations show that the price paid, in terms of power relative to the in-sample Granger-causality F test, is manageable. An illustrative application is given, to a re-analysis of the Engel and West (2005) study of the causal relationship between macroeconomic fundamentals and the exchange rate.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: ftp://repec.econ.vt.edu/Papers/Ashley/Ashley_Tsang_Cross_Sample_Validation_Granger_Causality.pdf
Our checks indicate that this address may not be valid because: 500 Failed to connect to FTP server repec.econ.vt.edu: Net::FTP: connect: 10060. If this is indeed the case, please notify (Djavad Salehi-Isfahani)


File Function: First version, 2013
Download Restriction: no

Paper provided by Virginia Polytechnic Institute and State University, Department of Economics in its series Working Papers with number e07-41.

as
in new window

Length: 20 pages
Date of creation: 2013
Date of revision:
Handle: RePEc:vpi:wpaper:e07-41
Contact details of provider: Postal: 3016 Pamplin Hall, Blacksburg, VA 24061-0316
Phone: 540-231-9636
Fax: 540-231-5097
Web page: http://www.econ.vt.edu

More information through EDIRC

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as in new window
  1. Engle, Robert F, 1974. "Band Spectrum Regression," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 15(1), pages 1-11, February.
  2. Richard A. Ashley & Kwok Ping Tsang & Randal J. Verbrugge, 2013. "Frequency Dependence in a Real-Time Monetary Policy Rule," Working Papers e07-43, Virginia Polytechnic Institute and State University, Department of Economics.
  3. David A. Pierce & Larry D. Haugh, 1977. "Causality in temporal systems: characterizations and a survey," Special Studies Papers 87, Board of Governors of the Federal Reserve System (U.S.).
  4. Richard A. Ashley & Randall J. Verbrugge., 2006. "Mis-Specification in Phillips Curve Regressions: Quantifying Frequency Dependence in This Relationship While Allowing for Feedback," Working Papers e06-11, Virginia Polytechnic Institute and State University, Department of Economics.
  5. Hamilton, James D., 2003. "What is an oil shock?," Journal of Econometrics, Elsevier, vol. 113(2), pages 363-398, April.
  6. Ashley, Richard, 1998. "A new technique for postsample model selection and validation," Journal of Economic Dynamics and Control, Elsevier, vol. 22(5), pages 647-665, May.
  7. Ashley, Richard, 1981. "Inflation and the Distribution of Price Changes across Markets: A Causal Analysis," Economic Inquiry, Western Economic Association International, vol. 19(4), pages 650-60, October.
  8. Barbara Rossi & Atsushi Inoue, 2012. "Out-of-Sample Forecast Tests Robust to the Choice of Window Size," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(3), pages 432-453, April.
  9. Miller, J. Isaac & Ni, Shawn, 2011. "Long-Term Oil Price Forecasts: A New Perspective On Oil And The Macroeconomy," Macroeconomic Dynamics, Cambridge University Press, vol. 15(S3), pages 396-415, November.
  10. Hamilton, James D., 1996. "This is what happened to the oil price-macroeconomy relationship," Journal of Monetary Economics, Elsevier, vol. 38(2), pages 215-220, October.
  11. Jeffrey S. Racine & Christopher F. Parmeter, 2012. "Data-Driven Model Evaluation: A Test for Revealed Performance," Department of Economics Working Papers 2012-13, McMaster University.
  12. Sílvia Gonçalves & Lutz Kilian, 2003. "Bootstrapping Autoregressions with Conditional Heteroskedasticity of Unknown Form," CIRANO Working Papers 2003s-17, CIRANO.
  13. Mork, Knut Anton, 1989. "Oil and Macroeconomy When Prices Go Up and Down: An Extension of Hamilton's Results," Journal of Political Economy, University of Chicago Press, vol. 97(3), pages 740-44, June.
  14. Clark, Todd E. & West, Kenneth D., 2006. "Using out-of-sample mean squared prediction errors to test the martingale difference hypothesis," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 155-186.
  15. Hamilton, James D, 1983. "Oil and the Macroeconomy since World War II," Journal of Political Economy, University of Chicago Press, vol. 91(2), pages 228-48, April.
  16. Ashley, Richard, 2003. "Statistically significant forecasting improvements: how much out-of-sample data is likely necessary?," International Journal of Forecasting, Elsevier, vol. 19(2), pages 229-239.
  17. Kiseok Lee & Shawn Ni & Ronald A. Ratti, 1995. "Oil Shocks and the Macroeconomy: The Role of Price Variability," The Energy Journal, International Association for Energy Economics, vol. 0(Number 4), pages 39-56.
  18. Steven J. Davis & John Haltiwanger, 1999. "Sectoral Job Creation and Destruction Responses to Oil Price Changes," NBER Working Papers 7095, National Bureau of Economic Research, Inc.
  19. Davidson, Russell & MacKinnon, James G., 1993. "Estimation and Inference in Econometrics," OUP Catalogue, Oxford University Press, number 9780195060119, March.
  20. Rebeca Jimenez-Rodriguez & Marcelo Sanchez, 2005. "Oil price shocks and real GDP growth: empirical evidence for some OECD countries," Applied Economics, Taylor & Francis Journals, vol. 37(2), pages 201-228.
  21. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-44, January.
  22. Diks, Cees & Panchenko, Valentyn, 2006. "A new statistic and practical guidelines for nonparametric Granger causality testing," Journal of Economic Dynamics and Control, Elsevier, vol. 30(9-10), pages 1647-1669.
  23. Richard Ashley, 2010. "On the Granger Causality between Median Inflation and Price Dispersion," Working Papers e07-24, Virginia Polytechnic Institute and State University, Department of Economics.
  24. Pesaran, M. Hashem & Timmermann, Allan, 2007. "Selection of estimation window in the presence of breaks," Journal of Econometrics, Elsevier, vol. 137(1), pages 134-161, March.
  25. Breitung, Jorg & Candelon, Bertrand, 2006. "Testing for short- and long-run causality: A frequency-domain approach," Journal of Econometrics, Elsevier, vol. 132(2), pages 363-378, June.
  26. Kenneth D. West & Todd Clark, 2006. "Approximately Normal Tests for Equal Predictive Accuracy in Nested Models," NBER Technical Working Papers 0326, National Bureau of Economic Research, Inc.
  27. Kilian, Lutz, 2006. "Not All Oil Price Shocks Are Alike: Disentangling Demand and Supply Shocks in the Crude Oil Market," CEPR Discussion Papers 5994, C.E.P.R. Discussion Papers.
  28. Hooker, Mark A., 1996. "What happened to the oil price-macroeconomy relationship?," Journal of Monetary Economics, Elsevier, vol. 38(2), pages 195-213, October.
  29. Todd Clark & Michael McCracken, 2005. "Evaluating Direct Multistep Forecasts," Econometric Reviews, Taylor & Francis Journals, vol. 24(4), pages 369-404.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:vpi:wpaper:e07-41. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Djavad Salehi-Isfahani)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.