A consistent test for nonlinear out of sample predictive accuracy
Abstract
In this paper, we draw on both the consistent specification testing and the predictive ability testing literatures and propose a test for predictive accuracy which is consistent against generic nonlinear alternatives. Broadly speaking, given a particular reference model, assume that the objective is to test whether there exists any alternative model, among an infinite number of alternatives, that has better predictive accuracy than the reference model, for a given loss function. A typical example is the case in which the reference model is a simple autoregressive model and the objective is to check whether a more accurate forecasting model can be constructed by including possibly unknown (non)linear functions of the past of the process or of the past of some other process(es). We propose a statistic which is similar in spirit to that of White (2000), although our approach differs from his as we allow for an infinite number of competing models that may be nested. In addition, we allow for non vanishing parameter estimation error. In order to construct valid asymptotic critical values, we implement a conditional p-value procedure which extends the work of Inoue (1999) by allowing for non vanishing parameter estimation error.(This abstract was borrowed from another version of this item.)
Download Info
If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.
Bibliographic Info
Article provided by Elsevier in its journal Journal of Econometrics.
Volume (Year): 110 (2002)
Issue (Month): 2 (October)
Pages: 353-381
Contact details of provider:
Web page: http://www.elsevier.com/locate/jeconom
Related research
Keywords:Other versions of this item:
- Corradi, V. & Swanson, N.R., 2000. "A Consistent Test for Nonlinear Out of Sample Predictive Accuracy," Discussion Papers 0012, Exeter University, Department of Economics.
- C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models
- C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation
References
References listed on IDEASPlease report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Granger, C. W. J., 1980. "Testing for causality : A personal viewpoint," Journal of Economic Dynamics and Control, Elsevier, vol. 2(1), pages 329-352, May.
- de Jong, Robert M., 1996. "The Bierens test under data dependence," Journal of Econometrics, Elsevier, vol. 72(1-2), pages 1-32.
- Hansen, Bruce E, 1996.
"Inference When a Nuisance Parameter Is Not Identified under the Null Hypothesis,"
Econometrica,
Econometric Society, vol. 64(2), pages 413-30, March.
- Tom Doan, . "RATS programs to replicate Hansen's threshold estimation and testing results," Statistical Software Components RTZ00091, Boston College Department of Economics.
- Tom Doan, . "TAR: RATS procedure to estimate a threshold autoregression, tests for threshold effect," Statistical Software Components RTS00209, Boston College Department of Economics.
- Hansen, B.E., 1991. "Inference when a Nuisance Parameter is Not Identified Under the Null Hypothesis," RCER Working Papers 296, University of Rochester - Center for Economic Research (RCER).
- Michael P. Clements & David F. Hendry, 1999. "On winning forecasting competitions in economics," Spanish Economic Review, Springer, vol. 1(2), pages 123-160.
- Lee, Tae-Hwy & White, Halbert & Granger, Clive W. J., 1993.
"Testing for neglected nonlinearity in time series models : A comparison of neural network methods and alternative tests,"
Journal of Econometrics,
Elsevier, vol. 56(3), pages 269-290, April.
- Tom Doan, . "REGRESET: RATS procedure to perform Ramsey RESET test on regression," Statistical Software Components RTS00181, Boston College Department of Economics.
- Tom Doan, . "REGWHITENNTEST: RATS procedure to perform White neural network test on regression," Statistical Software Components RTS00183, Boston College Department of Economics.
- Granger, C W J, 1969. "Investigating Causal Relations by Econometric Models and Cross-Spectral Methods," Econometrica, Econometric Society, vol. 37(3), pages 424-38, July.
- Todd E. Clark & Michael McCracken, 1999.
"Tests of Equal Forecast Accuracy and Encompassing for Nested Models,"
Computing in Economics and Finance 1999
1241, Society for Computational Economics.
- Clark, Todd E. & McCracken, Michael W., 2001. "Tests of equal forecast accuracy and encompassing for nested models," Journal of Econometrics, Elsevier, vol. 105(1), pages 85-110, November.
- Todd E. Clark & Michael W. McCracken, 2000. "Tests of Equal Forecast Accuracy and Encompassing for Nested Models," Econometric Society World Congress 2000 Contributed Papers 0319, Econometric Society.
- Todd E. Clark & Michael W. McCracken, 1999. "Tests of equal forecast accuracy and encompassing for nested models," Research Working Paper 99-11, Federal Reserve Bank of Kansas City.
- Bierens, Herman J, 1990.
"A Consistent Conditional Moment Test of Functional Form,"
Econometrica,
Econometric Society, vol. 58(6), pages 1443-58, November.
- Bierens, H.J., 1989. "A consistent conditional moment test of functional form," Serie Research Memoranda 0064, VU University Amsterdam, Faculty of Economics, Business Administration and Econometrics.
- Terasvirta, T & Anderson, H M, 1992. "Characterizing Nonlinearities in Business Cycles Using Smooth Transition Autoregressive Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 7(S), pages S119-36, Suppl. De.
- Christoffersen, Peter F & Diebold, Francis X, 1996.
"Further Results on Forecasting and Model Selection under Asymmetric Loss,"
Journal of Applied Econometrics,
John Wiley & Sons, Ltd., vol. 11(5), pages 561-71, Sept.-Oct.
- Christoffersen & Diebold, . "Further Results on Forecasting and Model Selection Under Asymmetric Loss," Home Pages _059, University of Pennsylvania.
- Kenneth D. West, 1994.
"Asymptotic Inference About Predictive Ability,"
Macroeconomics
9410002, EconWPA.
- West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-84, September.
- repec:att:wimass:9710 is not listed on IDEAS
- Phillip Rothman & Dick van Dijk & Philip Hans Franses, 2000.
"A Multivariate STAR Analysis of the Relationship Between Money and Output,"
Working Papers
0012, East Carolina University, Department of Economics.
- Rothman, P. & Dijk, D.J.C. van & Franses, Ph.H.B.F., 1999. "A multivariate STAR analysis of the relationship between money and output," Econometric Institute Report EI 9945-/A, Erasmus University Rotterdam, Econometric Institute.
- Philip Rothman & Dick van Dijk & Philip Hans Franses, 1999. "A Multivariate STAR Analysis of the Relationship Between Money and Output," Working Papers 9913, East Carolina University, Department of Economics.
- Corradi, Valentina & Swanson, Norman R. & Olivetti, Claudia, 2001. "Predictive ability with cointegrated variables," Journal of Econometrics, Elsevier, vol. 104(2), pages 315-358, September.
- Donald W.K. Andrews & Werner Ploberger, 1992.
"Optimal Tests When a Nuisance Parameter Is Present Only Under the Alternative,"
Cowles Foundation Discussion Papers
1015, Cowles Foundation for Research in Economics, Yale University.
- Andrews, Donald W K & Ploberger, Werner, 1994. "Optimal Tests When a Nuisance Parameter Is Present Only under the Alternative," Econometrica, Econometric Society, vol. 62(6), pages 1383-1414, November.
- Stinchcombe, Maxwell B. & White, Halbert, 1998. "Consistent Specification Testing With Nuisance Parameters Present Only Under The Alternative," Econometric Theory, Cambridge University Press, vol. 14(03), pages 295-325, June.
- Weiss, Andrew A, 1996. "Estimating Time Series Models Using the Relevant Cost Function," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 11(5), pages 539-60, Sept.-Oct.
- Diebold, Francis X & Mariano, Roberto S, 1995.
"Comparing Predictive Accuracy,"
Journal of Business & Economic Statistics,
American Statistical Association, vol. 13(3), pages 253-63, July.
- Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-44, January.
- Francis X. Diebold & Robert S. Mariano, 1994. "Comparing Predictive Accuracy," NBER Technical Working Papers 0169, National Bureau of Economic Research, Inc.
- Tom Doan, . "DMARIANO: RATS procedure to compute Diebold-Mariano Forecast Comparison Test," Statistical Software Components RTS00055, Boston College Department of Economics.
- Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
- Christoffersen, Peter F. & Diebold, Francis X., 1997.
"Optimal Prediction Under Asymmetric Loss,"
Econometric Theory,
Cambridge University Press, vol. 13(06), pages 808-817, December.
- Peter F. Christoffersen & Francis X. Diebold, 1997. "Optimal prediction under asymmetric loss," Working Papers 97-11, Federal Reserve Bank of Philadelphia.
- Peter F. Christoffersen & Francis X. Diebold, 1994. "Optimal Prediction Under Asymmetric Loss," NBER Technical Working Papers 0167, National Bureau of Economic Research, Inc.
- Christoffersen & Diebold, . "Optimal Prediction Under Asymmetric Loss," Home Pages 167, 1996., University of Pennsylvania.
- Peter F. Christoffersen & Francis X. Diebold, . "Optimal Prediction Under Asymmetric Loss," CARESS Working Papres 97-20, University of Pennsylvania Center for Analytic Research and Economics in the Social Sciences.
- Mc Cracken, Michael W., 2000. "Robust out-of-sample inference," Journal of Econometrics, Elsevier, vol. 99(2), pages 195-223, December.
- Clive W.J. Granger, 1999. "Outline of forecast theory using generalized cost functions," Spanish Economic Review, Springer, vol. 1(2), pages 161-173.
- Inoue, Atsushi, 2001. "Testing For Distributional Change In Time Series," Econometric Theory, Cambridge University Press, vol. 17(01), pages 156-187, February.
- Herman J. Bierens & Werner Ploberger, 1997.
"Asymptotic Theory of Integrated Conditional Moment Tests,"
Econometrica,
Econometric Society, vol. 65(5), pages 1129-1152, September.
- Bierens, H.J. & Ploberger, W., 1995. "Asymptotic theory of integrated conditional moment tests," Discussion Paper 1995-124, Tilburg University, Center for Economic Research.
- Swanson, Norman R & White, Halbert, 1995. "A Model-Selection Approach to Assessing the Information in the Term Structure Using Linear Models and Artificial Neural Networks," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(3), pages 265-75, July.
- West, Kenneth D & McCracken, Michael W, 1998.
"Regression-Based Tests of Predictive Ability,"
International Economic Review,
Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 817-40, November.
- Kenneth D. West & Michael W. McCracken, 1998. "Regression-Based Tests of Predictive Ability," NBER Technical Working Papers 0226, National Bureau of Economic Research, Inc.
- Bierens, Herman J., 1982. "Consistent model specification tests," Journal of Econometrics, Elsevier, vol. 20(1), pages 105-134, October.
- de Jong, Robert M., 2000. "A Strong Consistency Proof For Heteroskedasticity And Autocorrelation Consistent Covariance Matrix Estimators," Econometric Theory, Cambridge University Press, vol. 16(02), pages 262-268, April.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.Cited by:
This item has more than 25 citations. To prevent cluttering this page, these citations are listed on a separate page.
Lists
This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.Statistics
Access and download statisticsCorrections
When requesting a correction, please mention this item's handle: RePEc:eee:econom:v:110:y:2002:i:2:p:353-381For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Wendy Shamier).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.

