Robust Model Selection in Dynamic Models with an Application to Comparing Predictive Accuracy
A model selection procedure based on a general criterion function, with an example of the Kullback-Leibler Information Criterion (KLIC) using quasi-likelihood functions, is considered for dynamic non-nested models. We propose a robust test which generalizes Lien and Vuong's (1987) test with a Heteroscadasticity/Autocorrelation Consistent (HAC) variance estimator. We use the fixed-b asymptotics developed in Kiefer and Vogelsang (2005) to improve the asymptotic approximation to the sampling distribution of the test statistic. The fixed-b approach is compared with a bootstrap method and the standard normal approximation in Monte Carlo simulations. The fixed-b asymptotics and the bootstrap method are found to be markedly superior to the standard normal approximation. An empirical application for foreign exchange rate forecasting models is presented.
|Date of creation:||Sep 2006|
|Contact details of provider:|| Postal: 402 Uris Hall, Ithaca, NY 14853|
Phone: (607) 255-9901
Fax: (607) 255-2818
Web page: http://www.arts.cornell.edu/econ/CAE/workingpapers.html
More information through EDIRC
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Kiefer, Nicholas M. & Bunzel, Helle & Vogelsang, Timothy & Vogelsang, Timothy & Bunzel, Helle, 2000.
"Simple Robust Testing of Regression Hypotheses,"
Staff General Research Papers Archive
1832, Iowa State University, Department of Economics.
- Harvey, David & Leybourne, Stephen & Newbold, Paul, 1997. "Testing the equality of prediction mean squared errors," International Journal of Forecasting, Elsevier, vol. 13(2), pages 281-291, June.
- Godfrey, L. G., 1998. "Tests of non-nested regression models some results on small sample behaviour and the bootstrap," Journal of Econometrics, Elsevier, vol. 84(1), pages 59-74, May.
- Kiefer, Nicholas M. & Vogelsang, Timothy J., 2005.
"A New Asymptotic Theory For Heteroskedasticity-Autocorrelation Robust Tests,"
Cambridge University Press, vol. 21(06), pages 1130-1164, December.
- Kiefer, Nicholas M. & Vogelsang, Timothy J., 2005. "A New Asymptotic Theory for Heteroskedasticity-Autocorrelation Robust Tests," Working Papers 05-08, Cornell University, Center for Analytic Economics.
- McAleer, Michael, 1995. "The significance of testing empirical non-nested models," Journal of Econometrics, Elsevier, vol. 67(1), pages 149-171, May.
- Hansen, Bruce E., 2005. "Challenges For Econometric Model Selection," Econometric Theory, Cambridge University Press, vol. 21(01), pages 60-68, February.
- P. C. B. Phillips & S. N. Durlauf, 1986.
"Multiple Time Series Regression with Integrated Processes,"
Review of Economic Studies,
Oxford University Press, vol. 53(4), pages 473-495.
- Peter C.B. Phillips & Steven N. Durlauf, 1985. "Multiple Time Series Regression with Integrated Processes," Cowles Foundation Discussion Papers 768, Cowles Foundation for Research in Economics, Yale University.
- M. H. Pesaran, 1974. "On the General Problem of Model Selection," Review of Economic Studies, Oxford University Press, vol. 41(2), pages 153-171.
- Godfrey, L. G. & Pesaran, M. H., 1983. "Tests of non-nested regression models: Small sample adjustments and Monte Carlo evidence," Journal of Econometrics, Elsevier, vol. 21(1), pages 133-154, January.
- Gourieroux, C. & Monfort, A., 1986. "Testing non-nested hypotheses," Handbook of Econometrics, in: R. F. Engle & D. McFadden (ed.), Handbook of Econometrics, edition 1, volume 4, chapter 44, pages 2583-2637 Elsevier.
- Davidson, Russell & MacKinnon, James G, 1981.
"Several Tests for Model Specification in the Presence of Alternative Hypotheses,"
Econometric Society, vol. 49(3), pages 781-793, May.
- Russell Davidson & James G. MacKinnon, 1980. "Several Tests for Model Specification in the Presence of Alternative Hypotheses," Working Papers 378, Queen's University, Department of Economics.
- Lien, Donald & Vuong, Quang H., 1987. "Selecting the best linear regression model : A classical approach," Journal of Econometrics, Elsevier, vol. 35(1), pages 3-23, May.
- Kiefer, Nicholas M. & Vogelsang, Timothy J., 2002. "Heteroskedasticity-Autocorrelation Robust Testing Using Bandwidth Equal To Sample Size," Econometric Theory, Cambridge University Press, vol. 18(06), pages 1350-1366, December.
- Hall, Peter & Horowitz, Joel L, 1996. "Bootstrap Critical Values for Tests Based on Generalized-Method-of-Moments Estimators," Econometrica, Econometric Society, vol. 64(4), pages 891-916, July.
- Yanqin Fan & Qi Li, 1995. "Bootstrapping J-type tests for non-nested regression models," Economics Letters, Elsevier, vol. 48(2), pages 107-112, May.
- Michael Jansson, 2004. "The Error in Rejection Probability of Simple Autocorrelation Robust Tests," Econometrica, Econometric Society, vol. 72(3), pages 937-946, 05.
- Hansen, Peter Reinhard, 2005. "A Test for Superior Predictive Ability," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 365-380, October.
When requesting a correction, please mention this item's handle: RePEc:ecl:corcae:06-09. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ()
If references are entirely missing, you can add them using this form.