This file is part of IDEAS, which uses RePEc data


[ Papers | Articles | Software | Books | Chapters | Authors | Institutions | JEL Classification | NEP reports | Search | New papers by email | Author registration | Rankings | Volunteers | FAQ | Blog | Help! ]

On the selection of forecasting models

Author info | Abstract | Publisher info | Download info | Related research | Statistics
Author Info
Lutz Kilian () (University of Cambridge - Faculty of Economics and Politics at Ann Arbor - Department of Economics, 611 Tappan Street, Ann Arbor , MI 48109-1220, United States.)
Atsushi Inoue () (North Carolina State University - Department of Agricultural & Resource Economics, Box 8109, 3332 Nelson Hall, Raleigh , NC 27695-8109, United States.)

Additional information is available for the following registered author(s):

Abstract

It is standard in applied work to select forecasting models by ranking candidate models by their PMSE in simulated out-of-sample (SOOS) forecasts. Alternatively, forecast models may be selected using information criteria (IC). We compare the asymptotic and finite-sample properties of these methods in terms of their ability to minimize the true out-of-sample PMSE, allowing for possible misspecification of the forecast models under consideration. We first study a covariance stationary environment. We show that under suitable conditions the IC method will be consistent for the best approximating model among the candidate models. In contrast, under standard assumptions the SOOS method will select overparameterized models with positive probability, resulting in excessive finite-sample PMSEs. We also show that in the presence of unmodelled structural change both methods will be inadmissible in the sense that they may select a model with strictly higher PMSE than the best approximating model among the candidate models. JEL Classification: C22; C52; C53.

Download Info
To download:

If you experience problems downloading a file, check if you have the proper application to view it first. Information about this may be contained in the File-Format links below. In case of further problems read the IDEAS help file. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://www.ecb.europa.eu/pub/pdf/scpwps/ecbwp214.pdf
File Format: application/pdf
File Function:
Download Restriction: no

Publisher Info
Paper provided by European Central Bank in its series Working Paper Series with number 214.

Download reference. The following formats are available: HTML, plain text, BibTeX, RIS (EndNote), ReDIF
Length: 60 pages
Date of creation: Feb 2003
Date of revision:
Handle: RePEc:ecb:ecbwps:20030214

Contact details of provider:
Postal: Postfach 16 03 19, Frankfurt am Main, Germany
Phone: +49 69 1344 0
Fax: +49 69 1344 6000
Web page: http://www.ecb.europa.eu/home/html/index.en.html
More information through EDIRC

Order Information:
Postal: Press and Information Division, European Central Bank, Kaiserstrasse 29, 60311 Frankfurt am Main, Germany
Email:

For technical questions regarding this item, or to correct its listing, contact: (Official Publications).

Related research
Keywords: Model selection forecast accuracy structural change information criteria simulated out-of-sample method.

Other versions of this item:

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
  1. Clark, Todd E. & McCracken, Michael W., 2001. "Tests of equal forecast accuracy and encompassing for nested models," Journal of Econometrics, Elsevier, vol. 105(1), pages 85-110, November. [Downloadable!] (restricted)
    Other versions:
  2. Diebold, Francis X & Gunther, Todd A & Tay, Anthony S, 1998. "Evaluating Density Forecasts with Applications to Financial Risk Management," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 863-83, November.
  3. Swanson, Norman R & Zeng, Tian, 2001. "Choosing among Competing Econometric Forecasts: Regression-Based Forecast Combination Using Model Selection," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 20(6), pages 425-40, September.
  4. Meese, Richard A. & Rogoff, Kenneth, 1983. "Empirical exchange rate models of the seventies : Do they fit out of sample?," Journal of International Economics, Elsevier, vol. 14(1-2), pages 3-24, February. [Downloadable!] (restricted)
  5. Davidson, James, 2002. "Establishing conditions for the functional central limit theorem in nonlinear and semiparametric time series processes," Journal of Econometrics, Elsevier, vol. 106(2), pages 243-269, February. [Downloadable!] (restricted)
  6. Mc Cracken, Michael W., 2000. "Robust out-of-sample inference," Journal of Econometrics, Elsevier, vol. 99(2), pages 195-223, December. [Downloadable!] (restricted)
  7. Stock, James H. & Watson, Mark W., 1999. "Forecasting inflation," Journal of Monetary Economics, Elsevier, vol. 44(2), pages 293-335, October. [Downloadable!] (restricted)
    Other versions:
  8. Lutz Kilian & Atsushi Inoue, 2002. "In-Sample or out-of-sample tests of predictability: which one should we use?," Working Paper Series 195, European Central Bank. [Downloadable!]
    Other versions:
  9. Mark, Nelson C, 1995. "Exchange Rates and Fundamentals: Evidence on Long-Horizon Predictability," American Economic Review, American Economic Association, vol. 85(1), pages 201-18, March.
  10. James H. Stock & Mark W. Watson, 2003. "Forecasting Output and Inflation: The Role of Asset Prices," Journal of Economic Literature, American Economic Association, vol. 41(3), pages 788-829, September.
    Other versions:
  11. repec:att:wimass:199710 is not listed on IDEAS
  12. Corradi, Valentina & Swanson, Norman R. & Olivetti, Claudia, 2001. "Predictive ability with cointegrated variables," Journal of Econometrics, Elsevier, vol. 104(2), pages 315-358, September. [Downloadable!] (restricted)
  13. Christoffersen, Peter F, 1998. "Evaluating Interval Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 841-62, November.
  14. West, Kenneth D & McCracken, Michael W, 1998. "Regression-Based Tests of Predictive Ability," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 817-40, November.
    Other versions:
  15. repec:att:wimass:199417 is not listed on IDEAS
  16. Bossaerts, Peter & Hillion, Pierre, 1999. "Implementing Statistical Criteria to Select Return Forecasting Models: What Do We Learn?," Review of Financial Studies, Oxford University Press for Society for Financial Studies, vol. 12(2), pages 405-28.
  17. James H. Stock & Mark W. Watson, 1998. "A Comparison of Linear and Nonlinear Univariate Models for Forecasting Macroeconomic Time Series," NBER Working Papers 6607, National Bureau of Economic Research, Inc. [Downloadable!] (restricted)
Full references

Cited by:
(explanations, Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.)
This item has more than 25 citations. To prevent cluttering this page, these citations are listed on a separate page.
Statistics
Access and download statistics

Did you know? The yearly budget of IDEAS is exactly $0: it relies entirely on volunteer work.

This page was last updated on 2008-8-15.

This information is provided to you by IDEAS at the Department of Economics, College of Liberal Arts and Sciences, University of Connecticut using RePEc data on a server sponsored by the Society for Economic Dynamics.