This file is part of IDEAS, which uses RePEc data


[ Papers | Articles | Software | Books | Chapters | Authors | Institutions | JEL Classification | NEP reports | Search | New papers by email | Author registration | Rankings | Volunteers | FAQ | Blog | Help! ]

On the Selection of Forecasting Models

Author info | Abstract | Publisher info | Download info | Related research | Statistics
Author Info
Inoue, Atsushi
Kilian, Lutz

Additional information is available for the following registered author(s):

Abstract

It is standard in applied work to select forecasting models by ranking candidate models by their prediction mean squared error (PMSE) in simulated out-of-sample (SOOS) forecasts. Alternatively, forecast models may be selected using information criteria (IC). We compare the asymptotic and finite-sample properties of these methods in terms of their ability to mimimize the true out-of-sample PMSE, allowing for possible misspecification of the forecast models under consideration. We first study a covariance stationary environment. We show that under suitable conditions the IC method will be consistent for the best approximating model among the candidate models. In contrast, under standard assumptions the SOOS method will select over-parameterized models with positive probability, resulting in excessive finite-sample PMSEs. We also show that in the presence of unmodelled structural change both methods will be inadmissible in the sense that they may select a model with strictly higher PMSE than the best approximating model among the candidate models.

Download Info
To download:

If you experience problems downloading a file, check if you have the proper application to view it first. Information about this may be contained in the File-Format links below. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://www.cepr.org/pubs/dps/DP3809.asp
File Format: application/pdf
File Function:
Download Restriction: CEPR Discussion Papers are free to download for our researchers, subscribers and members. If you fall into one of these categories but have trouble downloading our papers, please contact us at subscribers@cepr.org

As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.

Publisher Info
Paper provided by C.E.P.R. Discussion Papers in its series CEPR Discussion Papers with number 3809.

Download reference. The following formats are available: HTML (with abstract), plain text (with abstract), BibTeX, RIS (EndNote, RefMan, ProCite), ReDIF
Length:
Date of creation: Mar 2003
Date of revision:
Handle: RePEc:cpr:ceprdp:3809

Contact details of provider:
Postal: Centre for Economic Policy Research, 53--56 Great Sutton Street, London EC1V 0DG
Phone: 44 - 20 - 7183 8801
Fax: 44 - 20 - 7183 8820

Order Information:
Email:

For technical questions regarding this item, or to correct its listing, contact: ().

Related research
Keywords: forecast accuracy; information criteria; model selection; simulated out-of-sample method; structural change;

Other versions of this item:

Find related papers by JEL classification:
C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions
C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation and Testing
C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Other Model Applications

This paper has been announced in the following NEP Reports:

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
  1. Diebold, Francis X & Gunther, Todd A & Tay, Anthony S, 1998. "Evaluating Density Forecasts with Applications to Financial Risk Management," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 863-83, November.
  2. Swanson, Norman R & Zeng, Tian, 2001. "Choosing among Competing Econometric Forecasts: Regression-Based Forecast Combination Using Model Selection," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 20(6), pages 425-40, September.
  3. McCracken, Michael W., 2007. "Asymptotics for out of sample tests of Granger causality," Journal of Econometrics, Elsevier, vol. 140(2), pages 719-752, October. [Downloadable!] (restricted)
  4. Ester Faia, 2004. "Monetary policy in a world with different financial systems," Money Macro and Finance (MMF) Research Group Conference 2003 28, Money Macro and Finance Research Group. [Downloadable!]
    Other versions:
  5. Alexei Onatski & Noah Williams, 2002. "Modeling model uncertainty," Discussion Papers 0203-05, Columbia University, Department of Economics. [Downloadable!]
    Other versions:
  6. Gregory Mankiw & Ricardo Reis, 2002. "What measure of inflation should a central bank target?," Working Paper Series 170, European Central Bank. [Downloadable!]
    Other versions:
  7. Evans, George W & Honkapohja, Seppo, 2002. "Monetary Policy, Expectations and Commitment," CEPR Discussion Papers 3434, C.E.P.R. Discussion Papers. [Downloadable!] (restricted)
    Other versions:
  8. Canova, Fabio, 2002. "G-7 Inflation Forecasts," CEPR Discussion Papers 3283, C.E.P.R. Discussion Papers. [Downloadable!] (restricted)
  9. Benigno, Pierpaolo & Lopez-Salido, J. David, 2006. "Inflation Persistence and Optimal Monetary Policy in the Euro Area," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 38(3), pages 587-614, April. [Downloadable!] (restricted)
    Other versions:
  10. Lutz Kilian & Atsushi Inoue, 2002. "In-Sample or out-of-sample tests of predictability: which one should we use?," Working Paper Series 195, European Central Bank. [Downloadable!]
    Other versions:
  11. Miguel Casares, 2002. "Time-to-build approach in a sticky price; sticky wage optimizing monetary model," Working Paper Series 147, European Central Bank. [Downloadable!]
  12. Mark A. Wynne & Diego Rodriguez-Palenzuela, 2004. "Measurement Bias in the HICP: What do we know and What do we need to know?," Journal of Economic Surveys, Blackwell Publishing, vol. 18(1), pages 79-112, 02. [Downloadable!] (restricted)
    Other versions:
  13. Ignazio Angeloni & Benoit Mojon & Anil K. Kashyap & Daniele Terlizzese, 2002. "Monetary transmission in the Euro Area: where do we stand?," Working Paper Series 114, European Central Bank. [Downloadable!]
  14. Olga Arratibel & Diego Rodriguez-Palenzuela & Christian Thimann, 2002. "Inflation dynamics and dual inflation in accession countries: a 'New Keynesian' perspective," Working Paper Series 132, European Central Bank. [Downloadable!]
  15. Corradi, Valentina & Swanson, Norman R. & Olivetti, Claudia, 2001. "Predictive ability with cointegrated variables," Journal of Econometrics, Elsevier, vol. 104(2), pages 315-358, September. [Downloadable!] (restricted)
  16. Christoffersen, Peter F, 1998. "Evaluating Interval Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 841-62, November.
  17. repec:att:wimass:199417 is not listed on IDEAS
  18. Kaushik Mitra & Seppo Honkapohja, 2004. "Performance of Monetary Policy with Internal Central Bank Forecasting," Royal Holloway, University of London: Discussion Papers in Economics 04/18, Department of Economics, Royal Holloway University of London, revised Jul 2004. [Downloadable!]
    Other versions:
  19. Bossaerts, Peter & Hillion, Pierre, 1999. "Implementing Statistical Criteria to Select Return Forecasting Models: What Do We Learn?," Review of Financial Studies, Oxford University Press for Society for Financial Studies, vol. 12(2), pages 405-28.
  20. Julian Benedict Morgan & Silvia Fabiani, 2003. "Aggregation and euro area Phillips curves," Working Paper Series 213, European Central Bank. [Downloadable!]
  21. Peter C.B. Phillips & Werner Ploberger, 1992. "Posterior Odds Testing for a Unit Root with Data-Based Model Selection," Cowles Foundation Discussion Papers 1017, Cowles Foundation, Yale University. [Downloadable!]
    Other versions:
  22. Simone Manganelli, 2002. "Duration: volume and volatility impact of trades," Working Paper Series 125, European Central Bank. [Downloadable!]
    Other versions:
  23. Clark, Todd E. & McCracken, Michael W., 2001. "Tests of equal forecast accuracy and encompassing for nested models," Journal of Econometrics, Elsevier, vol. 105(1), pages 85-110, November. [Downloadable!] (restricted)
    Other versions:
  24. Jean-Pierre Vidal & Philippe Michel, 2003. "Self-control and savings," Working Paper Series 211, European Central Bank. [Downloadable!]
  25. Günter Coenen & Volker Wieland, 2002. "Inflation Dynamics and International Linkages: A Model of the United States, the Euro Area and Japan," Computing in Economics and Finance 2002 240, Society for Computational Economics.
    Other versions:
  26. Seppo Honkapohja & Kaushik Mitra, 2002. "Learning stability in economics with heterogenous agents," Working Paper Series 120, European Central Bank. [Downloadable!]
    Other versions:
  27. Meese, Richard A. & Rogoff, Kenneth, 1983. "Empirical exchange rate models of the seventies : Do they fit out of sample?," Journal of International Economics, Elsevier, vol. 14(1-2), pages 3-24, February. [Downloadable!] (restricted)
  28. Davidson, James, 2002. "Establishing conditions for the functional central limit theorem in nonlinear and semiparametric time series processes," Journal of Econometrics, Elsevier, vol. 106(2), pages 243-269, February. [Downloadable!] (restricted)
  29. Nicole Jonker, 2002. "Constructing quality-adjusted price indices: a comparison of hedonic and discrete choice models," Working Paper Series 172, European Central Bank. [Downloadable!]
    Other versions:
  30. Evangelos Tabakis, 2002. "Analysing and combining multiple credit assessments of financial institutions," Working Paper Series 123, European Central Bank. [Downloadable!]
  31. De Fiore, Fiorella & Teles, Pedro, 2002. "The Optimal Mix of Taxes on Money, Consumption and Income," CEPR Discussion Papers 3437, C.E.P.R. Discussion Papers. [Downloadable!] (restricted)
    Other versions:
  32. Mc Cracken, Michael W., 2000. "Robust out-of-sample inference," Journal of Econometrics, Elsevier, vol. 99(2), pages 195-223, December. [Downloadable!] (restricted)
  33. Margarida Duarte & Alexander L. Wolman, 2002. "Regional inflation in a currency union: fiscal policy vs. fundamentals," International Finance Discussion Papers 746, Board of Governors of the Federal Reserve System (U.S.). [Downloadable!]
    Other versions:
  34. Charles Bean & Jens D.J. Larsen & Kalin Nikolov, 2002. "Financial frictions and the monetary transmission mechanism: theory; evidence and policy implications," Working Paper Series 113, European Central Bank. [Downloadable!]
  35. Reint Gropp & Jukka Vesala & Giuseppe Vulpes, 2002. "Equity and bond market signals as leading indicators of bank fragility," Conference Series ; [Proceedings], Federal Reserve Bank of Boston. [Downloadable!]
    Other versions:
  36. Stock, James H. & Watson, Mark W., 1999. "Forecasting inflation," Journal of Monetary Economics, Elsevier, vol. 44(2), pages 293-335, October. [Downloadable!] (restricted)
    Other versions:
  37. Marcel Fratzscher, 2002. "On currency crises and contagion," Working Paper Series 139, European Central Bank. [Downloadable!]
    Other versions:
  38. Corsetti, Giancarlo & Dedola, Luca, 2003. "Macroeconomics of International Price Discrimination," CEPR Discussion Papers 3710, C.E.P.R. Discussion Papers. [Downloadable!] (restricted)
    Other versions:
  39. Mark, Nelson C, 1995. "Exchange Rates and Fundamentals: Evidence on Long-Horizon Predictability," American Economic Review, American Economic Association, vol. 85(1), pages 201-18, March.
  40. James H. Stock & Mark W. Watson, 2003. "Forecasting Output and Inflation: The Role of Asset Prices," Journal of Economic Literature, American Economic Association, vol. 41(3), pages 788-829, September.
    Other versions:
  41. repec:att:wimass:199710 is not listed on IDEAS
  42. Martin Scheicher & Ernst Glatzer, 2003. "Modelling the implied probability of stock market movements," Working Paper Series 212, European Central Bank. [Downloadable!]
  43. West, Kenneth D & McCracken, Michael W, 1998. "Regression-Based Tests of Predictive Ability," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 817-40, November.
    Other versions:
  44. Christopher J. Erceg & Andrew T. Levin, 2002. "Optimal monetary policy with durable and non-durable goods," International Finance Discussion Papers 748, Board of Governors of the Federal Reserve System (U.S.). [Downloadable!]
    Other versions:
  45. Inoue, Atsushi & Kilian, Lutz, 2003. "On the Selection of Forecasting Models," CEPR Discussion Papers 3809, C.E.P.R. Discussion Papers. [Downloadable!] (restricted)
    Other versions:
  46. Cyril Monnet & Erwan Quintin, 2002. "Optimal contracts in a dynamic costly state verification model," Working Paper Series 126, European Central Bank. [Downloadable!]
    Other versions:
  47. James H. Stock & Mark W. Watson, 1998. "A Comparison of Linear and Nonlinear Univariate Models for Forecasting Macroeconomic Time Series," NBER Working Papers 6607, National Bureau of Economic Research, Inc. [Downloadable!] (restricted)
Full references

Cited by:
(explanations, Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.)
This item has more than 25 citations. To prevent cluttering this page, these citations are listed on a separate page.
Statistics
Access and download statistics

Did you know? You can create your own reading lists on IDEAS.

This page was last updated on 2009-11-25.

This information is provided to you by IDEAS at the Department of Economics, College of Liberal Arts and Sciences, University of Connecticut using RePEc data on a server sponsored by the Society for Economic Dynamics.