Model confidence sets for forecasting models
AbstractThe paper introduces the model confidence set (MCS) and applies it to the selection of forecasting models. An MCS is a set of models that is constructed so that it will contain the “best” forecasting model, given a level of confidence. Thus, an MCS is analogous to a confidence interval for a parameter. The MCS acknowledges the limitations of the data so that uninformative data yield an MCS with many models, whereas informative data yield an MCS with only a few models. We revisit the empirical application in Stock and Watson (1999) and apply the MCS procedure to their set of inflation forecasts. In the first pre-1984 subsample we obtain an MCS that contains only a few models, notably versions of the Solow-Gordon Phillips curve. On the other hand, the second post-1984 subsample contains little information and results in a large MCS. Yet, the random walk forecast is not contained in the MCS for either of the samples. This outcome shows that the random walk forecast is inferior to inflation forecasts based on Phillips curve-like relationships.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by Federal Reserve Bank of Atlanta in its series Working Paper with number 2005-07.
Date of creation: 2005
Date of revision:
This paper has been announced in the following NEP Reports:
- NEP-ALL-2005-05-23 (All new papers)
- NEP-ECM-2005-05-23 (Econometrics)
- NEP-ETS-2005-05-23 (Econometric Time Series)
- NEP-FIN-2005-05-23 (Finance)
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Andrew Atkeson & Lee E. Ohanian., 2001. "Are Phillips curves useful for forecasting inflation?," Quarterly Review, Federal Reserve Bank of Minneapolis, issue Win, pages 2-11.
- Caporin, M. & McAleer, M.J., 2010.
"Ranking multivariate GARCH models by problem dimension,"
Econometric Institute Report
EI 2010-34, Erasmus University Rotterdam, Econometric Institute.
- Massimiliano Caporin & Michael McAleer, 2010. "Ranking Multivariate GARCH Models by Problem Dimension," CIRJE F-Series CIRJE-F-742, CIRJE, Faculty of Economics, University of Tokyo.
- Massimiliano Caporin & Michael McAleer, 2010. "Ranking Multivariate GARCH Models by Problem Dimension," Working Papers in Economics 10/34, University of Canterbury, Department of Economics and Finance.
- Massimiliano Caporin & Michael McAleer, 2010. "Ranking Multivariate GARCH Models by Problem Dimension," "Marco Fanno" Working Papers 0124, Dipartimento di Scienze Economiche "Marco Fanno".
- Massimiliano Caporin & Michael McAleer, 2010. "Ranking Multivariate GARCH Models by Problem Dimension," CARF F-Series CARF-F-219, Center for Advanced Research in Finance, Faculty of Economics, The University of Tokyo.
- Christian Dreger & Konstantin A. Kholodilin, 2010.
"Forecasting Private Consumption by Consumer Surveys,"
Discussion Papers of DIW Berlin
1066, DIW Berlin, German Institute for Economic Research.
- Christian Dreger & Konstantin Arkadievich Kholodilin, 2013. "Forecasting Private Consumption by Consumer Surveys," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 32(1), pages 10-18, 01.
- James M. Nason & Gregor W. Smith, 2008.
"Identifying the new Keynesian Phillips curve,"
Journal of Applied Econometrics,
John Wiley & Sons, Ltd., vol. 23(5), pages 525-551.
- Romano, Joseph P. & Shaikh, Azeem M. & Wolf, Michael, 2008.
"Formalized Data Snooping Based On Generalized Error Rates,"
Cambridge University Press, vol. 24(02), pages 404-447, April.
- Joseph P & Romano & Azeem M. Shaikh & Michael Wolf, 2005. "Formalized Data Snooping Based on Generalized Error Rates," IEW - Working Papers 259, Institute for Empirical Research in Economics - University of Zurich.
- Geetesh Bhardwaj & Norman Swanson, 2004.
"An Empirical Investigation of the Usefulness of ARFIMA Models for Predicting Macroeconomic and Financial Time Series,"
Departmental Working Papers
200422, Rutgers University, Department of Economics.
- Bhardwaj, Geetesh & Swanson, Norman R., 2006. "An empirical investigation of the usefulness of ARFIMA models for predicting macroeconomic and financial time series," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 539-578.
- Hansen, Peter Reinhard & Lunde, Asger, 2006. "Consistent ranking of volatility models," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 97-121.
- Peter Hansen & Asger Lunde & James M. Nason, 2003.
"Choosing the Best Volatility Models:The Model Confidence Set Approach,"
2003-05, Brown University, Department of Economics.
- Peter Reinhard Hansen & Asger Lunde & James M. Nason, 2003. "Choosing the Best Volatility Models: The Model Confidence Set Approach," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 65(s1), pages 839-861, December.
- Peter Reinhard Hansen & Asger Lunde & James M. Nason, 2003. "Choosing the best volatility models: the model confidence set approach," Working Paper 2003-28, Federal Reserve Bank of Atlanta.
- Jörg Döpke & Ulrich Fritsche, 2006. "Growth and inflation forecasts for Germany a panel-based assessment of accuracy and efficiency," Empirical Economics, Springer, vol. 31(3), pages 777-798, September.
- Patton, Andrew J. & Sheppard, Kevin, 2009. "Optimal combinations of realised volatility estimators," International Journal of Forecasting, Elsevier, vol. 25(2), pages 218-238.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Diane Rosenberger).
If references are entirely missing, you can add them using this form.