Evaluating CPB's published GDP growth forecasts; a comparison with individual and pooled VAR based forecasts
AbstractWe compare the accuracy of our published GDP growth forecasts from our large macro model, SAFFIER, to those produced by VAR based models using both classical and Bayesian estimation techniques. We employ a data driven methodology for selecting variables to include in our VAR models and we find that a randomly selected classical VAR model performs worse in most cases than the Bayesian equivalent, which performs worse than our published forecasts in most cases. However, when we pool forecasts across many VARs we can produce more accurate forecasts than we published. A review of the literature suggests that forecast accuracy is likely irrelevant for the non-forecasting activities the model is used for at CPB because they are fundamentally different activities.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by CPB Netherlands Bureau for Economic Policy Analysis in its series CPB Document with number 172.
Date of creation: Oct 2008
Date of revision:
Find related papers by JEL classification:
- C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
- C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
- E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications
This paper has been announced in the following NEP Reports:
- NEP-ALL-2008-10-13 (All new papers)
- NEP-CBA-2008-10-13 (Central Banking)
- NEP-FOR-2008-10-13 (Forecasting)
- NEP-MAC-2008-10-13 (Macroeconomics)
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- David F. Hendry & Michael P. Clements, 2001.
"Economic forecasting: some lessons from recent research,"
Working Paper Series
082, European Central Bank.
- Hendry, David F. & Clements, Michael P., 2003. "Economic forecasting: some lessons from recent research," Economic Modelling, Elsevier, vol. 20(2), pages 301-329, March.
- David Hendry & Michael P. Clements, 2001. "Economic Forecasting: Some Lessons from Recent Research," Economics Series Working Papers 78, University of Oxford, Department of Economics.
- Hendry, David F & Michael P. Clements, 2002. "Economic Forecasting: Some Lessons from Recent Research," Royal Economic Society Annual Conference 2002 99, Royal Economic Society.
- David Hendry & Michael P. Clements, 2001. "Economic Forecasting: Some Lessons from Recent Research," Economics Papers 2002-W11, Economics Group, Nuffield College, University of Oxford.
- Makridakis, Spyros & Hibon, Michele, 2000. "The M3-Competition: results, conclusions and implications," International Journal of Forecasting, Elsevier, vol. 16(4), pages 451-476.
- Sims, Christopher A, 1980. "Macroeconomics and Reality," Econometrica, Econometric Society, vol. 48(1), pages 1-48, January.
- Cooper, J Phillip & Nelson, Charles R, 1975. "The Ex Ante Prediction Performance of the St. Louis and FRB-MIT-PENN Econometric Models and Some Results on Composite Predictors," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 7(1), pages 1-32, February.
- Smith, Ron, 1998. "Emergent policy-making with macroeconometric models," Economic Modelling, Elsevier, vol. 15(3), pages 429-442, July.
- Timmermann, Allan G, 2005.
CEPR Discussion Papers
5361, C.E.P.R. Discussion Papers.
- David F. Hendry & Michael P. Clements, 2004.
"Pooling of forecasts,"
Royal Economic Society, vol. 7(1), pages 1-31, 06.
- David Hendry & Michael P. Clements, 2001. "Pooling of Forecasts," Economics Papers 2002-W9, Economics Group, Nuffield College, University of Oxford.
- David Hendry & Michael Clements, 2001. "Pooling of Forecasts," Economics Series Working Papers 2002-W09, University of Oxford, Department of Economics.
- Phoebus J. Dhrymes & E. Philip Howrey & Saul H. Hymans & Jan Kmenta & Edward E. Leamer & Richard E. Quandt & James B. Ramsey & Harold T. Shapiro & Victor Zarnowitz, 1972. "Criteria For Evaluation Of Econometric Models," NBER Chapters, in: Annals of Economic and Social Measurement, Volume 1, number 3, pages 291-325 National Bureau of Economic Research, Inc.
- Makridakis, Spyros & Chatfield, Chris & Hibon, Michele & Lawrence, Michael & Mills, Terence & Ord, Keith & Simmons, LeRoy F., 1993. "The M2-competition: A real-time judgmentally based forecasting study," International Journal of Forecasting, Elsevier, vol. 9(1), pages 5-22, April.
- Litterman, Robert B, 1986.
"Forecasting with Bayesian Vector Autoregressions-Five Years of Experience,"
Journal of Business & Economic Statistics,
American Statistical Association, vol. 4(1), pages 25-38, January.
- Robert B. Litterman, 1985. "Forecasting with Bayesian vector autoregressions five years of experience," Working Papers 274, Federal Reserve Bank of Minneapolis.
- Clements,Michael & Hendry,David, 1998.
"Forecasting Economic Time Series,"
Cambridge University Press, number 9780521634809.
- Clemen, Robert T., 1989. "Combining forecasts: A review and annotated bibliography," International Journal of Forecasting, Elsevier, vol. 5(4), pages 559-583.
- Eitrheim, Oyvind & Husebo, Tore Anders & Nymoen, Ragnar, 1999. "Equilibrium-correction vs. differencing in macroeconometric forecasting," Economic Modelling, Elsevier, vol. 16(4), pages 515-544, December.
- Robert G. King & Charles I. Plosser & James H. Stock & Mark W. Watson, 1991.
"Stochastic trends and economic fluctuations,"
Working Paper Series, Macroeconomic Issues
91-4, Federal Reserve Bank of Chicago.
- Henk Kranendonk & Johan Verbruggen, 2007. "SAFFIER; a multi-purpose model of the Dutch economy for short-term and medium-term analyses," CPB Document 144, CPB Netherlands Bureau for Economic Policy Analysis.
- Ken Holden, 1997. "A comparison of forecasts from UK economic models and some Bayesian vector autoregressive models," Journal of Economic Studies, Emerald Group Publishing, vol. 24(4), pages 242-256, September.
- John C. Robertson & Ellis W. Tallman, 1999. "Vector autoregressions: forecasting and reality," Economic Review, Federal Reserve Bank of Atlanta, issue Q1, pages 4-18.
- Henk Don, 2003. "SAFE: a quarterly model of the Dutch economy for short-term analyses," CPB Document 42, CPB Netherlands Bureau for Economic Policy Analysis.
- Ard H.J. den Reijer, 2005. "Forecasting Dutch GDP using Large Scale Factor Models," DNB Working Papers 028, Netherlands Central Bank, Research Department.
- Sims, Christopher A & Stock, James H & Watson, Mark W, 1990. "Inference in Linear Time Series Models with Some Unit Roots," Econometrica, Econometric Society, vol. 58(1), pages 113-44, January.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ().
If references are entirely missing, you can add them using this form.