Evaluating CPB's published GDP growth forecasts; a comparison with individual and pooled VAR based forecasts
AbstractWe compare the accuracy of our published GDP growth forecasts from our large macro model, SAFFIER, to those produced by VAR based models using both classical and Bayesian estimation techniques. We employ a data driven methodology for selecting variables to include in our VAR models and we find that a randomly selected classical VAR model performs worse in most cases than the Bayesian equivalent, which performs worse than our published forecasts in most cases. However, when we pool forecasts across many VARs we can produce more accurate forecasts than we published. A review of the literature suggests that forecast accuracy is likely irrelevant for the non-forecasting activities the model is used for at CPB because they are fundamentally different activities.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by CPB Netherlands Bureau for Economic Policy Analysis in its series CPB Document with number 172.
Date of creation: Oct 2008
Date of revision:
Find related papers by JEL classification:
- C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
- C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
- E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications
This paper has been announced in the following NEP Reports:
- NEP-ALL-2008-10-13 (All new papers)
- NEP-CBA-2008-10-13 (Central Banking)
- NEP-FOR-2008-10-13 (Forecasting)
- NEP-MAC-2008-10-13 (Macroeconomics)
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Henk Kranendonk & Johan Verbruggen, 2007. "SAFFIER; a multi-purpose model of the Dutch economy for short-term and medium-term analyses," CPB Document 144, CPB Netherlands Bureau for Economic Policy Analysis.
- Robert B. Litterman, 1985.
"Forecasting with Bayesian vector autoregressions five years of experience,"
274, Federal Reserve Bank of Minneapolis.
- Litterman, Robert B, 1986. "Forecasting with Bayesian Vector Autoregressions-Five Years of Experience," Journal of Business & Economic Statistics, American Statistical Association, vol. 4(1), pages 25-38, January.
- David F. Hendry & Michael P. Clements, 2004.
"Pooling of forecasts,"
Royal Economic Society, vol. 7(1), pages 1-31, 06.
- David Hendry & Michael P. Clements, 2001. "Pooling of Forecasts," Economics Papers 2002-W9, Economics Group, Nuffield College, University of Oxford.
- David Hendry & Michael Clements, 2001. "Pooling of Forecasts," Economics Series Working Papers 2002-W09, University of Oxford, Department of Economics.
- Ken Holden, 1997. "A comparison of forecasts from UK economic models and some Bayesian vector autoregressive models," Journal of Economic Studies, Emerald Group Publishing, vol. 24(4), pages 242-256, September.
- Hendry, David F & Michael P. Clements, 2002.
"Economic Forecasting: Some Lessons from Recent Research,"
Royal Economic Society Annual Conference 2002
99, Royal Economic Society.
- Hendry, David F. & Clements, Michael P., 2003. "Economic forecasting: some lessons from recent research," Economic Modelling, Elsevier, vol. 20(2), pages 301-329, March.
- Hendry, David F. & Clements, Michael P., 2001. "Economic forecasting: some lessons from recent research," Working Paper Series 0082, European Central Bank.
- David Hendry & Michael P. Clements, 2001. "Economic Forecasting: Some Lessons from Recent Research," Economics Series Working Papers 78, University of Oxford, Department of Economics.
- David Hendry & Michael P. Clements, 2001. "Economic Forecasting: Some Lessons from Recent Research," Economics Papers 2002-W11, Economics Group, Nuffield College, University of Oxford.
- Henk Don, 2003. "SAFE: a quarterly model of the Dutch economy for short-term analyses," CPB Document 42, CPB Netherlands Bureau for Economic Policy Analysis.
- Timmermann, Allan G, 2005.
CEPR Discussion Papers
5361, C.E.P.R. Discussion Papers.
- Phoebus J. Dhrymes & E. Philip Howrey & Saul H. Hymans & Jan Kmenta & Edward E. Leamer & Richard E. Quandt & James B. Ramsey & Harold T. Shapiro & Victor Zarnowitz, 1972. "Criteria For Evaluation Of Econometric Models," NBER Chapters, in: Annals of Economic and Social Measurement, Volume 1, number 3, pages 291-325 National Bureau of Economic Research, Inc.
- Makridakis, Spyros & Hibon, Michele, 2000. "The M3-Competition: results, conclusions and implications," International Journal of Forecasting, Elsevier, vol. 16(4), pages 451-476.
- Sims, Christopher A, 1980. "Macroeconomics and Reality," Econometrica, Econometric Society, vol. 48(1), pages 1-48, January.
- Robert G. King & Charles I. Plosser & James H. Stock & Mark W. Watson, 1987.
"Stochastic Trends and Economic Fluctuations,"
NBER Working Papers
2229, National Bureau of Economic Research, Inc.
- Jan P.A.M. Jacobs & Kenneth F. Wallis, 2007.
"Cointegration, Long-Run Structural Modelling And Weak Exogeneity: Two Models Of The Uk Economy,"
CAMA Working Papers
2007-12, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
- Jacobs, Jan P.A.M. & Wallis, Kenneth F., 2010. "Cointegration, long-run structural modelling and weak exogeneity: Two models of the UK economy," Journal of Econometrics, Elsevier, vol. 158(1), pages 108-116, September.
- Jan PAM Jacobs & Kenneth F.Wallis, 2010. "Cointegration, long-run structural modelling and weak exogeneity: Two models of the UK economy," CAMA Working Papers 2010-41, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
- Sims, Christopher A & Stock, James H & Watson, Mark W, 1990. "Inference in Linear Time Series Models with Some Unit Roots," Econometrica, Econometric Society, vol. 58(1), pages 113-44, January.
- Clemen, Robert T., 1989. "Combining forecasts: A review and annotated bibliography," International Journal of Forecasting, Elsevier, vol. 5(4), pages 559-583.
- John C. Robertson & Ellis W. Tallman, 1999. "Vector autoregressions: forecasting and reality," Economic Review, Federal Reserve Bank of Atlanta, issue Q1, pages 4-18.
- James H. Stock & Mark W. Watson, 1998. "A Comparison of Linear and Nonlinear Univariate Models for Forecasting Macroeconomic Time Series," NBER Working Papers 6607, National Bureau of Economic Research, Inc.
- Eitrheim, Oyvind & Husebo, Tore Anders & Nymoen, Ragnar, 1999. "Equilibrium-correction vs. differencing in macroeconometric forecasting," Economic Modelling, Elsevier, vol. 16(4), pages 515-544, December.
- Clements,Michael & Hendry,David, 1998.
"Forecasting Economic Time Series,"
Cambridge University Press, number 9780521634809.
- Makridakis, Spyros & Chatfield, Chris & Hibon, Michele & Lawrence, Michael & Mills, Terence & Ord, Keith & Simmons, LeRoy F., 1993. "The M2-competition: A real-time judgmentally based forecasting study," International Journal of Forecasting, Elsevier, vol. 9(1), pages 5-22, April.
- Ard H.J. den Reijer, 2005. "Forecasting Dutch GDP using Large Scale Factor Models," DNB Working Papers 028, Netherlands Central Bank, Research Department.
- Smith, Ron, 1998. "Emergent policy-making with macroeconometric models," Economic Modelling, Elsevier, vol. 15(3), pages 429-442, July.
- Cooper, J Phillip & Nelson, Charles R, 1975. "The Ex Ante Prediction Performance of the St. Louis and FRB-MIT-PENN Econometric Models and Some Results on Composite Predictors," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 7(1), pages 1-32, February.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ().
If references are entirely missing, you can add them using this form.