Evaluating CPB's published GDP growth forecasts; a comparison with individual and pooled VAR based forecasts
AbstractWe compare the accuracy of our published GDP growth forecasts from our large macro model, SAFFIER, to those produced by VAR based models using both classical and Bayesian estimation techniques. We employ a data driven methodology for selecting variables to include in our VAR models and we find that a randomly selected classical VAR model performs worse in most cases than the Bayesian equivalent, which performs worse than our published forecasts in most cases. However, when we pool forecasts across many VARs we can produce more accurate forecasts than we published. A review of the literature suggests that forecast accuracy is likely irrelevant for the non-forecasting activities the model is used for at CPB because they are fundamentally different activities.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by CPB Netherlands Bureau for Economic Policy Analysis in its series CPB Document with number 172.
Date of creation: Oct 2008
Date of revision:
Find related papers by JEL classification:
- C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
- C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
- E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications
This paper has been announced in the following NEP Reports:
- NEP-ALL-2008-10-13 (All new papers)
- NEP-CBA-2008-10-13 (Central Banking)
- NEP-FOR-2008-10-13 (Forecasting)
- NEP-MAC-2008-10-13 (Macroeconomics)
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Hendry, David F. & Clements, Michael P., 2001.
"Economic forecasting: some lessons from recent research,"
Working Paper Series
0082, European Central Bank.
- Hendry, David F. & Clements, Michael P., 2003. "Economic forecasting: some lessons from recent research," Economic Modelling, Elsevier, vol. 20(2), pages 301-329, March.
- Hendry, David F & Michael P. Clements, 2002. "Economic Forecasting: Some Lessons from Recent Research," Royal Economic Society Annual Conference 2002 99, Royal Economic Society.
- David Hendry & Michael P. Clements, 2001. "Economic Forecasting: Some Lessons from Recent Research," Economics Series Working Papers 78, University of Oxford, Department of Economics.
- David Hendry & Michael P. Clements, 2001. "Economic Forecasting: Some Lessons from Recent Research," Economics Papers 2002-W11, Economics Group, Nuffield College, University of Oxford.
- Cooper, J Phillip & Nelson, Charles R, 1975. "The Ex Ante Prediction Performance of the St. Louis and FRB-MIT-PENN Econometric Models and Some Results on Composite Predictors," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 7(1), pages 1-32, February.
- Eitrheim, Oyvind & Husebo, Tore Anders & Nymoen, Ragnar, 1999. "Equilibrium-correction vs. differencing in macroeconometric forecasting," Economic Modelling, Elsevier, vol. 16(4), pages 515-544, December.
- David Hendry & Michael Clements, 2001.
"Pooling of Forecasts,"
Economics Series Working Papers
2002-W09, University of Oxford, Department of Economics.
- Clemen, Robert T., 1989. "Combining forecasts: A review and annotated bibliography," International Journal of Forecasting, Elsevier, vol. 5(4), pages 559-583.
- Smith, Ron, 1998. "Emergent policy-making with macroeconometric models," Economic Modelling, Elsevier, vol. 15(3), pages 429-442, July.
- Jan PAM Jacobs & Kenneth F.Wallis, 2010.
"Cointegration, long-run structural modelling and weak exogeneity: Two models of the UK economy,"
CAMA Working Papers
2010-41, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
- Jacobs, Jan P.A.M. & Wallis, Kenneth F., 2010. "Cointegration, long-run structural modelling and weak exogeneity: Two models of the UK economy," Journal of Econometrics, Elsevier, vol. 158(1), pages 108-116, September.
- Jan P.A.M. Jacobs & Kenneth F. Wallis, 2007. "Cointegration, Long-Run Structural Modelling And Weak Exogeneity: Two Models Of The Uk Economy," CAMA Working Papers 2007-12, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
- Robert B. Litterman, 1985.
"Forecasting with Bayesian vector autoregressions five years of experience,"
274, Federal Reserve Bank of Minneapolis.
- Litterman, Robert B, 1986. "Forecasting with Bayesian Vector Autoregressions-Five Years of Experience," Journal of Business & Economic Statistics, American Statistical Association, vol. 4(1), pages 25-38, January.
- Henk Kranendonk & Johan Verbruggen, 2007. "SAFFIER; a multi-purpose model of the Dutch economy for short-term and medium-term analyses," CPB Document 144, CPB Netherlands Bureau for Economic Policy Analysis.
- Phoebus J. Dhrymes & E. Philip Howrey & Saul H. Hymans & Jan Kmenta & Edward E. Leamer & Richard E. Quandt & James B. Ramsey & Harold T. Shapiro & Victor Zarnowitz, 1972. "Criteria For Evaluation Of Econometric Models," NBER Chapters, in: Annals of Economic and Social Measurement, Volume 1, number 3, pages 291-325 National Bureau of Economic Research, Inc.
- Clements,Michael & Hendry,David, 1998.
"Forecasting Economic Time Series,"
Cambridge University Press, number 9780521634809, December.
- Ard H.J. den Reijer, 2005. "Forecasting Dutch GDP using Large Scale Factor Models," DNB Working Papers 028, Netherlands Central Bank, Research Department.
- Marco Aiolfi & Carlos Capistrán & Allan Timmermann, 2010.
CREATES Research Papers
2010-21, School of Economics and Management, University of Aarhus.
- Sims, Christopher A, 1980. "Macroeconomics and Reality," Econometrica, Econometric Society, vol. 48(1), pages 1-48, January.
- Henk Don, 2003. "SAFE: a quarterly model of the Dutch economy for short-term analyses," CPB Document 42, CPB Netherlands Bureau for Economic Policy Analysis.
- Robert G. King & Charles I. Plosser & James H. Stock & Mark W. Watson, 1992.
"Stochastic Trends and Economic Fluctuations,"
NBER Working Papers
2229, National Bureau of Economic Research, Inc.
- Ken Holden, 1997. "A comparison of forecasts from UK economic models and some Bayesian vector autoregressive models," Journal of Economic Studies, Emerald Group Publishing, vol. 24(4), pages 242-256, September.
- John C. Robertson & Ellis W. Tallman, 1999. "Vector autoregressions: forecasting and reality," Economic Review, Federal Reserve Bank of Atlanta, issue Q1, pages 4-18.
- Sims, Christopher A & Stock, James H & Watson, Mark W, 1990. "Inference in Linear Time Series Models with Some Unit Roots," Econometrica, Econometric Society, vol. 58(1), pages 113-44, January.
- Makridakis, Spyros & Hibon, Michele, 2000. "The M3-Competition: results, conclusions and implications," International Journal of Forecasting, Elsevier, vol. 16(4), pages 451-476.
- Makridakis, Spyros & Chatfield, Chris & Hibon, Michele & Lawrence, Michael & Mills, Terence & Ord, Keith & Simmons, LeRoy F., 1993. "The M2-competition: A real-time judgmentally based forecasting study," International Journal of Forecasting, Elsevier, vol. 9(1), pages 5-22, April.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ().
If references are entirely missing, you can add them using this form.