Evaluating CPB's published GDP growth forecasts; a comparison with individual and pooled VAR based forecasts
AbstractWe compare the accuracy of our published GDP growth forecasts from our large macro model, SAFFIER, to those produced by VAR based models using both classical and Bayesian estimation techniques. We employ a data driven methodology for selecting variables to include in our VAR models and we find that a randomly selected classical VAR model performs worse in most cases than the Bayesian equivalent, which performs worse than our published forecasts in most cases. However, when we pool forecasts across many VARs we can produce more accurate forecasts than we published. A review of the literature suggests that forecast accuracy is likely irrelevant for the non-forecasting activities the model is used for at CPB because they are fundamentally different activities.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by CPB Netherlands Bureau for Economic Policy Analysis in its series CPB Document with number 172.
Date of creation: Oct 2008
Date of revision:
Find related papers by JEL classification:
- C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
- C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
- E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications
This paper has been announced in the following NEP Reports:
- NEP-ALL-2008-10-13 (All new papers)
- NEP-CBA-2008-10-13 (Central Banking)
- NEP-FOR-2008-10-13 (Forecasting)
- NEP-MAC-2008-10-13 (Macroeconomics)
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- James H. Stock & Mark W. Watson, 1998. "A Comparison of Linear and Nonlinear Univariate Models for Forecasting Macroeconomic Time Series," NBER Working Papers 6607, National Bureau of Economic Research, Inc.
- John C. Robertson & Ellis W. Tallman, 1999. "Vector autoregressions: forecasting and reality," Economic Review, Federal Reserve Bank of Atlanta, issue Q1, pages 4-18.
- Litterman, Robert B, 1986.
"Forecasting with Bayesian Vector Autoregressions-Five Years of Experience,"
Journal of Business & Economic Statistics,
American Statistical Association, vol. 4(1), pages 25-38, January.
- Robert B. Litterman, 1985. "Forecasting with Bayesian vector autoregressions five years of experience," Working Papers 274, Federal Reserve Bank of Minneapolis.
- David Hendry & Michael Clements, 2001.
"Pooling of Forecasts,"
Economics Series Working Papers
2002-W09, University of Oxford, Department of Economics.
- Jan PAM Jacobs & Kenneth F.Wallis, 2010.
"Cointegration, long-run structural modelling and weak exogeneity: Two models of the UK economy,"
CAMA Working Papers
2010-41, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
- Jacobs, Jan P.A.M. & Wallis, Kenneth F., 2010. "Cointegration, long-run structural modelling and weak exogeneity: Two models of the UK economy," Journal of Econometrics, Elsevier, vol. 158(1), pages 108-116, September.
- Jan P.A.M. Jacobs & Kenneth F. Wallis, 2007. "Cointegration, Long-Run Structural Modelling And Weak Exogeneity: Two Models Of The Uk Economy," CAMA Working Papers 2007-12, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
- Cooper, J Phillip & Nelson, Charles R, 1975. "The Ex Ante Prediction Performance of the St. Louis and FRB-MIT-PENN Econometric Models and Some Results on Composite Predictors," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 7(1), pages 1-32, February.
- Sims, Christopher A & Stock, James H & Watson, Mark W, 1990. "Inference in Linear Time Series Models with Some Unit Roots," Econometrica, Econometric Society, vol. 58(1), pages 113-44, January.
- David Hendry & Michael P. Clements, 2001.
"Economic Forecasting: Some Lessons from Recent Research,"
Economics Series Working Papers
78, University of Oxford, Department of Economics.
- Hendry, David F. & Clements, Michael P., 2003. "Economic forecasting: some lessons from recent research," Economic Modelling, Elsevier, vol. 20(2), pages 301-329, March.
- David Hendry & Michael P. Clements, 2001. "Economic Forecasting: Some Lessons from Recent Research," Economics Papers 2002-W11, Economics Group, Nuffield College, University of Oxford.
- Hendry, David F & Michael P. Clements, 2002. "Economic Forecasting: Some Lessons from Recent Research," Royal Economic Society Annual Conference 2002 99, Royal Economic Society.
- Hendry, David F. & Clements, Michael P., 2001. "Economic forecasting: some lessons from recent research," Working Paper Series 0082, European Central Bank.
- Marco Aiolfi & Carlos Capistrán & Allan Timmermann, 2010.
CREATES Research Papers
2010-21, School of Economics and Management, University of Aarhus.
- Clemen, Robert T., 1989. "Combining forecasts: A review and annotated bibliography," International Journal of Forecasting, Elsevier, vol. 5(4), pages 559-583.
- Eitrheim, Oyvind & Husebo, Tore Anders & Nymoen, Ragnar, 1999. "Equilibrium-correction vs. differencing in macroeconometric forecasting," Economic Modelling, Elsevier, vol. 16(4), pages 515-544, December.
- King, Robert G. & Plosser, Charles I. & Stock, James H. & Watson, Mark W., 1991.
"Stochastic Trends and Economic Fluctuations,"
American Economic Review,
American Economic Association, vol. 81(4), pages 819-40, September.
- Robert G. King & Charles I. Plosser & James H. Stock & Mark W. Watson, 1987. "Stochastic Trends and Economic Fluctuations," NBER Working Papers 2229, National Bureau of Economic Research, Inc.
- Tom Doan, . "RATS programs to replicate King, Plosser, Stock, Watson AER 1991 results," Statistical Software Components RTZ00107, Boston College Department of Economics.
- Robert G. King & Charles I. Plosser & James H. Stock & Mark W. Watson, 1991. "Stochastic trends and economic fluctuations," Working Paper Series, Macroeconomic Issues 91-4, Federal Reserve Bank of Chicago.
- Phoebus J. Dhrymes & E. Philip Howrey & Saul H. Hymans & Jan Kmenta & Edward E. Leamer & Richard E. Quandt & James B. Ramsey & Harold T. Shapiro & Victor Zarnowitz, 1972. "Criteria For Evaluation Of Econometric Models," NBER Chapters, in: Annals of Economic and Social Measurement, Volume 1, number 3, pages 291-325 National Bureau of Economic Research, Inc.
- Sims, Christopher A, 1980. "Macroeconomics and Reality," Econometrica, Econometric Society, vol. 48(1), pages 1-48, January.
- Henk Don, 2003. "SAFE: a quarterly model of the Dutch economy for short-term analyses," CPB Document 42, CPB Netherlands Bureau for Economic Policy Analysis.
- Ard H.J. den Reijer, 2005. "Forecasting Dutch GDP using Large Scale Factor Models," DNB Working Papers 028, Netherlands Central Bank, Research Department.
- Smith, Ron, 1998. "Emergent policy-making with macroeconometric models," Economic Modelling, Elsevier, vol. 15(3), pages 429-442, July.
- Clements,Michael & Hendry,David, 1998.
"Forecasting Economic Time Series,"
Cambridge University Press, number 9780521632423, October.
- Makridakis, Spyros & Hibon, Michele, 2000. "The M3-Competition: results, conclusions and implications," International Journal of Forecasting, Elsevier, vol. 16(4), pages 451-476.
- Henk Kranendonk & Johan Verbruggen, 2007. "SAFFIER; a multi-purpose model of the Dutch economy for short-term and medium-term analyses," CPB Document 144, CPB Netherlands Bureau for Economic Policy Analysis.
- Makridakis, Spyros & Chatfield, Chris & Hibon, Michele & Lawrence, Michael & Mills, Terence & Ord, Keith & Simmons, LeRoy F., 1993. "The M2-competition: A real-time judgmentally based forecasting study," International Journal of Forecasting, Elsevier, vol. 9(1), pages 5-22, April.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ().
If references are entirely missing, you can add them using this form.