International organisations’ vs. private analysts’ forecasts: an evaluation
AbstractThis paper evaluates the performance of the macroeconomic forecasts disclosed by three leading international organisations - the IMF, the European Commission and the OECD - and compares it with that of the mean forecasts of two surveys of private analysts - the Consensus Economics and The Economist. The publication of forecasts twice a year by international organisations always receives a great deal of public attention but the timely forecasts disclosed monthly by private institutions have been gaining increased visibility. The aim of this work is to help forecast users in answering the question of how much (little) confidence they should place in the alternative forecasts that are available at each moment. The evaluation covers real GDP growth and inflation projections for nine main advanced economies, over the period 1991-2009. Several evaluation criteria are used. The quantitative accuracy of forecasts is assessed and their unbiasedness and efficiency is tested. The directional accuracy of forecasts and the ability to predict economic recessions are also examined. The results suggest that the forecasting performance of the international organisations is broadly similar to that of the surveys of private analysts. By and large, current-year forecasts present desirable features and clearly outperform year-ahead forecasts for which evidence is more mixed both in terms of quantitative and qualitative accuracy.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by Banco de Portugal, Economics and Research Department in its series Working Papers with number w201120.
Date of creation: 2011
Date of revision:
Find related papers by JEL classification:
- E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications
This paper has been announced in the following NEP Reports:
- NEP-ALL-2011-08-02 (All new papers)
- NEP-CBA-2011-08-02 (Central Banking)
- NEP-FOR-2011-08-02 (Forecasting)
- NEP-MAC-2011-08-02 (Macroeconomics)
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Filip Keereman, 1999. "The track record of the Commission forecasts," European Economy - Economic Papers 137, Directorate General Economic and Monetary Affairs (DG ECFIN), European Commission.
- Masahiro Ashiya, 2003. "The directional accuracy of 15-months-ahead forecasts made by the IMF," Applied Economics Letters, Taylor and Francis Journals, vol. 10(6), pages 331-333.
- Diebold, Francis X & Mariano, Roberto S, 2002.
"Comparing Predictive Accuracy,"
Journal of Business & Economic Statistics,
American Statistical Association, vol. 20(1), pages 134-44, January.
- Allan Timmermann, 2006.
"An Evaluation of the World Economic Outlook Forecasts,"
IMF Working Papers
06/59, International Monetary Fund.
- Allan Timmermann, 2007. "An Evaluation of the World Economic Outlook Forecasts," IMF Staff Papers, Palgrave Macmillan, vol. 54(1), pages 1-33, May.
- H Stekler & R A Fildes, 1999.
"The state of macroeconomic forecasting,"
539557, Lancaster University Management School, Economics Department.
- Patton, Andrew J. & Timmermann, Allan, 2007.
"Properties of optimal forecasts under asymmetric loss and nonlinearity,"
Journal of Econometrics,
Elsevier, vol. 140(2), pages 884-918, October.
- Allan Timmermann & Andrew Patton, 2004. "Properties of Optimal Forecasts under Asymmetric Loss and Nonlinearity," Working Papers wp04-05, Warwick Business School, Financial Econometrics Research Centre.
- repec:fth:eeccco:137 is not listed on IDEAS
- Victor Zarnowitz & Phillip Braun, 1993.
"Twenty-two Years of the NBER-ASA Quarterly Economic Outlook Surveys: Aspects and Comparisons of Forecasting Performance,"
in: Business Cycles, Indicators and Forecasting, pages 11-94
National Bureau of Economic Research, Inc.
- Victor Zarnowitz & Phillip Braun, 1994. "Twenty-two Years of the NBER-ASA Quarterly Economic Outlook Surveys: Aspects and Comparisons of Forecasting Performance," NBER Working Papers 3965, National Bureau of Economic Research, Inc.
- Natalia T. Tamirisa & Prakash Loungani & Herman O. Stekler, 2011. "Information Rigidity in Growth Forecasts: Some Cross-Country Evidence," IMF Working Papers 11/125, International Monetary Fund.
- Ash, J. C. K. & Smyth, D. J. & Heravi, S. M., 1998. "Are OECD forecasts rational and useful?: a directional analysis," International Journal of Forecasting, Elsevier, vol. 14(3), pages 381-391, September.
- Harvey, David & Leybourne, Stephen & Newbold, Paul, 1997. "Testing the equality of prediction mean squared errors," International Journal of Forecasting, Elsevier, vol. 13(2), pages 281-291, June.
- Lukas Vogel, 2007. "How do the OECD Growth Projections for the G7 Economies Perform?: A Post-Mortem," OECD Economics Department Working Papers 573, OECD Publishing.
- Harvey, David I & Leybourne, Stephen J & Newbold, Paul, 1998. "Tests for Forecast Encompassing," Journal of Business & Economic Statistics, American Statistical Association, vol. 16(2), pages 254-59, April.
- Stock, James H. & Watson, Mark W., 1999.
Journal of Monetary Economics,
Elsevier, vol. 44(2), pages 293-335, October.
- Vassiliki Koutsogeorgopoulou, 2000. "A Post-Mortem on Economic Outlook Projections," OECD Economics Department Working Papers 274, OECD Publishing.
- A. Melander & G. Sismanidis & D. Grenouilleau, 2007. "The track record of the Commission's forecasts - an update," European Economy - Economic Papers 291, Directorate General Economic and Monetary Affairs (DG ECFIN), European Commission.
- Fildes, Robert & Stekler, Herman, 2002. "Reply to the comments on 'The state of macroeconomic forecasting'," Journal of Macroeconomics, Elsevier, vol. 24(4), pages 503-505, December.
- Stephen K. McNees, 1992. "How large are economic forecast errors?," New England Economic Review, Federal Reserve Bank of Boston, issue Jul, pages 25-42.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (DEE-NTDD).
If references are entirely missing, you can add them using this form.