International organisations’ vs. private analysts’ forecasts: an evaluation
AbstractThis paper evaluates the performance of the macroeconomic forecasts disclosed by three leading international organisations - the IMF, the European Commission and the OECD - and compares it with that of the mean forecasts of two surveys of private analysts - the Consensus Economics and The Economist. The publication of forecasts twice a year by international organisations always receives a great deal of public attention but the timely forecasts disclosed monthly by private institutions have been gaining increased visibility. The aim of this work is to help forecast users in answering the question of how much (little) confidence they should place in the alternative forecasts that are available at each moment. The evaluation covers real GDP growth and inflation projections for nine main advanced economies, over the period 1991-2009. Several evaluation criteria are used. The quantitative accuracy of forecasts is assessed and their unbiasedness and efficiency is tested. The directional accuracy of forecasts and the ability to predict economic recessions are also examined. The results suggest that the forecasting performance of the international organisations is broadly similar to that of the surveys of private analysts. By and large, current-year forecasts present desirable features and clearly outperform year-ahead forecasts for which evidence is more mixed both in terms of quantitative and qualitative accuracy.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by Banco de Portugal, Economics and Research Department in its series Working Papers with number w201120.
Date of creation: 2011
Date of revision:
Find related papers by JEL classification:
- E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications
This paper has been announced in the following NEP Reports:
- NEP-ALL-2011-08-02 (All new papers)
- NEP-CBA-2011-08-02 (Central Banking)
- NEP-FOR-2011-08-02 (Forecasting)
- NEP-MAC-2011-08-02 (Macroeconomics)
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Ash, J. C. K. & Smyth, D. J. & Heravi, S. M., 1998. "Are OECD forecasts rational and useful?: a directional analysis," International Journal of Forecasting, Elsevier, vol. 14(3), pages 381-391, September.
- Patton, Andrew J. & Timmermann, Allan, 2007.
"Properties of optimal forecasts under asymmetric loss and nonlinearity,"
Journal of Econometrics,
Elsevier, vol. 140(2), pages 884-918, October.
- Allan Timmermann & Andrew Patton, 2004. "Properties of Optimal Forecasts under Asymmetric Loss and Nonlinearity," Working Papers wp04-05, Warwick Business School, Finance Group.
- Filip Keereman, 1999. "The track record of the Commission forecasts," European Economy - Economic Papers 137, Directorate General Economic and Monetary Affairs (DG ECFIN), European Commission.
- Vassiliki Koutsogeorgopoulou, 2000. "A Post-Mortem on Economic Outlook Projections," OECD Economics Department Working Papers 274, OECD Publishing.
- Francis X. Diebold & Robert S. Mariano, 1994.
"Comparing Predictive Accuracy,"
NBER Technical Working Papers
0169, National Bureau of Economic Research, Inc.
- Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-44, January.
- Diebold, Francis X & Mariano, Roberto S, 1995. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(3), pages 253-63, July.
- A. Melander & G. Sismanidis & D. Grenouilleau, 2007. "The track record of the Commission's forecasts - an update," European Economy - Economic Papers 291, Directorate General Economic and Monetary Affairs (DG ECFIN), European Commission.
- James H. Stock & Mark W. Watson, 1999.
NBER Working Papers
7023, National Bureau of Economic Research, Inc.
- Allan Timmermann, 2006.
"An Evaluation of the World Economic Outlook Forecasts,"
IMF Working Papers
06/59, International Monetary Fund.
- Allan Timmermann, 2007. "An Evaluation of the World Economic Outlook Forecasts," IMF Staff Papers, Palgrave Macmillan, vol. 54(1), pages 1-33, May.
- Victor Zarnowitz & Phillip Braun, 1992.
"Twenty-two Years of the NBER-ASA Quarterly Economic Outlook Surveys: Aspects and Comparisons of Forecasting Performance,"
NBER Working Papers
3965, National Bureau of Economic Research, Inc.
- Victor Zarnowitz & Phillip Braun, 1993. "Twenty-two Years of the NBER-ASA Quarterly Economic Outlook Surveys: Aspects and Comparisons of Forecasting Performance," NBER Chapters, in: Business Cycles, Indicators and Forecasting, pages 11-94 National Bureau of Economic Research, Inc.
- repec:fth:eeccco:137 is not listed on IDEAS
- Lukas Vogel, 2007. "How do the OECD Growth Projections for the G7 Economies Perform?: A Post-Mortem," OECD Economics Department Working Papers 573, OECD Publishing.
- Harvey, David & Leybourne, Stephen & Newbold, Paul, 1997. "Testing the equality of prediction mean squared errors," International Journal of Forecasting, Elsevier, vol. 13(2), pages 281-291, June.
- Harvey, David I & Leybourne, Stephen J & Newbold, Paul, 1998. "Tests for Forecast Encompassing," Journal of Business & Economic Statistics, American Statistical Association, vol. 16(2), pages 254-59, April.
- Natalia T. Tamirisa & Prakash Loungani & Herman O. Stekler, 2011. "Information Rigidity in Growth Forecasts," IMF Working Papers 11/125, International Monetary Fund.
- Masahiro Ashiya, 2003. "The directional accuracy of 15-months-ahead forecasts made by the IMF," Applied Economics Letters, Taylor & Francis Journals, vol. 10(6), pages 331-333.
- Fildes, Robert & Stekler, Herman, 2002. "The state of macroeconomic forecasting," Journal of Macroeconomics, Elsevier, vol. 24(4), pages 435-468, December.
- Stephen K. McNees, 1992. "How large are economic forecast errors?," New England Economic Review, Federal Reserve Bank of Boston, issue Jul, pages 25-42.
- Fildes, Robert & Stekler, Herman, 2002. "Reply to the comments on 'The state of macroeconomic forecasting'," Journal of Macroeconomics, Elsevier, vol. 24(4), pages 503-505, December.
- Makram El-Shagi & Sebastian Giesen & A. Jung, 2012.
"Does Central Bank Staff Beat Private Forecasters?,"
IWH Discussion Papers
5, Halle Institute for Economic Research.
- Jung, Alexander & El-Shagi, Makram & Giesen, Sebastian, 2013. "Does Central Bank Staff Beat Private Forecasters?," Annual Conference 2013 (Duesseldorf): Competition Policy and Regulation in a Global Economic Order 79925, Verein für Socialpolitik / German Economic Association.
- El-Shagi, Makram & Giesen, Sebastian & Jung, Alexander, 2014. "Does the federal reserve staff still beat private forecasters?," Working Paper Series 1635, European Central Bank.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (DEE-NTDD).
If references are entirely missing, you can add them using this form.