Forecast evaluation with cross-sectional data: The Blue Chip Surveys
AbstractIf economic forecasts are to be used for decision making, then being able to evaluate their accuracy is essential. Assessing accuracy using single variables from a forecast is acceptable as a first pass, but this approach has inherent problems. This article addresses some of these problems by evaluating and comparing the general accuracy of a set of multivariate forecasts over time. ; Using the methodology developed in Eisenbeis, Waggoner, and Zha (2002), the authors compare the economic forecasts in the Blue Chip Economic Indicators Survey. The survey, published monthly since 1977, contains forecasts of many macroeconomic variables over a relatively long time span. The forecasters are a mix of economists from major investment banks, corporations, consulting firms, and academic institutions, many of whom have participated in the survey for several years. The survey thus provides a useful set of forecasts to explore the methodologies and to investigate several aspects of forecast performance over time. ; The methodology assigns each forecast a composite score based on the standard theory of probability and statistics. This single number is easy to interpret and can be used to compare forecasts even if the number of variables being forecast, or their definitions, changes over time. ; The analysis shows that the Blue Chip Consensus Forecast, which is the average of the individual forecasts, performs better than any individual forecaster although several forecasters performed almost as well as the consensus.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoArticle provided by Federal Reserve Bank of Atlanta in its journal Economic Review.
Volume (Year): (2003)
Issue (Month): Q2 ()
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Robert Eisenbeis & Daniel Waggoner & Tao Zha, 2002. "Evaluating Wall Street Journal survey forecasters: a multivariate approach," Working Paper 2002-8, Federal Reserve Bank of Atlanta.
- Marco Ottaviani & Peter Norman Sorensen, 2001.
"The Strategy of Professional Forecasting,"
01-09, University of Copenhagen. Department of Economics.
- Olivier Coibion & Yuriy Gorodnichenko, 2010.
"Information Rigidity and the Expectations Formation Process: A Simple Framework and New Facts,"
102, Department of Economics, College of William and Mary.
- Olivier Coibion & Yuriy Gorodnichenko, 2012. "Information Rigidity and the Expectations Formation Process: A Simple Framework and New Facts," IMF Working Papers 12/296, International Monetary Fund.
- Olivier Coibion & Yuriy Gorodnichenko, 2010. "Information Rigidity and the Expectations Formation Process: A Simple Framework and New Facts," NBER Working Papers 16537, National Bureau of Economic Research, Inc.
- Andrew Bauer & Robert A. Eisenbeis & Daniel F. Waggoner & Tao Zha, 2006.
"Transparency, expectations and forecasts,"
Federal Reserve Bank of Atlanta, issue Q 1, pages 1-25.
- Andrew Bauer & Robert A. Eisenbeis & Daniel F. Waggoner & Tao Zha, 2006. "Transparency, expectations, and forecasts," Working Paper 2006-03, Federal Reserve Bank of Atlanta.
- Bauer, Andrew & Eisenbeis, Robert & Waggoner, Daniel & Zha, Tao, 2006. "Transparency, expectations, and forecasts," Working Paper Series 0637, European Central Bank.
- Devereux, Michael B. & Smith, Gregor W. & Yetman, James, 2012.
"Consumption and real exchange rates in professional forecasts,"
Journal of International Economics,
Elsevier, vol. 86(1), pages 33-42.
- Michael B. Devereux & Gregor W. Smith & James Yetman, 2009. "Consumption and Real Exchange Rates in Professional Forecasts," Working Papers 1195, Queen's University, Department of Economics.
- Michael B. Devereux & Gregor W. Smith & James Yetman, 2009. "Consumption and Real Exchange Rates in Professional Forecasts," NBER Working Papers 14795, National Bureau of Economic Research, Inc.
- Michael B Devereux & Gregor W Smith & James Yetman, 2009. "Consumption and real exchange rates in professional forecasts," BIS Working Papers 295, Bank for International Settlements.
- Carvalho, Fabia A. & Minella, André, 2012. "Survey forecasts in Brazil: A prismatic assessment of epidemiology, performance, and determinants," Journal of International Money and Finance, Elsevier, vol. 31(6), pages 1371-1391.
- Baghestani, Hamid, 2006. "An evaluation of the professional forecasts of U.S. long-term interest rates," Review of Financial Economics, Elsevier, vol. 15(2), pages 177-191.
- Frank A.G. den Butter & Pieter W. Jansen, 2008. "Beating the Random Walk: a Performance Assessment of Long-term Interest Rate Forecasts," Tinbergen Institute Discussion Papers 08-102/3, Tinbergen Institute.
- Spencer Krane, 2006. "How professional forecasters view shocks to GDP," Working Paper Series WP-06-19, Federal Reserve Bank of Chicago.
- Berkelmans, Leon, 2011. "Imperfect information, multiple shocks, and policy's signaling role," Journal of Monetary Economics, Elsevier, vol. 58(4), pages 373-386.
- Leon W. Berkelmans, 2008. "Imperfect information and monetary models: multiple shocks and their consequences," Finance and Economics Discussion Series 2008-58, Board of Governors of the Federal Reserve System (U.S.).
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Meredith Rector).
If references are entirely missing, you can add them using this form.