Forecast evaluation with cross-sectional data: The Blue Chip Surveys
AbstractIf economic forecasts are to be used for decision making, then being able to evaluate their accuracy is essential. Assessing accuracy using single variables from a forecast is acceptable as a first pass, but this approach has inherent problems. This article addresses some of these problems by evaluating and comparing the general accuracy of a set of multivariate forecasts over time. ; Using the methodology developed in Eisenbeis, Waggoner, and Zha (2002), the authors compare the economic forecasts in the Blue Chip Economic Indicators Survey. The survey, published monthly since 1977, contains forecasts of many macroeconomic variables over a relatively long time span. The forecasters are a mix of economists from major investment banks, corporations, consulting firms, and academic institutions, many of whom have participated in the survey for several years. The survey thus provides a useful set of forecasts to explore the methodologies and to investigate several aspects of forecast performance over time. ; The methodology assigns each forecast a composite score based on the standard theory of probability and statistics. This single number is easy to interpret and can be used to compare forecasts even if the number of variables being forecast, or their definitions, changes over time. ; The analysis shows that the Blue Chip Consensus Forecast, which is the average of the individual forecasts, performs better than any individual forecaster although several forecasters performed almost as well as the consensus.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoArticle provided by Federal Reserve Bank of Atlanta in its journal Economic Review.
Volume (Year): (2003)
Issue (Month): Q2 ()
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Marco Ottaviani & Peter Norman Sorensen, 2001.
"The Strategy of Professional Forecasting,"
01-09, University of Copenhagen. Department of Economics.
- Robert Eisenbeis & Daniel Waggoner & Tao Zha, 2002. "Evaluating Wall Street Journal survey forecasters: a multivariate approach," Working Paper 2002-8, Federal Reserve Bank of Atlanta.
- Spencer D. Krane, 2011. "Professional Forecasters' View of Permanent and Transitory Shocks to GDP," American Economic Journal: Macroeconomics, American Economic Association, vol. 3(1), pages 184-211, January.
- Andrew Bauer & Robert A. Eisenbeis & Daniel F. Waggoner & Tao Zha, 2006.
"Transparency, expectations and forecasts,"
Federal Reserve Bank of Atlanta, issue Q 1, pages 1-25.
- Bauer, Andrew & Eisenbeis, Robert & Waggoner, Daniel & Zha, Tao, 2006. "Transparency, expectations, and forecasts," Working Paper Series 0637, European Central Bank.
- Andrew Bauer & Robert A. Eisenbeis & Daniel F. Waggoner & Tao Zha, 2006. "Transparency, expectations, and forecasts," Working Paper 2006-03, Federal Reserve Bank of Atlanta.
- Baghestani, Hamid, 2006. "An evaluation of the professional forecasts of U.S. long-term interest rates," Review of Financial Economics, Elsevier, vol. 15(2), pages 177-191.
- Michael B. Devereux & Gregor W. Smith & James Yetman, 2009.
"Consumption and Real Exchange Rates in Professional Forecasts,"
1195, Queen's University, Department of Economics.
- Devereux, Michael B. & Smith, Gregor W. & Yetman, James, 2012. "Consumption and real exchange rates in professional forecasts," Journal of International Economics, Elsevier, vol. 86(1), pages 33-42.
- Michael B. Devereux & Gregor W. Smith & James Yetman, 2009. "Consumption and Real Exchange Rates in Professional Forecasts," NBER Working Papers 14795, National Bureau of Economic Research, Inc.
- Michael B Devereux & Gregor W Smith & James Yetman, 2009. "Consumption and real exchange rates in professional forecasts," BIS Working Papers 295, Bank for International Settlements.
- Berkelmans, Leon, 2011. "Imperfect information, multiple shocks, and policy's signaling role," Journal of Monetary Economics, Elsevier, vol. 58(4), pages 373-386.
- Frank A.G. den Butter & Pieter W. Jansen, 2008. "Beating the Random Walk: a Performance Assessment of Long-term Interest Rate Forecasts," Tinbergen Institute Discussion Papers 08-102/3, Tinbergen Institute.
- Spencer Krane, 2006. "How professional forecasters view shocks to GDP," Working Paper Series WP-06-19, Federal Reserve Bank of Chicago.
- Olivier Coibion & Yuriy Gorodnichenko, 2010.
"Information Rigidity and the Expectations Formation Process: A Simple Framework and New Facts,"
102, Department of Economics, College of William and Mary.
- Olivier Coibion & Yuriy Gorodnichenko, 2010. "Information Rigidity and the Expectations Formation Process: A Simple Framework and New Facts," NBER Working Papers 16537, National Bureau of Economic Research, Inc.
- Olivier Coibion & Yuriy Gorodnichenko, 2012. "Information Rigidity and the Expectations Formation Process: A Simple Framework and New Facts," IMF Working Papers 12/296, International Monetary Fund.
- Carvalho, Fabia A. & Minella, André, 2012. "Survey forecasts in Brazil: A prismatic assessment of epidemiology, performance, and determinants," Journal of International Money and Finance, Elsevier, vol. 31(6), pages 1371-1391.
- Leon W. Berkelmans, 2008. "Imperfect information and monetary models: multiple shocks and their consequences," Finance and Economics Discussion Series 2008-58, Board of Governors of the Federal Reserve System (U.S.).
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Meredith Rector).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.