Advanced Search
MyIDEAS: Login to save this paper or follow this series

Perspectives on Evaluating Macroeconomic Forecasts

Contents:

Author Info

  • Ullrich Heilemann

    (Univeristy of Leipzig)

  • Herman Stekler

    (Department of Economics The George Washington University)

Abstract

Over the past 50 or so years, I have been concerned with the quality of economic forecasts and have written both about the procedures for evaluating these predictions and the results that were obtained from these evaluations. In this paper I provide some perspectives on the issues involved in judging the quality of these forecasts. These include the reasons for evaluating forecasts, the questions that have been asked in these evaluations, the statistical tools that have been used, and the generally accepted results. (I do also present some new material that has not yet been published.) I do this in two parts: first focusing on short-run GDP and inflation predictions and then turning to labor market forecasts.

Download Info

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
File URL: http://www.gwu.edu/~forcpgm/2010-002.pdf
File Function: First version, 2010
Download Restriction: no

Bibliographic Info

Paper provided by The George Washington University, Department of Economics, Research Program on Forecasting in its series Working Papers with number 2010-002.

as in new window
Length: 43 pages
Date of creation: Mar 2010
Date of revision:
Handle: RePEc:gwc:wpaper:2010-002

Contact details of provider:
Postal: Monroe Hall #340, 2115 G Street, NW, Washington, DC 20052
Phone: (202) 994-6150
Fax: (202) 994-6147
Email:
Web page: http://www.gwu.edu/~forcpgm
More information through EDIRC

Related research

Keywords:

This paper has been announced in the following NEP Reports:

References

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
as in new window
  1. Öller, Lars-Erik & Barot, Bharat, 1999. "Comparing the Accuracy of European GDP Forecasts," Working Paper, National Institute of Economic Research 64, National Institute of Economic Research.
  2. Newey, Whitney K & West, Kenneth D, 1987. "A Simple, Positive Semi-definite, Heteroskedasticity and Autocorrelation Consistent Covariance Matrix," Econometrica, Econometric Society, Econometric Society, vol. 55(3), pages 703-08, May.
  3. Oller, Lars-Erik & Teterukovsky, Alex, 2007. "Quantifying the quality of macroeconomic variables," International Journal of Forecasting, Elsevier, Elsevier, vol. 23(2), pages 205-217.
  4. Skalin, Joakim & Ter svirta, Timo, 2002. "Modeling Asymmetries And Moving Equilibria In Unemployment Rates," Macroeconomic Dynamics, Cambridge University Press, Cambridge University Press, vol. 6(02), pages 202-241, April.
  5. Allan Timmermann & M. Hashem Pesaran, 2003. "How Costly is it to Ignore Breaks when Forecasting the Direction of a Time Series?," CESifo Working Paper Series 875, CESifo Group Munich.
  6. Christina D. Romer & David H. Romer, 2008. "The FOMC versus the Staff: Where Can Monetary Policymakers Add Value?," American Economic Review, American Economic Association, American Economic Association, vol. 98(2), pages 230-35, May.
  7. Diebold, Francis X & Rudebusch, Glenn D, 1989. "Scoring the Leading Indicators," The Journal of Business, University of Chicago Press, University of Chicago Press, vol. 62(3), pages 369-91, July.
  8. Kajal Lahiri & Gultekin Isiklar, 2006. "How Far Ahead Can We Forecast? Evidence From Cross-country Surveys," Discussion Papers, University at Albany, SUNY, Department of Economics 06-04, University at Albany, SUNY, Department of Economics.
  9. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, American Statistical Association, vol. 20(1), pages 134-44, January.
  10. Baghestani, Hamid, 2008. "Federal Reserve versus private information: Who is the best unemployment rate predictor," Journal of Policy Modeling, Elsevier, Elsevier, vol. 30(1), pages 101-110.
  11. Michael Woodford, 2001. "The Taylor Rule and Optimal Monetary Policy," American Economic Review, American Economic Association, American Economic Association, vol. 91(2), pages 232-237, May.
  12. Christopher D. Carroll, 2003. "Macroeconomic Expectations Of Households And Professional Forecasters," The Quarterly Journal of Economics, MIT Press, MIT Press, vol. 118(1), pages 269-298, February.
  13. Jacob A. Mincer & Victor Zarnowitz, 1969. "The Evaluation of Economic Forecasts," NBER Chapters, National Bureau of Economic Research, Inc, in: Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance, pages 1-46 National Bureau of Economic Research, Inc.
  14. D. A. Peel & A. E. H. Speight, 2000. "Threshold nonlinearities in unemployment rates: further evidence for the UK and G3 economies," Applied Economics, Taylor & Francis Journals, Taylor & Francis Journals, vol. 32(6), pages 705-715.
  15. Heilemann, Ullrich, 2002. "Increasing the transparency of macroeconometric forecasts: a report from the trenches," International Journal of Forecasting, Elsevier, Elsevier, vol. 18(1), pages 85-105.
  16. West, Kenneth D., 2006. "Forecast Evaluation," Handbook of Economic Forecasting, Elsevier, Elsevier.
  17. Christian Pierdzioch & Jan-Christoph Rulke & Georg Stadtmann, 2011. "Do professional economists' forecasts reflect Okun's law? Some evidence for the G7 countries," Applied Economics, Taylor & Francis Journals, Taylor & Francis Journals, vol. 43(11), pages 1365-1373.
  18. Hans-Martin Krolzig & Michael Clements, 2000. "Business Cycle Asymmetries: Characterisation and Testing based on Markov-Switching Autoregressions," Economics Series Working Papers, University of Oxford, Department of Economics 2000-W32, University of Oxford, Department of Economics.
  19. Jörg Döpke & Ulrich Fritsche, 2006. "Growth and inflation forecasts for Germany a panel-based assessment of accuracy and efficiency," Empirical Economics, Springer, Springer, vol. 31(3), pages 777-798, September.
  20. Fred Joutz & Michael P. Clements & Herman O. Stekler, 2007. "An evaluation of the forecasts of the federal reserve: a pooled approach," Journal of Applied Econometrics, John Wiley & Sons, Ltd., John Wiley & Sons, Ltd., vol. 22(1), pages 121-136.
  21. Laura Brown & Saeed Moshiri, 2004. "Unemployment variation over the business cycles: a comparison of forecasting models," Journal of Forecasting, John Wiley & Sons, Ltd., John Wiley & Sons, Ltd., vol. 23(7), pages 497-511.
  22. Athanasios Orphanides, 1998. "Monetary policy rules based on real-time data," Finance and Economics Discussion Series, Board of Governors of the Federal Reserve System (U.S.) 1998-03, Board of Governors of the Federal Reserve System (U.S.).
  23. Costas Milas & Philip Rothman, 2007. "Out-of-Sample Forecasting of Unemployment Rates with Pooled STVECM Forecasts," Working Paper Series, The Rimini Centre for Economic Analysis 49-07, The Rimini Centre for Economic Analysis, revised Jul 2007.
  24. Lawrence, Michael & Goodwin, Paul & O'Connor, Marcus & Onkal, Dilek, 2006. "Judgmental forecasting: A review of progress over the last 25 years," International Journal of Forecasting, Elsevier, Elsevier, vol. 22(3), pages 493-518.
  25. Neftci, Salih N, 1984. "Are Economic Time Series Asymmetric over the Business Cycle?," Journal of Political Economy, University of Chicago Press, University of Chicago Press, vol. 92(2), pages 307-28, April.
  26. Batchelor, Roy, 2007. "Bias in macroeconomic forecasts," International Journal of Forecasting, Elsevier, Elsevier, vol. 23(2), pages 189-203.
  27. Leitch, Gordon & Tanner, J Ernest, 1991. "Economic Forecast Evaluation: Profits versus the Conventional Error Measures," American Economic Review, American Economic Association, American Economic Association, vol. 81(3), pages 580-90, June.
  28. Smith, Stanley K. & Sincich, Terry, 1992. "Evaluating the forecast accuracy and bias of alternative population projections for states," International Journal of Forecasting, Elsevier, Elsevier, vol. 8(3), pages 495-508, November.
  29. Batchelor, R A, 1990. "All Forecasters Are Equal," Journal of Business & Economic Statistics, American Statistical Association, American Statistical Association, vol. 8(1), pages 143-44, January.
  30. Harvey, David & Leybourne, Stephen & Newbold, Paul, 1997. "Testing the equality of prediction mean squared errors," International Journal of Forecasting, Elsevier, Elsevier, vol. 13(2), pages 281-291, June.
  31. Amos Golan & Jeffrey M. Perloff, 2004. "Superior Forecasts of the U.S. Unemployment Rate Using a Nonparametric Method," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 433-438, February.
  32. Ullrich Heilemann & Herman O. Stekler, 2010. "Has the Accuracy of German Macroeconomic Forecasts Improved?," Working Papers, The George Washington University, Department of Economics, Research Program on Forecasting 2010-001, The George Washington University, Department of Economics, Research Program on Forecasting, revised Feb 2012.
  33. Elliott, Graham & Timmermann, Allan G, 2007. "Economic Forecasting," CEPR Discussion Papers, C.E.P.R. Discussion Papers 6158, C.E.P.R. Discussion Papers.
  34. Francis X. Diebold & Glenn D. Rudebusch, 1989. "Forecasting output with the composite leading index: an ex ante analysis," Finance and Economics Discussion Series, Board of Governors of the Federal Reserve System (U.S.) 90, Board of Governors of the Federal Reserve System (U.S.).
  35. repec:gwc:wpaper:2008-9 is not listed on IDEAS
  36. Lukas Vogel, 2007. "How do the OECD Growth Projections for the G7 Economies Perform?: A Post-Mortem," OECD Economics Department Working Papers 573, OECD Publishing.
  37. Schnader, M H & Stekler, H O, 1990. "Evaluating Predictions of Change," The Journal of Business, University of Chicago Press, University of Chicago Press, vol. 63(1), pages 99-107, January.
  38. Philip Rothman, . "Forecasting Asymmetric Unemployment Rates," Working Papers, East Carolina University, Department of Economics 9618, East Carolina University, Department of Economics.
  39. Stekler, H. O., 1991. "Macroeconomic forecast evaluation techniques," International Journal of Forecasting, Elsevier, Elsevier, vol. 7(3), pages 375-384, November.
  40. Herman O. Stekler, 2008. "What Do We Know About G-7 Macro Forecasts?," Working Papers, The George Washington University, Department of Economics, Research Program on Forecasting 2008-009, The George Washington University, Department of Economics, Research Program on Forecasting.
  41. Allen, P. Geoffrey & Morzuch, Bernard J., 2006. "Twenty-five years of progress, problems, and conflicting evidence in econometric forecasting. What about the next 25 years?," International Journal of Forecasting, Elsevier, Elsevier, vol. 22(3), pages 475-492.
Full references (including those not matched with items on IDEAS)

Citations

Lists

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

Statistics

Access and download statistics

Corrections

When requesting a correction, please mention this item's handle: RePEc:gwc:wpaper:2010-002. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Tara M. Sinclair).

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.