Evaluating Macroeconomic Forecasts: A Review of Some Recent Developments
Macroeconomic forecasts are frequently produced, widely published, intensively discussed and comprehensively used. The formal evaluation of such forecasts has a long research history. Recently, a new angle to the evaluation of forecasts has been addressed, and in this review we analyse some recent developments from that perspective. The literature on forecast evaluation predominantly assumes that macroeconomic forecasts are generated from econometric models. In practice, however, most macroeconomic forecasts, such as those from the IMF, World Bank, OECD, Federal Reserve Board, Federal Open Market Committee (FOMC) and the ECB, are typically based on econometric model forecasts jointly with human intuition. This seemingly inevitable combination renders most of these forecasts biased and, as such, their evaluation becomes non-standard. In this review, we consider the evaluation of two forecasts in which: (i) the two forecasts are generated from two distinct econometric models; (ii) one forecast is generated from an econometric model and the other is obtained as a combination of a model and intuition; and (iii) the two forecasts are generated from two distinct (but unknown) combinations of different models and intuition. It is shown that alternative tools are needed to compare and evaluate the forecasts in each of these three situations. These alternative techniques are illustrated by comparing the forecasts from the (econometric) Staff of the Federal Reserve Board and the FOMC on inflation, unemployment and real GDP growth. It is shown that the FOMC does not forecast significantly better than the Staff, and that the intuition of the FOMC does not add significantly in forecasting the actual values of the economic fundamentals. This would seem to belie the purported expertise of the FOMC.
|Date of creation:||2011|
|Date of revision:|
|Contact details of provider:|| Phone: 913942604|
Web page: https://www.ucm.es/icae
More information through EDIRC
|Order Information:|| Postal: Facultad de Ciencias Económicas y Empresariales. Pabellón prefabricado, 1ª Planta, ala norte. Campus de Somosaguas, 28223 - POZUELO DE ALARCÓN (MADRID)|
Web: https://www.ucm.es/fundamentos-analisis-economico2/documentos-de-trabajo-del-icae Email:
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Franses, Ph.H.B.F. & McAleer, M.J. & Legerstee, R., 2008.
"Expert opinion versus expertise in forecasting,"
Econometric Institute Research Papers
EI 2008-30, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
- Diebold, Francis X & Mariano, Roberto S, 1995.
"Comparing Predictive Accuracy,"
Journal of Business & Economic Statistics,
American Statistical Association, vol. 13(3), pages 253-63, July.
- Francis X. Diebold & Robert S. Mariano, 1994. "Comparing Predictive Accuracy," NBER Technical Working Papers 0169, National Bureau of Economic Research, Inc.
- Tom Doan, . "DMARIANO: RATS procedure to compute Diebold-Mariano Forecast Comparison Test," Statistical Software Components RTS00055, Boston College Department of Economics.
- Clark, Todd E. & McCracken, Michael W., 2001.
"Tests of equal forecast accuracy and encompassing for nested models,"
Journal of Econometrics,
Elsevier, vol. 105(1), pages 85-110, November.
- Todd E. Clark & Michael W. McCracken, 2000. "Tests of Equal Forecast Accuracy and Encompassing for Nested Models," Econometric Society World Congress 2000 Contributed Papers 0319, Econometric Society.
- Todd E. Clark & Michael W. McCracken, 1999. "Tests of equal forecast accuracy and encompassing for nested models," Research Working Paper 99-11, Federal Reserve Bank of Kansas City.
- Todd E. Clark & Michael McCracken, 1999. "Tests of Equal Forecast Accuracy and Encompassing for Nested Models," Computing in Economics and Finance 1999 1241, Society for Computational Economics.
- Christina D. Romer & David H. Romer, 2003.
"A New Measure of Monetary Shocks: Derivation and Implications,"
NBER Working Papers
9866, National Bureau of Economic Research, Inc.
- Christina D. Romer & David H. Romer, 2004. "A New Measure of Monetary Shocks: Derivation and Implications," American Economic Review, American Economic Association, vol. 94(4), pages 1055-1084, September.
- Timmermann, Allan, 2006.
Handbook of Economic Forecasting,
- Marco Aiolfi & Carlos Capistrán & Allan Timmermann, 2010. "Forecast Combinations," CREATES Research Papers 2010-21, School of Economics and Management, University of Aarhus.
- Marco Aiolfi & Carlos Capistrán & Allan Timmermann, 2010. "Forecast Combinations," Working Papers 2010-04, Banco de México.
- Timmermann, Allan G, 2005. "Forecast Combinations," CEPR Discussion Papers 5361, C.E.P.R. Discussion Papers.
- Roy Batchelor, 2007. "Forecaster Behaviour and Bias in Macroeconomic Forecasts," Ifo Working Paper Series Ifo Working Paper No. 39, Ifo Institute for Economic Research at the University of Munich.
- Chia-Lin Chang & Philip Hans Franses & Michael McAleer, 2010.
"How Accurate are Government Forecasts of Economic Fundamentals? The Case of Taiwan,"
KIER Working Papers
720, Kyoto University, Institute of Economic Research.
- Chang, Chia-Lin & Franses, Philip Hans & McAleer, Michael, 2011. "How accurate are government forecasts of economic fundamentals? The case of Taiwan," International Journal of Forecasting, Elsevier, vol. 27(4), pages 1066-1075, October.
- Chia-Lin Chang & Philip Hans Franses & Michael McAleer, 2010. "How Accurate are Government Forecasts of Economic Fundamentals? The Case of Taiwan," Working Papers in Economics 10/16, University of Canterbury, Department of Economics and Finance.
- Chia-Lin Chang & Philip Hans Franses & Michael McAleer, 2009. "How Accurate are Government Forecasts of Economic Fundamentals? The Case of Taiwan," CIRJE F-Series CIRJE-F-637, CIRJE, Faculty of Economics, University of Tokyo.
- Graham Elliott & Allan Timmermann, 2008.
Journal of Economic Literature,
American Economic Association, vol. 46(1), pages 3-56, March.
- Chong, Yock Y & Hendry, David F, 1986. "Econometric Evaluation of Linear Macro-Economic Models," Review of Economic Studies, Wiley Blackwell, vol. 53(4), pages 671-90, August.
- McAleer, Michael, 1992. "Efficient Estimation: The Rao-Zyskind Condition, Kruskal's Theorem and Ordinary Least Squares," The Economic Record, The Economic Society of Australia, vol. 68(200), pages 65-72, March.
- West, Kenneth D, 1996.
"Asymptotic Inference about Predictive Ability,"
Econometric Society, vol. 64(5), pages 1067-84, September.
- Batchelor, Roy, 2007. "Bias in macroeconomic forecasts," International Journal of Forecasting, Elsevier, vol. 23(2), pages 189-203.
- Fiebig, Denzil G. & McAleer, Michael & Bartels, Robert, 1992. "Properties of ordinary least squares estimators in regression models with nonspherical disturbances," Journal of Econometrics, Elsevier, vol. 54(1-3), pages 321-334.
- Christina D. Romer & David H. Romer, 2008.
"The FOMC versus the Staff: Where Can Monetary Policymakers Add Value?,"
American Economic Review,
American Economic Association, vol. 98(2), pages 230-35, May.
- Christina D. Romer & David H. Romer, 2008. "The FOMC versus the Staff: Where Can Monetary Policymakers Add Value?," NBER Working Papers 13751, National Bureau of Economic Research, Inc.
When requesting a correction, please mention this item's handle: RePEc:ucm:doicae:1111. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Águeda González Abad)
If references are entirely missing, you can add them using this form.