Is forecasting with large models informative? Assessing the role of judgement in macroeconomic forecasts
We evaluate residual projection strategies in the context of a large-scale macro model of the euro area and smaller benchmark time-series models. The exercises attempt to measure the accuracy of model-based forecasts simulated both out-of-sample and in-sample. Both exercises incorporate alternative residual-projection methods, to assess the importance of unaccounted-for breaks in forecast accuracy and off-model judgment. Conclusions reached are that simple mechanical residual adjustments have a significant impact of forecasting accuracy irrespective of the model in use, ostensibly due to the presence of breaks in trends in the data. The testing procedure and conclusions are applicable to a wide class of models and thus of general interest. JEL Classification: C52, E30, E32, E37
|Date of creation:||Oct 2008|
|Date of revision:|
|Contact details of provider:|| Postal: |
Phone: +49 69 1344 0
Fax: +49 69 1344 6000
Web page: http://www.ecb.europa.eu/
More information through EDIRC
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Brock,W.A. & Durlauf,S.N. & West,K.D., 2004.
"Model uncertainty and policy evaluation : some theory and empirics,"
19, Wisconsin Madison - Social Systems.
- William Brock & Steven Durlauf & Kenneth West, 2005. "Model uncertainty and policy evaluation: some theory and empirics," Proceedings, Federal Reserve Bank of San Francisco.
- Brock, William A. & Durlauf, Steven N. & West, Kenneth D., 2007. "Model uncertainty and policy evaluation: Some theory and empirics," Journal of Econometrics, Elsevier, vol. 136(2), pages 629-664, February.
- William A. Brock & Steven N. Durlauf & Kenneth D. West, 2004. "Model Uncertainty and Policy Evaluation: Some Theory and Empirics," NBER Working Papers 10916, National Bureau of Economic Research, Inc.
- BAI, Jushan & PERRON, Pierre, 1998.
"Computation and Analysis of Multiple Structural-Change Models,"
Cahiers de recherche
9807, Universite de Montreal, Departement de sciences economiques.
- Jushan Bai & Pierre Perron, 2003. "Computation and analysis of multiple structural change models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 18(1), pages 1-22.
- Chryssi Giannitsarou & Eva Carceles-Poveda, 2004.
"Adaptive Learning in Practice,"
Computing in Economics and Finance 2004
271, Society for Computational Economics.
- Inoue, Atsushi & Kilian, Lutz, 2002.
"In-Sample or Out-of-Sample Tests of Predictability: Which One Should We Use?,"
CEPR Discussion Papers
3671, C.E.P.R. Discussion Papers.
- Atsushi Inoue & Lutz Kilian, 2005. "In-Sample or Out-of-Sample Tests of Predictability: Which One Should We Use?," Econometric Reviews, Taylor & Francis Journals, vol. 23(4), pages 371-402.
- Inoue, Atsushi & Kilian, Lutz, 2002. "In-sample or out-of-sample tests of predictability: which one should we use?," Working Paper Series 0195, European Central Bank.
- Ramón Adalid & Günter Coenen & Peter McAdam & Stefano Siviero, 2005.
"The Performance and Robustness of Interest-Rate Rules in Models of the Euro Area,"
International Journal of Central Banking,
International Journal of Central Banking, vol. 1(1), May.
- Adalid, Ramón & Coenen, Günter & McAdam, Peter & Siviero, Stefano, 2005. "The performance and robustness of interest-rate rules in models of the euro area," Working Paper Series 0479, European Central Bank.
- Adalid, Ramon & Coenen, Gunter & McAdam, Peter & Siviero, Stefano, 2005. "The Performance and Robustness of Interest-Rate Rules in Models of the Euro Area," MPRA Paper 821, University Library of Munich, Germany.
- Dieppe, Alistair & McAdam, Peter, 2006. "Monetary policy under a liquidity trap: Simulation evidence for the euro area," Journal of the Japanese and International Economies, Elsevier, vol. 20(3), pages 338-363, September.
- Clements, Michael P & Hendry, David F, 1996. "Intercept Corrections and Structural Change," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 11(5), pages 475-94, Sept.-Oct.
- Margaret M. McConnell & Gabriel Perez Quiros, 1997.
"Output fluctuations in the United States: what has changed since the early 1980s?,"
9735, Federal Reserve Bank of New York.
- Gabriel Perez-Quiros & Margaret M. McConnell, 2000. "Output Fluctuations in the United States: What Has Changed since the Early 1980's?," American Economic Review, American Economic Association, vol. 90(5), pages 1464-1476, December.
- Margaret McConnell & Gabriel Perez Quiros, 2000. "Output fluctuations in the United States: what has changed since the early 1980s?," Proceedings, Federal Reserve Bank of San Francisco, issue Mar.
- Margaret M. McConnell & Gabriel Perez Quiros, 1998. "Output fluctuations in the United States: what has changed since the early 1980s?," Staff Reports 41, Federal Reserve Bank of New York.
- Marcellino, Massimiliano & Stock, James H. & Watson, Mark W., 2003.
"Macroeconomic forecasting in the Euro area: Country specific versus area-wide information,"
European Economic Review,
Elsevier, vol. 47(1), pages 1-18, February.
- Massimiliano Marcellino & James H. Stock & Mark W. Watson, . "Macroeconomic Forecasting in the Euro Area: Country Specific versus Area-Wide Information," Working Papers 201, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
- Todd Clark & Michael McCracken, 2005. "Evaluating Direct Multistep Forecasts," Econometric Reviews, Taylor & Francis Journals, vol. 24(4), pages 369-404.
- Stefano Siviero & Daniele Terlizzese, 2007.
"Macroeconomic Forecasting: Debunking a Few Old Wives' Tales,"
Journal of Business Cycle Measurement and Analysis,
OECD Publishing,Centre for International Research on Economic Tendency Surveys, vol. 2007(3), pages 287-316.
- Stefano Siviero & Daniele Terlizzese, 2001. "Macroeconomic forecasting: Debunking a few old wives' tales," Temi di discussione (Economic working papers) 395, Bank of Italy, Economic Research and International Relations Area.
- Stock, James H & Watson, Mark W, 1996.
"Evidence on Structural Instability in Macroeconomic Time Series Relations,"
Journal of Business & Economic Statistics,
American Statistical Association, vol. 14(1), pages 11-30, January.
- James H. Stock & Mark W. Watson, 1994. "Evidence on Structural Instability in Macroeconomic Time Series Relations," NBER Technical Working Papers 0164, National Bureau of Economic Research, Inc.
- James H. Stock & Mark W. Watson, 1994. "Evidence on structural instability in macroeconomic times series relations," Working Paper Series, Macroeconomic Issues 94-13, Federal Reserve Bank of Chicago.
- Clements, Michael P. & Hendry, David F., 1998. "Forecasting economic processes," International Journal of Forecasting, Elsevier, vol. 14(1), pages 111-131, March.
- Christopher A. Sims, 2002. "The Role of Models and Probabilities in the Monetary Policy Process," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 33(2), pages 1-62.
- Peter McAdam & Alpo Willman, 2004. "Supply, Factor Shares and Inflation Persistence: Re-examining Euro-area New-Keynesian Phillips Curves," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 66(s1), pages 637-670, 09.
When requesting a correction, please mention this item's handle: RePEc:ecb:ecbwps:20080950. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Official Publications)
If references are entirely missing, you can add them using this form.