Is forecasting with large models informative? Assessing the role of judgement in macroeconomic forecasts
We evaluate residual projection strategies in the context of a large-scale macro model of the euro area and smaller benchmark time-series models. The exercises attempt to measure the accuracy of model-based forecasts simulated both out-of-sample and in-sample. Both exercises incorporate alternative residual-projection methods, to assess the importance of unaccounted-for breaks in forecast accuracy and off-model judgment. Conclusions reached are that simple mechanical residual adjustments have a significant impact of forecasting accuracy irrespective of the model in use, ostensibly due to the presence of breaks in trends in the data. The testing procedure and conclusions are applicable to a wide class of models and thus of general interest. JEL Classification: C52, E30, E32, E37
|Date of creation:||Oct 2008|
|Date of revision:|
|Contact details of provider:|| Postal: 60640 Frankfurt am Main, Germany|
Phone: +49 69 1344 0
Fax: +49 69 1344 6000
Web page: http://www.ecb.europa.eu/
More information through EDIRC
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Stefano Siviero & Daniele Terlizzese, 2001.
"Macroeconomic forecasting: Debunking a few old wives' tales,"
Temi di discussione (Economic working papers)
395, Bank of Italy, Economic Research and International Relations Area.
- Stefano Siviero & Daniele Terlizzese, 2008. "Macroeconomic Forecasting: Debunking a Few Old Wives' Tales," Journal of Business Cycle Measurement and Analysis, OECD Publishing, Centre for International Research on Economic Tendency Surveys, vol. 2007(3), pages 287-316.
- Carceles-Poveda, Eva & Giannitsarou, Chryssi, 2007.
"Adaptive learning in practice,"
Journal of Economic Dynamics and Control,
Elsevier, vol. 31(8), pages 2659-2697, August.
- Chryssi Giannitsarou & Eva Carceles-Poveda, 2004. "Adaptive Learning in Practice," Computing in Economics and Finance 2004 271, Society for Computational Economics.
- Carceles-Poveda, Eva & Giannitsarou, Chryssi, 2006. "Adaptive Learning in Practice," CEPR Discussion Papers 5627, C.E.P.R. Discussion Papers.
- Inoue, Atsushi & Kilian, Lutz, 2002.
"In-Sample or Out-of-Sample Tests of Predictability: Which One Should We Use?,"
CEPR Discussion Papers
3671, C.E.P.R. Discussion Papers.
- Atsushi Inoue & Lutz Kilian, 2005. "In-Sample or Out-of-Sample Tests of Predictability: Which One Should We Use?," Econometric Reviews, Taylor & Francis Journals, vol. 23(4), pages 371-402.
- Inoue, Atsushi & Kilian, Lutz, 2002. "In-sample or out-of-sample tests of predictability: which one should we use?," Working Paper Series 0195, European Central Bank.
- Margaret M. McConnell & Gabriel Perez Quiros, 1998.
"Output fluctuations in the United States: what has changed since the early 1980s?,"
41, Federal Reserve Bank of New York.
- Gabriel Perez-Quiros & Margaret M. McConnell, 2000. "Output Fluctuations in the United States: What Has Changed since the Early 1980's?," American Economic Review, American Economic Association, vol. 90(5), pages 1464-1476, December.
- Margaret M. McConnell & Gabriel Perez-Quiros, 2000. "Output fluctuations in the United States: what has changed since the early 1980s?," Proceedings, Federal Reserve Bank of San Francisco, issue Mar.
- Margaret M. McConnell & Gabriel Perez Quiros, 1997. "Output fluctuations in the United States: what has changed since the early 1980s?," Research Paper 9735, Federal Reserve Bank of New York.
- Brock,W.A. & Durlauf,S.N. & West,K.D., 2004.
"Model uncertainty and policy evaluation : some theory and empirics,"
19, Wisconsin Madison - Social Systems.
- William A. Brock & Steven N. Durlauf & Kenneth D. West, 2005. "Model uncertainty and policy evaluation: some theory and empirics," Proceedings, Federal Reserve Bank of San Francisco.
- Brock, William A. & Durlauf, Steven N. & West, Kenneth D., 2007. "Model uncertainty and policy evaluation: Some theory and empirics," Journal of Econometrics, Elsevier, vol. 136(2), pages 629-664, February.
- William A. Brock & Steven N. Durlauf & Kenneth D. West, 2004. "Model Uncertainty and Policy Evaluation: Some Theory and Empirics," NBER Working Papers 10916, National Bureau of Economic Research, Inc.
- Ramón Adalid & Günter Coenen & Peter McAdam & Stefano Siviero, 2005.
"The Performance and Robustness of Interest-Rate Rules in Models of the Euro Area,"
International Journal of Central Banking,
International Journal of Central Banking, vol. 1(1), May.
- Adalid, Ramon & Coenen, Gunter & McAdam, Peter & Siviero, Stefano, 2005. "The Performance and Robustness of Interest-Rate Rules in Models of the Euro Area," MPRA Paper 821, University Library of Munich, Germany.
- Adalid, Ramón & Coenen, Günter & McAdam, Peter & Siviero, Stefano, 2005. "The performance and robustness of interest-rate rules in models of the euro area," Working Paper Series 0479, European Central Bank.
- Marcellino, Massimiliano & Stock, James H. & Watson, Mark W., 2003.
"Macroeconomic forecasting in the Euro area: Country specific versus area-wide information,"
European Economic Review,
Elsevier, vol. 47(1), pages 1-18, February.
- Massimiliano Marcellino & James H. Stock & Mark W. Watson, . "Macroeconomic Forecasting in the Euro Area: Country Specific versus Area-Wide Information," Working Papers 201, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
- Stock, James H & Watson, Mark W, 1996.
"Evidence on Structural Instability in Macroeconomic Time Series Relations,"
Journal of Business & Economic Statistics,
American Statistical Association, vol. 14(1), pages 11-30, January.
- James H. Stock & Mark W. Watson, 1994. "Evidence on Structural Instability in Macroeconomic Time Series Relations," NBER Technical Working Papers 0164, National Bureau of Economic Research, Inc.
- James H. Stock & Mark W. Watson, 1994. "Evidence on structural instability in macroeconomic times series relations," Working Paper Series, Macroeconomic Issues 94-13, Federal Reserve Bank of Chicago.
- Peter McAdam & Alpo Willman, 2004. "Supply, Factor Shares and Inflation Persistence: Re-examining Euro-area New-Keynesian Phillips Curves," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 66(s1), pages 637-670, 09.
- Clements, Michael P & Hendry, David F, 1996. "Intercept Corrections and Structural Change," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 11(5), pages 475-94, Sept.-Oct.
- BAI, Jushan & PERRON, Pierre, 1998.
"Computation and Analysis of Multiple Structural-Change Models,"
Cahiers de recherche
9807, Universite de Montreal, Departement de sciences economiques.
- Jushan Bai & Pierre Perron, 2003. "Computation and analysis of multiple structural change models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 18(1), pages 1-22.
- Dieppe, Alistair & McAdam, Peter, 2006. "Monetary policy under a liquidity trap: Simulation evidence for the euro area," Journal of the Japanese and International Economies, Elsevier, vol. 20(3), pages 338-363, September.
- Todd Clark & Michael McCracken, 2005. "Evaluating Direct Multistep Forecasts," Econometric Reviews, Taylor & Francis Journals, vol. 24(4), pages 369-404.
- Christopher A. Sims, 2002. "The Role of Models and Probabilities in the Monetary Policy Process," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 33(2), pages 1-62.
- Clements, Michael P. & Hendry, David F., 1998. "Forecasting economic processes," International Journal of Forecasting, Elsevier, vol. 14(1), pages 111-131, March.
When requesting a correction, please mention this item's handle: RePEc:ecb:ecbwps:20080950. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Official Publications)
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.