Is forecasting with large models informative? Assessing the role of judgement in macroeconomic forecasts
We evaluate residual projection strategies in the context of a large-scale macro model of the euro area and smaller benchmark time-series models. The exercises attempt to measure the accuracy of model-based forecasts simulated both out-of-sample and in-sample. Both exercises incorporate alternative residual-projection methods, to assess the importance of unaccounted-for breaks in forecast accuracy and off-model judgment. Conclusions reached are that simple mechanical residual adjustments have a significant impact of forecasting accuracy irrespective of the model in use, ostensibly due to the presence of breaks in trends in the data. The testing procedure and conclusions are applicable to a wide class of models and thus of general interest. JEL Classification: C52, E30, E32, E37
|Date of creation:||Oct 2008|
|Date of revision:|
|Contact details of provider:|| Postal: 60640 Frankfurt am Main, Germany|
Phone: +49 69 1344 0
Fax: +49 69 1344 6000
Web page: http://www.ecb.europa.eu/
More information through EDIRC
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Chryssi Giannitsarou & Eva Carceles-Poveda, 2004.
"Adaptive Learning in Practice,"
Computing in Economics and Finance 2004
271, Society for Computational Economics.
- Margaret M. McConnell & Gabriel Perez Quiros, 1998.
"Output fluctuations in the United States: what has changed since the early 1980s?,"
41, Federal Reserve Bank of New York.
- Gabriel Perez-Quiros & Margaret M. McConnell, 2000. "Output Fluctuations in the United States: What Has Changed since the Early 1980's?," American Economic Review, American Economic Association, vol. 90(5), pages 1464-1476, December.
- Margaret M. McConnell & Gabriel Perez-Quiros, 2000. "Output fluctuations in the United States: what has changed since the early 1980s?," Proceedings, Federal Reserve Bank of San Francisco, issue Mar.
- Margaret M. McConnell & Gabriel Perez Quiros, 1997. "Output fluctuations in the United States: what has changed since the early 1980s?," Research Paper 9735, Federal Reserve Bank of New York.
- William A. Brock & Steven N. Durlauf & Kenneth D. West, 2005.
"Model uncertainty and policy evaluation: some theory and empirics,"
Federal Reserve Bank of San Francisco.
- Brock, William A. & Durlauf, Steven N. & West, Kenneth D., 2007. "Model uncertainty and policy evaluation: Some theory and empirics," Journal of Econometrics, Elsevier, vol. 136(2), pages 629-664, February.
- Brock,W.A. & Durlauf,S.N. & West,K.D., 2004. "Model uncertainty and policy evaluation : some theory and empirics," Working papers 19, Wisconsin Madison - Social Systems.
- William A. Brock & Steven N. Durlauf & Kenneth D. West, 2004. "Model Uncertainty and Policy Evaluation: Some Theory and Empirics," NBER Working Papers 10916, National Bureau of Economic Research, Inc.
- Inoue, Atsushi & Kilian, Lutz, 2002.
"In-Sample or Out-of-Sample Tests of Predictability: Which One Should We Use?,"
CEPR Discussion Papers
3671, C.E.P.R. Discussion Papers.
- Atsushi Inoue & Lutz Kilian, 2005. "In-Sample or Out-of-Sample Tests of Predictability: Which One Should We Use?," Econometric Reviews, Taylor & Francis Journals, vol. 23(4), pages 371-402.
- Inoue, Atsushi & Kilian, Lutz, 2002. "In-sample or out-of-sample tests of predictability: which one should we use?," Working Paper Series 0195, European Central Bank.
- Clements, Michael P. & Hendry, David F., 1998. "Forecasting economic processes," International Journal of Forecasting, Elsevier, vol. 14(1), pages 111-131, March.
- Stefano Siviero & Daniele Terlizzese, 2007.
"Macroeconomic Forecasting: Debunking a Few Old Wives' Tales,"
Journal of Business Cycle Measurement and Analysis,
OECD Publishing,Centre for International Research on Economic Tendency Surveys, vol. 2007(3), pages 287-316.
- Stefano Siviero & Daniele Terlizzese, 2001. "Macroeconomic forecasting: Debunking a few old wives' tales," Temi di discussione (Economic working papers) 395, Bank of Italy, Economic Research and International Relations Area.
- Clements, Michael P & Hendry, David F, 1996. "Intercept Corrections and Structural Change," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 11(5), pages 475-94, Sept.-Oct.
- Todd Clark & Michael McCracken, 2005. "Evaluating Direct Multistep Forecasts," Econometric Reviews, Taylor & Francis Journals, vol. 24(4), pages 369-404.
- Adalid, Ramon & Coenen, Gunter & McAdam, Peter & Siviero, Stefano, 2005.
"The Performance and Robustness of Interest-Rate Rules in Models of the Euro Area,"
821, University Library of Munich, Germany.
- Ramón Adalid & Günter Coenen & Peter McAdam & Stefano Siviero, 2005. "The Performance and Robustness of Interest-Rate Rules in Models of the Euro Area," International Journal of Central Banking, International Journal of Central Banking, vol. 1(1), May.
- Adalid, Ramón & Coenen, Günter & McAdam, Peter & Siviero, Stefano, 2005. "The performance and robustness of interest-rate rules in models of the euro area," Working Paper Series 0479, European Central Bank.
- Stock, James H & Watson, Mark W, 1996.
"Evidence on Structural Instability in Macroeconomic Time Series Relations,"
Journal of Business & Economic Statistics,
American Statistical Association, vol. 14(1), pages 11-30, January.
- James H. Stock & Mark W. Watson, 1994. "Evidence on structural instability in macroeconomic times series relations," Working Paper Series, Macroeconomic Issues 94-13, Federal Reserve Bank of Chicago.
- James H. Stock & Mark W. Watson, 1994. "Evidence on Structural Instability in Macroeconomic Time Series Relations," NBER Technical Working Papers 0164, National Bureau of Economic Research, Inc.
- Peter McAdam & Alpo Willman, 2004. "Supply, Factor Shares and Inflation Persistence: Re-examining Euro-area New-Keynesian Phillips Curves," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 66(s1), pages 637-670, 09.
- Massimiliano Marcellino & James H. Stock & Mark W. Watson, .
"Macroeconomic Forecasting in the Euro Area: Country Specific versus Area-Wide Information,"
201, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
- Marcellino, Massimiliano & Stock, James H. & Watson, Mark W., 2003. "Macroeconomic forecasting in the Euro area: Country specific versus area-wide information," European Economic Review, Elsevier, vol. 47(1), pages 1-18, February.
- Jushan Bai & Pierre Perron, 2003.
"Computation and analysis of multiple structural change models,"
Journal of Applied Econometrics,
John Wiley & Sons, Ltd., vol. 18(1), pages 1-22.
- BAI, Jushan & PERRON, Pierre, 1998. "Computation and Analysis of Multiple Structural-Change Models," Cahiers de recherche 9807, Universite de Montreal, Departement de sciences economiques.
- Tom Doan, . "BAIPERRON: RATS procedure to perform Bai-Perron Test for Multiple Structural Changes," Statistical Software Components RTS00013, Boston College Department of Economics.
- Tom Doan, . "RATS programs to replicate examples of Bai-Perron procedure," Statistical Software Components RTZ00008, Boston College Department of Economics.
- Tom Doan, . "MULTIPLEBREAKS: RATS procedure to perform multiple structural change analysis," Statistical Software Components RTS00138, Boston College Department of Economics.
- Christopher A. Sims, 2002. "The Role of Models and Probabilities in the Monetary Policy Process," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 33(2), pages 1-62.
- Dieppe, Alistair & McAdam, Peter, 2006. "Monetary policy under a liquidity trap: Simulation evidence for the euro area," Journal of the Japanese and International Economies, Elsevier, vol. 20(3), pages 338-363, September.
When requesting a correction, please mention this item's handle: RePEc:ecb:ecbwps:20080950. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Official Publications)
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.