Is forecasting with large models informative? Assessing the role of judgement in macroeconomic forecasts
We evaluate residual projection strategies in the context of a large-scale macro model of the euro area and smaller benchmark time‐series models. The exercises attempt to measure the accuracy of model‐based forecasts simulated both out‐of‐sample and in‐sample. Both exercises incorporate alternative residual‐projection methods, to assess the importance of unaccounted‐for breaks in forecast accuracy and off‐model judgement. Conclusions reached are that simple mechanical residual adjustments have a significant impact on forecasting accuracy irrespective of the model in use, likely due to the presence of breaks in trends in the data. The testing procedure and conclusions are applicable to a wide class of models and of general interest. Copyright (C) 2010 John Wiley & Sons, Ltd.
Volume (Year): 30 (2011)
Issue (Month): 3 (April)
|Contact details of provider:|| Web page: http://www3.interscience.wiley.com/cgi-bin/jhome/2966 |
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- James H. Stock & Mark W. Watson, 1994.
"Evidence on structural instability in macroeconomic times series relations,"
Working Paper Series, Macroeconomic Issues
94-13, Federal Reserve Bank of Chicago.
- Stock, James H & Watson, Mark W, 1996. "Evidence on Structural Instability in Macroeconomic Time Series Relations," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(1), pages 11-30, January.
- James H. Stock & Mark W. Watson, 1994. "Evidence on Structural Instability in Macroeconomic Time Series Relations," NBER Technical Working Papers 0164, National Bureau of Economic Research, Inc.
- Todd Clark & Michael McCracken, 2005. "Evaluating Direct Multistep Forecasts," Econometric Reviews, Taylor & Francis Journals, vol. 24(4), pages 369-404.
- Carceles-Poveda, Eva & Giannitsarou, Chryssi, 2006.
"Adaptive Learning in Practice,"
CEPR Discussion Papers
5627, C.E.P.R. Discussion Papers.
- Stefano Siviero & Daniele Terlizzese, 2007.
"Macroeconomic Forecasting: Debunking a Few Old Wives' Tales,"
Journal of Business Cycle Measurement and Analysis,
OECD Publishing,CIRET, vol. 2007(3), pages 287-316.
- Stefano Siviero & Daniele Terlizzese, 2001. "Macroeconomic forecasting: Debunking a few old wives' tales," Temi di discussione (Economic working papers) 395, Bank of Italy, Economic Research and International Relations Area.
- Atsushi Inoue & Lutz Kilian, 2005.
"In-Sample or Out-of-Sample Tests of Predictability: Which One Should We Use?,"
Taylor & Francis Journals, vol. 23(4), pages 371-402.
- Inoue, Atsushi & Kilian, Lutz, 2002. "In-sample or out-of-sample tests of predictability: which one should we use?," Working Paper Series 0195, European Central Bank.
- Inoue, Atsushi & Kilian, Lutz, 2002. "In-Sample or Out-of-Sample Tests of Predictability: Which One Should We Use?," CEPR Discussion Papers 3671, C.E.P.R. Discussion Papers.
- Clements, Michael P. & Hendry, David F., 1998. "Forecasting economic processes," International Journal of Forecasting, Elsevier, vol. 14(1), pages 111-131, March.
- Brock, William A. & Durlauf, Steven N. & West, Kenneth D., 2007.
"Model uncertainty and policy evaluation: Some theory and empirics,"
Journal of Econometrics,
Elsevier, vol. 136(2), pages 629-664, February.
- William Brock & Steven Durlauf & Kenneth West, 2005. "Model uncertainty and policy evaluation: some theory and empirics," Proceedings, Federal Reserve Bank of San Francisco.
- Brock,W.A. & Durlauf,S.N. & West,K.D., 2004. "Model uncertainty and policy evaluation : some theory and empirics," Working papers 19, Wisconsin Madison - Social Systems.
- William A. Brock & Steven N. Durlauf & Kenneth D. West, 2004. "Model Uncertainty and Policy Evaluation: Some Theory and Empirics," NBER Working Papers 10916, National Bureau of Economic Research, Inc.
- Margaret M. McConnell & Gabriel Perez Quiros, 1997.
"Output fluctuations in the United States: what has changed since the early 1980s?,"
9735, Federal Reserve Bank of New York.
- Margaret McConnell & Gabriel Perez Quiros, 2000. "Output fluctuations in the United States: what has changed since the early 1980s?," Proceedings, Federal Reserve Bank of San Francisco, issue Mar.
- Gabriel Perez-Quiros & Margaret M. McConnell, 2000. "Output Fluctuations in the United States: What Has Changed since the Early 1980's?," American Economic Review, American Economic Association, vol. 90(5), pages 1464-1476, December.
- Margaret M. McConnell & Gabriel Perez Quiros, 1998. "Output fluctuations in the United States: what has changed since the early 1980s?," Staff Reports 41, Federal Reserve Bank of New York.
- Marcellino, Massimiliano & Stock, James H. & Watson, Mark W., 2003.
"Macroeconomic forecasting in the Euro area: Country specific versus area-wide information,"
European Economic Review,
Elsevier, vol. 47(1), pages 1-18, February.
- Massimiliano Marcellino & James H. Stock & Mark W. Watson, . "Macroeconomic Forecasting in the Euro Area: Country Specific versus Area-Wide Information," Working Papers 201, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
- Peter McAdam & Alpo Willman, 2004. "Supply, Factor Shares and Inflation Persistence: Re-examining Euro-area New-Keynesian Phillips Curves," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 66(s1), pages 637-670, 09.
- Clements, Michael P & Hendry, David F, 1996. "Intercept Corrections and Structural Change," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 11(5), pages 475-94, Sept.-Oct.
- Jushan Bai & Pierre Perron, 2003.
"Computation and analysis of multiple structural change models,"
Journal of Applied Econometrics,
John Wiley & Sons, Ltd., vol. 18(1), pages 1-22.
- Tom Doan, . "RATS programs to replicate examples of Bai-Perron procedure," Statistical Software Components RTZ00008, Boston College Department of Economics.
- Tom Doan, . "MULTIPLEBREAKS: RATS procedure to perform multiple structural change analysis," Statistical Software Components RTS00138, Boston College Department of Economics.
- BAI, Jushan & PERRON, Pierre, 1998. "Computation and Analysis of Multiple Structural-Change Models," Cahiers de recherche 9807, Universite de Montreal, Departement de sciences economiques.
- Tom Doan, . "BAIPERRON: RATS procedure to perform Bai-Perron Test for Multiple Structural Changes," Statistical Software Components RTS00013, Boston College Department of Economics.
- Christopher A. Sims, 2002. "The Role of Models and Probabilities in the Monetary Policy Process," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 33(2), pages 1-62.
- Adalid, Ramon & Coenen, Gunter & McAdam, Peter & Siviero, Stefano, 2005.
"The Performance and Robustness of Interest-Rate Rules in Models of the Euro Area,"
821, University Library of Munich, Germany.
- Ramón Adalid & Günter Coenen & Peter McAdam & Stefano Siviero, 2005. "The Performance and Robustness of Interest-Rate Rules in Models of the Euro Area," International Journal of Central Banking, International Journal of Central Banking, vol. 1(1), May.
- Adalid, Ramón & Coenen, Günter & McAdam, Peter & Siviero, Stefano, 2005. "The performance and robustness of interest-rate rules in models of the euro area," Working Paper Series 0479, European Central Bank.
- Dieppe, Alistair & McAdam, Peter, 2006. "Monetary policy under a liquidity trap: Simulation evidence for the euro area," Journal of the Japanese and International Economies, Elsevier, vol. 20(3), pages 338-363, September.
When requesting a correction, please mention this item's handle: RePEc:jof:jforec:v:30:y:2011:i:3:p:303-324. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Wiley-Blackwell Digital Licensing)or (Christopher F. Baum)
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.