IDEAS home Printed from https://ideas.repec.org/a/jof/jforec/v30y2011i3p303-324.html
   My bibliography  Save this article

Is forecasting with large models informative? Assessing the role of judgement in macroeconomic forecasts

Author

Listed:
  • Ricardo Mestre
  • Peter McAdam

Abstract

We evaluate residual projection strategies in the context of a large-scale macro model of the euro area and smaller benchmark time‐series models. The exercises attempt to measure the accuracy of model‐based forecasts simulated both out‐of‐sample and in‐sample. Both exercises incorporate alternative residual‐projection methods, to assess the importance of unaccounted‐for breaks in forecast accuracy and off‐model judgement. Conclusions reached are that simple mechanical residual adjustments have a significant impact on forecasting accuracy irrespective of the model in use, likely due to the presence of breaks in trends in the data. The testing procedure and conclusions are applicable to a wide class of models and of general interest. Copyright (C) 2010 John Wiley & Sons, Ltd.

Suggested Citation

  • Ricardo Mestre & Peter McAdam, 2011. "Is forecasting with large models informative? Assessing the role of judgement in macroeconomic forecasts," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 30(3), pages 303-324, April.
  • Handle: RePEc:jof:jforec:v:30:y:2011:i:3:p:303-324
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1002/for.1173
    Download Restriction: no

    Other versions of this item:

    References listed on IDEAS

    as
    1. Stock, James H. & Watson, Mark W., 1999. "Business cycle fluctuations in us macroeconomic time series," Handbook of Macroeconomics,in: J. B. Taylor & M. Woodford (ed.), Handbook of Macroeconomics, edition 1, volume 1, chapter 1, pages 3-64 Elsevier.
    2. G. Coenen & J.-L. Vega, 2001. "The demand for M3 in the euro area," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 16(6), pages 727-748.
    3. Peter McAdam & Alpo Willman, 2004. "Supply, Factor Shares and Inflation Persistence: Re-examining Euro-area New-Keynesian Phillips Curves," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 66(s1), pages 637-670, September.
    4. Benati, Luca & Vitale, Giovanni, 2007. "Joint estimation of the natural rate of interest, the natural rate of unemployment, expected inflation, and potential output," Working Paper Series 797, European Central Bank.
    5. Atsushi Inoue & Lutz Kilian, 2005. "In-Sample or Out-of-Sample Tests of Predictability: Which One Should We Use?," Econometric Reviews, Taylor & Francis Journals, vol. 23(4), pages 371-402.
    6. Gali, Jordi & Gertler, Mark & Lopez-Salido, J. David, 2001. "European inflation dynamics," European Economic Review, Elsevier, vol. 45(7), pages 1237-1270.
    7. Stefano Siviero & Daniele Terlizzese, 2008. "Macroeconomic Forecasting: Debunking a Few Old Wives' Tales," Journal of Business Cycle Measurement and Analysis, OECD Publishing, Centre for International Research on Economic Tendency Surveys, vol. 2007(3), pages 287-316.
    8. Christopher A. Sims, 2002. "The Role of Models and Probabilities in the Monetary Policy Process," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 33(2), pages 1-62.
    9. Ramón Adalid & Günter Coenen & Peter McAdam & Stefano Siviero, 2005. "The Performance and Robustness of Interest-Rate Rules in Models of the Euro Area," International Journal of Central Banking, International Journal of Central Banking, vol. 1(1), May.
    10. Todd Clark & Michael McCracken, 2005. "Evaluating Direct Multistep Forecasts," Econometric Reviews, Taylor & Francis Journals, vol. 24(4), pages 369-404.
    11. Stock, James H & Watson, Mark W, 1996. "Evidence on Structural Instability in Macroeconomic Time Series Relations," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(1), pages 11-30, January.
    12. Brock, William A. & Durlauf, Steven N. & West, Kenneth D., 2007. "Model uncertainty and policy evaluation: Some theory and empirics," Journal of Econometrics, Elsevier, vol. 136(2), pages 629-664, February.
    13. Carceles-Poveda, Eva & Giannitsarou, Chryssi, 2007. "Adaptive learning in practice," Journal of Economic Dynamics and Control, Elsevier, vol. 31(8), pages 2659-2697, August.
    14. John F. Henry & L. Randall Wray, 1998. "Economic Time," Macroeconomics 9811004, EconWPA.
    15. Stephen K. McNees, 1990. "Man vs. model? The role of judgment in forecasting," New England Economic Review, Federal Reserve Bank of Boston, issue Jul, pages 41-52.
    16. Margaret M. McConnell & Gabriel Perez-Quiros, 2000. "Output fluctuations in the United States: what has changed since the early 1980s?," Proceedings, Federal Reserve Bank of San Francisco, issue Mar.
    17. Marcellino, Massimiliano & Stock, James H. & Watson, Mark W., 2003. "Macroeconomic forecasting in the Euro area: Country specific versus area-wide information," European Economic Review, Elsevier, vol. 47(1), pages 1-18, February.
    18. Jushan Bai & Pierre Perron, 2003. "Computation and analysis of multiple structural change models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 18(1), pages 1-22.
    19. Detken, Carsten & Dieppe, Alistair & Henry, Jérôme & Marin, Carmen & Smets, Frank, 2002. "Model uncertainty and the equilibrium value of the real effective euro exchange rate," Working Paper Series 0160, European Central Bank.
    20. Clements, Michael P & Hendry, David F, 1996. "Intercept Corrections and Structural Change," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 11(5), pages 475-494, Sept.-Oct.
    21. Dieppe, Alistair & McAdam, Peter, 2006. "Monetary policy under a liquidity trap: Simulation evidence for the euro area," Journal of the Japanese and International Economies, Elsevier, vol. 20(3), pages 338-363, September.
    22. Clements, Michael P. & Hendry, David F., 1998. "Forecasting economic processes," International Journal of Forecasting, Elsevier, vol. 14(1), pages 111-131, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hjelm, Göran & Jönsson, Kristian, 2010. "In Search of a Method for Measuring the Output Gap of the Swedish Economy," Working Papers 115, National Institute of Economic Research.
    2. Henzel, Steffen R. & Mayr, Johannes, 2013. "The mechanics of VAR forecast pooling—A DSGE model based Monte Carlo study," The North American Journal of Economics and Finance, Elsevier, vol. 24(C), pages 1-24.
    3. Christian Ragacs & Martin Schneider, 2009. "Why did we fail to predict GDP during the last cycle? A breakdown of forecast errors for Austria," Working Papers 151, Oesterreichische Nationalbank (Austrian Central Bank).
    4. repec:onb:oenbwp:y::i:151:b:1 is not listed on IDEAS
    5. Kevin Clinton & Marianne Johnson & Jaromir Benes & Douglas Laxton & Troy D Matheson, 2010. "Structural Models in Real Time," IMF Working Papers 10/56, International Monetary Fund.

    More about this item

    Keywords

    macro model ; forecast projections ; out‐of‐sample ; in‐sample ; forecast accuracy ; structural break ; Economic Monetary Union ;

    JEL classification:

    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • E30 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - General (includes Measurement and Data)
    • E32 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Business Fluctuations; Cycles
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jof:jforec:v:30:y:2011:i:3:p:303-324. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Wiley-Blackwell Digital Licensing) or (Christopher F. Baum). General contact details of provider: http://www3.interscience.wiley.com/cgi-bin/jhome/2966 .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.