IDEAS home Printed from https://ideas.repec.org/p/fip/fedlwp/2017-040.html
   My bibliography  Save this paper

An Empirical Investigation of Direct and Iterated Multistep Conditional Forecasts

Author

Abstract

When constructing unconditional point forecasts, both direct- and iterated-multistep (DMS and IMS) approaches are common. However, in the context of producing conditional forecasts, IMS approaches based on vector autoregressions (VAR) are far more common than simpler DMS models. This is despite the fact that there are theoretical reasons to believe that DMS models are more robust to misspecification than are IMS models. In the context of unconditional forecasts, Marcellino, Stock, and Watson (MSW, 2006) investigate the empirical relevance of these theories. In this paper, we extend that work to conditional forecasts. We do so based on linear bivariate and trivariate models estimated using a large dataset of macroeconomic time series. Over comparable samples, our results reinforce those in MSW: the IMS approach is typically a bit better than DMS with significant improvements only at longer horizons. In contrast, when we focus on the Great Moderation sample we find a marked improvement in the DMS approach relative to IMS. The distinction is particularly clear when we forecast nominal rather than real variables where the relative gains can be substantial.

Suggested Citation

  • Michael W. McCracken & Joseph McGillicuddy, 2017. "An Empirical Investigation of Direct and Iterated Multistep Conditional Forecasts," Working Papers 2017-40, Federal Reserve Bank of St. Louis.
  • Handle: RePEc:fip:fedlwp:2017-040
    DOI: 10.20955/wp.2017.040
    as

    Download full text from publisher

    File URL: https://files.stlouisfed.org/files/htdocs/wp/2017/2017-040.pdf
    File Function: Full text
    Download Restriction: no

    File URL: https://doi.org/10.20955/wp.2017.040
    File Function: https://doi.org/10.20955/wp.2017.040
    Download Restriction: no

    File URL: https://libkey.io/10.20955/wp.2017.040?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Gary M. Koop, 2013. "Forecasting with Medium and Large Bayesian VARS," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(2), pages 177-203, March.
    2. Òscar Jordà, 2005. "Estimation and Inference of Impulse Responses by Local Projections," American Economic Review, American Economic Association, vol. 95(1), pages 161-182, March.
    3. Rhys Bidder & Raffaella Giacomini & Andrew McKenna, 2016. "Stress Testing with Misspecified Models," Working Paper Series 2016-26, Federal Reserve Bank of San Francisco.
    4. Òscar Jordà & Massimiliano Marcellino, 2010. "Path forecast evaluation," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 635-662.
    5. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-1084, September.
    6. Michael W. McCracken & Serena Ng, 2016. "FRED-MD: A Monthly Database for Macroeconomic Research," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(4), pages 574-589, October.
    7. James H. Stock & Mark W. Watson, 2005. "Implications of Dynamic Factor Models for VAR Analysis," NBER Working Papers 11467, National Bureau of Economic Research, Inc.
    8. Jarocinski, Marek, 2010. "Conditional forecasts and uncertainty about forecast revisions in vector autoregressions," Economics Letters, Elsevier, vol. 108(3), pages 257-259, September.
    9. Warne, Anders & Coenen, Günter & Christoffel, Kai, 2008. "The new area-wide model of the euro area: a micro-founded open-economy model for forecasting and policy analysis," Working Paper Series 944, European Central Bank.
    10. Christiane Baumeister & Lutz Kilian, 2014. "Real-Time Analysis of Oil Price Risks Using Forecast Scenarios," IMF Economic Review, Palgrave Macmillan;International Monetary Fund, vol. 62(1), pages 119-145, April.
    11. Bańbura, Marta & Giannone, Domenico & Lenza, Michele, 2015. "Conditional forecasts and scenario analysis with vector autoregressions for large cross-sections," International Journal of Forecasting, Elsevier, vol. 31(3), pages 739-756.
    12. Brüggemann, Ralf & Jentsch, Carsten & Trenkler, Carsten, 2016. "Inference in VARs with conditional heteroskedasticity of unknown form," Journal of Econometrics, Elsevier, vol. 191(1), pages 69-85.
    13. Marcellino, Massimiliano & Stock, James H. & Watson, Mark W., 2006. "A comparison of direct and iterated multistep AR methods for forecasting macroeconomic time series," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 499-526.
    14. Todd E. Clark & Michael W. McCracken, 2017. "Tests of Predictive Ability for Vector Autoregressions Used for Conditional Forecasting," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(3), pages 533-553, April.
    15. James H. Stock & Mark W. Watson, 2007. "Why Has U.S. Inflation Become Harder to Forecast?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(s1), pages 3-33, February.
    16. Pavel Kapinos & Oscar A. Mitnik, 2016. "A Top-down Approach to Stress-testing Banks," Journal of Financial Services Research, Springer;Western Finance Association, vol. 49(2), pages 229-264, June.
    17. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    18. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    19. Daniel F. Waggoner & Tao Zha, 1999. "Conditional Forecasts In Dynamic Multivariate Models," The Review of Economics and Statistics, MIT Press, vol. 81(4), pages 639-651, November.
    20. Giannone, Domenico & Lenza, Michele & Momferatou, Daphne & Onorante, Luca, 2014. "Short-term inflation projections: A Bayesian vector autoregressive approach," International Journal of Forecasting, Elsevier, vol. 30(3), pages 635-644.
    21. Chevillon, Guillaume, 2017. "Robustness of Multistep Forecasts and Predictive Regressions at Intermediate and Long Horizons," ESSEC Working Papers WP1710, ESSEC Research Center, ESSEC Business School.
    22. Alberto Caruso & Lucrezia Reichlin & Giovanni Ricco, 2015. "The Legacy Debt and the Joint Path of Public Deficit and Debt in the Euro Area," European Economy - Discussion Papers 2015 - 010, Directorate General Economic and Financial Affairs (DG ECFIN), European Commission.
    23. Domenico Giannone & Michele Lenza & Giorgio E. Primiceri, 2015. "Prior Selection for Vector Autoregressions," The Review of Economics and Statistics, MIT Press, vol. 97(2), pages 436-451, May.
    24. James H. Stock & Mark W. Watson, 2007. "Erratum to "Why Has U.S. Inflation Become Harder to Forecast?"," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(7), pages 1849-1849, October.
    25. Hirtle, Beverly & Kovner, Anna & Vickery, James & Bhanot, Meru, 2016. "Assessing financial stability: The Capital and Loss Assessment under Stress Scenarios (CLASS) model," Journal of Banking & Finance, Elsevier, vol. 69(S1), pages 35-55.
    26. Schorfheide, Frank, 2005. "VAR forecasting under misspecification," Journal of Econometrics, Elsevier, vol. 128(1), pages 99-136, September.
    27. Campbell, Sean D., 2007. "Macroeconomic Volatility, Predictability, and Uncertainty in the Great Moderation: Evidence From the Survey of Professional Forecasters," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 191-200, April.
    28. Jane K. Dokko & Brian M. Doyle & Skander J. van den Heuvel & Michael T. Kiley & Jinill Kim & Shane M. Sherlund & Jae W. Sim, 2009. "Monetary policy and the housing bubble," Finance and Economics Discussion Series 2009-49, Board of Governors of the Federal Reserve System (U.S.).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Michael W. McCracken & Joseph McGillicuddy & Michael T. Owyang, 2019. "Binary Conditional Forecasts," Working Papers 2019-029, Federal Reserve Bank of St. Louis, revised Apr 2021.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tallman, Ellis W. & Zaman, Saeed, 2020. "Combining survey long-run forecasts and nowcasts with BVAR forecasts using relative entropy," International Journal of Forecasting, Elsevier, vol. 36(2), pages 373-398.
    2. Todd E. Clark & Michael W. McCracken, 2014. "Evaluating Conditional Forecasts from Vector Autoregressions," Working Papers 2014-25, Federal Reserve Bank of St. Louis.
    3. Bańbura, Marta & Giannone, Domenico & Lenza, Michele, 2015. "Conditional forecasts and scenario analysis with vector autoregressions for large cross-sections," International Journal of Forecasting, Elsevier, vol. 31(3), pages 739-756.
    4. Koop, Gary & Korobilis, Dimitris & Pettenuzzo, Davide, 2019. "Bayesian compressed vector autoregressions," Journal of Econometrics, Elsevier, vol. 210(1), pages 135-154.
    5. Michael W. McCracken & Joseph McGillicuddy & Michael T. Owyang, 2019. "Binary Conditional Forecasts," Working Papers 2019-029, Federal Reserve Bank of St. Louis, revised Apr 2021.
    6. Joshua C. C. Chan & Eric Eisenstat & Chenghan Hou & Gary Koop, 2020. "Composite likelihood methods for large Bayesian VARs with stochastic volatility," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(6), pages 692-711, September.
    7. Carriero, Andrea & Galvão, Ana Beatriz & Kapetanios, George, 2019. "A comprehensive evaluation of macroeconomic forecasting methods," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1226-1239.
    8. Mandalinci, Zeyyad, 2017. "Forecasting inflation in emerging markets: An evaluation of alternative models," International Journal of Forecasting, Elsevier, vol. 33(4), pages 1082-1104.
    9. Andrea Carriero & Francesco Corsello & Massimiliano Marcellino, 2018. "The global component of inflation volatility," Temi di discussione (Economic working papers) 1170, Bank of Italy, Economic Research and International Relations Area.
    10. Christopher G. Gibbs & Andrey L. Vasnev, 2017. "Conditionally Optimal Weights and Forward-Looking Approaches to Combining Forecasts," Discussion Papers 2017-10, School of Economics, The University of New South Wales.
    11. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    12. Berg, Tim O. & Henzel, Steffen R., 2015. "Point and density forecasts for the euro area using Bayesian VARs," International Journal of Forecasting, Elsevier, vol. 31(4), pages 1067-1095.
    13. Mayer, Walter J. & Liu, Feng & Dang, Xin, 2017. "Improving the power of the Diebold–Mariano–West test for least squares predictions," International Journal of Forecasting, Elsevier, vol. 33(3), pages 618-626.
    14. Groen, Jan J.J. & Kapetanios, George & Price, Simon, 2009. "A real time evaluation of Bank of England forecasts of inflation and growth," International Journal of Forecasting, Elsevier, vol. 25(1), pages 74-80.
    15. Roberto Casarin & Fausto Corradin & Francesco Ravazzolo & Nguyen Domenico Sartore & Wing-Keung Wong, 2020. "A Scoring Rule for Factor and Autoregressive Models Under Misspecification," Advances in Decision Sciences, Asia University, Taiwan, vol. 24(2), pages 66-103, June.
    16. Karlsson, Sune, 2013. "Forecasting with Bayesian Vector Autoregression," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 791-897, Elsevier.
    17. Ganics, Gergely & Odendahl, Florens, 2021. "Bayesian VAR forecasts, survey information, and structural change in the euro area," International Journal of Forecasting, Elsevier, vol. 37(2), pages 971-999.
    18. Antolín-Díaz, Juan & Petrella, Ivan & Rubio-Ramírez, Juan F., 2021. "Structural scenario analysis with SVARs," Journal of Monetary Economics, Elsevier, vol. 117(C), pages 798-815.
    19. Granziera, Eleonora & Sekhposyan, Tatevik, 2019. "Predicting relative forecasting performance: An empirical investigation," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1636-1657.
    20. Carriero, Andrea & Mumtaz, Haroon & Theophilopoulou, Angeliki, 2015. "Macroeconomic information, structural change, and the prediction of fiscal aggregates," International Journal of Forecasting, Elsevier, vol. 31(2), pages 325-348.

    More about this item

    Keywords

    Prediction; forecasting; out-of-sample;
    All these keywords.

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fedlwp:2017-040. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://edirc.repec.org/data/frbslus.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (email available below). General contact details of provider: https://edirc.repec.org/data/frbslus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.