IDEAS home Printed from https://ideas.repec.org/p/fip/fedlwp/2017-040.html
   My bibliography  Save this paper

An Empirical Investigation of Direct and Iterated Multistep Conditional Forecasts

Author

Abstract

When constructing unconditional point forecasts, both direct- and iterated-multistep (DMS and IMS) approaches are common. However, in the context of producing conditional forecasts, IMS approaches based on vector autoregressions (VAR) are far more common than simpler DMS models. This is despite the fact that there are theoretical reasons to believe that DMS models are more robust to misspecification than are IMS models. In the context of unconditional forecasts, Marcellino, Stock, and Watson (MSW, 2006) investigate the empirical relevance of these theories. In this paper, we extend that work to conditional forecasts. We do so based on linear bivariate and trivariate models estimated using a large dataset of macroeconomic time series. Over comparable samples, our results reinforce those in MSW: the IMS approach is typically a bit better than DMS with significant improvements only at longer horizons. In contrast, when we focus on the Great Moderation sample we find a marked improvement in the DMS approach relative to IMS. The distinction is particularly clear when we forecast nominal rather than real variables where the relative gains can be substantial.

Suggested Citation

  • Michael W. McCracken & Joseph McGillicuddy, 2017. "An Empirical Investigation of Direct and Iterated Multistep Conditional Forecasts," Working Papers 2017-40, Federal Reserve Bank of St. Louis.
  • Handle: RePEc:fip:fedlwp:2017-040
    DOI: 10.20955/wp.2017.040
    as

    Download full text from publisher

    File URL: https://files.stlouisfed.org/files/htdocs/wp/2017/2017-040.pdf
    File Function: Full text
    Download Restriction: no

    File URL: https://doi.org/10.20955/wp.2017.040
    File Function: https://doi.org/10.20955/wp.2017.040
    Download Restriction: no

    File URL: https://libkey.io/10.20955/wp.2017.040?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-1084, September.
    2. Michael W. McCracken & Serena Ng, 2016. "FRED-MD: A Monthly Database for Macroeconomic Research," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(4), pages 574-589, October.
    3. Warne, Anders & Coenen, Günter & Christoffel, Kai, 2008. "The new area-wide model of the euro area: a micro-founded open-economy model for forecasting and policy analysis," Working Paper Series 944, European Central Bank.
    4. Brüggemann, Ralf & Jentsch, Carsten & Trenkler, Carsten, 2016. "Inference in VARs with conditional heteroskedasticity of unknown form," Journal of Econometrics, Elsevier, vol. 191(1), pages 69-85.
    5. Marcellino, Massimiliano & Stock, James H. & Watson, Mark W., 2006. "A comparison of direct and iterated multistep AR methods for forecasting macroeconomic time series," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 499-526.
    6. Daniel F. Waggoner & Tao Zha, 1999. "Conditional Forecasts In Dynamic Multivariate Models," The Review of Economics and Statistics, MIT Press, vol. 81(4), pages 639-651, November.
    7. David M. Arseneau, 2020. "How Would U.S. Banks Fare in a Negative Interest Rate Environment?," International Journal of Central Banking, International Journal of Central Banking, vol. 16(5), pages 269-308, October.
    8. Òscar Jordà & Massimiliano Marcellino, 2010. "Path forecast evaluation," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 635-662.
    9. Gary M. Koop, 2013. "Forecasting with Medium and Large Bayesian VARS," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(2), pages 177-203, March.
    10. Bańbura, Marta & Giannone, Domenico & Lenza, Michele, 2015. "Conditional forecasts and scenario analysis with vector autoregressions for large cross-sections," International Journal of Forecasting, Elsevier, vol. 31(3), pages 739-756.
    11. Domenico Giannone & Michele Lenza & Giorgio E. Primiceri, 2015. "Prior Selection for Vector Autoregressions," The Review of Economics and Statistics, MIT Press, vol. 97(2), pages 436-451, May.
    12. Rhys M. Bidder & Raffaella Giacomini & Andrew McKenna, 2016. "Stress Testing with Misspecified Models," Working Paper Series 2016-26, Federal Reserve Bank of San Francisco.
    13. Jarocinski, Marek, 2010. "Conditional forecasts and uncertainty about forecast revisions in vector autoregressions," Economics Letters, Elsevier, vol. 108(3), pages 257-259, September.
    14. James H. Stock & Mark W. Watson, 2007. "Why Has U.S. Inflation Become Harder to Forecast?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(s1), pages 3-33, February.
    15. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    16. Raffaella Giacomini, 2013. "The relationship between DSGE and VAR models," CeMMAP working papers CWP21/13, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    17. Campbell, Sean D., 2007. "Macroeconomic Volatility, Predictability, and Uncertainty in the Great Moderation: Evidence From the Survey of Professional Forecasters," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 191-200, April.
    18. Jane K. Dokko & Brian M. Doyle & Skander J. van den Heuvel & Michael T. Kiley & Jinill Kim & Shane M. Sherlund & Jae W. Sim, 2009. "Monetary policy and the housing bubble," Finance and Economics Discussion Series 2009-49, Board of Governors of the Federal Reserve System (U.S.).
    19. James H. Stock & Mark W. Watson, 2005. "Implications of Dynamic Factor Models for VAR Analysis," NBER Working Papers 11467, National Bureau of Economic Research, Inc.
    20. Christiane Baumeister & Lutz Kilian, 2014. "Real-Time Analysis of Oil Price Risks Using Forecast Scenarios," IMF Economic Review, Palgrave Macmillan;International Monetary Fund, vol. 62(1), pages 119-145, April.
    21. Pavel Kapinos & Oscar A. Mitnik, 2016. "A Top-down Approach to Stress-testing Banks," Journal of Financial Services Research, Springer;Western Finance Association, vol. 49(2), pages 229-264, June.
    22. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    23. Giannone, Domenico & Lenza, Michele & Momferatou, Daphne & Onorante, Luca, 2014. "Short-term inflation projections: A Bayesian vector autoregressive approach," International Journal of Forecasting, Elsevier, vol. 30(3), pages 635-644.
    24. Chevillon, Guillaume, 2017. "Robustness of Multistep Forecasts and Predictive Regressions at Intermediate and Long Horizons," ESSEC Working Papers WP1710, ESSEC Research Center, ESSEC Business School.
    25. Alberto Caruso & Lucrezia Reichlin & Giovanni Ricco, 2015. "The Legacy Debt and the Joint Path of Public Deficit and Debt in the Euro Area," European Economy - Discussion Papers 010, Directorate General Economic and Financial Affairs (DG ECFIN), European Commission.
    26. James H. Stock & Mark W. Watson, 2007. "Erratum to "Why Has U.S. Inflation Become Harder to Forecast?"," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(7), pages 1849-1849, October.
    27. Anna, Petrenko, 2016. "Мaркування готової продукції як складова частина інформаційного забезпечення маркетингової діяльності підприємств овочепродуктового підкомплексу," Agricultural and Resource Economics: International Scientific E-Journal, Agricultural and Resource Economics: International Scientific E-Journal, vol. 2(1), March.
    28. Hirtle, Beverly & Kovner, Anna & Vickery, James & Bhanot, Meru, 2016. "Assessing financial stability: The Capital and Loss Assessment under Stress Scenarios (CLASS) model," Journal of Banking & Finance, Elsevier, vol. 69(S1), pages 35-55.
    29. Schorfheide, Frank, 2005. "VAR forecasting under misspecification," Journal of Econometrics, Elsevier, vol. 128(1), pages 99-136, September.
    30. Òscar Jordà, 2005. "Estimation and Inference of Impulse Responses by Local Projections," American Economic Review, American Economic Association, vol. 95(1), pages 161-182, March.
    31. Todd E. Clark & Michael W. McCracken, 2017. "Tests of Predictive Ability for Vector Autoregressions Used for Conditional Forecasting," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(3), pages 533-553, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Michael W. McCracken & Joseph T. McGillicuddy & Michael T. Owyang, 2022. "Binary Conditional Forecasts," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(3), pages 1246-1258, June.
    2. Sokol, Andrej, 2021. "Fan charts 2.0: flexible forecast distributions with expert judgement," Working Paper Series 2624, European Central Bank.
    3. Lahiri, Kajal & Yang, Cheng, 2022. "Boosting tax revenues with mixed-frequency data in the aftermath of COVID-19: The case of New York," International Journal of Forecasting, Elsevier, vol. 38(2), pages 545-566.
    4. Yunyun Wang & Tatsushi Oka & Dan Zhu, 2023. "Distributional Vector Autoregression: Eliciting Macro and Financial Dependence," Papers 2303.04994, arXiv.org.
    5. Philip Beran & Arne Vogler, 2021. "Multi-Day-Ahead Electricity Price Forecasting: A Comparison of fundamental, econometric and hybrid Models," EWL Working Papers 2102, University of Duisburg-Essen, Chair for Management Science and Energy Economics, revised Oct 2021.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Todd E. Clark & Michael W. McCracken, 2014. "Evaluating Conditional Forecasts from Vector Autoregressions," Working Papers (Old Series) 1413, Federal Reserve Bank of Cleveland.
    2. Tallman, Ellis W. & Zaman, Saeed, 2020. "Combining survey long-run forecasts and nowcasts with BVAR forecasts using relative entropy," International Journal of Forecasting, Elsevier, vol. 36(2), pages 373-398.
    3. Koop, Gary & Korobilis, Dimitris & Pettenuzzo, Davide, 2019. "Bayesian compressed vector autoregressions," Journal of Econometrics, Elsevier, vol. 210(1), pages 135-154.
    4. Michael W. McCracken & Joseph T. McGillicuddy & Michael T. Owyang, 2022. "Binary Conditional Forecasts," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(3), pages 1246-1258, June.
    5. Bańbura, Marta & Giannone, Domenico & Lenza, Michele, 2015. "Conditional forecasts and scenario analysis with vector autoregressions for large cross-sections," International Journal of Forecasting, Elsevier, vol. 31(3), pages 739-756.
    6. Joshua C. C. Chan & Eric Eisenstat & Chenghan Hou & Gary Koop, 2020. "Composite likelihood methods for large Bayesian VARs with stochastic volatility," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(6), pages 692-711, September.
    7. Araujo, Gustavo Silva & Gaglianone, Wagner Piazza, 2023. "Machine learning methods for inflation forecasting in Brazil: New contenders versus classical models," Latin American Journal of Central Banking (previously Monetaria), Elsevier, vol. 4(2).
    8. Magnus Reif, 2020. "Macroeconomics, Nonlinearities, and the Business Cycle," ifo Beiträge zur Wirtschaftsforschung, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, number 87.
    9. Matei Demetrescu & Christoph Hanck & Robinson Kruse‐Becher, 2022. "Robust inference under time‐varying volatility: A real‐time evaluation of professional forecasters," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(5), pages 1010-1030, August.
    10. Mandalinci, Zeyyad, 2017. "Forecasting inflation in emerging markets: An evaluation of alternative models," International Journal of Forecasting, Elsevier, vol. 33(4), pages 1082-1104.
    11. Andrea Carriero & Francesco Corsello & Massimiliano Marcellino, 2022. "The global component of inflation volatility," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(4), pages 700-721, June.
    12. Hauzenberger, Niko, 2021. "Flexible Mixture Priors for Large Time-varying Parameter Models," Econometrics and Statistics, Elsevier, vol. 20(C), pages 87-108.
    13. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    14. Berg, Tim O. & Henzel, Steffen R., 2015. "Point and density forecasts for the euro area using Bayesian VARs," International Journal of Forecasting, Elsevier, vol. 31(4), pages 1067-1095.
    15. Mayer, Walter J. & Liu, Feng & Dang, Xin, 2017. "Improving the power of the Diebold–Mariano–West test for least squares predictions," International Journal of Forecasting, Elsevier, vol. 33(3), pages 618-626.
    16. Ganics, Gergely & Odendahl, Florens, 2021. "Bayesian VAR forecasts, survey information, and structural change in the euro area," International Journal of Forecasting, Elsevier, vol. 37(2), pages 971-999.
    17. Granziera, Eleonora & Sekhposyan, Tatevik, 2019. "Predicting relative forecasting performance: An empirical investigation," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1636-1657.
    18. Karlsson, Sune, 2013. "Forecasting with Bayesian Vector Autoregression," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 791-897, Elsevier.
    19. Carriero, Andrea & Mumtaz, Haroon & Theophilopoulou, Angeliki, 2015. "Macroeconomic information, structural change, and the prediction of fiscal aggregates," International Journal of Forecasting, Elsevier, vol. 31(2), pages 325-348.
    20. Pincheira, Pablo M. & West, Kenneth D., 2016. "A comparison of some out-of-sample tests of predictability in iterated multi-step-ahead forecasts," Research in Economics, Elsevier, vol. 70(2), pages 304-319.

    More about this item

    Keywords

    Prediction; forecasting; out-of-sample;
    All these keywords.

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fedlwp:2017-040. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Anna Oates (email available below). General contact details of provider: https://edirc.repec.org/data/frbslus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.