IDEAS home Printed from https://ideas.repec.org/p/ris/albaec/2017_009.html
   My bibliography  Save this paper

Testing for State-Dependent Predictive Ability

Author

Listed:
  • Fossati, Sebastian

    (University of Alberta, Department of Economics)

Abstract

This paper proposes a new test for comparing the out-of sample forecasting performance of two competing models for situations in which the predictive content may be state-dependent (for example, expansion and recession states or low and high volatility states). To apply this test the econometrician is not required to observe when the underlying states shift. The test is simple to implement and accommodates several different cases of interest. An out-of-sample forecasting exercise for US output growth using real-time data illustrates the improvement of this test over previous approaches to perform forecast comparison.

Suggested Citation

  • Fossati, Sebastian, 2017. "Testing for State-Dependent Predictive Ability," Working Papers 2017-9, University of Alberta, Department of Economics.
  • Handle: RePEc:ris:albaec:2017_009
    as

    Download full text from publisher

    File URL: https://sites.ualberta.ca/~econwps/2017/wp2017-09.pdf
    File Function: Full text
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-1084, September.
    2. Antonio Gargano & Davide Pettenuzzo & Allan Timmermann, 2019. "Bond Return Predictability: Economic Value and Links to the Macroeconomy," Management Science, INFORMS, vol. 65(2), pages 508-540, February.
    3. Hamilton, James D, 1989. "A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle," Econometrica, Econometric Society, vol. 57(2), pages 357-384, March.
    4. Luis Filipe Martins & Pierre Perron, 2016. "Improved Tests for Forecast Comparisons in the Presence of Instabilities," Journal of Time Series Analysis, Wiley Blackwell, vol. 37(5), pages 650-659, September.
    5. Clark, Todd E. & West, Kenneth D., 2006. "Using out-of-sample mean squared prediction errors to test the martingale difference hypothesis," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 155-186.
    6. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    7. Hamilton, James D., 1990. "Analysis of time series subject to changes in regime," Journal of Econometrics, Elsevier, vol. 45(1-2), pages 39-70.
    8. Maximo Camacho & Gabriel Perez‐Quiros & Pilar Poncela, 2015. "Extracting Nonlinear Signals from Several Economic Indicators," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(7), pages 1073-1089, November.
    9. Henkel, Sam James & Martin, J. Spencer & Nardari, Federico, 2011. "Time-varying short-horizon predictability," Journal of Financial Economics, Elsevier, vol. 99(3), pages 560-580, March.
    10. Chauvet, Marcelle & Piger, Jeremy, 2008. "A Comparison of the Real-Time Performance of Business Cycle Dating Methods," Journal of Business & Economic Statistics, American Statistical Association, vol. 26, pages 42-49, January.
    11. Sebastian Fossati, 2015. "Forecasting US recessions with macro factors," Applied Economics, Taylor & Francis Journals, vol. 47(53), pages 5726-5738, November.
    12. Fossati Sebastian, 2016. "Dating US business cycles with macro factors," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 20(5), pages 529-547, December.
    13. Chauvet, Marcelle, 1998. "An Econometric Characterization of Business Cycle Dynamics with Factor Structure and Regime Switching," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 969-996, November.
    14. Christopher G. Gibbs & Andrey L. Vasnev, 2017. "Conditionally Optimal Weights and Forward-Looking Approaches to Combining Forecasts," Discussion Papers 2017-10, School of Economics, The University of New South Wales.
    15. Chang-Jin Kim & Charles R. Nelson, 1999. "State-Space Models with Regime Switching: Classical and Gibbs-Sampling Approaches with Applications," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262112388.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Granziera, Eleonora & Sekhposyan, Tatevik, 2019. "Predicting relative forecasting performance: An empirical investigation," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1636-1657.
    2. Boriss Siliverstovs & Daniel S. Wochner, 2021. "State‐dependent evaluation of predictive ability," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(3), pages 547-574, April.
    3. Alessandro Casini & Pierre Perron, 2018. "Generalized Laplace Inference in Multiple Change-Points Models," Papers 1803.10871, arXiv.org, revised Jan 2021.
    4. Alessandro Casini & Pierre Perron, 2018. "Structural Breaks in Time Series," Papers 1805.03807, arXiv.org.
    5. Boriss Siliverstovs & Daniel Wochner, 2019. "Recessions as Breadwinner for Forecasters State-Dependent Evaluation of Predictive Ability: Evidence from Big Macroeconomic US Data," KOF Working papers 19-463, KOF Swiss Economic Institute, ETH Zurich.
    6. Alessandro Casini, 2018. "Tests for Forecast Instability and Forecast Failure under a Continuous Record Asymptotic Framework," Papers 1803.10883, arXiv.org, revised Dec 2018.
    7. Daniel Wochner, 2020. "Dynamic Factor Trees and Forests – A Theory-led Machine Learning Framework for Non-Linear and State-Dependent Short-Term U.S. GDP Growth Predictions," KOF Working papers 20-472, KOF Swiss Economic Institute, ETH Zurich.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guérin, Pierre & Leiva-Leon, Danilo, 2017. "Model averaging in Markov-switching models: Predicting national recessions with regional data," Economics Letters, Elsevier, vol. 157(C), pages 45-49.
    2. Raffaella Giacomini & Barbara Rossi, 2013. "Forecasting in macroeconomics," Chapters, in: Nigar Hashimzade & Michael A. Thornton (ed.), Handbook of Research Methods and Applications in Empirical Macroeconomics, chapter 17, pages 381-408, Edward Elgar Publishing.
    3. Daniel Borup & Jonas N. Eriksen & Mads M. Kjær & Martin Thyrsgaard, 2020. "Predicting bond return predictability," CREATES Research Papers 2020-09, Department of Economics and Business Economics, Aarhus University.
    4. Theobald, Thomas, 2013. "Markov Switching with Endogenous Number of Regimes and Leading Indicators in a Real-Time Business Cycle Forecast," VfS Annual Conference 2013 (Duesseldorf): Competition Policy and Regulation in a Global Economic Order 79911, Verein für Socialpolitik / German Economic Association.
    5. Richard H. Clarida & Lucio Sarno & Mark P. Taylor & Giorgio Valente, 2006. "The Role of Asymmetries and Regime Shifts in the Term Structure of Interest Rates," The Journal of Business, University of Chicago Press, vol. 79(3), pages 1193-1224, May.
    6. Antonin Aviat & Frédérique Bec & Claude Diebolt & Catherine Doz & Denis Ferrand & Laurent Ferrara & Eric Heyer & Valérie Mignon & Pierre-Alain Pionnier, 2021. "Dating business cycles in France: A reference chronology," Working Papers 08-21, Association Française de Cliométrie (AFC).
    7. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    8. Olivier Darné & Laurent Ferrara, 2011. "Identification of Slowdowns and Accelerations for the Euro Area Economy," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 73(3), pages 335-364, June.
    9. Fiorentini, Gabriele & Planas, Christophe & Rossi, Alessandro, 2016. "Skewness and kurtosis of multivariate Markov-switching processes," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 153-159.
    10. Granziera, Eleonora & Sekhposyan, Tatevik, 2019. "Predicting relative forecasting performance: An empirical investigation," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1636-1657.
    11. Issler, Joao Victor & Notini, Hilton & Rodrigues, Claudia & Soares, Ana Flávia, 2013. "Constructing coincident indices of economic activity for the Latin American economy," Revista Brasileira de Economia - RBE, EPGE Brazilian School of Economics and Finance - FGV EPGE (Brazil), vol. 67(1), April.
    12. Camacho, Maximo & Perez-Quiros, Gabriel & Poncela, Pilar, 2018. "Markov-switching dynamic factor models in real time," International Journal of Forecasting, Elsevier, vol. 34(4), pages 598-611.
    13. Byrne, Joseph P. & Korobilis, Dimitris & Ribeiro, Pinho J., 2016. "Exchange rate predictability in a changing world," Journal of International Money and Finance, Elsevier, vol. 62(C), pages 1-24.
    14. Levant, Jared & Ma, Jun, 2017. "A dynamic Nelson-Siegel yield curve model with Markov switching," Economic Modelling, Elsevier, vol. 67(C), pages 73-87.
    15. Chauvet, Marcelle & Senyuz, Zeynep & Yoldas, Emre, 2015. "What does financial volatility tell us about macroeconomic fluctuations?," Journal of Economic Dynamics and Control, Elsevier, vol. 52(C), pages 340-360.
    16. Hamilton, James D., 2011. "Calling recessions in real time," International Journal of Forecasting, Elsevier, vol. 27(4), pages 1006-1026, October.
    17. Paap, Richard & Segers, Rene & van Dijk, Dick, 2009. "Do Leading Indicators Lead Peaks More Than Troughs?," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 528-543.
    18. Catherine Doz & Peter Fuleky, 2019. "Dynamic Factor Models," Working Papers 2019-4, University of Hawaii Economic Research Organization, University of Hawaii at Manoa.
    19. Felix Haase & Matthias Neuenkirch, 2020. "Predictability of Bull and Bear Markets: A New Look at Forecasting Stock Market Regimes (and Returns) in the US," Research Papers in Economics 2020-01, University of Trier, Department of Economics.
    20. Golosnoy, Vasyl & Hogrefe, Jens, 2009. "Sequential methodology for signaling business cycle turning points," Kiel Working Papers 1528, Kiel Institute for the World Economy (IfW).

    More about this item

    Keywords

    Forecast Evaluation; Testing; Regime Switching; Structural Change;
    All these keywords.

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ris:albaec:2017_009. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://edirc.repec.org/data/deualca.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Joseph Marchand (email available below). General contact details of provider: https://edirc.repec.org/data/deualca.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.