IDEAS home Printed from https://ideas.repec.org/a/bpj/sndecm/v9y2005i2n6.html
   My bibliography  Save this article

What Causes The Forecasting Failure of Markov-Switching Models? A Monte Carlo Study

Author

Listed:
  • Bessec Marie

    () (EURIsCO, University of Paris Dauphine)

  • Bouabdallah Othman

    () (EUREQua, University of Paris 1 Panthéon Sorbonne)

Abstract

This paper explores the forecasting abilities of Markov-Switching models. Although MS models generally display a superior in-sample fit relative to linear models, the gain in prediction remains small. We confirm this result using simulated data for a wide range of specifications by applying several tests of forecast accuracy and encompassing robust to nested models. In order to explain this poor performance, we use a forecasting error decomposition. We identify four components and derive their analytical expressions in different MS specifications. The relative contribution of each source is assessed through Monte Carlo simulations. We find that the main source of error is due to the misclassification of future regimes.

Suggested Citation

  • Bessec Marie & Bouabdallah Othman, 2005. "What Causes The Forecasting Failure of Markov-Switching Models? A Monte Carlo Study," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 9(2), pages 1-24, June.
    • Handle: RePEc:bpj:sndecm:v:9:y:2005:i:2:n:6
    as

    Download full text from publisher

    File URL: https://www.degruyter.com/view/j/snde.2005.9.2/snde.2005.9.2.1171/snde.2005.9.2.1171.xml?format=INT
    Download Restriction: For access to full text, subscription to the journal or payment for the individual article is required.

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Engel, Charles, 1994. "Can the Markov switching model forecast exchange rates?," Journal of International Economics, Elsevier, vol. 36(1-2), pages 151-165, February.
    2. Harvey, David I & Leybourne, Stephen J & Newbold, Paul, 1998. "Tests for Forecast Encompassing," Journal of Business & Economic Statistics, American Statistical Association, vol. 16(2), pages 254-259, April.
    3. Hans-Martin Krolzig & Juan Toro, 2004. "Classical and modern business cycle measurement: The European case," Spanish Economic Review, Springer;Spanish Economic Association, vol. 7(1), pages 1-21, January.
    4. Todd E. Clark & Michael W. McCracken, 2001. "Evaluating long-horizon forecasts," Research Working Paper RWP 01-14, Federal Reserve Bank of Kansas City.
    5. Cecchetti, Stephen G & Lam, Pok-sang & Mark, Nelson C, 1990. "Mean Reversion in Equilibrium Asset Prices," American Economic Review, American Economic Association, vol. 80(3), pages 398-418, June.
    6. Garcia, Rene & Perron, Pierre, 1996. "An Analysis of the Real Interest Rate under Regime Shifts," The Review of Economics and Statistics, MIT Press, vol. 78(1), pages 111-125, February.
    7. Bidarkota, Prasad V, 2001. "Alternative Regime Switching Models for Forecasting Inflation," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 20(1), pages 21-35, January.
    8. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    9. Clements, Michael P. & Franses, Philip Hans & Swanson, Norman R., 2004. "Forecasting economic and financial time-series with non-linear models," International Journal of Forecasting, Elsevier, vol. 20(2), pages 169-183.
    10. Michael P. Clements & Hans-Martin Krolzig, 1998. "A comparison of the forecast performance of Markov-switching and threshold autoregressive models of US GNP," Econometrics Journal, Royal Economic Society, vol. 1(Conferenc), pages 47-75.
    11. Clements, Michael P & Krolzig, Hans-Martin, 2003. "Business Cycle Asymmetries: Characterization and Testing Based on Markov-Switching Autoregressions," Journal of Business & Economic Statistics, American Statistical Association, vol. 21(1), pages 196-211, January.
    12. Clements, Michael & Krolzig, Hans-Martin, 1998. "Business Cycle Asymmetries: Characterisation and Testing based on Markov-Switching Autoregressions," Economic Research Papers 269248, University of Warwick - Department of Economics.
    13. Engel, Charles & Hamilton, James D, 1990. "Long Swings in the Dollar: Are They in the Data and Do Markets Know It?," American Economic Review, American Economic Association, vol. 80(4), pages 689-713, September.
    14. Hamilton, James D, 1989. "A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle," Econometrica, Econometric Society, vol. 57(2), pages 357-384, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. W. Miles, 2008. "Boom–Bust Cycles and the Forecasting Performance of Linear and Non-Linear Models of House Prices," The Journal of Real Estate Finance and Economics, Springer, vol. 36(3), pages 249-264, April.
    2. Weron, Rafal & Misiorek, Adam, 2008. "Forecasting spot electricity prices: A comparison of parametric and semiparametric time series models," International Journal of Forecasting, Elsevier, vol. 24(4), pages 744-763.
    3. Giordani, Paolo & Villani, Mattias, 2010. "Forecasting macroeconomic time series with locally adaptive signal extraction," International Journal of Forecasting, Elsevier, vol. 26(2), pages 312-325, April.
    4. Serinaldi, Francesco, 2011. "Distributional modeling and short-term forecasting of electricity prices by Generalized Additive Models for Location, Scale and Shape," Energy Economics, Elsevier, vol. 33(6), pages 1216-1226.
    5. Brent Bundick, 2007. "Do federal funds futures need adjustment for excess returns? a state-dependent approach," Research Working Paper RWP 07-08, Federal Reserve Bank of Kansas City.
    6. Mahua Barari & Nityananda Sarkar & Srikanta Kundu & Kushal Banik Chowdhury, 2014. "Forecasting House Prices in the United States with Multiple Structural Breaks," International Econometric Review (IER), Econometric Research Association, vol. 6(1), pages 1-23, April.
    7. Misiorek Adam & Trueck Stefan & Weron Rafal, 2006. "Point and Interval Forecasting of Spot Electricity Prices: Linear vs. Non-Linear Time Series Models," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 10(3), pages 1-36, September.
    8. Joanna Janczura & Rafał Weron, 2013. "Goodness-of-fit testing for the marginal distribution of regime-switching models with an application to electricity spot prices," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 97(3), pages 239-270, July.
    9. Weron, Rafał, 2014. "Electricity price forecasting: A review of the state-of-the-art with a look into the future," International Journal of Forecasting, Elsevier, vol. 30(4), pages 1030-1081.
    10. Katarzyna Maciejowska & Rafal Weron, 2015. "Short- and mid-term forecasting of baseload electricity prices in the UK: The impact of intra-day price relationships and market fundamentals," HSC Research Reports HSC/15/04, Hugo Steinhaus Center, Wroclaw University of Technology.
    11. Adam Misiorek & Rafal Weron, 2006. "Interval forecasting of spot electricity prices," HSC Research Reports HSC/06/05, Hugo Steinhaus Center, Wroclaw University of Technology.
    12. Rafal Weron, 2006. "Modeling and Forecasting Electricity Loads and Prices: A Statistical Approach," HSC Books, Hugo Steinhaus Center, Wroclaw University of Technology, number hsbook0601.
    13. Arora Siddharth & Little Max A. & McSharry Patrick E., 2013. "Nonlinear and nonparametric modeling approaches for probabilistic forecasting of the US gross national product," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 17(4), pages 395-420, September.

    More about this item

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bpj:sndecm:v:9:y:2005:i:2:n:6. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Peter Golla). General contact details of provider: https://www.degruyter.com .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.