IDEAS home Printed from https://ideas.repec.org/p/fip/fedlwp/2006-059.html
   My bibliography  Save this paper

The economic and statistical value of forecast combinations under regime switching: an application to predictable U.S. returns

Author

Listed:
  • Massimo Guidolin
  • Carrie Fangzhou Na

Abstract

We address one interesting case ? the predictability of excess US asset returns from macroeconomic factors within a flexible regime switching VAR framework ? in which the presence of regimes may lead to superior forecasting performance from forecast combinations. After having documented that forecast combinations provide gains in prediction accuracy and these gains are statistically significant, we show that combinations may substantially improve portfolio selection. We find that the best performing forecast combinations are those that either avoid estimating the pooling weights or that minimize the need for estimation. In practice, we report that the best performing combination schemes are based on the principle of relative, past forecasting performance. The economic gains from combining forecasts in portfolio management applications appear to be large, stable over time, and robust to the introduction of realistic transaction costs.

Suggested Citation

  • Massimo Guidolin & Carrie Fangzhou Na, 2007. "The economic and statistical value of forecast combinations under regime switching: an application to predictable U.S. returns," Working Papers 2006-059, Federal Reserve Bank of St. Louis.
  • Handle: RePEc:fip:fedlwp:2006-059
    as

    Download full text from publisher

    File URL: http://research.stlouisfed.org/wp/2006/2006-059.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Clements, Michael P. & Smith, Jeremy, 1997. "The performance of alternative forecasting methods for SETAR models," International Journal of Forecasting, Elsevier, vol. 13(4), pages 463-475, December.
    2. Palm, F. & Zellner, A., 1991. "To combine or not to combine? issues of combining forecasts," LIDAM Discussion Papers CORE 1991022, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    3. Turner, Christopher M. & Startz, Richard & Nelson, Charles R., 1989. "A Markov model of heteroskedasticity, risk, and learning in the stock market," Journal of Financial Economics, Elsevier, vol. 25(1), pages 3-22, November.
    4. Andrew Ang & Geert Bekaert, 2002. "International Asset Allocation With Regime Shifts," The Review of Financial Studies, Society for Financial Studies, vol. 15(4), pages 1137-1187.
    5. Berkowitz, Jeremy, 2001. "Testing Density Forecasts, with Applications to Risk Management," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(4), pages 465-474, October.
    6. Ravazzolo, F. & van Dijk, D.J.C. & Paap, R. & Franses, Ph.H.B.F., 2006. "Bayesian Model Averaging in the Presence of Structural Breaks," Econometric Institute Research Papers EI 2006-33, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    7. Campbell, John Y., 1987. "Stock returns and the term structure," Journal of Financial Economics, Elsevier, vol. 18(2), pages 373-399, June.
    8. Bunn, Derek W., 1985. "Statistical efficiency in the linear combination of forecasts," International Journal of Forecasting, Elsevier, vol. 1(2), pages 151-163.
    9. Timmermann, Allan, 2006. "Forecast Combinations," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 4, pages 135-196, Elsevier.
    10. Bekaert, Geert & Hodrick, Robert J, 1992. "Characterizing Predictable Components in Excess Returns on Equity and Foreign Exchange Markets," Journal of Finance, American Finance Association, vol. 47(2), pages 467-509, June.
    11. Ang, Andrew & Bekaert, Geert, 2002. "Regime Switches in Interest Rates," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 163-182, April.
    12. Hamilton, James D, 1989. "A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle," Econometrica, Econometric Society, vol. 57(2), pages 357-384, March.
    13. Elliott, Graham & Timmermann, Allan, 2004. "Optimal forecast combinations under general loss functions and forecast error distributions," Journal of Econometrics, Elsevier, vol. 122(1), pages 47-79, September.
    14. Fama, Eugene F. & French, Kenneth R., 1988. "Dividend yields and expected stock returns," Journal of Financial Economics, Elsevier, vol. 22(1), pages 3-25, October.
    15. Amit Goyal & Ivo Welch, 2003. "Predicting the Equity Premium with Dividend Ratios," Management Science, INFORMS, vol. 49(5), pages 639-654, May.
    16. David H. Cutler & James M. Poterba & Lawrence H. Summers, 1988. "What Moves Stock Prices?," Working papers 487, Massachusetts Institute of Technology (MIT), Department of Economics.
    17. Carolina Fugazza & Massimo Guidolin & Giovanna Nicodano, 2007. "Investing for the Long-run in European Real Estate," The Journal of Real Estate Finance and Economics, Springer, vol. 34(1), pages 35-80, January.
    18. Francis X. Diebold & Todd A. Gunther & Anthony S. Tay, "undated". "Evaluating Density Forecasts," CARESS Working Papres 97-18, University of Pennsylvania Center for Analytic Research and Economics in the Social Sciences.
    19. Massimo Guidolin & Allan Timmermann, 2005. "Economic Implications of Bull and Bear Regimes in UK Stock and Bond Returns," Economic Journal, Royal Economic Society, vol. 115(500), pages 111-143, January.
    20. Yang, Yuhong, 2004. "Combining Forecasting Procedures: Some Theoretical Results," Econometric Theory, Cambridge University Press, vol. 20(1), pages 176-222, February.
    21. Marco Aiolfi & Carlo Ambrogio Favero, "undated". "Model Uncertainty, Thick Modelling and the predictability of Stock Returns," Working Papers 221, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    22. Fenton, Victor M. & Gallant, A. Ronald, 1996. "Qualitative and asymptotic performance of SNP density estimators," Journal of Econometrics, Elsevier, vol. 74(1), pages 77-118, September.
    23. Rapach, David E. & Wohar, Mark E., 2006. "In-sample vs. out-of-sample tests of stock return predictability in the context of data mining," Journal of Empirical Finance, Elsevier, vol. 13(2), pages 231-247, March.
    24. Neely, Christopher J. & Weller, Paul, 2000. "Predictability in International Asset Returns: A Reexamination," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 35(4), pages 601-620, December.
    25. Francis X. Diebold & Jose A. Lopez, 1995. "Forecast evaluation and combination," Research Paper 9525, Federal Reserve Bank of New York.
    26. Francis X. Diebold & Glenn Rudebusch & Daniel Sichel, 1993. "Further Evidence on Business-Cycle Duration Dependence," NBER Chapters, in: Business Cycles, Indicators, and Forecasting, pages 255-284, National Bureau of Economic Research, Inc.
    27. James, Christopher & Koreisha, Sergio & Partch, Megan, 1985. "A VARMA Analysis of the Causal Relations among Stock Returns, Real Output, and Nominal Interest Rates," Journal of Finance, American Finance Association, vol. 40(5), pages 1375-1384, December.
    28. Chan, Louis K. C. & Karceski, Jason & Lakonishok, Josef, 1998. "The Risk and Return from Factors," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 33(2), pages 159-188, June.
    29. Garcia, Rene, 1998. "Asymptotic Null Distribution of the Likelihood Ratio Test in Markov Switching Models," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(3), pages 763-788, August.
    30. Clements,Michael & Hendry,David, 1998. "Forecasting Economic Time Series," Cambridge Books, Cambridge University Press, number 9780521634809.
    31. Guidolin, Massimo & Timmermann, Allan, 2006. "Term structure of risk under alternative econometric specifications," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 285-308.
    32. Guidolin, Massimo & Ono, Sadayuki, 2006. "Are the dynamic linkages between the macroeconomy and asset prices time-varying?," Journal of Economics and Business, Elsevier, vol. 58(5-6), pages 480-518.
    33. James H. Stock & Mark W. Watson, 1989. "New Indexes of Coincident and Leading Economic Indicators," NBER Chapters, in: NBER Macroeconomics Annual 1989, Volume 4, pages 351-409, National Bureau of Economic Research, Inc.
    34. Winkler, Robert L., 1989. "Combining forecasts: A philosophical basis and some current issues," International Journal of Forecasting, Elsevier, vol. 5(4), pages 605-609.
    35. Gray, Stephen F., 1996. "Modeling the conditional distribution of interest rates as a regime-switching process," Journal of Financial Economics, Elsevier, vol. 42(1), pages 27-62, September.
    36. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    37. Fama, Eugene F. & Schwert, G. William, 1977. "Asset returns and inflation," Journal of Financial Economics, Elsevier, vol. 5(2), pages 115-146, November.
    38. Michael P. Clements & Hans-Martin Krolzig, 1998. "A comparison of the forecast performance of Markov-switching and threshold autoregressive models of US GNP," Econometrics Journal, Royal Economic Society, vol. 1(Conferenc), pages 47-75.
    39. Massimo Guidolin & Allan Timmermann, 2006. "An econometric model of nonlinear dynamics in the joint distribution of stock and bond returns," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(1), pages 1-22, January.
    40. Diebold, Francis X, 1988. "Serial Correlation and the Combination of Forecasts," Journal of Business & Economic Statistics, American Statistical Association, vol. 6(1), pages 105-111, January.
    41. James H. Stock & Mark W.Watson, 2003. "Forecasting Output and Inflation: The Role of Asset Prices," Journal of Economic Literature, American Economic Association, vol. 41(3), pages 788-829, September.
    42. Bossaerts, Peter & Hillion, Pierre, 1999. "Implementing Statistical Criteria to Select Return Forecasting Models: What Do We Learn?," The Review of Financial Studies, Society for Financial Studies, vol. 12(2), pages 405-428.
    43. Sola, Martin & Driffill, John, 1994. "Testing the term structure of interest rates using a stationary vector autoregression with regime switching," Journal of Economic Dynamics and Control, Elsevier, vol. 18(3-4), pages 601-628.
    44. James H. Stock & Mark W. Watson, 1998. "A Comparison of Linear and Nonlinear Univariate Models for Forecasting Macroeconomic Time Series," NBER Working Papers 6607, National Bureau of Economic Research, Inc.
    45. Paye, Bradley S. & Timmermann, Allan, 2006. "Instability of return prediction models," Journal of Empirical Finance, Elsevier, vol. 13(3), pages 274-315, June.
    46. James H. Stock & Mark W. Watson, 1993. "Business Cycles, Indicators, and Forecasting," NBER Books, National Bureau of Economic Research, Inc, number stoc93-1, March.
    47. Clemen, Robert T., 1989. "Combining forecasts: A review and annotated bibliography," International Journal of Forecasting, Elsevier, vol. 5(4), pages 559-583.
    48. Fama, Eugene F. & French, Kenneth R., 1989. "Business conditions and expected returns on stocks and bonds," Journal of Financial Economics, Elsevier, vol. 25(1), pages 23-49, November.
    49. Fama, Eugene F. & French, Kenneth R., 1993. "Common risk factors in the returns on stocks and bonds," Journal of Financial Economics, Elsevier, vol. 33(1), pages 3-56, February.
    50. Pesaran, M Hashem & Timmermann, Allan, 1995. "Predictability of Stock Returns: Robustness and Economic Significance," Journal of Finance, American Finance Association, vol. 50(4), pages 1201-1228, September.
    51. Stock, James H. & Watson, Mark W. (ed.), 1993. "Business Cycles, Indicators, and Forecasting," National Bureau of Economic Research Books, University of Chicago Press, edition 1, number 9780226774886, December.
    52. David F. Hendry & Michael P. Clements, 2004. "Pooling of forecasts," Econometrics Journal, Royal Economic Society, vol. 7(1), pages 1-31, June.
    53. Robert B. Davies, 2002. "Hypothesis testing when a nuisance parameter is present only under the alternative: Linear model case," Biometrika, Biometrika Trust, vol. 89(2), pages 484-489, June.
    54. Hamilton, James D. & Susmel, Raul, 1994. "Autoregressive conditional heteroskedasticity and changes in regime," Journal of Econometrics, Elsevier, vol. 64(1-2), pages 307-333.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Francesco Ravazzolo & Marco J. Lombardi, 2012. "Oil price density forecasts: Exploring the linkages with stock markets," Working Papers No 3/2012, Centre for Applied Macro- and Petroleum economics (CAMP), BI Norwegian Business School.
    2. Lombardi, Marco J. & Ravazzolo, Francesco, 2016. "On the correlation between commodity and equity returns: Implications for portfolio allocation," Journal of Commodity Markets, Elsevier, vol. 2(1), pages 45-57.
    3. Wang Pu & Yixiang Chen & Feng Ma, 2016. "Forecasting the realized volatility in the Chinese stock market: further evidence," Applied Economics, Taylor & Francis Journals, vol. 48(33), pages 3116-3130, July.
    4. Massimo Guidolin & Federica Ria, 2011. "Regime shifts in mean-variance efficient frontiers: Some international evidence," Journal of Asset Management, Palgrave Macmillan, vol. 12(5), pages 322-349, November.
    5. Massimo Guidolin, 2011. "Markov Switching Models in Empirical Finance," Advances in Econometrics, in: Missing Data Methods: Time-Series Methods and Applications, pages 1-86, Emerald Group Publishing Limited.
    6. Guidolin, Massimo & Hyde, Stuart, 2012. "Can VAR models capture regime shifts in asset returns? A long-horizon strategic asset allocation perspective," Journal of Banking & Finance, Elsevier, vol. 36(3), pages 695-716.
    7. Ma, Feng & Li, Yu & Liu, Li & Zhang, Yaojie, 2018. "Are low-frequency data really uninformative? A forecasting combination perspective," The North American Journal of Economics and Finance, Elsevier, vol. 44(C), pages 92-108.
    8. Massimo Guidolin & Stuart Hyde, 2012. "Optimal Portfolios for Occupational Funds under Time-Varying Correlations in Bull and Bear Markets? Assessing the Ex-Post Economic Value," Working Papers 455, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guidolin, Massimo & Ono, Sadayuki, 2006. "Are the dynamic linkages between the macroeconomy and asset prices time-varying?," Journal of Economics and Business, Elsevier, vol. 58(5-6), pages 480-518.
    2. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    3. Massimo Guidolin, 2011. "Markov Switching Models in Empirical Finance," Advances in Econometrics, in: Missing Data Methods: Time-Series Methods and Applications, pages 1-86, Emerald Group Publishing Limited.
    4. Rapach, David & Zhou, Guofu, 2013. "Forecasting Stock Returns," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 328-383, Elsevier.
    5. Guidolin, Massimo & Timmermann, Allan, 2007. "Asset allocation under multivariate regime switching," Journal of Economic Dynamics and Control, Elsevier, vol. 31(11), pages 3503-3544, November.
    6. Chang, Kuang-Liang, 2009. "Do macroeconomic variables have regime-dependent effects on stock return dynamics? Evidence from the Markov regime switching model," Economic Modelling, Elsevier, vol. 26(6), pages 1283-1299, November.
    7. Guidolin, Massimo & Hyde, Stuart & McMillan, David & Ono, Sadayuki, 2009. "Non-linear predictability in stock and bond returns: When and where is it exploitable?," International Journal of Forecasting, Elsevier, vol. 25(2), pages 373-399.
    8. Henkel, Sam James & Martin, J. Spencer & Nardari, Federico, 2011. "Time-varying short-horizon predictability," Journal of Financial Economics, Elsevier, vol. 99(3), pages 560-580, March.
    9. Timmermann, Allan, 2006. "Forecast Combinations," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 4, pages 135-196, Elsevier.
    10. Massimo Guidolin & Allan Timmerman, 2005. "Optimal portfolio choice under regime switching, skew and kurtosis preferences," Working Papers 2005-006, Federal Reserve Bank of St. Louis.
    11. Schrimpf, Andreas, 2010. "International stock return predictability under model uncertainty," Journal of International Money and Finance, Elsevier, vol. 29(7), pages 1256-1282, November.
    12. Timmermann, Allan, 2008. "Elusive return predictability," International Journal of Forecasting, Elsevier, vol. 24(1), pages 1-18.
    13. Davide Pettenuzzo & Francesco Ravazzolo, 2016. "Optimal Portfolio Choice Under Decision‐Based Model Combinations," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 31(7), pages 1312-1332, November.
    14. Massimo Guidolin & Giovanna Nicodano, 2009. "Small caps in international equity portfolios: the effects of variance risk," Annals of Finance, Springer, vol. 5(1), pages 15-48, January.
    15. Guidolin, Massimo & Timmermann, Allan, 2009. "Forecasts of US short-term interest rates: A flexible forecast combination approach," Journal of Econometrics, Elsevier, vol. 150(2), pages 297-311, June.
    16. Andrew Ang & Allan Timmermann, 2012. "Regime Changes and Financial Markets," Annual Review of Financial Economics, Annual Reviews, vol. 4(1), pages 313-337, October.
    17. Thomadakis, Apostolos, 2016. "Do Combination Forecasts Outperform the Historical Average? Economic and Statistical Evidence," MPRA Paper 71589, University Library of Munich, Germany.
    18. Rapach, David E. & Wohar, Mark E. & Rangvid, Jesper, 2005. "Macro variables and international stock return predictability," International Journal of Forecasting, Elsevier, vol. 21(1), pages 137-166.
    19. Guidolin, Massimo & Hyde, Stuart, 2012. "Can VAR models capture regime shifts in asset returns? A long-horizon strategic asset allocation perspective," Journal of Banking & Finance, Elsevier, vol. 36(3), pages 695-716.
    20. Daniel Mantilla-García & Vijay Vaidyanathan, 2017. "Predicting stock returns in the presence of uncertain structural changes and sample noise," Financial Markets and Portfolio Management, Springer;Swiss Society for Financial Market Research, vol. 31(3), pages 357-391, August.

    More about this item

    Keywords

    Forecasting;

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fedlwp:2006-059. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Anna Oates (email available below). General contact details of provider: https://edirc.repec.org/data/frbslus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.