IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v40y2024i1p62-76.html
   My bibliography  Save this article

Forecasting in factor augmented regressions under structural change

Author

Listed:
  • Massacci, Daniele
  • Kapetanios, George

Abstract

Factor augmented regressions are widely used to produce out-of-sample forecasts of macroeconomic and financial time series. However, these series are subject to occasional breaks. We study the effect of neglected structural instability on the forecasts produced by factor augmented regressions when the latent factors are estimated by cross-sectional averages from a large panel of variables. Our results show that neglecting structural instability can be very costly in terms of forecasting performance. We derive analytical results to show that instability in the factor model and in the forecasting equation impacts the produced forecasts. We further provide numerical results showing that conditioning upon the most recent break tends to produce more accurate forecasts than unconditional estimation methods based on expanding or rolling windows. However, the actual gain depends on the location and the magnitude of the breaks. Finally, an application to out-of-sample stock return forecasting using liquidity proxies illustrates the empirical relevance of our results.

Suggested Citation

  • Massacci, Daniele & Kapetanios, George, 2024. "Forecasting in factor augmented regressions under structural change," International Journal of Forecasting, Elsevier, vol. 40(1), pages 62-76.
  • Handle: RePEc:eee:intfor:v:40:y:2024:i:1:p:62-76
    DOI: 10.1016/j.ijforecast.2022.12.004
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207022001698
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijforecast.2022.12.004?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
    2. Jushan Bai & Serena Ng, 2002. "Determining the Number of Factors in Approximate Factor Models," Econometrica, Econometric Society, vol. 70(1), pages 191-221, January.
    3. Timmermann, Allan, 2001. "Structural Breaks, Incomplete Information, and Stock Prices," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(3), pages 299-314, July.
    4. Michael Brennan & Sahn-Wook Huh & Avanidhar Subrahmanyam, 2013. "An Analysis of the Amihud Illiquidity Premium," The Review of Asset Pricing Studies, Society for Financial Studies, vol. 3(1), pages 133-176.
    5. Ľluboš Pástor & Robert F. Stambaugh, 2001. "The Equity Premium and Structural Breaks," Journal of Finance, American Finance Association, vol. 56(4), pages 1207-1239, August.
    6. Baetje, Fabian & Menkhoff, Lukas, 2016. "Equity premium prediction: Are economic and technical indicators unstable?," International Journal of Forecasting, Elsevier, vol. 32(4), pages 1193-1207.
    7. Chen, Liang & Dolado, Juan J. & Gonzalo, Jesús, 2014. "Detecting big structural breaks in large factor models," Journal of Econometrics, Elsevier, vol. 180(1), pages 30-48.
    8. Gonçalves, Sílvia & McCracken, Michael W. & Perron, Benoit, 2017. "Tests of equal accuracy for nested models with estimated factors," Journal of Econometrics, Elsevier, vol. 198(2), pages 231-252.
    9. Ludvigson, Sydney C. & Ng, Serena, 2007. "The empirical risk-return relation: A factor analysis approach," Journal of Financial Economics, Elsevier, vol. 83(1), pages 171-222, January.
    10. Pastor, Lubos & Stambaugh, Robert F., 2003. "Liquidity Risk and Expected Stock Returns," Journal of Political Economy, University of Chicago Press, vol. 111(3), pages 642-685, June.
    11. Chen, Yong & Eaton, Gregory W. & Paye, Bradley S., 2018. "Micro(structure) before macro? The predictive power of aggregate illiquidity for stock returns and economic activity," Journal of Financial Economics, Elsevier, vol. 130(1), pages 48-73.
    12. Christopher J. Neely & David E. Rapach & Jun Tu & Guofu Zhou, 2014. "Forecasting the Equity Risk Premium: The Role of Technical Indicators," Management Science, INFORMS, vol. 60(7), pages 1772-1791, July.
    13. Giovannelli, Alessandro & Massacci, Daniele & Soccorsi, Stefano, 2021. "Forecasting stock returns with large dimensional factor models," Journal of Empirical Finance, Elsevier, vol. 63(C), pages 252-269.
    14. Çakmaklı, Cem & van Dijk, Dick, 2016. "Getting the most out of macroeconomic information for predicting excess stock returns," International Journal of Forecasting, Elsevier, vol. 32(3), pages 650-668.
    15. Lesmond, David A & Ogden, Joseph P & Trzcinka, Charles A, 1999. "A New Estimate of Transaction Costs," The Review of Financial Studies, Society for Financial Studies, vol. 12(5), pages 1113-1141.
    16. Jushan Bai & Pierre Perron, 1998. "Estimating and Testing Linear Models with Multiple Structural Changes," Econometrica, Econometric Society, vol. 66(1), pages 47-78, January.
    17. Pesaran, M. Hashem & Timmermann, Allan, 2004. "How costly is it to ignore breaks when forecasting the direction of a time series?," International Journal of Forecasting, Elsevier, vol. 20(3), pages 411-425.
    18. M. Hashem Pesaran, 2006. "Estimation and Inference in Large Heterogeneous Panels with a Multifactor Error Structure," Econometrica, Econometric Society, vol. 74(4), pages 967-1012, July.
    19. Mario Forni & Alessandro Giovannelli & Marco Lippi & Stefano Soccorsi, 2018. "Dynamic factor model with infinite‐dimensional factor space: Forecasting," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 33(5), pages 625-642, August.
    20. Sydney C. Ludvigson & Serena Ng, 2009. "Macro Factors in Bond Risk Premia," The Review of Financial Studies, Society for Financial Studies, vol. 22(12), pages 5027-5067, December.
    21. Amihud, Yakov, 2002. "Illiquidity and stock returns: cross-section and time-series effects," Journal of Financial Markets, Elsevier, vol. 5(1), pages 31-56, January.
    22. David E. Rapach & Mark E. Wohar, 2006. "Structural Breaks and Predictive Regression Models of Aggregate U.S. Stock Returns," Journal of Financial Econometrics, Oxford University Press, vol. 4(2), pages 238-274.
    23. Han, Xu & Inoue, Atsushi, 2015. "Tests For Parameter Instability In Dynamic Factor Models," Econometric Theory, Cambridge University Press, vol. 31(5), pages 1117-1152, October.
    24. Stock, James H & Watson, Mark W, 1996. "Evidence on Structural Instability in Macroeconomic Time Series Relations," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(1), pages 11-30, January.
    25. Allan Timmermann, 2018. "Forecasting Methods in Finance," Annual Review of Financial Economics, Annual Reviews, vol. 10(1), pages 449-479, November.
    26. Pesaran, M. Hashem & Timmermann, Allan, 2007. "Selection of estimation window in the presence of breaks," Journal of Econometrics, Elsevier, vol. 137(1), pages 134-161, March.
    27. Holden, Craig W., 2009. "New low-frequency spread measures," Journal of Financial Markets, Elsevier, vol. 12(4), pages 778-813, November.
    28. repec:oup:rfinst:v:21:y:2017:i:4:p:1355-1401. is not listed on IDEAS
    29. Bair, Eric & Hastie, Trevor & Paul, Debashis & Tibshirani, Robert, 2006. "Prediction by Supervised Principal Components," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 119-137, March.
    30. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
    31. Kewei Hou & Tobias J. Moskowitz, 2005. "Market Frictions, Price Delay, and the Cross-Section of Expected Returns," The Review of Financial Studies, Society for Financial Studies, vol. 18(3), pages 981-1020.
    32. Kingsley Y. L. Fong & Craig W. Holden & Charles A. Trzcinka, 2017. "What Are the Best Liquidity Proxies for Global Research?," Review of Finance, European Finance Association, vol. 21(4), pages 1355-1401.
    33. Daniele Massacci, 2019. "Unstable Diffusion Indexes: With an Application to Bond Risk Premia," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 81(6), pages 1376-1400, December.
    34. Corradi, Valentina & Swanson, Norman R., 2014. "Testing for structural stability of factor augmented forecasting models," Journal of Econometrics, Elsevier, vol. 182(1), pages 100-118.
    35. Timmermann, Allan, 2018. "Forecasting Methods in Finance," CEPR Discussion Papers 12692, C.E.P.R. Discussion Papers.
    36. Jushan Bai, 2003. "Inferential Theory for Factor Models of Large Dimensions," Econometrica, Econometric Society, vol. 71(1), pages 135-171, January.
    37. Jushan Bai & Serena Ng, 2006. "Confidence Intervals for Diffusion Index Forecasts and Inference for Factor-Augmented Regressions," Econometrica, Econometric Society, vol. 74(4), pages 1133-1150, July.
    38. Paye, Bradley S. & Timmermann, Allan, 2006. "Instability of return prediction models," Journal of Empirical Finance, Elsevier, vol. 13(3), pages 274-315, June.
    39. Stock, James H & Watson, Mark W, 2002. "Macroeconomic Forecasting Using Diffusion Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 147-162, April.
    40. Goyenko, Ruslan Y. & Holden, Craig W. & Trzcinka, Charles A., 2009. "Do liquidity measures measure liquidity?," Journal of Financial Economics, Elsevier, vol. 92(2), pages 153-181, May.
    41. Stock J.H. & Watson M.W., 2002. "Forecasting Using Principal Components From a Large Number of Predictors," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 1167-1179, December.
    42. Timmermann, Allan, 2008. "Elusive return predictability," International Journal of Forecasting, Elsevier, vol. 24(1), pages 1-18.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Giovannelli, Alessandro & Massacci, Daniele & Soccorsi, Stefano, 2021. "Forecasting stock returns with large dimensional factor models," Journal of Empirical Finance, Elsevier, vol. 63(C), pages 252-269.
    2. Barbara Rossi, 2019. "Forecasting in the presence of instabilities: How do we know whether models predict well and how to improve them," Economics Working Papers 1711, Department of Economics and Business, Universitat Pompeu Fabra, revised Jul 2021.
    3. Çakmaklı, Cem & van Dijk, Dick, 2016. "Getting the most out of macroeconomic information for predicting excess stock returns," International Journal of Forecasting, Elsevier, vol. 32(3), pages 650-668.
    4. Chen, Yong & Eaton, Gregory W. & Paye, Bradley S., 2018. "Micro(structure) before macro? The predictive power of aggregate illiquidity for stock returns and economic activity," Journal of Financial Economics, Elsevier, vol. 130(1), pages 48-73.
    5. Chen, Sanpan & Cui, Guowei & Zhang, Jianhua, 2017. "On testing for structural break of coefficients in factor-augmented regression models," Economics Letters, Elsevier, vol. 161(C), pages 141-145.
    6. Catherine Doz & Peter Fuleky, 2019. "Dynamic Factor Models," Working Papers 2019-4, University of Hawaii Economic Research Organization, University of Hawaii at Manoa.
    7. Stock, J.H. & Watson, M.W., 2016. "Dynamic Factor Models, Factor-Augmented Vector Autoregressions, and Structural Vector Autoregressions in Macroeconomics," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 415-525, Elsevier.
    8. Hammerschmid, Regina & Lohre, Harald, 2018. "Regime shifts and stock return predictability," International Review of Economics & Finance, Elsevier, vol. 56(C), pages 138-160.
    9. Baltagi, Badi H. & Kao, Chihwa & Wang, Fa, 2021. "Estimating and testing high dimensional factor models with multiple structural changes," Journal of Econometrics, Elsevier, vol. 220(2), pages 349-365.
    10. Buncic, Daniel & Tischhauser, Martin, 2017. "Macroeconomic factors and equity premium predictability," International Review of Economics & Finance, Elsevier, vol. 51(C), pages 621-644.
    11. Rapach, David & Zhou, Guofu, 2013. "Forecasting Stock Returns," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 328-383, Elsevier.
    12. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    13. Cem Cakmakli & Dick van Dijk, 2010. "Getting the Most out of Macroeconomic Information for Predicting Stock Returns and Volatility," Tinbergen Institute Discussion Papers 10-115/4, Tinbergen Institute.
    14. Baetje, Fabian & Menkhoff, Lukas, 2016. "Equity premium prediction: Are economic and technical indicators unstable?," International Journal of Forecasting, Elsevier, vol. 32(4), pages 1193-1207.
    15. Baltagi, Badi H. & Kao, Chihwa & Wang, Fa, 2017. "Identification and estimation of a large factor model with structural instability," Journal of Econometrics, Elsevier, vol. 197(1), pages 87-100.
    16. Haase, Felix & Neuenkirch, Matthias, 2023. "Predictability of bull and bear markets: A new look at forecasting stock market regimes (and returns) in the US," International Journal of Forecasting, Elsevier, vol. 39(2), pages 587-605.
    17. Bai, Jushan & Han, Xu & Shi, Yutang, 2020. "Estimation and inference of change points in high-dimensional factor models," Journal of Econometrics, Elsevier, vol. 219(1), pages 66-100.
    18. Ma, Chenchen & Tu, Yundong, 2023. "Group fused Lasso for large factor models with multiple structural breaks," Journal of Econometrics, Elsevier, vol. 233(1), pages 132-154.
    19. Wei, Jie & Zhang, Yonghui, 2020. "A time-varying diffusion index forecasting model," Economics Letters, Elsevier, vol. 193(C).
    20. Gregory Connor & Lisa R. Goldberg & Robert A. Korajczyk, 2010. "Portfolio Risk Analysis," Economics Books, Princeton University Press, edition 1, number 9224.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:40:y:2024:i:1:p:62-76. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.