IDEAS home Printed from https://ideas.repec.org/p/isu/genstf/201501010800005727.html
   My bibliography  Save this paper

Forecasting and model averaging with structural breaks

Author

Listed:
  • Yin, Anwen

Abstract

This dissertation consists of three chapters. Collectively they attempt to investigateon how to better forecast a time series variable when there is uncertainty on the stabilityof model parameters.The first chapter applies the newly developed theory of optimal and robust weightsto forecasting the U.S. market equity premium in the presence of structural breaks.The empirical results suggest that parameter instability cannot fully explain the weakforecasting performance of most predictors used in related empirical research.The second chapter introduces a two-stage forecast combination method to forecastingthe U.S. market equity premium out-of-sample. In the first stage, for each predictivemodel, we combine its stable and break cases by using several model averaging methods. Next, we pool all adjusted predictive models together by applying equal weights. The empirical results suggest that this new method can potentially offer substantial predictive gains relative to the simple one-stage overall equal weights method.The third chapter extends model averaging theory under uncertainty regarding structuralbreaks to the out-of-sample forecast setting, and proposes new predictive modelweights based on the leave-one-out cross-validation criterion (CV), as CV is robust toheteroscedasticity and can be applied generally. It provides Monte Carlo and empiricalevidence showing that CV weights outperform several competing methods.

Suggested Citation

  • Yin, Anwen, 2015. "Forecasting and model averaging with structural breaks," ISU General Staff Papers 201501010800005727, Iowa State University, Department of Economics.
  • Handle: RePEc:isu:genstf:201501010800005727
    as

    Download full text from publisher

    File URL: https://dr.lib.iastate.edu/server/api/core/bitstreams/76cf8a19-d719-49df-ae61-2b20bfee8d25/content
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Pesaran, M.H. & Pick, A. & Pranovich, M., 2011. "Optimal Forecasts in the Presence of Structural Breaks (Updated 14 November 2011)," Cambridge Working Papers in Economics 1163, Faculty of Economics, University of Cambridge.
    2. Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
    3. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    4. D. W. K. Andrews, 2003. "End-of-Sample Instability Tests," Econometrica, Econometric Society, vol. 71(6), pages 1661-1694, November.
    5. Rossi, Barbara, 2005. "Optimal Tests For Nested Model Selection With Underlying Parameter Instability," Econometric Theory, Cambridge University Press, vol. 21(5), pages 962-990, October.
    6. Clark, Todd E. & McCracken, Michael W., 2001. "Tests of equal forecast accuracy and encompassing for nested models," Journal of Econometrics, Elsevier, vol. 105(1), pages 85-110, November.
    7. Raffaella Giacomini & Barbara Rossi, 2009. "Detecting and Predicting Forecast Breakdowns," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(2), pages 669-705.
    8. Davidson, James, 1994. "Stochastic Limit Theory: An Introduction for Econometricians," OUP Catalogue, Oxford University Press, number 9780198774037, Decembrie.
    9. Zeileis, Achim & Kleiber, Christian & Kramer, Walter & Hornik, Kurt, 2003. "Testing and dating of structural changes in practice," Computational Statistics & Data Analysis, Elsevier, vol. 44(1-2), pages 109-123, October.
    10. Raffaella Giacomini & Barbara Rossi, 2016. "Model Comparisons In Unstable Environments," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 57(2), pages 369-392, May.
    11. Pesaran, M. Hashem & Pick, Andreas & Pranovich, Mikhail, 2013. "Optimal forecasts in the presence of structural breaks," Journal of Econometrics, Elsevier, vol. 177(2), pages 134-152.
    12. West, Kenneth D., 2006. "Forecast Evaluation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 3, pages 99-134, Elsevier.
    13. Jushan Bai & Pierre Perron, 1998. "Estimating and Testing Linear Models with Multiple Structural Changes," Econometrica, Econometric Society, vol. 66(1), pages 47-78, January.
    14. Bai, Jushan, 1997. "Estimating Multiple Breaks One at a Time," Econometric Theory, Cambridge University Press, vol. 13(3), pages 315-352, June.
    15. Timmermann, Allan, 2006. "Forecast Combinations," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 4, pages 135-196, Elsevier.
    16. Clark, Todd & McCracken, Michael, 2013. "Advances in Forecast Evaluation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1107-1201, Elsevier.
    17. Hansen, Bruce E., 2008. "Least-squares forecast averaging," Journal of Econometrics, Elsevier, vol. 146(2), pages 342-350, October.
    18. Andrews, Donald W K, 1993. "Tests for Parameter Instability and Structural Change with Unknown Change Point," Econometrica, Econometric Society, vol. 61(4), pages 821-856, July.
    19. Clark, Todd E. & West, Kenneth D., 2007. "Approximately normal tests for equal predictive accuracy in nested models," Journal of Econometrics, Elsevier, vol. 138(1), pages 291-311, May.
    20. James H. Stock & Mark W.Watson, 2003. "Forecasting Output and Inflation: The Role of Asset Prices," Journal of Economic Literature, American Economic Association, vol. 41(3), pages 788-829, September.
    21. Clark, Todd E. & McCracken, Michael W., 2005. "The power of tests of predictive ability in the presence of structural breaks," Journal of Econometrics, Elsevier, vol. 124(1), pages 1-31, January.
    22. Capistrán, Carlos & Timmermann, Allan, 2009. "Forecast Combination With Entry and Exit of Experts," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 428-440.
    23. Bai, Jushan, 1999. "Likelihood ratio tests for multiple structural changes," Journal of Econometrics, Elsevier, vol. 91(2), pages 299-323, August.
    24. Todd E. Clark & Michael W. McCracken, 2010. "Averaging forecasts from VARs with uncertain instabilities," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 5-29, January.
    25. Qingfeng Liu & Ryo Okui, 2013. "Heteroscedasticity‐robust C(p) model averaging," Econometrics Journal, Royal Economic Society, vol. 16(3), pages 463-472, October.
    26. Andrews, Donald W. K., 1991. "Asymptotic optimality of generalized CL, cross-validation, and generalized cross-validation in regression with heteroskedastic errors," Journal of Econometrics, Elsevier, vol. 47(2-3), pages 359-377, February.
    27. Paye, Bradley S. & Timmermann, Allan, 2006. "Instability of return prediction models," Journal of Empirical Finance, Elsevier, vol. 13(3), pages 274-315, June.
    28. Calhoun, Gray, 2014. "Out-Of-Sample Comparisons of Overfit Models," Staff General Research Papers Archive 32462, Iowa State University, Department of Economics.
    29. John Y. Campbell & Samuel B. Thompson, 2008. "Predicting Excess Stock Returns Out of Sample: Can Anything Beat the Historical Average?," Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1509-1531, July.
    30. Hansen, Bruce E., 2000. "Testing for structural change in conditional models," Journal of Econometrics, Elsevier, vol. 97(1), pages 93-115, July.
    31. Xu Cheng & Bruce E. Hansen, 2012. "Forecasting with Factor-Augmented Regression: A Frequentist Model Averaging Approach, Second Version," PIER Working Paper Archive 13-061, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 03 Sep 2013.
    32. Graham Elliott & Ulrich K. Muller, 2006. "Efficient Tests for General Persistent Time Variation in Regression Coefficients," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 73(4), pages 907-940.
    33. Andrews, Donald W K & Ploberger, Werner, 1994. "Optimal Tests When a Nuisance Parameter Is Present Only under the Alternative," Econometrica, Econometric Society, vol. 62(6), pages 1383-1414, November.
    34. David E. Rapach & Mark E. Wohar, 2006. "Structural Breaks and Predictive Regression Models of Aggregate U.S. Stock Returns," Journal of Financial Econometrics, Oxford University Press, vol. 4(2), pages 238-274.
    35. James H. Stock, 2004. "Structural Stability and Models of the Business Cycle," De Economist, Springer, vol. 152(2), pages 197-209, June.
    36. Hansen, Bruce E., 2009. "Averaging Estimators For Regressions With A Possible Structural Break," Econometric Theory, Cambridge University Press, vol. 25(6), pages 1498-1514, December.
    37. Mc Cracken, Michael W., 2000. "Robust out-of-sample inference," Journal of Econometrics, Elsevier, vol. 99(2), pages 195-223, December.
    38. Rapach, David & Zhou, Guofu, 2013. "Forecasting Stock Returns," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 328-383, Elsevier.
    39. McCracken, Michael W., 2007. "Asymptotics for out of sample tests of Granger causality," Journal of Econometrics, Elsevier, vol. 140(2), pages 719-752, October.
    40. Hansen, Bruce E. & Racine, Jeffrey S., 2012. "Jackknife model averaging," Journal of Econometrics, Elsevier, vol. 167(1), pages 38-46.
    41. David E. Rapach & Jack K. Strauss & Guofu Zhou, 2010. "Out-of-Sample Equity Premium Prediction: Combination Forecasts and Links to the Real Economy," Review of Financial Studies, Society for Financial Studies, vol. 23(2), pages 821-862, February.
    42. Pesaran, M. Hashem & Pick, Andreas & Pranovich, Mikhail, 2013. "Optimal forecasts in the presence of structural breaks," Journal of Econometrics, Elsevier, vol. 177(2), pages 134-152.
    43. Pesaran, M. Hashem & Timmermann, Allan, 2007. "Selection of estimation window in the presence of breaks," Journal of Econometrics, Elsevier, vol. 137(1), pages 134-161, March.
    44. G. Elliott & C. Granger & A. Timmermann (ed.), 2006. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 1, number 1.
    45. Bruce E. Hansen, 2007. "Least Squares Model Averaging," Econometrica, Econometric Society, vol. 75(4), pages 1175-1189, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Lyócsa, Štefan & Molnár, Peter, 2018. "Exploiting dependence: Day-ahead volatility forecasting for crude oil and natural gas exchange-traded funds," Energy, Elsevier, vol. 155(C), pages 462-473.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    2. Rapach, David & Zhou, Guofu, 2013. "Forecasting Stock Returns," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 328-383, Elsevier.
    3. Yin, Anwen, 2019. "Out-of-sample equity premium prediction in the presence of structural breaks," International Review of Financial Analysis, Elsevier, vol. 65(C).
    4. Barbara Rossi, 2019. "Forecasting in the presence of instabilities: How do we know whether models predict well and how to improve them," Economics Working Papers 1711, Department of Economics and Business, Universitat Pompeu Fabra, revised Jul 2021.
    5. Baetje, Fabian & Menkhoff, Lukas, 2016. "Equity premium prediction: Are economic and technical indicators unstable?," International Journal of Forecasting, Elsevier, vol. 32(4), pages 1193-1207.
    6. Yin, Anwen, 2020. "Equity premium prediction and optimal portfolio decision with Bagging," The North American Journal of Economics and Finance, Elsevier, vol. 54(C).
    7. Raffaella Giacomini & Barbara Rossi, 2013. "Forecasting in macroeconomics," Chapters, in: Nigar Hashimzade & Michael A. Thornton (ed.), Handbook of Research Methods and Applications in Empirical Macroeconomics, chapter 17, pages 381-408, Edward Elgar Publishing.
    8. Inoue, Atsushi & Jin, Lu & Rossi, Barbara, 2017. "Rolling window selection for out-of-sample forecasting with time-varying parameters," Journal of Econometrics, Elsevier, vol. 196(1), pages 55-67.
    9. Cotter, John & Eyiah-Donkor, Emmanuel & Potì, Valerio, 2023. "Commodity futures return predictability and intertemporal asset pricing," Journal of Commodity Markets, Elsevier, vol. 31(C).
    10. Leland E. Farmer & Lawrence Schmidt & Allan Timmermann, 2023. "Pockets of Predictability," Journal of Finance, American Finance Association, vol. 78(3), pages 1279-1341, June.
    11. Graham Elliott & Allan Timmermann, 2016. "Forecasting in Economics and Finance," Annual Review of Economics, Annual Reviews, vol. 8(1), pages 81-110, October.
    12. Sun, Yuying & Hong, Yongmiao & Lee, Tae-Hwy & Wang, Shouyang & Zhang, Xinyu, 2021. "Time-varying model averaging," Journal of Econometrics, Elsevier, vol. 222(2), pages 974-992.
    13. Rossi, Barbara & Inoue, Atsushi & Jin, Lu, 2014. "Window Selection for Out-of-Sample Forecasting with Time-Varying Parameters," CEPR Discussion Papers 10168, C.E.P.R. Discussion Papers.
    14. Boot, Tom & Pick, Andreas, 2020. "Does modeling a structural break improve forecast accuracy?," Journal of Econometrics, Elsevier, vol. 215(1), pages 35-59.
    15. Clark, Todd & McCracken, Michael, 2013. "Advances in Forecast Evaluation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1107-1201, Elsevier.
    16. Schrimpf, Andreas & Wang, Qingwei, 2010. "A reappraisal of the leading indicator properties of the yield curve under structural instability," International Journal of Forecasting, Elsevier, vol. 26(4), pages 836-857, October.
    17. Daniel Borup & Jonas N. Eriksen & Mads M. Kjær & Martin Thyrsgaard, 2020. "Predicting bond return predictability," CREATES Research Papers 2020-09, Department of Economics and Business Economics, Aarhus University.
    18. Lu, Xun & Su, Liangjun, 2015. "Jackknife model averaging for quantile regressions," Journal of Econometrics, Elsevier, vol. 188(1), pages 40-58.
    19. Tsiakas, Ilias & Li, Jiahan & Zhang, Haibin, 2020. "Equity premium prediction and the state of the economy," Journal of Empirical Finance, Elsevier, vol. 58(C), pages 75-95.
    20. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:isu:genstf:201501010800005727. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Curtis Balmer (email available below). General contact details of provider: https://edirc.repec.org/data/deiasus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.