IDEAS home Printed from https://ideas.repec.org/p/tor/tecipa/tecipa-293.html
   My bibliography  Save this paper

How useful are historical data for forecasting the long-run equity return distribution?

Author

Listed:
  • John M Maheu
  • Thomas H McCurdy

Abstract

We provide an approach to forecasting the long-run (unconditional) distribution of equity returns making optimal use of historical data in the presence of structural breaks. Our focus is on learning about breaks in real time and assessing their impact on out-of-sample density forecasts. Forecasts use a probability-weighted average of submodels, each of which is estimated over a different history of data. The paper illustrates the importance of uncertainty about structural breaks and the value of modeling higher-order moments of excess returns when forecasting the return distribution and its moments. The shape of the long-run distribution and the dynamics of the higher-order moments are quite different from those generated by forecasts which cannot capture structural breaks. The empirical results strongly reject ignoring structural change in favor of our forecasts which weight historical data to accommodate uncertainty about structural breaks. We also strongly reject the common practice of using a fixed-length moving window. These differences in long-run forecasts have implications for many financial decisions, particularly for risk management and long-run investment decisions.

Suggested Citation

  • John M Maheu & Thomas H McCurdy, 2007. "How useful are historical data for forecasting the long-run equity return distribution?," Working Papers tecipa-293, University of Toronto, Department of Economics.
  • Handle: RePEc:tor:tecipa:tecipa-293
    as

    Download full text from publisher

    File URL: https://www.economics.utoronto.ca/public/workingPapers/tecipa-293.pdf
    File Function: Main Text
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Todd E. Clark & Michael W. McCracken, 2010. "Averaging forecasts from VARs with uncertain instabilities," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 5-29.
    2. Martin Lettau & Stijn Van Nieuwerburgh, 2008. "Reconciling the Return Predictability Evidence," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1607-1652, July.
    3. Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
    4. Martin Lettau & Sydney C. Ludvigson & Jessica A. Wachter, 2008. "The Declining Equity Premium: What Role Does Macroeconomic Risk Play?," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1653-1687, July.
    5. Chib, Siddhartha, 2001. "Markov chain Monte Carlo methods: computation and inference," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 5, chapter 57, pages 3569-3649, Elsevier.
    6. Paye, Bradley S. & Timmermann, Allan, 2006. "Instability of return prediction models," Journal of Empirical Finance, Elsevier, vol. 13(3), pages 274-315, June.
    7. Schwert, G William, 1990. "Indexes of U.S. Stock Prices from 1802 to 1987," The Journal of Business, University of Chicago Press, vol. 63(3), pages 399-426, July.
    8. Turner, Christopher M. & Startz, Richard & Nelson, Charles R., 1989. "A Markov model of heteroskedasticity, risk, and learning in the stock market," Journal of Financial Economics, Elsevier, vol. 25(1), pages 3-22, November.
    9. Martin Lettau & Sydney Ludvigson, 2001. "Consumption, Aggregate Wealth, and Expected Stock Returns," Journal of Finance, American Finance Association, vol. 56(3), pages 815-849, June.
    10. Eric Jacquier & Alex Kane & Alan J. Marcus, 2005. "Optimal Estimation of the Risk Premium for the Long Run and Asset Allocation: A Case of Compounded Estimation Risk," Journal of Financial Econometrics, Oxford University Press, vol. 3(1), pages 37-55.
    11. Richard Derrig & Elisha Orr, 2004. "Equity Risk Premium," North American Actuarial Journal, Taylor & Francis Journals, vol. 8(1), pages 45-69.
    12. Eugene F. Fama & Kenneth R. French, 2002. "The Equity Premium," Journal of Finance, American Finance Association, vol. 57(2), pages 637-659, April.
    13. John M. Maheu & Stephen Gordon, 2008. "Learning, forecasting and structural breaks," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 23(5), pages 553-583.
    14. Ľluboš Pástor & Robert F. Stambaugh, 2001. "The Equity Premium and Structural Breaks," Journal of Finance, American Finance Association, vol. 56(4), pages 1207-1239, August.
    15. David E. Rapach & Mark E. Wohar, 2006. "Structural Breaks and Predictive Regression Models of Aggregate U.S. Stock Returns," Journal of Financial Econometrics, Oxford University Press, vol. 4(2), pages 238-274.
    16. Elena Andreou & Eric Ghysels, 2002. "Detecting multiple breaks in financial market volatility dynamics," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 17(5), pages 579-600.
    17. Jana Eklund & Sune Karlsson, 2007. "Forecast Combination and Model Averaging Using Predictive Measures," Econometric Reviews, Taylor & Francis Journals, vol. 26(2-4), pages 329-363.
    18. M. Hashem Pesaran & Davide Pettenuzzo & Allan Timmermann, 2006. "Forecasting Time Series Subject to Multiple Structural Breaks," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 73(4), pages 1057-1084.
    19. Scott Mayfield, E., 2004. "Estimating the market risk premium," Journal of Financial Economics, Elsevier, vol. 73(3), pages 465-496, September.
    20. Geweke, John & Whiteman, Charles, 2006. "Bayesian Forecasting," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 1, pages 3-80, Elsevier.
    21. John Y. Campbell & Samuel B. Thompson, 2005. "Predicting the Equity Premium Out of Sample: Can Anything Beat the Historical Average?," Harvard Institute of Economic Research Working Papers 2084, Harvard - Institute of Economic Research.
    22. Pesaran, M. Hashem & Timmermann, Allan, 2002. "Market timing and return prediction under model instability," Journal of Empirical Finance, Elsevier, vol. 9(5), pages 495-510, December.
    23. Siegel, Jeremy J., 1992. "The real rate of interest from 1800-1990 : A study of the U.S. and the U.K," Journal of Monetary Economics, Elsevier, vol. 29(2), pages 227-252, April.
    24. Gary Koop & Simon M. Potter, 2007. "Estimation and Forecasting in Models with Multiple Breaks," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 74(3), pages 763-789.
    25. Giordani, Paolo & Kohn, Robert, 2008. "Efficient Bayesian Inference for Multiple Change-Point and Mixture Innovation Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 26, pages 66-77, January.
    26. Kim, Chang-Jin & Morley, James C. & Nelson, Charles R., 2005. "The Structural Break in the Equity Premium," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 181-191, April.
    27. Graham, John R. & Harvey, Campbell R., 2005. "The long-run equity risk premium," Finance Research Letters, Elsevier, vol. 2(4), pages 185-194, December.
    28. Jonathan H. Wright, 2009. "Forecasting US inflation by Bayesian model averaging," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 28(2), pages 131-144.
    29. K. J. Martijn Cremers, 2002. "Stock Return Predictability: A Bayesian Model Selection Perspective," The Review of Financial Studies, Society for Financial Studies, vol. 15(4), pages 1223-1249.
    30. Pesaran, M. Hashem & Timmermann, Allan, 2007. "Selection of estimation window in the presence of breaks," Journal of Econometrics, Elsevier, vol. 137(1), pages 134-161, March.
    31. Mehra, Rajnish & Prescott, Edward C., 2003. "The equity premium in retrospect," Handbook of the Economics of Finance, in: G.M. Constantinides & M. Harris & R. M. Stulz (ed.), Handbook of the Economics of Finance, edition 1, volume 1, chapter 14, pages 889-938, Elsevier.
    32. Nicholas Barberis, 2000. "Investing for the Long Run when Returns Are Predictable," Journal of Finance, American Finance Association, vol. 55(1), pages 225-264, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Fernandez, Pablo & Aguirreamalloa, Javier & Liechtenstein, Heinrich, 2009. "The equity premium puzzle: High required equity premium, undervaluation and self fulfilling prophecy," IESE Research Papers D/821, IESE Business School.
    2. Jiawen Xu & Pierre Perron, 2015. "Forecasting in the presence of in and out of sample breaks," Boston University - Department of Economics - Working Papers Series wp2015-012, Boston University - Department of Economics.
    3. Georges Dionne & Olfa Maalaoui Chun, 2013. "Default and liquidity regimes in the bond market during the 2002-2012 period," Canadian Journal of Economics, Canadian Economics Association, vol. 46(4), pages 1160-1195, November.
    4. Maheu, John M. & Song, Yong, 2014. "A new structural break model, with an application to Canadian inflation forecasting," International Journal of Forecasting, Elsevier, vol. 30(1), pages 144-160.
    5. Andrew Ang & Allan Timmermann, 2012. "Regime Changes and Financial Markets," Annual Review of Financial Economics, Annual Reviews, vol. 4(1), pages 313-337, October.
    6. Ida Wolden Bache & James Mitchell & Francesco Ravazzolo & Shaun P. Vahey, 2009. "Macro modelling with many models," Working Paper 2009/15, Norges Bank.
    7. Yoontae Jeon & Thomas H. McCurdy, 2017. "Time-Varying Window Length for Correlation Forecasts," Econometrics, MDPI, vol. 5(4), pages 1-29, December.
    8. Jiawen Xu & Pierre Perron, 2015. "Forecasting in the presence of in and out of sample breaks," Boston University - Department of Economics - Working Papers Series wp2015-012, Boston University - Department of Economics.
    9. He, Zhongfang & Maheu, John M., 2010. "Real time detection of structural breaks in GARCH models," Computational Statistics & Data Analysis, Elsevier, vol. 54(11), pages 2628-2640, November.
    10. Knut Are Aastveit & James Mitchell & Francesco Ravazzolo & Herman van Dijk, 2018. "The Evolution of Forecast Density Combinations in Economics," Tinbergen Institute Discussion Papers 18-069/III, Tinbergen Institute.
    11. Georges Dionne & Olfa Maalaoui Chun, 2013. "Presidential Address: Default and liquidity regimes in the bond market during the 2002–2012 period," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 46(4), pages 1160-1195, November.
    12. De Angelis Luca & Viroli Cinzia, 2017. "A Markov-switching regression model with non-Gaussian innovations: estimation and testing," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 21(2), pages 1-22, April.
    13. Mwasi Paza Mboya & Philipp Sibbertsen, 2023. "Optimal forecasts in the presence of discrete structural breaks under long memory," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(7), pages 1889-1908, November.
    14. Daniele Bianchi & Massimo Guidolin & Francesco Ravazzolo, 2017. "Macroeconomic Factors Strike Back: A Bayesian Change-Point Model of Time-Varying Risk Exposures and Premia in the U.S. Cross-Section," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 35(1), pages 110-129, January.
    15. Yong Song, 2014. "Modelling Regime Switching And Structural Breaks With An Infinite Hidden Markov Model," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(5), pages 825-842, August.
    16. Jochmann, Markus & Koop, Gary & Strachan, Rodney W., 2010. "Bayesian forecasting using stochastic search variable selection in a VAR subject to breaks," International Journal of Forecasting, Elsevier, vol. 26(2), pages 326-347, April.
    17. Huang, Yan & Kou, Gang & Peng, Yi, 2017. "Nonlinear manifold learning for early warnings in financial markets," European Journal of Operational Research, Elsevier, vol. 258(2), pages 692-702.
    18. Allan Timmermann, 2018. "Forecasting Methods in Finance," Annual Review of Financial Economics, Annual Reviews, vol. 10(1), pages 449-479, November.
    19. He, Zhongfang, 2009. "Forecasting output growth by the yield curve: the role of structural breaks," MPRA Paper 28208, University Library of Munich, Germany.
    20. Francesco Ravazzolo & Shaun P Vahey, 2010. "Measuring Core Inflation in Australia with Disaggregate Ensembles," RBA Annual Conference Volume (Discontinued), in: Renée Fry & Callum Jones & Christopher Kent (ed.),Inflation in an Era of Relative Price Shocks, Reserve Bank of Australia.
    21. Jiawen Xu & Pierre Perron, 2023. "Forecasting in the presence of in-sample and out-of-sample breaks," Empirical Economics, Springer, vol. 64(6), pages 3001-3035, June.
    22. Meligkotsidou, Loukia & Tzavalis, Elias & Vrontos, Ioannis, 2017. "On Bayesian analysis and unit root testing for autoregressive models in the presence of multiple structural breaks," Econometrics and Statistics, Elsevier, vol. 4(C), pages 70-90.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chatzitzisi, Evanthia & Fountas, Stilianos & Panagiotidis, Theodore, 2021. "Another look at calendar anomalies," The Quarterly Review of Economics and Finance, Elsevier, vol. 80(C), pages 823-840.
    2. Yoontae Jeon & Thomas H. McCurdy, 2017. "Time-Varying Window Length for Correlation Forecasts," Econometrics, MDPI, vol. 5(4), pages 1-29, December.
    3. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    4. Jiawen Xu & Pierre Perron, 2023. "Forecasting in the presence of in-sample and out-of-sample breaks," Empirical Economics, Springer, vol. 64(6), pages 3001-3035, June.
    5. Jiawen Xu & Pierre Perron, 2015. "Forecasting in the presence of in and out of sample breaks," Boston University - Department of Economics - Working Papers Series wp2015-012, Boston University - Department of Economics.
    6. Jiawen Xu & Pierre Perron, 2015. "Forecasting in the presence of in and out of sample breaks," Boston University - Department of Economics - Working Papers Series wp2015-012, Boston University - Department of Economics.
    7. Rapach, David & Zhou, Guofu, 2013. "Forecasting Stock Returns," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 328-383, Elsevier.
    8. Barbara Rossi, 2019. "Forecasting in the presence of instabilities: How do we know whether models predict well and how to improve them," Economics Working Papers 1711, Department of Economics and Business, Universitat Pompeu Fabra, revised Jul 2021.
    9. Smith, Simon C., 2017. "Equity premium estimates from economic fundamentals under structural breaks," International Review of Financial Analysis, Elsevier, vol. 52(C), pages 49-61.
    10. Sjoerd van den Hauwe & Richard Paap & Dick J.C. van Dijk, 2011. "An Alternative Bayesian Approach to Structural Breaks in Time Series Models," Tinbergen Institute Discussion Papers 11-023/4, Tinbergen Institute.
    11. Dangl, Thomas & Halling, Michael, 2012. "Predictive regressions with time-varying coefficients," Journal of Financial Economics, Elsevier, vol. 106(1), pages 157-181.
    12. Arnaud Dufays & Zhuo Li & Jeroen V.K. Rombouts & Yong Song, 2021. "Sparse change‐point VAR models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(6), pages 703-727, September.
    13. Narayan, Seema & Smyth, Russell, 2015. "The financial econometrics of price discovery and predictability," International Review of Financial Analysis, Elsevier, vol. 42(C), pages 380-393.
    14. Pettenuzzo, Davide & Timmermann, Allan, 2011. "Predictability of stock returns and asset allocation under structural breaks," Journal of Econometrics, Elsevier, vol. 164(1), pages 60-78, September.
    15. Çakmaklı, Cem & van Dijk, Dick, 2016. "Getting the most out of macroeconomic information for predicting excess stock returns," International Journal of Forecasting, Elsevier, vol. 32(3), pages 650-668.
    16. Nonejad, Nima, 2021. "Predicting equity premium using dynamic model averaging. Does the state–space representation matter?," The North American Journal of Economics and Finance, Elsevier, vol. 57(C).
    17. Demetrescu, Matei & Georgiev, Iliyan & Rodrigues, Paulo M.M. & Taylor, A.M. Robert, 2022. "Testing for episodic predictability in stock returns," Journal of Econometrics, Elsevier, vol. 227(1), pages 85-113.
    18. Cem Cakmakli & Dick van Dijk, 2010. "Getting the Most out of Macroeconomic Information for Predicting Stock Returns and Volatility," Tinbergen Institute Discussion Papers 10-115/4, Tinbergen Institute.
    19. Baetje, Fabian & Menkhoff, Lukas, 2016. "Equity premium prediction: Are economic and technical indicators unstable?," International Journal of Forecasting, Elsevier, vol. 32(4), pages 1193-1207.
    20. He, Zhongfang, 2009. "Forecasting output growth by the yield curve: the role of structural breaks," MPRA Paper 28208, University Library of Munich, Germany.

    More about this item

    Keywords

    density forecasts; structural change; model risk; parameter uncertainty; Bayesian learning; market returns;
    All these keywords.

    JEL classification:

    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tor:tecipa:tecipa-293. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: RePEc Maintainer (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.