IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/11468.html
   My bibliography  Save this paper

Predicting the Equity Premium Out of Sample: Can Anything Beat the Historical Average?

Author

Listed:
  • John Y. Campbell
  • Samuel B. Thompson

Abstract

A number of variables are correlated with subsequent returns on the aggregate US stock market in the 20th Century. Some of these variables are stock market valuation ratios, others reflect patterns in corporate finance or the levels of short- and long-term interest rates. Amit Goyal and Ivo Welch (2004) have argued that in-sample correlations conceal a systematic failure of these variables out of sample: None are able to beat a simple forecast based on the historical average stock return. In this note we show that forecasting variables with significant forecasting power in-sample generally have a better out-of-sample performance than a forecast based on the historical average return, once sensible restrictions are imposed on the signs of coefficients and return forecasts. The out-of-sample predictive power is small, but we find that it is economically meaningful. We also show that a variable is quite likely to have poor out-of-sample performance for an extended period of time even when the variable genuinely predicts returns with a stable coefficient.

Suggested Citation

  • John Y. Campbell & Samuel B. Thompson, 2005. "Predicting the Equity Premium Out of Sample: Can Anything Beat the Historical Average?," NBER Working Papers 11468, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:11468
    Note: AP
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w11468.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
    2. Owen Lamont, 1998. "Earnings and Expected Returns," Journal of Finance, American Finance Association, vol. 53(5), pages 1563-1587, October.
    3. Campbell, John Y., 2001. "Why long horizons? A study of power against persistent alternatives," Journal of Empirical Finance, Elsevier, vol. 8(5), pages 459-491, December.
    4. Kothari, S. P. & Shanken, Jay, 1997. "Book-to-market, dividend yield, and expected market returns: A time-series analysis," Journal of Financial Economics, Elsevier, vol. 44(2), pages 169-203, May.
    5. Walter Torous & Rossen Valkanov & Shu Yan, 2004. "On Predicting Stock Returns with Nearly Integrated Explanatory Variables," The Journal of Business, University of Chicago Press, vol. 77(4), pages 937-966, October.
    6. Polk, Christopher & Thompson, Samuel & Vuolteenaho, Tuomo, 2006. "Cross-sectional forecasts of the equity premium," Journal of Financial Economics, Elsevier, vol. 81(1), pages 101-141, July.
    7. Malcolm Baker & Jeffrey Wurgler, 2000. "The Equity Share in New Issues and Aggregate Stock Returns," Journal of Finance, American Finance Association, vol. 55(5), pages 2219-2257, October.
    8. John Y. Campbell & Robert J. Shiller, 2001. "Valuation Ratios and the Long-Run Stock Market Outlook: An Update," NBER Working Papers 8221, National Bureau of Economic Research, Inc.
    9. Campbell, John Y., 1987. "Stock returns and the term structure," Journal of Financial Economics, Elsevier, vol. 18(2), pages 373-399, June.
    10. Alexander W. Butler & Gustavo Grullon & James P. Weston, 2005. "Can Managers Forecast Aggregate Market Returns?," Journal of Finance, American Finance Association, vol. 60(2), pages 963-986, April.
    11. Campbell, John Y. & Yogo, Motohiro, 2006. "Efficient tests of stock return predictability," Journal of Financial Economics, Elsevier, vol. 81(1), pages 27-60, July.
    12. John Y. Campbell, Robert J. Shiller, 1988. "The Dividend-Price Ratio and Expectations of Future Dividends and Discount Factors," The Review of Financial Studies, Society for Financial Studies, vol. 1(3), pages 195-228.
    13. Martin Lettau & Sydney Ludvigson, 2001. "Consumption, Aggregate Wealth, and Expected Stock Returns," Journal of Finance, American Finance Association, vol. 56(3), pages 815-849, June.
    14. Atsushi Inoue & Lutz Kilian, 2005. "In-Sample or Out-of-Sample Tests of Predictability: Which One Should We Use?," Econometric Reviews, Taylor & Francis Journals, vol. 23(4), pages 371-402.
    15. Fama, Eugene F. & French, Kenneth R., 1988. "Dividend yields and expected stock returns," Journal of Financial Economics, Elsevier, vol. 22(1), pages 3-25, October.
    16. Stambaugh, Robert F., 1999. "Predictive regressions," Journal of Financial Economics, Elsevier, vol. 54(3), pages 375-421, December.
    17. Amit Goyal & Ivo Welch, 2003. "Predicting the Equity Premium with Dividend Ratios," Management Science, INFORMS, vol. 49(5), pages 639-654, May.
    18. Hodrick, Robert J, 1992. "Dividend Yields and Expected Stock Returns: Alternative Procedures for Inference and Measurement," The Review of Financial Studies, Society for Financial Studies, vol. 5(3), pages 357-386.
    19. Litterman, Robert B, 1986. "Forecasting with Bayesian Vector Autoregressions-Five Years of Experience," Journal of Business & Economic Statistics, American Statistical Association, vol. 4(1), pages 25-38, January.
    20. Jacob Boudoukh & Roni Michaely & Matthew Richardson & Michael R. Roberts, 2007. "On the Importance of Measuring Payout Yield: Implications for Empirical Asset Pricing," Journal of Finance, American Finance Association, vol. 62(2), pages 877-915, April.
    21. Campbell, John Y. & Viceira, Luis M., 2002. "Strategic Asset Allocation: Portfolio Choice for Long-Term Investors," OUP Catalogue, Oxford University Press, number 9780198296942.
    22. Bollerslev, Tim, 1990. "Modelling the Coherence in Short-run Nominal Exchange Rates: A Multivariate Generalized ARCH Model," The Review of Economics and Statistics, MIT Press, vol. 72(3), pages 498-505, August.
    23. Cavanagh, Christopher L. & Elliott, Graham & Stock, James H., 1995. "Inference in Models with Nearly Integrated Regressors," Econometric Theory, Cambridge University Press, vol. 11(5), pages 1131-1147, October.
    24. Mark, Nelson C, 1995. "Exchange Rates and Fundamentals: Evidence on Long-Horizon Predictability," American Economic Review, American Economic Association, vol. 85(1), pages 201-218, March.
    25. repec:cup:etheor:v:11:y:1995:i:5:p:1131-47 is not listed on IDEAS
    26. Kilian, Lutz, 1999. "Exchange Rates and Monetary Fundamentals: What Do We Learn from Long-Horizon Regressions?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 14(5), pages 491-510, Sept.-Oct.
    27. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
    28. Wayne E. Ferson & Sergei Sarkissian & Timothy T. Simin, 2003. "Spurious Regressions in Financial Economics?," Journal of Finance, American Finance Association, vol. 58(4), pages 1393-1413, August.
    29. Fama, Eugene F. & Schwert, G. William, 1977. "Asset returns and inflation," Journal of Financial Economics, Elsevier, vol. 5(2), pages 115-146, November.
    30. Lewellen, Jonathan, 2004. "Predicting returns with financial ratios," Journal of Financial Economics, Elsevier, vol. 74(2), pages 209-235, November.
    31. Clark, Todd E. & McCracken, Michael W., 2005. "The power of tests of predictive ability in the presence of structural breaks," Journal of Econometrics, Elsevier, vol. 124(1), pages 1-31, January.
    32. Wayne E. Ferson & Sergei Sarkissian & Timothy T. Simin, 2003. "Spurious Regressions in Financial Economics?," Journal of Finance, American Finance Association, vol. 58(4), pages 1393-1414, August.
    33. Fama, Eugene F. & French, Kenneth R., 1989. "Business conditions and expected returns on stocks and bonds," Journal of Financial Economics, Elsevier, vol. 25(1), pages 23-49, November.
    34. Merton, Robert C, 1969. "Lifetime Portfolio Selection under Uncertainty: The Continuous-Time Case," The Review of Economics and Statistics, MIT Press, vol. 51(3), pages 247-257, August.
    35. Pontiff, Jeffrey & Schall, Lawrence D., 1998. "Book-to-market ratios as predictors of market returns," Journal of Financial Economics, Elsevier, vol. 49(2), pages 141-160, August.
    36. Litterman, Robert, 1986. "Forecasting with Bayesian vector autoregressions -- Five years of experience : Robert B. Litterman, Journal of Business and Economic Statistics 4 (1986) 25-38," International Journal of Forecasting, Elsevier, vol. 2(4), pages 497-498.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. John Y. Campbell & Samuel B. Thompson, 2008. "Predicting Excess Stock Returns Out of Sample: Can Anything Beat the Historical Average?," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1509-1531, July.
    2. Rapach, David & Zhou, Guofu, 2013. "Forecasting Stock Returns," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 328-383, Elsevier.
    3. John Y. Campbell, 2008. "Viewpoint: Estimating the equity premium," Canadian Journal of Economics, Canadian Economics Association, vol. 41(1), pages 1-21, February.
    4. Ferreira, Miguel A. & Santa-Clara, Pedro, 2011. "Forecasting stock market returns: The sum of the parts is more than the whole," Journal of Financial Economics, Elsevier, vol. 100(3), pages 514-537, June.
    5. Schrimpf, Andreas, 2010. "International stock return predictability under model uncertainty," Journal of International Money and Finance, Elsevier, vol. 29(7), pages 1256-1282, November.
    6. Michael Scholz & Jens Perch Nielsen & Stefan Sperlich, 2012. "Nonparametric prediction of stock returns guided by prior knowledge," Graz Economics Papers 2012-02, University of Graz, Department of Economics.
    7. Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
    8. Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
    9. Jiang, Xiaoquan & Lee, Bong-Soo, 2007. "Stock returns, dividend yield, and book-to-market ratio," Journal of Banking & Finance, Elsevier, vol. 31(2), pages 455-475, February.
    10. Eric Hillebrand & Tae-Hwy Lee & Marcelo C. Medeiros, 2012. "Let's Do It Again: Bagging Equity Premium Predictors," CREATES Research Papers 2012-41, Department of Economics and Business Economics, Aarhus University.
    11. Rapach, David E. & Wohar, Mark E., 2006. "In-sample vs. out-of-sample tests of stock return predictability in the context of data mining," Journal of Empirical Finance, Elsevier, vol. 13(2), pages 231-247, March.
    12. Davide Pettenuzzo & Allan G. Timmermann & Rossen I. Valkanov, 2008. "Return Predictability under Equilibrium Constraints on the Equity Premium," Working Papers 37, Brandeis University, Department of Economics and International Business School.
    13. José Afonso Faias & Tiago Castel-Branco, 2018. "Out-Of-Sample Stock Return Prediction Using Higher-Order Moments," International Journal of Theoretical and Applied Finance (IJTAF), World Scientific Publishing Co. Pte. Ltd., vol. 21(06), pages 1-27, September.
    14. Neil Kellard & John Nankervis & Fotis Papadimitriou, 2007. "Predicting the UK Equity Premium with Dividend Ratios: An Out-Of-Sample Recursive Residuals Graphical Approach," Money Macro and Finance (MMF) Research Group Conference 2006 129, Money Macro and Finance Research Group.
    15. Stephan Jank, 2015. "Changes in the Composition of Publicly Traded Firms: Implications for the Dividend-Price Ratio and Return Predictability," Management Science, INFORMS, vol. 61(6), pages 1362-1377, June.
    16. Wachter, Jessica A. & Warusawitharana, Missaka, 2009. "Predictable returns and asset allocation: Should a skeptical investor time the market?," Journal of Econometrics, Elsevier, vol. 148(2), pages 162-178, February.
    17. Faias, José Afonso, 2023. "Predicting the equity risk premium using the smooth cross-sectional tail risk: The importance of correlation," Journal of Financial Markets, Elsevier, vol. 63(C).
    18. Yu, Jialin, 2011. "Disagreement and return predictability of stock portfolios," Journal of Financial Economics, Elsevier, vol. 99(1), pages 162-183, January.
    19. Tim Bollerslev & George Tauchen & Hao Zhou, 2009. "Expected Stock Returns and Variance Risk Premia," The Review of Financial Studies, Society for Financial Studies, vol. 22(11), pages 4463-4492, November.
    20. Chen, Long, 2009. "On the reversal of return and dividend growth predictability: A tale of two periods," Journal of Financial Economics, Elsevier, vol. 92(1), pages 128-151, April.

    More about this item

    JEL classification:

    • G1 - Financial Economics - - General Financial Markets

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:11468. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.