IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/12814.html
   My bibliography  Save this paper

Predictive Systems: Living with Imperfect Predictors

Author

Listed:
  • Lubos Pastor
  • Robert F. Stambaugh

Abstract

The standard regression approach to modeling return predictability seems too restrictive in one way but too lax in another. A predictive regression models expected returns as an exact linear function of a given set of predictors but does not exploit the likely economic property that innovations in expected returns are negatively correlated with unexpected returns. We develop an alternative framework - a predictive system - that accommodates imperfect predictors and beliefs about that negative correlation. In this framework, the predictive ability of imperfect predictors is supplemented by information in lagged returns as well as lags of the predictors. Compared to predictive regressions, predictive systems deliver different and substantially more precise estimates of expected returns as well as different assessments of a given predictor's usefulness.

Suggested Citation

  • Lubos Pastor & Robert F. Stambaugh, 2007. "Predictive Systems: Living with Imperfect Predictors," NBER Working Papers 12814, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:12814
    Note: AP
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w12814.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Martin Lettau & Stijn Van Nieuwerburgh, 2008. "Reconciling the Return Predictability Evidence," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1607-1652, July.
    2. Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
    3. Campbell, John Y & Ammer, John, 1993. "What Moves the Stock and Bond Markets? A Variance Decomposition for Long-Term Asset Returns," Journal of Finance, American Finance Association, vol. 48(1), pages 3-37, March.
    4. Owen Lamont, 1998. "Earnings and Expected Returns," Journal of Finance, American Finance Association, vol. 53(5), pages 1563-1587, October.
    5. Klaas P. Baks & Andrew Metrick & Jessica Wachter, 2001. "Should Investors Avoid All Actively Managed Mutual Funds? A Study in Bayesian Performance Evaluation," Journal of Finance, American Finance Association, vol. 56(1), pages 45-85, February.
    6. Clark, Todd E. & West, Kenneth D., 2006. "Using out-of-sample mean squared prediction errors to test the martingale difference hypothesis," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 155-186.
    7. Ľuboš Pástor & Meenakshi Sinha & Bhaskaran Swaminathan, 2008. "Estimating the Intertemporal Risk–Return Tradeoff Using the Implied Cost of Capital," Journal of Finance, American Finance Association, vol. 63(6), pages 2859-2897, December.
    8. Pastor, Lubos & Stambaugh, Robert F., 2002. "Investing in equity mutual funds," Journal of Financial Economics, Elsevier, vol. 63(3), pages 351-380, March.
    9. Andrew Ang & Geert Bekaert, 2007. "Stock Return Predictability: Is it There?," The Review of Financial Studies, Society for Financial Studies, vol. 20(3), pages 651-707.
    10. Campbell, John Y, 1991. "A Variance Decomposition for Stock Returns," Economic Journal, Royal Economic Society, vol. 101(405), pages 157-179, March.
    11. Kothari, S.P. & Lewellen, Jonathan & Warner, Jerold B., 2006. "Stock returns, aggregate earnings surprises, and behavioral finance," Journal of Financial Economics, Elsevier, vol. 79(3), pages 537-568, March.
    12. Ľluboš Pástor & Robert F. Stambaugh, 2001. "The Equity Premium and Structural Breaks," Journal of Finance, American Finance Association, vol. 56(4), pages 1207-1239, August.
    13. Stambaugh, Robert F., 1997. "Analyzing investments whose histories differ in length," Journal of Financial Economics, Elsevier, vol. 45(3), pages 285-331, September.
    14. John Y. Campbell & Samuel B. Thompson, 2005. "Predicting the Equity Premium Out of Sample: Can Anything Beat the Historical Average?," Harvard Institute of Economic Research Working Papers 2084, Harvard - Institute of Economic Research.
    15. repec:cup:etheor:v:10:y:1994:i:3-4:p:672-700 is not listed on IDEAS
    16. Wayne E. Ferson & Sergei Sarkissian & Timothy T. Simin, 2003. "Spurious Regressions in Financial Economics?," Journal of Finance, American Finance Association, vol. 58(4), pages 1393-1413, August.
    17. Kandel, Shmuel & Stambaugh, Robert F, 1996. "On the Predictability of Stock Returns: An Asset-Allocation Perspective," Journal of Finance, American Finance Association, vol. 51(2), pages 385-424, June.
    18. Ferson, Wayne E & Harvey, Campbell R, 1991. "The Variation of Economic Risk Premiums," Journal of Political Economy, University of Chicago Press, vol. 99(2), pages 385-415, April.
    19. Fama, Eugene F. & Schwert, G. William, 1977. "Asset returns and inflation," Journal of Financial Economics, Elsevier, vol. 5(2), pages 115-146, November.
    20. Elliott, Graham & Stock, James H., 1994. "Inference in Time Series Regression When the Order of Integration of a Regressor is Unknown," Econometric Theory, Cambridge University Press, vol. 10(3-4), pages 672-700, August.
    21. Pastor, Lubos & Stambaugh, Robert F., 2002. "Mutual fund performance and seemingly unrelated assets," Journal of Financial Economics, Elsevier, vol. 63(3), pages 315-349, March.
    22. Campbell, John Y., 1987. "Stock returns and the term structure," Journal of Financial Economics, Elsevier, vol. 18(2), pages 373-399, June.
    23. Campbell, John Y. & Yogo, Motohiro, 2006. "Efficient tests of stock return predictability," Journal of Financial Economics, Elsevier, vol. 81(1), pages 27-60, July.
    24. Pastor, Lubos & Stambaugh, Robert F., 2000. "Comparing asset pricing models: an investment perspective," Journal of Financial Economics, Elsevier, vol. 56(3), pages 335-381, June.
    25. Gregory Mankiw, N. & Shapiro, Matthew D., 1986. "Do we reject too often? : Small sample properties of tests of rational expectations models," Economics Letters, Elsevier, vol. 20(2), pages 139-145.
    26. Lewellen, Jonathan, 2004. "Predicting returns with financial ratios," Journal of Financial Economics, Elsevier, vol. 74(2), pages 209-235, November.
    27. Shiller, Robert J, 1981. "Do Stock Prices Move Too Much to be Justified by Subsequent Changes in Dividends?," American Economic Review, American Economic Association, vol. 71(3), pages 421-436, June.
    28. Clark, Todd E. & West, Kenneth D., 2007. "Approximately normal tests for equal predictive accuracy in nested models," Journal of Econometrics, Elsevier, vol. 138(1), pages 291-311, May.
    29. Wayne E. Ferson & Sergei Sarkissian & Timothy T. Simin, 2003. "Spurious Regressions in Financial Economics?," Journal of Finance, American Finance Association, vol. 58(4), pages 1393-1414, August.
    30. Ľuboš Pástor & Robert F. Stambaugh, 1999. "Costs of Equity Capital and Model Mispricing," Journal of Finance, American Finance Association, vol. 54(1), pages 67-121, February.
    31. Sylvia Frühwirth‐Schnatter, 1994. "Data Augmentation And Dynamic Linear Models," Journal of Time Series Analysis, Wiley Blackwell, vol. 15(2), pages 183-202, March.
    32. Lettau, Martin & Ludvigson, Sydney C., 2005. "Expected returns and expected dividend growth," Journal of Financial Economics, Elsevier, vol. 76(3), pages 583-626, June.
    33. John H. Cochrane, 2008. "The Dog That Did Not Bark: A Defense of Return Predictability," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1533-1575, July.
    34. Michael Jansson & Marcelo J. Moreira, 2006. "Optimal Inference in Regression Models with Nearly Integrated Regressors," Econometrica, Econometric Society, vol. 74(3), pages 681-714, May.
    35. repec:fth:pennfi:72 is not listed on IDEAS
    36. Fama, Eugene F. & French, Kenneth R., 1988. "Dividend yields and expected stock returns," Journal of Financial Economics, Elsevier, vol. 22(1), pages 3-25, October.
    37. Stambaugh, Robert F., 1999. "Predictive regressions," Journal of Financial Economics, Elsevier, vol. 54(3), pages 375-421, December.
    38. Amit Goyal & Ivo Welch, 2003. "Predicting the Equity Premium with Dividend Ratios," Management Science, INFORMS, vol. 49(5), pages 639-654, May.
    39. Unknown, 1986. "Letters," Choices: The Magazine of Food, Farm, and Resource Issues, Agricultural and Applied Economics Association, vol. 1(4), pages 1-9.
    40. Wachter, Jessica A. & Warusawitharana, Missaka, 2009. "Predictable returns and asset allocation: Should a skeptical investor time the market?," Journal of Econometrics, Elsevier, vol. 148(2), pages 162-178, February.
    41. Doron Avramov, 2004. "Stock Return Predictability and Asset Pricing Models," The Review of Financial Studies, Society for Financial Studies, vol. 17(3), pages 699-738.
    42. Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
    43. Avramov, Doron & Wermers, Russ, 2006. "Investing in mutual funds when returns are predictable," Journal of Financial Economics, Elsevier, vol. 81(2), pages 339-377, August.
    44. Ang, Andrew & Piazzesi, Monika, 2003. "A no-arbitrage vector autoregression of term structure dynamics with macroeconomic and latent variables," Journal of Monetary Economics, Elsevier, vol. 50(4), pages 745-787, May.
    45. John Y. Campbell & Samuel B. Thompson, 2008. "Predicting Excess Stock Returns Out of Sample: Can Anything Beat the Historical Average?," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1509-1531, July.
    46. Lior Menzly & Tano Santos & Pietro Veronesi, 2004. "Understanding Predictability," Journal of Political Economy, University of Chicago Press, vol. 112(1), pages 1-47, February.
    47. Keim, Donald B. & Stambaugh, Robert F., 1986. "Predicting returns in the stock and bond markets," Journal of Financial Economics, Elsevier, vol. 17(2), pages 357-390, December.
    48. Erik Hjalmarsson, 2006. "Should we expect significant out-of-sample results when predicting stock returns?," International Finance Discussion Papers 855, Board of Governors of the Federal Reserve System (U.S.).
    49. Conrad, Jennifer & Kaul, Gautam, 1988. "Time-Variation in Expected Returns," The Journal of Business, University of Chicago Press, vol. 61(4), pages 409-425, October.
    50. Nelson, Charles R & Kim, Myung J, 1993. "Predictable Stock Returns: The Role of Small Sample Bias," Journal of Finance, American Finance Association, vol. 48(2), pages 641-661, June.
    51. Lamoureux, Christopher G & Zhou, Guofu, 1996. "Temporary Components of Stock Returns: What Do the Data Tell Us?," The Review of Financial Studies, Society for Financial Studies, vol. 9(4), pages 1033-1059.
    52. Jones, Christopher S. & Shanken, Jay, 2005. "Mutual fund performance with learning across funds," Journal of Financial Economics, Elsevier, vol. 78(3), pages 507-552, December.
    53. Ľuboš Pástor, 2000. "Portfolio Selection and Asset Pricing Models," Journal of Finance, American Finance Association, vol. 55(1), pages 179-223, February.
    54. K. J. Martijn Cremers, 2002. "Stock Return Predictability: A Bayesian Model Selection Perspective," The Review of Financial Studies, Society for Financial Studies, vol. 15(4), pages 1223-1249.
    55. Avramov, Doron, 2002. "Stock return predictability and model uncertainty," Journal of Financial Economics, Elsevier, vol. 64(3), pages 423-458, June.
    56. Brandt, Michael W. & Kang, Qiang, 2004. "On the relationship between the conditional mean and volatility of stock returns: A latent VAR approach," Journal of Financial Economics, Elsevier, vol. 72(2), pages 217-257, May.
    57. Nicholas Barberis, 2000. "Investing for the Long Run when Returns Are Predictable," Journal of Finance, American Finance Association, vol. 55(1), pages 225-264, February.
    58. Cavanagh, Christopher L. & Elliott, Graham & Stock, James H., 1995. "Inference in Models with Nearly Integrated Regressors," Econometric Theory, Cambridge University Press, vol. 11(5), pages 1131-1147, October.
    59. Tano Santos & Pietro Veronesi, 2006. "Labor Income and Predictable Stock Returns," The Review of Financial Studies, Society for Financial Studies, vol. 19(1), pages 1-44.
    60. repec:cup:etheor:v:11:y:1995:i:5:p:1131-47 is not listed on IDEAS
    61. Ferson, Wayne E & Harvey, Campbell R, 1993. "The Risk and Predictability of International Equity Returns," The Review of Financial Studies, Society for Financial Studies, vol. 6(3), pages 527-566.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wachter, Jessica A. & Warusawitharana, Missaka, 2009. "Predictable returns and asset allocation: Should a skeptical investor time the market?," Journal of Econometrics, Elsevier, vol. 148(2), pages 162-178, February.
    2. Rapach, David & Zhou, Guofu, 2013. "Forecasting Stock Returns," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 328-383, Elsevier.
    3. Mykola Babiak & Jozef Barunik, 2020. "Deep Learning, Predictability, and Optimal Portfolio Returns," CERGE-EI Working Papers wp677, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
    4. Yufeng Han, 2010. "On the Economic Value of Return Predictability," Annals of Economics and Finance, Society for AEF, vol. 11(1), pages 1-33, May.
    5. Michael Johannes & Arthur Korteweg & Nicholas Polson, 2014. "Sequential Learning, Predictability, and Optimal Portfolio Returns," Journal of Finance, American Finance Association, vol. 69(2), pages 611-644, April.
    6. Chen, Long, 2009. "On the reversal of return and dividend growth predictability: A tale of two periods," Journal of Financial Economics, Elsevier, vol. 92(1), pages 128-151, April.
    7. Davide Pettenuzzo & Allan G. Timmermann & Rossen I. Valkanov, 2008. "Return Predictability under Equilibrium Constraints on the Equity Premium," Working Papers 37, Brandeis University, Department of Economics and International Business School.
    8. Schrimpf, Andreas, 2010. "International stock return predictability under model uncertainty," Journal of International Money and Finance, Elsevier, vol. 29(7), pages 1256-1282, November.
    9. Efstathios Avdis & Jessica A. Wachter, 2013. "Maximum likelihood estimation of the equity premium," NBER Working Papers 19684, National Bureau of Economic Research, Inc.
    10. Pettenuzzo, Davide & Timmermann, Allan & Valkanov, Rossen, 2014. "Forecasting stock returns under economic constraints," Journal of Financial Economics, Elsevier, vol. 114(3), pages 517-553.
    11. Jiang, Fuwei & Lee, Joshua & Martin, Xiumin & Zhou, Guofu, 2019. "Manager sentiment and stock returns," Journal of Financial Economics, Elsevier, vol. 132(1), pages 126-149.
    12. Doron Avramov & Guofu Zhou, 2010. "Bayesian Portfolio Analysis," Annual Review of Financial Economics, Annual Reviews, vol. 2(1), pages 25-47, December.
    13. Avdis, Efstathios & Wachter, Jessica A., 2017. "Maximum likelihood estimation of the equity premium," Journal of Financial Economics, Elsevier, vol. 125(3), pages 589-609.
    14. Puneet Handa, 2006. "Does Stock Return Predictability Imply Improved Asset Allocation and Performance? Evidence from the U.S. Stock Market (1954–2002)," The Journal of Business, University of Chicago Press, vol. 79(5), pages 2423-2468, September.
    15. Ferreira, Miguel A. & Santa-Clara, Pedro, 2011. "Forecasting stock market returns: The sum of the parts is more than the whole," Journal of Financial Economics, Elsevier, vol. 100(3), pages 514-537, June.
    16. repec:wyi:journl:002108 is not listed on IDEAS
    17. John H. Cochrane, 2008. "The Dog That Did Not Bark: A Defense of Return Predictability," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1533-1575, July.
    18. Shanken, Jay & Tamayo, Ane, 2012. "Payout yield, risk, and mispricing: A Bayesian analysis," Journal of Financial Economics, Elsevier, vol. 105(1), pages 131-152.
    19. John Y. Campbell, 2008. "Viewpoint: Estimating the equity premium," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 41(1), pages 1-21, February.
    20. Henkel, Sam James & Martin, J. Spencer & Nardari, Federico, 2011. "Time-varying short-horizon predictability," Journal of Financial Economics, Elsevier, vol. 99(3), pages 560-580, March.
    21. Martin Lettau & Stijn Van Nieuwerburgh, 2008. "Reconciling the Return Predictability Evidence," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1607-1652, July.

    More about this item

    JEL classification:

    • G1 - Financial Economics - - General Financial Markets

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:12814. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.