IDEAS home Printed from https://ideas.repec.org/a/bla/jfinan/v64y2009i4p1583-1628.html
   My bibliography  Save this article

Predictive Systems: Living with Imperfect Predictors

Author

Listed:
  • ĽUBOŠ PÁSTOR
  • ROBERT F. STAMBAUGH

Abstract

We develop a framework for estimating expected returns—a predictive system—that allows predictors to be imperfectly correlated with the conditional expected return. When predictors are imperfect, the estimated expected return depends on past returns in a manner that hinges on the correlation between unexpected returns and innovations in expected returns. We find empirically that prior beliefs about this correlation, which is most likely negative, substantially affect estimates of expected returns as well as various inferences about predictability, including assessments of a predictor's usefulness. Compared to standard predictive regressions, predictive systems deliver different expected returns with higher estimated precision.

Suggested Citation

  • Ľuboš Pástor & Robert F. Stambaugh, 2009. "Predictive Systems: Living with Imperfect Predictors," Journal of Finance, American Finance Association, vol. 64(4), pages 1583-1628, August.
  • Handle: RePEc:bla:jfinan:v:64:y:2009:i:4:p:1583-1628
    DOI: 10.1111/j.1540-6261.2009.01474.x
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/j.1540-6261.2009.01474.x
    Download Restriction: no

    File URL: https://libkey.io/10.1111/j.1540-6261.2009.01474.x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Martin Lettau & Stijn Van Nieuwerburgh, 2008. "Reconciling the Return Predictability Evidence," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1607-1652, July.
    2. Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
    3. Doron Avramov, 2004. "Stock Return Predictability and Asset Pricing Models," The Review of Financial Studies, Society for Financial Studies, vol. 17(3), pages 699-738.
    4. Campbell, John Y & Ammer, John, 1993. "What Moves the Stock and Bond Markets? A Variance Decomposition for Long-Term Asset Returns," Journal of Finance, American Finance Association, vol. 48(1), pages 3-37, March.
    5. Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
    6. repec:bla:jfinan:v:53:y:1998:i:5:p:1563-1587 is not listed on IDEAS
    7. Ľuboš Pástor & Robert F. Stambaugh, 1999. "Costs of Equity Capital and Model Mispricing," Journal of Finance, American Finance Association, vol. 54(1), pages 67-121, February.
    8. Elliott, Graham & Stock, James H., 1994. "Inference in Time Series Regression When the Order of Integration of a Regressor is Unknown," Econometric Theory, Cambridge University Press, vol. 10(3-4), pages 672-700, August.
    9. Avramov, Doron & Wermers, Russ, 2006. "Investing in mutual funds when returns are predictable," Journal of Financial Economics, Elsevier, vol. 81(2), pages 339-377, August.
    10. Ang, Andrew & Piazzesi, Monika, 2003. "A no-arbitrage vector autoregression of term structure dynamics with macroeconomic and latent variables," Journal of Monetary Economics, Elsevier, vol. 50(4), pages 745-787, May.
    11. Klaas P. Baks & Andrew Metrick & Jessica Wachter, 2001. "Should Investors Avoid All Actively Managed Mutual Funds? A Study in Bayesian Performance Evaluation," Journal of Finance, American Finance Association, vol. 56(1), pages 45-85, February.
    12. John Y. Campbell & Samuel B. Thompson, 2008. "Predicting Excess Stock Returns Out of Sample: Can Anything Beat the Historical Average?," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1509-1531, July.
    13. Clark, Todd E. & West, Kenneth D., 2006. "Using out-of-sample mean squared prediction errors to test the martingale difference hypothesis," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 155-186.
    14. Michael Jansson & Marcelo J. Moreira, 2006. "Optimal Inference in Regression Models with Nearly Integrated Regressors," Econometrica, Econometric Society, vol. 74(3), pages 681-714, May.
    15. Lior Menzly & Tano Santos & Pietro Veronesi, 2004. "Understanding Predictability," Journal of Political Economy, University of Chicago Press, vol. 112(1), pages 1-47, February.
    16. Keim, Donald B. & Stambaugh, Robert F., 1986. "Predicting returns in the stock and bond markets," Journal of Financial Economics, Elsevier, vol. 17(2), pages 357-390, December.
    17. Ľuboš Pástor & Meenakshi Sinha & Bhaskaran Swaminathan, 2008. "Estimating the Intertemporal Risk–Return Tradeoff Using the Implied Cost of Capital," Journal of Finance, American Finance Association, vol. 63(6), pages 2859-2897, December.
    18. Erik Hjalmarsson, 2006. "Should we expect significant out-of-sample results when predicting stock returns?," International Finance Discussion Papers 855, Board of Governors of the Federal Reserve System (U.S.).
    19. Pastor, Lubos & Stambaugh, Robert F., 2002. "Investing in equity mutual funds," Journal of Financial Economics, Elsevier, vol. 63(3), pages 351-380, March.
    20. Conrad, Jennifer & Kaul, Gautam, 1988. "Time-Variation in Expected Returns," The Journal of Business, University of Chicago Press, vol. 61(4), pages 409-425, October.
    21. Andrew Ang & Geert Bekaert, 2007. "Stock Return Predictability: Is it There?," The Review of Financial Studies, Society for Financial Studies, vol. 20(3), pages 651-707.
    22. Nelson, Charles R & Kim, Myung J, 1993. "Predictable Stock Returns: The Role of Small Sample Bias," Journal of Finance, American Finance Association, vol. 48(2), pages 641-661, June.
    23. Lamoureux, Christopher G & Zhou, Guofu, 1996. "Temporary Components of Stock Returns: What Do the Data Tell Us?," The Review of Financial Studies, Society for Financial Studies, vol. 9(4), pages 1033-1059.
    24. Jones, Christopher S. & Shanken, Jay, 2005. "Mutual fund performance with learning across funds," Journal of Financial Economics, Elsevier, vol. 78(3), pages 507-552, December.
    25. Lettau, Martin & Ludvigson, Sydney C., 2005. "Expected returns and expected dividend growth," Journal of Financial Economics, Elsevier, vol. 76(3), pages 583-626, June.
    26. Campbell, John Y, 1991. "A Variance Decomposition for Stock Returns," Economic Journal, Royal Economic Society, vol. 101(405), pages 157-179, March.
    27. Kothari, S.P. & Lewellen, Jonathan & Warner, Jerold B., 2006. "Stock returns, aggregate earnings surprises, and behavioral finance," Journal of Financial Economics, Elsevier, vol. 79(3), pages 537-568, March.
    28. Ľluboš Pástor & Robert F. Stambaugh, 2001. "The Equity Premium and Structural Breaks," Journal of Finance, American Finance Association, vol. 56(4), pages 1207-1239, August.
    29. Pastor, Lubos & Stambaugh, Robert F., 2000. "Comparing asset pricing models: an investment perspective," Journal of Financial Economics, Elsevier, vol. 56(3), pages 335-381, June.
    30. Stambaugh, Robert F., 1997. "Analyzing investments whose histories differ in length," Journal of Financial Economics, Elsevier, vol. 45(3), pages 285-331, September.
    31. John Y. Campbell & Samuel B. Thompson, 2005. "Predicting the Equity Premium Out of Sample: Can Anything Beat the Historical Average?," Harvard Institute of Economic Research Working Papers 2084, Harvard - Institute of Economic Research.
    32. repec:cup:etheor:v:10:y:1994:i:3-4:p:672-700 is not listed on IDEAS
    33. Amit Goyal & Ivo Welch, 2003. "Predicting the Equity Premium with Dividend Ratios," Management Science, INFORMS, vol. 49(5), pages 639-654, May.
    34. Wayne E. Ferson & Sergei Sarkissian & Timothy T. Simin, 2003. "Spurious Regressions in Financial Economics?," Journal of Finance, American Finance Association, vol. 58(4), pages 1393-1413, August.
    35. Kandel, Shmuel & Stambaugh, Robert F, 1996. "On the Predictability of Stock Returns: An Asset-Allocation Perspective," Journal of Finance, American Finance Association, vol. 51(2), pages 385-424, June.
    36. Ferson, Wayne E & Harvey, Campbell R, 1991. "The Variation of Economic Risk Premiums," Journal of Political Economy, University of Chicago Press, vol. 99(2), pages 385-415, April.
    37. Ľuboš Pástor, 2000. "Portfolio Selection and Asset Pricing Models," Journal of Finance, American Finance Association, vol. 55(1), pages 179-223, February.
    38. Campbell, John Y. & Yogo, Motohiro, 2006. "Efficient tests of stock return predictability," Journal of Financial Economics, Elsevier, vol. 81(1), pages 27-60, July.
    39. Fama, Eugene F. & Schwert, G. William, 1977. "Asset returns and inflation," Journal of Financial Economics, Elsevier, vol. 5(2), pages 115-146, November.
    40. Pastor, Lubos & Stambaugh, Robert F., 2002. "Mutual fund performance and seemingly unrelated assets," Journal of Financial Economics, Elsevier, vol. 63(3), pages 315-349, March.
    41. Campbell, John Y., 1987. "Stock returns and the term structure," Journal of Financial Economics, Elsevier, vol. 18(2), pages 373-399, June.
    42. Clark, Todd E. & West, Kenneth D., 2007. "Approximately normal tests for equal predictive accuracy in nested models," Journal of Econometrics, Elsevier, vol. 138(1), pages 291-311, May.
    43. Gregory Mankiw, N. & Shapiro, Matthew D., 1986. "Do we reject too often? : Small sample properties of tests of rational expectations models," Economics Letters, Elsevier, vol. 20(2), pages 139-145.
    44. Lewellen, Jonathan, 2004. "Predicting returns with financial ratios," Journal of Financial Economics, Elsevier, vol. 74(2), pages 209-235, November.
    45. K. J. Martijn Cremers, 2002. "Stock Return Predictability: A Bayesian Model Selection Perspective," The Review of Financial Studies, Society for Financial Studies, vol. 15(4), pages 1223-1249.
    46. Shiller, Robert J, 1981. "Do Stock Prices Move Too Much to be Justified by Subsequent Changes in Dividends?," American Economic Review, American Economic Association, vol. 71(3), pages 421-436, June.
    47. Wachter, Jessica A. & Warusawitharana, Missaka, 2009. "Predictable returns and asset allocation: Should a skeptical investor time the market?," Journal of Econometrics, Elsevier, vol. 148(2), pages 162-178, February.
    48. Avramov, Doron, 2002. "Stock return predictability and model uncertainty," Journal of Financial Economics, Elsevier, vol. 64(3), pages 423-458, June.
    49. repec:bla:jfinan:v:58:y:2003:i:4:p:1393-1414 is not listed on IDEAS
    50. Brandt, Michael W. & Kang, Qiang, 2004. "On the relationship between the conditional mean and volatility of stock returns: A latent VAR approach," Journal of Financial Economics, Elsevier, vol. 72(2), pages 217-257, May.
    51. Nicholas Barberis, 2000. "Investing for the Long Run when Returns Are Predictable," Journal of Finance, American Finance Association, vol. 55(1), pages 225-264, February.
    52. Sylvia Frühwirth‐Schnatter, 1994. "Data Augmentation And Dynamic Linear Models," Journal of Time Series Analysis, Wiley Blackwell, vol. 15(2), pages 183-202, March.
    53. John H. Cochrane, 2008. "The Dog That Did Not Bark: A Defense of Return Predictability," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1533-1575, July.
    54. repec:fth:pennfi:72 is not listed on IDEAS
    55. Fama, Eugene F. & French, Kenneth R., 1988. "Dividend yields and expected stock returns," Journal of Financial Economics, Elsevier, vol. 22(1), pages 3-25, October.
    56. Cavanagh, Christopher L. & Elliott, Graham & Stock, James H., 1995. "Inference in Models with Nearly Integrated Regressors," Econometric Theory, Cambridge University Press, vol. 11(5), pages 1131-1147, October.
    57. Stambaugh, Robert F., 1999. "Predictive regressions," Journal of Financial Economics, Elsevier, vol. 54(3), pages 375-421, December.
    58. Unknown, 1986. "Letters," Choices: The Magazine of Food, Farm, and Resource Issues, Agricultural and Applied Economics Association, vol. 1(4), pages 1-9.
    59. Tano Santos & Pietro Veronesi, 2006. "Labor Income and Predictable Stock Returns," The Review of Financial Studies, Society for Financial Studies, vol. 19(1), pages 1-44.
    60. repec:cup:etheor:v:11:y:1995:i:5:p:1131-47 is not listed on IDEAS
    61. Ferson, Wayne E & Harvey, Campbell R, 1993. "The Risk and Predictability of International Equity Returns," The Review of Financial Studies, Society for Financial Studies, vol. 6(3), pages 527-566.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wachter, Jessica A. & Warusawitharana, Missaka, 2009. "Predictable returns and asset allocation: Should a skeptical investor time the market?," Journal of Econometrics, Elsevier, vol. 148(2), pages 162-178, February.
    2. Rapach, David & Zhou, Guofu, 2013. "Forecasting Stock Returns," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 328-383, Elsevier.
    3. Mykola Babiak & Jozef Barunik, 2020. "Deep Learning, Predictability, and Optimal Portfolio Returns," CERGE-EI Working Papers wp677, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
    4. Michael Johannes & Arthur Korteweg & Nicholas Polson, 2014. "Sequential Learning, Predictability, and Optimal Portfolio Returns," Journal of Finance, American Finance Association, vol. 69(2), pages 611-644, April.
    5. Chen, Long, 2009. "On the reversal of return and dividend growth predictability: A tale of two periods," Journal of Financial Economics, Elsevier, vol. 92(1), pages 128-151, April.
    6. Yufeng Han, 2010. "On the Economic Value of Return Predictability," Annals of Economics and Finance, Society for AEF, vol. 11(1), pages 1-33, May.
    7. Davide Pettenuzzo & Allan G. Timmermann & Rossen I. Valkanov, 2008. "Return Predictability under Equilibrium Constraints on the Equity Premium," Working Papers 37, Brandeis University, Department of Economics and International Business School.
    8. Doron Avramov & Guofu Zhou, 2010. "Bayesian Portfolio Analysis," Annual Review of Financial Economics, Annual Reviews, vol. 2(1), pages 25-47, December.
    9. repec:wyi:journl:002108 is not listed on IDEAS
    10. John H. Cochrane, 2008. "The Dog That Did Not Bark: A Defense of Return Predictability," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1533-1575, July.
    11. Jiang, Fuwei & Lee, Joshua & Martin, Xiumin & Zhou, Guofu, 2019. "Manager sentiment and stock returns," Journal of Financial Economics, Elsevier, vol. 132(1), pages 126-149.
    12. Efstathios Avdis & Jessica A. Wachter, 2013. "Maximum likelihood estimation of the equity premium," NBER Working Papers 19684, National Bureau of Economic Research, Inc.
    13. Shanken, Jay & Tamayo, Ane, 2012. "Payout yield, risk, and mispricing: A Bayesian analysis," Journal of Financial Economics, Elsevier, vol. 105(1), pages 131-152.
    14. Pettenuzzo, Davide & Timmermann, Allan & Valkanov, Rossen, 2014. "Forecasting stock returns under economic constraints," Journal of Financial Economics, Elsevier, vol. 114(3), pages 517-553.
    15. Henkel, Sam James & Martin, J. Spencer & Nardari, Federico, 2011. "Time-varying short-horizon predictability," Journal of Financial Economics, Elsevier, vol. 99(3), pages 560-580, March.
    16. Avdis, Efstathios & Wachter, Jessica A., 2017. "Maximum likelihood estimation of the equity premium," Journal of Financial Economics, Elsevier, vol. 125(3), pages 589-609.
    17. Zongwu Cai & Yongmiao Hong, 2013. "Some Recent Developments in Nonparametric Finance," Working Papers 2013-10-14, Wang Yanan Institute for Studies in Economics (WISE), Xiamen University.
    18. Schrimpf, Andreas, 2010. "International stock return predictability under model uncertainty," Journal of International Money and Finance, Elsevier, vol. 29(7), pages 1256-1282, November.
    19. Puneet Handa, 2006. "Does Stock Return Predictability Imply Improved Asset Allocation and Performance? Evidence from the U.S. Stock Market (1954–2002)," The Journal of Business, University of Chicago Press, vol. 79(5), pages 2423-2468, September.
    20. Maio, Paulo & Santa-Clara, Pedro, 2012. "Multifactor models and their consistency with the ICAPM," Journal of Financial Economics, Elsevier, vol. 106(3), pages 586-613.
    21. Dangl, Thomas & Halling, Michael, 2012. "Predictive regressions with time-varying coefficients," Journal of Financial Economics, Elsevier, vol. 106(1), pages 157-181.

    More about this item

    JEL classification:

    • G1 - Financial Economics - - General Financial Markets
    • G11 - Financial Economics - - General Financial Markets - - - Portfolio Choice; Investment Decisions
    • G12 - Financial Economics - - General Financial Markets - - - Asset Pricing; Trading Volume; Bond Interest Rates

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jfinan:v:64:y:2009:i:4:p:1583-1628. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/afaaaea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.