IDEAS home Printed from https://ideas.repec.org/p/lan/wpaper/268005798.html
   My bibliography  Save this paper

Investor Sentiment as a Predictor of Market Returns

Author

Listed:
  • Kim Kaivanto
  • Peng Zhang

Abstract

Investor sentiment's effect on asset prices has been studied extensively to date, without delivering consistent results across samples and datasets. We investigate the asset-pricing impacts of eight widely cited investor-sentiment indicators (one direct, six indirect, one composite), within a unified long-horizon regression framework, predicting real NYSE-index returns over horizon lengths of 1, 3, 12, 24, 36, and 48 months. Results reveal that three of the non-composite indicators have consistent predictive power: the Michigan Index of Consumer Sentiment (MICS), IPO volume (NIPO), and the dividend premium (PDND). This finding has implications for the widely cited Baker-Wurgler first principal component (SFPC) composite indicator, which extracts information from the full set of six indirect indicators. As the diffusion-index literature shows, this type of wide-net approach is likely to impound idiosyncratic noise into the composite summary indicator, exacerbating forecasting errors. Therefore we create a new `targeted' composite indicator from the first principal component of the three indicators that perform well in long-horizon regressions, i.e. MICS, NIPO, and PDND. The resulting targeted composite indicator outperforms SFPC in a market-returns prediction horse race. Whereas SFPC primarily predicts Equally Weighted Returns (EWR) rather than Value Weighted Returns (VWR), our new sentiment indicator performs better than SFPC in predicting both VWR and EWR. This improved performance is due in part to a reduction in overfitting, and in part to incorporation of the direct sentiment indicator MICS.

Suggested Citation

  • Kim Kaivanto & Peng Zhang, 2019. "Investor Sentiment as a Predictor of Market Returns," Working Papers 268005798, Lancaster University Management School, Economics Department.
  • Handle: RePEc:lan:wpaper:268005798
    as

    Download full text from publisher

    File URL: http://www.lancaster.ac.uk/media/lancaster-university/content-assets/documents/lums/economics/working-papers/LancasterWP2019_013.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Forni, Mario & Hallin, Marc & Lippi, Marco & Reichlin, Lucrezia, 2005. "The Generalized Dynamic Factor Model: One-Sided Estimation and Forecasting," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 830-840, September.
    2. Brennan, Michael J. & Subrahmanyam, Avanidhar, 1996. "Market microstructure and asset pricing: On the compensation for illiquidity in stock returns," Journal of Financial Economics, Elsevier, vol. 41(3), pages 441-464, July.
    3. Alexander Ljungqvist & Vikram Nanda & Rajdeep Singh, 2006. "Hot Markets, Investor Sentiment, and IPO Pricing," The Journal of Business, University of Chicago Press, vol. 79(4), pages 1667-1702, July.
    4. Andrew W. Lo, A. Craig MacKinlay, 1988. "Stock Market Prices do not Follow Random Walks: Evidence from a Simple Specification Test," Review of Financial Studies, Society for Financial Studies, vol. 1(1), pages 41-66.
    5. Malcolm Baker & Jeffrey Wurgler, 2000. "The Equity Share in New Issues and Aggregate Stock Returns," Journal of Finance, American Finance Association, vol. 55(5), pages 2219-2257, October.
    6. Hansen, Lars Peter & Hodrick, Robert J, 1980. "Forward Exchange Rates as Optimal Predictors of Future Spot Rates: An Econometric Analysis," Journal of Political Economy, University of Chicago Press, vol. 88(5), pages 829-853, October.
    7. Campbell, John Y., 2001. "Why long horizons? A study of power against persistent alternatives," Journal of Empirical Finance, Elsevier, vol. 8(5), pages 459-491, December.
    8. Goetzmann, William Nelson & Jorion, Philippe, 1993. "Testing the Predictive Power of Dividend Yields," Journal of Finance, American Finance Association, vol. 48(2), pages 663-679, June.
    9. Baker, Malcolm & Stein, Jeremy C., 2004. "Market liquidity as a sentiment indicator," Journal of Financial Markets, Elsevier, vol. 7(3), pages 271-299, June.
    10. Dashan Huang & Fuwei Jiang & Jun Tu & Guofu Zhou, 2015. "Investor Sentiment Aligned: A Powerful Predictor of Stock Returns," Review of Financial Studies, Society for Financial Studies, vol. 28(3), pages 791-837.
    11. Gregory W. Brown & Michael T. Cliff, 2005. "Investor Sentiment and Asset Valuation," The Journal of Business, University of Chicago Press, vol. 78(2), pages 405-440, March.
    12. Malcolm Baker & Jeffrey Wurgler, 2006. "Investor Sentiment and the Cross‐Section of Stock Returns," Journal of Finance, American Finance Association, vol. 61(4), pages 1645-1680, August.
    13. Boivin, Jean & Ng, Serena, 2006. "Are more data always better for factor analysis?," Journal of Econometrics, Elsevier, vol. 132(1), pages 169-194, May.
    14. Zhi Da & Joseph Engelberg & Pengjie Gao, 2015. "Editor's Choice The Sum of All FEARS Investor Sentiment and Asset Prices," Review of Financial Studies, Society for Financial Studies, vol. 28(1), pages 1-32.
    15. Schmeling, Maik, 2009. "Investor sentiment and stock returns: Some international evidence," Journal of Empirical Finance, Elsevier, vol. 16(3), pages 394-408, June.
    16. Sun, Licheng & Najand, Mohammad & Shen, Jiancheng, 2016. "Stock return predictability and investor sentiment: A high-frequency perspective," Journal of Banking & Finance, Elsevier, vol. 73(C), pages 147-164.
    17. JAMES G. MacKINNON, 2006. "Bootstrap Methods in Econometrics," The Economic Record, The Economic Society of Australia, vol. 82(s1), pages 2-18, September.
    18. Fama, Eugene F & French, Kenneth R, 1988. "Permanent and Temporary Components of Stock Prices," Journal of Political Economy, University of Chicago Press, vol. 96(2), pages 246-273, April.
    19. John Y. Campbell, Robert J. Shiller, 1988. "The Dividend-Price Ratio and Expectations of Future Dividends and Discount Factors," Review of Financial Studies, Society for Financial Studies, vol. 1(3), pages 195-228.
    20. Han, Xing & Li, Youwei, 2017. "Can investor sentiment be a momentum time-series predictor? Evidence from China," Journal of Empirical Finance, Elsevier, vol. 42(C), pages 212-239.
    21. Wang, Yaw-Huei & Keswani, Aneel & Taylor, Stephen J., 2006. "The relationships between sentiment, returns and volatility," International Journal of Forecasting, Elsevier, vol. 22(1), pages 109-123.
    22. Fama, Eugene F. & Schwert, G. William, 1977. "Asset returns and inflation," Journal of Financial Economics, Elsevier, vol. 5(2), pages 115-146, November.
    23. Malcolm Baker & Jeffrey Wurgler, 2007. "Investor Sentiment in the Stock Market," Journal of Economic Perspectives, American Economic Association, vol. 21(2), pages 129-152, Spring.
    24. Campbell, John Y., 1987. "Stock returns and the term structure," Journal of Financial Economics, Elsevier, vol. 18(2), pages 373-399, June.
    25. Bai, Jushan & Ng, Serena, 2008. "Forecasting economic time series using targeted predictors," Journal of Econometrics, Elsevier, vol. 146(2), pages 304-317, October.
    26. Lee, Charles M C & Shleifer, Andrei & Thaler, Richard H, 1991. "Investor Sentiment and the Closed-End Fund Puzzle," Journal of Finance, American Finance Association, vol. 46(1), pages 75-109, March.
    27. Ludvigson, Sydney C. & Ng, Serena, 2007. "The empirical risk-return relation: A factor analysis approach," Journal of Financial Economics, Elsevier, vol. 83(1), pages 171-222, January.
    28. Diego García, 2013. "Sentiment during Recessions," Journal of Finance, American Finance Association, vol. 68(3), pages 1267-1300, June.
    29. Malcolm Baker & Jeffrey Wurgler, 2004. "A Catering Theory of Dividends," Journal of Finance, American Finance Association, vol. 59(3), pages 1125-1165, June.
    30. Amihud, Yakov & Mendelson, Haim, 1986. "Asset pricing and the bid-ask spread," Journal of Financial Economics, Elsevier, vol. 17(2), pages 223-249, December.
    31. Baker, Malcolm & Wurgler, Jeffrey & Yuan, Yu, 2012. "Global, local, and contagious investor sentiment," Journal of Financial Economics, Elsevier, vol. 104(2), pages 272-287.
    32. Mishkin, Frederic S., 1992. "Is the Fisher effect for real? : A reexamination of the relationship between inflation and interest rates," Journal of Monetary Economics, Elsevier, vol. 30(2), pages 195-215, November.
    33. Jackwerth, Jens Carsten & Rubinstein, Mark, 1996. "Recovering Probability Distributions from Option Prices," Journal of Finance, American Finance Association, vol. 51(5), pages 1611-1632, December.
    34. Mark J. Kamstra & Lisa A. Kramer & Maurice D. Levi, 2003. "Winter Blues: A SAD Stock Market Cycle," American Economic Review, American Economic Association, vol. 93(1), pages 324-343, March.
    35. Jegadeesh, Narasimhan, 1991. "Seasonality in Stock Price Mean Reversion: Evidence from the U.S. and the U.K," Journal of Finance, American Finance Association, vol. 46(4), pages 1427-1444, September.
    36. Baker, Malcolm & Wurgler, Jeffrey, 2004. "Appearing and disappearing dividends: The link to catering incentives," Journal of Financial Economics, Elsevier, vol. 73(2), pages 271-288, August.
    37. Fama, Eugene F. & French, Kenneth R., 1988. "Dividend yields and expected stock returns," Journal of Financial Economics, Elsevier, vol. 22(1), pages 3-25, October.
    38. Stambaugh, Robert F., 1999. "Predictive regressions," Journal of Financial Economics, Elsevier, vol. 54(3), pages 375-421, December.
    39. Li, Hongyi & Maddala, G. S., 1997. "Bootstrapping cointegrating regressions," Journal of Econometrics, Elsevier, vol. 80(2), pages 297-318, October.
    40. Fama, Eugene F, 1991. "Efficient Capital Markets: II," Journal of Finance, American Finance Association, vol. 46(5), pages 1575-1617, December.
    41. Summers, Lawrence H, 1986. "Does the Stock Market Rationally Reflect Fundamental Values?," Journal of Finance, American Finance Association, vol. 41(3), pages 591-601, July.
    42. Swaminathan, Bhaskaran, 1996. "Time-Varying Expected Small Firm Returns and Closed-End Fund Discounts," Review of Financial Studies, Society for Financial Studies, vol. 9(3), pages 845-887.
    43. Alex Edmans & Diego García & Øyvind Norli, 2007. "Sports Sentiment and Stock Returns," Journal of Finance, American Finance Association, vol. 62(4), pages 1967-1998, August.
    44. Hodrick, Robert J, 1992. "Dividend Yields and Expected Stock Returns: Alternative Procedures for Inference and Measurement," Review of Financial Studies, Society for Financial Studies, vol. 5(3), pages 357-386.
    45. Keim, Donald B. & Stambaugh, Robert F., 1986. "Predicting returns in the stock and bond markets," Journal of Financial Economics, Elsevier, vol. 17(2), pages 357-390, December.
    46. Lee, Wayne Y. & Jiang, Christine X. & Indro, Daniel C., 2002. "Stock market volatility, excess returns, and the role of investor sentiment," Journal of Banking & Finance, Elsevier, vol. 26(12), pages 2277-2299.
    47. Neal, Robert & Wheatley, Simon M., 1998. "Do Measures of Investor Sentiment Predict Returns?," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 33(4), pages 523-547, December.
    48. Fama, Eugene F. & French, Kenneth R., 1989. "Business conditions and expected returns on stocks and bonds," Journal of Financial Economics, Elsevier, vol. 25(1), pages 23-49, November.
    49. Zweig, Martin E, 1973. "An Investor Expectations Stock Price Predictive Model Using Closed-End Fund Premiums," Journal of Finance, American Finance Association, vol. 28(1), pages 67-78, March.
    50. R. Cont, 2001. "Empirical properties of asset returns: stylized facts and statistical issues," Quantitative Finance, Taylor & Francis Journals, vol. 1(2), pages 223-236.
    51. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    52. Brown, Gregory W. & Cliff, Michael T., 2004. "Investor sentiment and the near-term stock market," Journal of Empirical Finance, Elsevier, vol. 11(1), pages 1-27, January.
    53. Paul C. Tetlock, 2007. "Giving Content to Investor Sentiment: The Role of Media in the Stock Market," Journal of Finance, American Finance Association, vol. 62(3), pages 1139-1168, June.
    54. Stock, James H & Watson, Mark W, 2002. "Macroeconomic Forecasting Using Diffusion Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 147-162, April.
    55. Kim, Jun Sik & Ryu, Doojin & Seo, Sung Won, 2014. "Investor sentiment and return predictability of disagreement," Journal of Banking & Finance, Elsevier, vol. 42(C), pages 166-178.
    56. Brennan, Michael J. & Chordia, Tarun & Subrahmanyam, Avanidhar, 1998. "Alternative factor specifications, security characteristics, and the cross-section of expected stock returns," Journal of Financial Economics, Elsevier, vol. 49(3), pages 345-373, September.
    57. Bair, Eric & Hastie, Trevor & Paul, Debashis & Tibshirani, Robert, 2006. "Prediction by Supervised Principal Components," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 119-137, March.
    58. Valkanov, Rossen, 2003. "Long-horizon regressions: theoretical results and applications," Journal of Financial Economics, Elsevier, vol. 68(2), pages 201-232, May.
    59. Poterba, James M. & Summers, Lawrence H., 1988. "Mean reversion in stock prices : Evidence and Implications," Journal of Financial Economics, Elsevier, vol. 22(1), pages 27-59, October.
    60. Bing Han, 2008. "Investor Sentiment and Option Prices," Review of Financial Studies, Society for Financial Studies, vol. 21(1), pages 387-414, January.
    61. Michael Lemmon & Evgenia Portniaguina, 2006. "Consumer Confidence and Asset Prices: Some Empirical Evidence," Review of Financial Studies, Society for Financial Studies, vol. 19(4), pages 1499-1529.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kim Kaivanto & Peng Zhang, 2019. "Popular Music, Sentiment, and Noise Trading," Working Papers 279326509, Lancaster University Management School, Economics Department.
    2. Wang, Wenzhao & Su, Chen & Duxbury, Darren, 2021. "Investor sentiment and stock returns: Global evidence," Journal of Empirical Finance, Elsevier, vol. 63(C), pages 365-391.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Corredor, Pilar & Ferrer, Elena & Santamaria, Rafael, 2013. "Investor sentiment effect in stock markets: Stock characteristics or country-specific factors?," International Review of Economics & Finance, Elsevier, vol. 27(C), pages 572-591.
    2. David C. Ling & Andy Naranjo & Benjamin Scheick, 2014. "Investor Sentiment, Limits to Arbitrage and Private Market Returns," Real Estate Economics, American Real Estate and Urban Economics Association, vol. 42(3), pages 531-577, September.
    3. Malcolm Baker & Jeffrey Wurgler, 2007. "Investor Sentiment in the Stock Market," Journal of Economic Perspectives, American Economic Association, vol. 21(2), pages 129-152, Spring.
    4. Seok, Sang Ik & Cho, Hoon & Ryu, Doojin, 2019. "Firm-specific investor sentiment and daily stock returns," The North American Journal of Economics and Finance, Elsevier, vol. 50(C).
    5. Jiang, Fuwei & Lee, Joshua & Martin, Xiumin & Zhou, Guofu, 2019. "Manager sentiment and stock returns," Journal of Financial Economics, Elsevier, vol. 132(1), pages 126-149.
    6. Kim Kaivanto & Peng Zhang, 2019. "Popular Music, Sentiment, and Noise Trading," Working Papers 279326509, Lancaster University Management School, Economics Department.
    7. Nikos C. Papapostolou & Nikos K. Nomikos & Panos K. Pouliasis & Ioannis Kyriakou, 2014. "Investor Sentiment for Real Assets: The Case of Dry Bulk Shipping Market," Review of Finance, European Finance Association, vol. 18(4), pages 1507-1539.
    8. Aissia, Dorsaf Ben, 2016. "Home and foreign investor sentiment and the stock returns," The Quarterly Review of Economics and Finance, Elsevier, vol. 59(C), pages 71-77.
    9. Yang, Yan & Copeland, Laurence, 2014. "The Effects of Sentiment on Market Return and Volatility and The Cross-Sectional Risk Premium of Sentiment-affected Volatility," Cardiff Economics Working Papers E2014/12, Cardiff University, Cardiff Business School, Economics Section.
    10. Li, Xiao & Shen, Dehua & Xue, Mei & Zhang, Wei, 2017. "Daily happiness and stock returns: The case of Chinese company listed in the United States," Economic Modelling, Elsevier, vol. 64(C), pages 496-501.
    11. Kostopoulos, Dimitrios & Meyer, Steffen, 2018. "Disentangling investor sentiment: Mood and household attitudes towards the economy," Journal of Economic Behavior & Organization, Elsevier, vol. 155(C), pages 28-78.
    12. Yu, Jialin, 2011. "Disagreement and return predictability of stock portfolios," Journal of Financial Economics, Elsevier, vol. 99(1), pages 162-183, January.
    13. Committee, Nobel Prize, 2013. "Understanding Asset Prices," Nobel Prize in Economics documents 2013-1, Nobel Prize Committee.
    14. Corredor, Pilar & Ferrer, Elena & Santamaria, Rafael, 2014. "Is cognitive bias really present in analyst forecasts? The role of investor sentiment," International Business Review, Elsevier, vol. 23(4), pages 824-837.
    15. J. Annaert & W. Van Hyfte, 2006. "Long-Horizon Mean Reversion for the Brussels Stock Exchange: Evidence for the 19th Century," Working Papers of Faculty of Economics and Business Administration, Ghent University, Belgium 06/376, Ghent University, Faculty of Economics and Business Administration.
    16. Wang, Wenzhao, 2018. "Investor sentiment and the mean-variance relationship: European evidence," Research in International Business and Finance, Elsevier, vol. 46(C), pages 227-239.
    17. Wenjie Ding & Khelifa Mazouz & Qingwei Wang, 2019. "Investor sentiment and the cross-section of stock returns: new theory and evidence," Review of Quantitative Finance and Accounting, Springer, vol. 53(2), pages 493-525, August.
    18. Campbell, John Y., 2001. "Why long horizons? A study of power against persistent alternatives," Journal of Empirical Finance, Elsevier, vol. 8(5), pages 459-491, December.
    19. Mehmet Balcilar & Rangan Gupta & Clement Kyei, 2018. "Predicting Stock Returns And Volatility With Investor Sentiment Indices: A Reconsideration Using A Nonparametric Causality†In†Quantiles Test," Bulletin of Economic Research, Wiley Blackwell, vol. 70(1), pages 74-87, January.
    20. Baker, Malcolm & Wurgler, Jeffrey & Yuan, Yu, 2012. "Global, local, and contagious investor sentiment," Journal of Financial Economics, Elsevier, vol. 104(2), pages 272-287.

    More about this item

    Keywords

    investor sentiment; market return; predictability; long-horizon regression; bootstrap diffusion index; composite index; overfitting;
    All these keywords.

    JEL classification:

    • G12 - Financial Economics - - General Financial Markets - - - Asset Pricing; Trading Volume; Bond Interest Rates
    • G17 - Financial Economics - - General Financial Markets - - - Financial Forecasting and Simulation

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:lan:wpaper:268005798. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://edirc.repec.org/data/delanuk.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Giorgio Motta (email available below). General contact details of provider: https://edirc.repec.org/data/delanuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.