IDEAS home Printed from https://ideas.repec.org/p/lan/wpaper/268005798.html
   My bibliography  Save this paper

Investor Sentiment as a Predictor of Market Returns

Author

Listed:
  • Kim Kaivanto
  • Peng Zhang

Abstract

Investor sentiment's effect on asset prices has been studied extensively to date, without delivering consistent results across samples and datasets. We investigate the asset-pricing impacts of eight widely cited investor-sentiment indicators (one direct, six indirect, one composite), within a unified long-horizon regression framework, predicting real NYSE-index returns over horizon lengths of 1, 3, 12, 24, 36, and 48 months. Results reveal that three of the non-composite indicators have consistent predictive power: the Michigan Index of Consumer Sentiment (MICS), IPO volume (NIPO), and the dividend premium (PDND). This finding has implications for the widely cited Baker-Wurgler first principal component (SFPC) composite indicator, which extracts information from the full set of six indirect indicators. As the diffusion-index literature shows, this type of wide-net approach is likely to impound idiosyncratic noise into the composite summary indicator, exacerbating forecasting errors. Therefore we create a new `targeted' composite indicator from the first principal component of the three indicators that perform well in long-horizon regressions, i.e. MICS, NIPO, and PDND. The resulting targeted composite indicator outperforms SFPC in a market-returns prediction horse race. Whereas SFPC primarily predicts Equally Weighted Returns (EWR) rather than Value Weighted Returns (VWR), our new sentiment indicator performs better than SFPC in predicting both VWR and EWR. This improved performance is due in part to a reduction in overfitting, and in part to incorporation of the direct sentiment indicator MICS.

Suggested Citation

  • Kim Kaivanto & Peng Zhang, 2019. "Investor Sentiment as a Predictor of Market Returns," Working Papers 268005798, Lancaster University Management School, Economics Department.
  • Handle: RePEc:lan:wpaper:268005798
    as

    Download full text from publisher

    File URL: http://www.lancaster.ac.uk/media/lancaster-university/content-assets/documents/lums/economics/working-papers/LancasterWP2019_013.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Alexander Ljungqvist & Vikram Nanda & Rajdeep Singh, 2006. "Hot Markets, Investor Sentiment, and IPO Pricing," The Journal of Business, University of Chicago Press, vol. 79(4), pages 1667-1702, July.
    2. Hansen, Lars Peter & Hodrick, Robert J, 1980. "Forward Exchange Rates as Optimal Predictors of Future Spot Rates: An Econometric Analysis," Journal of Political Economy, University of Chicago Press, vol. 88(5), pages 829-853, October.
    3. Campbell, John Y., 2001. "Why long horizons? A study of power against persistent alternatives," Journal of Empirical Finance, Elsevier, vol. 8(5), pages 459-491, December.
    4. Robert J. Shiller, 1984. "Stock Prices and Social Dynamics," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 15(2), pages 457-510.
    5. Baker, Malcolm & Stein, Jeremy C., 2004. "Market liquidity as a sentiment indicator," Journal of Financial Markets, Elsevier, vol. 7(3), pages 271-299, June.
    6. Malcolm Baker & Jeffrey Wurgler, 2006. "Investor Sentiment and the Cross‐Section of Stock Returns," Journal of Finance, American Finance Association, vol. 61(4), pages 1645-1680, August.
    7. Zhi Da & Joseph Engelberg & Pengjie Gao, 2015. "Editor's Choice The Sum of All FEARS Investor Sentiment and Asset Prices," The Review of Financial Studies, Society for Financial Studies, vol. 28(1), pages 1-32.
    8. Fama, Eugene F & French, Kenneth R, 1988. "Permanent and Temporary Components of Stock Prices," Journal of Political Economy, University of Chicago Press, vol. 96(2), pages 246-273, April.
    9. Malcolm Baker & Jeffrey Wurgler, 2000. "The Equity Share in New Issues and Aggregate Stock Returns," Journal of Finance, American Finance Association, vol. 55(5), pages 2219-2257, October.
    10. Malcolm Baker & Jeffrey Wurgler, 2007. "Investor Sentiment in the Stock Market," Journal of Economic Perspectives, American Economic Association, vol. 21(2), pages 129-152, Spring.
    11. Campbell, John Y., 1987. "Stock returns and the term structure," Journal of Financial Economics, Elsevier, vol. 18(2), pages 373-399, June.
    12. Bai, Jushan & Ng, Serena, 2008. "Forecasting economic time series using targeted predictors," Journal of Econometrics, Elsevier, vol. 146(2), pages 304-317, October.
    13. John Y. Campbell, Robert J. Shiller, 1988. "The Dividend-Price Ratio and Expectations of Future Dividends and Discount Factors," The Review of Financial Studies, Society for Financial Studies, vol. 1(3), pages 195-228.
    14. Lee, Charles M C & Shleifer, Andrei & Thaler, Richard H, 1991. "Investor Sentiment and the Closed-End Fund Puzzle," Journal of Finance, American Finance Association, vol. 46(1), pages 75-109, March.
    15. Ludvigson, Sydney C. & Ng, Serena, 2007. "The empirical risk-return relation: A factor analysis approach," Journal of Financial Economics, Elsevier, vol. 83(1), pages 171-222, January.
    16. Amihud, Yakov & Mendelson, Haim, 1986. "Asset pricing and the bid-ask spread," Journal of Financial Economics, Elsevier, vol. 17(2), pages 223-249, December.
    17. Jackwerth, Jens Carsten & Rubinstein, Mark, 1996. "Recovering Probability Distributions from Option Prices," Journal of Finance, American Finance Association, vol. 51(5), pages 1611-1632, December.
    18. Jegadeesh, Narasimhan, 1991. "Seasonality in Stock Price Mean Reversion: Evidence from the U.S. and the U.K," Journal of Finance, American Finance Association, vol. 46(4), pages 1427-1444, September.
    19. Baker, Malcolm & Wurgler, Jeffrey, 2004. "Appearing and disappearing dividends: The link to catering incentives," Journal of Financial Economics, Elsevier, vol. 73(2), pages 271-288, August.
    20. Fama, Eugene F. & French, Kenneth R., 1988. "Dividend yields and expected stock returns," Journal of Financial Economics, Elsevier, vol. 22(1), pages 3-25, October.
    21. Stambaugh, Robert F., 1999. "Predictive regressions," Journal of Financial Economics, Elsevier, vol. 54(3), pages 375-421, December.
    22. Han, Xing & Li, Youwei, 2017. "Can investor sentiment be a momentum time-series predictor? Evidence from China," Journal of Empirical Finance, Elsevier, vol. 42(C), pages 212-239.
    23. Mark J. Kamstra & Lisa A. Kramer & Maurice D. Levi, 2003. "Winter Blues: A SAD Stock Market Cycle," American Economic Review, American Economic Association, vol. 93(1), pages 324-343, March.
    24. Fama, Eugene F, 1991. "Efficient Capital Markets: II," Journal of Finance, American Finance Association, vol. 46(5), pages 1575-1617, December.
    25. Summers, Lawrence H, 1986. "Does the Stock Market Rationally Reflect Fundamental Values?," Journal of Finance, American Finance Association, vol. 41(3), pages 591-601, July.
    26. Swaminathan, Bhaskaran, 1996. "Time-Varying Expected Small Firm Returns and Closed-End Fund Discounts," The Review of Financial Studies, Society for Financial Studies, vol. 9(3), pages 845-887.
    27. Hodrick, Robert J, 1992. "Dividend Yields and Expected Stock Returns: Alternative Procedures for Inference and Measurement," The Review of Financial Studies, Society for Financial Studies, vol. 5(3), pages 357-386.
    28. Keim, Donald B. & Stambaugh, Robert F., 1986. "Predicting returns in the stock and bond markets," Journal of Financial Economics, Elsevier, vol. 17(2), pages 357-390, December.
    29. Lee, Wayne Y. & Jiang, Christine X. & Indro, Daniel C., 2002. "Stock market volatility, excess returns, and the role of investor sentiment," Journal of Banking & Finance, Elsevier, vol. 26(12), pages 2277-2299.
    30. Neal, Robert & Wheatley, Simon M., 1998. "Do Measures of Investor Sentiment Predict Returns?," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 33(4), pages 523-547, December.
    31. Goetzmann, William Nelson & Jorion, Philippe, 1993. "Testing the Predictive Power of Dividend Yields," Journal of Finance, American Finance Association, vol. 48(2), pages 663-679, June.
    32. Zweig, Martin E, 1973. "An Investor Expectations Stock Price Predictive Model Using Closed-End Fund Premiums," Journal of Finance, American Finance Association, vol. 28(1), pages 67-78, March.
    33. Forni, Mario & Hallin, Marc & Lippi, Marco & Reichlin, Lucrezia, 2005. "The Generalized Dynamic Factor Model: One-Sided Estimation and Forecasting," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 830-840, September.
    34. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    35. Andrew W. Lo, A. Craig MacKinlay, 1988. "Stock Market Prices do not Follow Random Walks: Evidence from a Simple Specification Test," The Review of Financial Studies, Society for Financial Studies, vol. 1(1), pages 41-66.
    36. Kim, Jun Sik & Ryu, Doojin & Seo, Sung Won, 2014. "Investor sentiment and return predictability of disagreement," Journal of Banking & Finance, Elsevier, vol. 42(C), pages 166-178.
    37. Bair, Eric & Hastie, Trevor & Paul, Debashis & Tibshirani, Robert, 2006. "Prediction by Supervised Principal Components," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 119-137, March.
    38. Valkanov, Rossen, 2003. "Long-horizon regressions: theoretical results and applications," Journal of Financial Economics, Elsevier, vol. 68(2), pages 201-232, May.
    39. Poterba, James M. & Summers, Lawrence H., 1988. "Mean reversion in stock prices : Evidence and Implications," Journal of Financial Economics, Elsevier, vol. 22(1), pages 27-59, October.
    40. Bing Han, 2008. "Investor Sentiment and Option Prices," The Review of Financial Studies, Society for Financial Studies, vol. 21(1), pages 387-414, January.
    41. Michael Lemmon & Evgenia Portniaguina, 2006. "Consumer Confidence and Asset Prices: Some Empirical Evidence," The Review of Financial Studies, Society for Financial Studies, vol. 19(4), pages 1499-1529.
    42. Brennan, Michael J. & Subrahmanyam, Avanidhar, 1996. "Market microstructure and asset pricing: On the compensation for illiquidity in stock returns," Journal of Financial Economics, Elsevier, vol. 41(3), pages 441-464, July.
    43. Dashan Huang & Fuwei Jiang & Jun Tu & Guofu Zhou, 2015. "Investor Sentiment Aligned: A Powerful Predictor of Stock Returns," The Review of Financial Studies, Society for Financial Studies, vol. 28(3), pages 791-837.
    44. Gregory W. Brown & Michael T. Cliff, 2005. "Investor Sentiment and Asset Valuation," The Journal of Business, University of Chicago Press, vol. 78(2), pages 405-440, March.
    45. Boivin, Jean & Ng, Serena, 2006. "Are more data always better for factor analysis?," Journal of Econometrics, Elsevier, vol. 132(1), pages 169-194, May.
    46. Schmeling, Maik, 2009. "Investor sentiment and stock returns: Some international evidence," Journal of Empirical Finance, Elsevier, vol. 16(3), pages 394-408, June.
    47. Sun, Licheng & Najand, Mohammad & Shen, Jiancheng, 2016. "Stock return predictability and investor sentiment: A high-frequency perspective," Journal of Banking & Finance, Elsevier, vol. 73(C), pages 147-164.
    48. JAMES G. MacKINNON, 2006. "Bootstrap Methods in Econometrics," The Economic Record, The Economic Society of Australia, vol. 82(s1), pages 2-18, September.
    49. Wang, Yaw-Huei & Keswani, Aneel & Taylor, Stephen J., 2006. "The relationships between sentiment, returns and volatility," International Journal of Forecasting, Elsevier, vol. 22(1), pages 109-123.
    50. Fama, Eugene F. & Schwert, G. William, 1977. "Asset returns and inflation," Journal of Financial Economics, Elsevier, vol. 5(2), pages 115-146, November.
    51. Diego García, 2013. "Sentiment during Recessions," Journal of Finance, American Finance Association, vol. 68(3), pages 1267-1300, June.
    52. Malcolm Baker & Jeffrey Wurgler, 2004. "A Catering Theory of Dividends," Journal of Finance, American Finance Association, vol. 59(3), pages 1125-1165, June.
    53. Baker, Malcolm & Wurgler, Jeffrey & Yuan, Yu, 2012. "Global, local, and contagious investor sentiment," Journal of Financial Economics, Elsevier, vol. 104(2), pages 272-287.
    54. Mishkin, Frederic S., 1992. "Is the Fisher effect for real? : A reexamination of the relationship between inflation and interest rates," Journal of Monetary Economics, Elsevier, vol. 30(2), pages 195-215, November.
    55. Li, Hongyi & Maddala, G. S., 1997. "Bootstrapping cointegrating regressions," Journal of Econometrics, Elsevier, vol. 80(2), pages 297-318, October.
    56. Jose A. Scheinkman & Wei Xiong, 2003. "Overconfidence and Speculative Bubbles," Journal of Political Economy, University of Chicago Press, vol. 111(6), pages 1183-1219, December.
    57. Alex Edmans & Diego García & Øyvind Norli, 2007. "Sports Sentiment and Stock Returns," Journal of Finance, American Finance Association, vol. 62(4), pages 1967-1998, August.
    58. Robert J. Shiller, 1999. "Measuring Bubble Expectations and Investor Confidence," NBER Working Papers 7008, National Bureau of Economic Research, Inc.
    59. Fama, Eugene F. & French, Kenneth R., 1989. "Business conditions and expected returns on stocks and bonds," Journal of Financial Economics, Elsevier, vol. 25(1), pages 23-49, November.
    60. R. Cont, 2001. "Empirical properties of asset returns: stylized facts and statistical issues," Quantitative Finance, Taylor & Francis Journals, vol. 1(2), pages 223-236.
    61. Brown, Gregory W. & Cliff, Michael T., 2004. "Investor sentiment and the near-term stock market," Journal of Empirical Finance, Elsevier, vol. 11(1), pages 1-27, January.
    62. Paul C. Tetlock, 2007. "Giving Content to Investor Sentiment: The Role of Media in the Stock Market," Journal of Finance, American Finance Association, vol. 62(3), pages 1139-1168, June.
    63. Stock, James H & Watson, Mark W, 2002. "Macroeconomic Forecasting Using Diffusion Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 147-162, April.
    64. Brennan, Michael J. & Chordia, Tarun & Subrahmanyam, Avanidhar, 1998. "Alternative factor specifications, security characteristics, and the cross-section of expected stock returns," Journal of Financial Economics, Elsevier, vol. 49(3), pages 345-373, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Wang, Wenzhao & Su, Chen & Duxbury, Darren, 2021. "Investor sentiment and stock returns: Global evidence," Journal of Empirical Finance, Elsevier, vol. 63(C), pages 365-391.
    2. Kim Kaivanto & Peng Zhang, 2019. "Popular Music, Sentiment, and Noise Trading," Working Papers 279326509, Lancaster University Management School, Economics Department.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Corredor, Pilar & Ferrer, Elena & Santamaria, Rafael, 2013. "Investor sentiment effect in stock markets: Stock characteristics or country-specific factors?," International Review of Economics & Finance, Elsevier, vol. 27(C), pages 572-591.
    2. Malcolm Baker & Jeffrey Wurgler, 2007. "Investor Sentiment in the Stock Market," Journal of Economic Perspectives, American Economic Association, vol. 21(2), pages 129-152, Spring.
    3. David C. Ling & Andy Naranjo & Benjamin Scheick, 2014. "Investor Sentiment, Limits to Arbitrage and Private Market Returns," Real Estate Economics, American Real Estate and Urban Economics Association, vol. 42(3), pages 531-577, September.
    4. Wang, Wenzhao & Su, Chen & Duxbury, Darren, 2022. "The conditional impact of investor sentiment in global stock markets: A two-channel examination," Journal of Banking & Finance, Elsevier, vol. 138(C).
    5. Tiwari, Aviral Kumar & Abakah, Emmanuel Joel Aikins & Bonsu, Christiana Osei & Karikari, Nana Kwasi & Hammoudeh, Shawkat, 2022. "The effects of public sentiments and feelings on stock market behavior: Evidence from Australia," Journal of Economic Behavior & Organization, Elsevier, vol. 193(C), pages 443-472.
    6. Seok, Sang Ik & Cho, Hoon & Ryu, Doojin, 2019. "Firm-specific investor sentiment and daily stock returns," The North American Journal of Economics and Finance, Elsevier, vol. 50(C).
    7. Wang, Wenzhao & Duxbury, Darren, 2021. "Institutional investor sentiment and the mean-variance relationship: Global evidence," Journal of Economic Behavior & Organization, Elsevier, vol. 191(C), pages 415-441.
    8. Jiang, Fuwei & Lee, Joshua & Martin, Xiumin & Zhou, Guofu, 2019. "Manager sentiment and stock returns," Journal of Financial Economics, Elsevier, vol. 132(1), pages 126-149.
    9. Committee, Nobel Prize, 2013. "Understanding Asset Prices," Nobel Prize in Economics documents 2013-1, Nobel Prize Committee.
    10. Corredor, Pilar & Ferrer, Elena & Santamaria, Rafael, 2014. "Is cognitive bias really present in analyst forecasts? The role of investor sentiment," International Business Review, Elsevier, vol. 23(4), pages 824-837.
    11. Ung, Sze Nie & Gebka, Bartosz & Anderson, Robert D.J., 2023. "Is sentiment the solution to the risk–return puzzle? A (cautionary) note," Journal of Behavioral and Experimental Finance, Elsevier, vol. 37(C).
    12. Baker, Malcolm & Wurgler, Jeffrey & Yuan, Yu, 2012. "Global, local, and contagious investor sentiment," Journal of Financial Economics, Elsevier, vol. 104(2), pages 272-287.
    13. Yu, Jialin, 2011. "Disagreement and return predictability of stock portfolios," Journal of Financial Economics, Elsevier, vol. 99(1), pages 162-183, January.
    14. Kim Kaivanto & Peng Zhang, 2019. "Popular Music, Sentiment, and Noise Trading," Working Papers 279326509, Lancaster University Management School, Economics Department.
    15. Nikos C. Papapostolou & Nikos K. Nomikos & Panos K. Pouliasis & Ioannis Kyriakou, 2014. "Investor Sentiment for Real Assets: The Case of Dry Bulk Shipping Market," Review of Finance, European Finance Association, vol. 18(4), pages 1507-1539.
    16. Yuan Li, 2022. "Mood Beta, Sentiment and Stock Returns in China," SAGE Open, , vol. 12(1), pages 21582440221, February.
    17. Aissia, Dorsaf Ben, 2016. "Home and foreign investor sentiment and the stock returns," The Quarterly Review of Economics and Finance, Elsevier, vol. 59(C), pages 71-77.
    18. Yang, Yan & Copeland, Laurence, 2014. "The Effects of Sentiment on Market Return and Volatility and The Cross-Sectional Risk Premium of Sentiment-affected Volatility," Cardiff Economics Working Papers E2014/12, Cardiff University, Cardiff Business School, Economics Section.
    19. Li, Xiao & Shen, Dehua & Xue, Mei & Zhang, Wei, 2017. "Daily happiness and stock returns: The case of Chinese company listed in the United States," Economic Modelling, Elsevier, vol. 64(C), pages 496-501.
    20. Kostopoulos, Dimitrios & Meyer, Steffen, 2018. "Disentangling investor sentiment: Mood and household attitudes towards the economy," Journal of Economic Behavior & Organization, Elsevier, vol. 155(C), pages 28-78.

    More about this item

    Keywords

    investor sentiment; market return; predictability; long-horizon regression; bootstrap diffusion index; composite index; overfitting;
    All these keywords.

    JEL classification:

    • G12 - Financial Economics - - General Financial Markets - - - Asset Pricing; Trading Volume; Bond Interest Rates
    • G17 - Financial Economics - - General Financial Markets - - - Financial Forecasting and Simulation

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:lan:wpaper:268005798. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Giorgio Motta (email available below). General contact details of provider: https://edirc.repec.org/data/delanuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.