IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v68y2022i6p4301-4325.html
   My bibliography  Save this article

Investor Sentiment and Paradigm Shifts in Equity Return Forecasting

Author

Listed:
  • Liya Chu

    (East China University of Science and Technology, Shanghai 200231, China)

  • Xue-Zhong He

    (Xi’an Jiaotong-Liverpool University, Suzhou 215123, China)

  • Kai Li

    (Southwestern University of Finance and Economics, Chengdu 611130, China; Macquarie University, Sydney, New South Wales 2109, Australia)

  • Jun Tu

    (Singapore Management University, Singapore, Singapore 188065)

Abstract

This study investigates the impact of investor sentiment on excess equity return forecasting. A high (low) investor sentiment may weaken the connection between fundamental economic (behavioral-based nonfundamental) predictors and market returns. We find that although fundamental variables can be strong predictors when sentiment is low, they tend to lose their predictive power when investor sentiment is high. Nonfundamental predictors perform well during high-sentiment periods while their predictive ability deteriorates when investor sentiment is low. These paradigm shifts in equity return forecasting provide a key to understanding and resolving the lack of predictive power for both fundamental and nonfundamental variables debated in recent studies.

Suggested Citation

  • Liya Chu & Xue-Zhong He & Kai Li & Jun Tu, 2022. "Investor Sentiment and Paradigm Shifts in Equity Return Forecasting," Management Science, INFORMS, vol. 68(6), pages 4301-4325, June.
  • Handle: RePEc:inm:ormnsc:v:68:y:2022:i:6:p:4301-4325
    DOI: 10.1287/mnsc.2020.3834
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mnsc.2020.3834
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mnsc.2020.3834?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
    2. Jun Tu, 2010. "Is Regime Switching in Stock Returns Important in Portfolio Decisions?," Management Science, INFORMS, vol. 56(7), pages 1198-1215, July.
    3. Harrison Hong & Jeremy C. Stein, 2003. "Differences of Opinion, Short-Sales Constraints, and Market Crashes," The Review of Financial Studies, Society for Financial Studies, vol. 16(2), pages 487-525.
    4. Bryan Kelly & Hao Jiang, 2014. "Editor's Choice Tail Risk and Asset Prices," The Review of Financial Studies, Society for Financial Studies, vol. 27(10), pages 2841-2871.
    5. Malcolm Baker & Jeffrey Wurgler, 2006. "Investor Sentiment and the Cross‐Section of Stock Returns," Journal of Finance, American Finance Association, vol. 61(4), pages 1645-1680, August.
    6. Stefano Cassella & Huseyin Gulen, 2018. "Extrapolation Bias and the Predictability of Stock Returns by Price-Scaled Variables," The Review of Financial Studies, Society for Financial Studies, vol. 31(11), pages 4345-4397.
    7. Zhi Da & Joseph Engelberg & Pengjie Gao, 2015. "Editor's Choice The Sum of All FEARS Investor Sentiment and Asset Prices," The Review of Financial Studies, Society for Financial Studies, vol. 28(1), pages 1-32.
    8. Diego Comin & Mark Gertler, 2006. "Medium-Term Business Cycles," American Economic Review, American Economic Association, vol. 96(3), pages 523-551, June.
    9. Malcolm Baker & Jeffrey Wurgler, 2007. "Investor Sentiment in the Stock Market," Journal of Economic Perspectives, American Economic Association, vol. 21(2), pages 129-152, Spring.
    10. De Long, J Bradford & Andrei Shleifer & Lawrence H. Summers & Robert J. Waldmann, 1990. "Noise Trader Risk in Financial Markets," Journal of Political Economy, University of Chicago Press, vol. 98(4), pages 703-738, August.
    11. John Y. Campbell, Robert J. Shiller, 1988. "The Dividend-Price Ratio and Expectations of Future Dividends and Discount Factors," The Review of Financial Studies, Society for Financial Studies, vol. 1(3), pages 195-228.
    12. Clark, Todd E. & West, Kenneth D., 2007. "Approximately normal tests for equal predictive accuracy in nested models," Journal of Econometrics, Elsevier, vol. 138(1), pages 291-311, May.
    13. William A. Brock & Cars H. Hommes, 1997. "A Rational Route to Randomness," Econometrica, Econometric Society, vol. 65(5), pages 1059-1096, September.
    14. Yu, Jialin, 2011. "Disagreement and return predictability of stock portfolios," Journal of Financial Economics, Elsevier, vol. 99(1), pages 162-183, January.
    15. Christopher J. Neely & David E. Rapach & Jun Tu & Guofu Zhou, 2014. "Forecasting the Equity Risk Premium: The Role of Technical Indicators," Management Science, INFORMS, vol. 60(7), pages 1772-1791, July.
    16. John Y. Campbell & John Cochrane, 1999. "Force of Habit: A Consumption-Based Explanation of Aggregate Stock Market Behavior," Journal of Political Economy, University of Chicago Press, vol. 107(2), pages 205-251, April.
    17. Shen, Junyan & Yu, Jianfeng & Zhao, Shen, 2017. "Investor sentiment and economic forces," Journal of Monetary Economics, Elsevier, vol. 86(C), pages 1-21.
    18. John H. Cochrane, 2008. "The Dog That Did Not Bark: A Defense of Return Predictability," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1533-1575, July.
    19. Stambaugh, Robert F., 1999. "Predictive regressions," Journal of Financial Economics, Elsevier, vol. 54(3), pages 375-421, December.
    20. Ling Cen & Hai Lu & Liyan Yang, 2013. "Investor Sentiment, Disagreement, and the Breadth--Return Relationship," Management Science, INFORMS, vol. 59(5), pages 1076-1091, May.
    21. George P Gao & Pengjie Gao & Zhaogang Song, 2018. "Do Hedge Funds Exploit Rare Disaster Concerns?," The Review of Financial Studies, Society for Financial Studies, vol. 31(7), pages 2650-2692.
    22. Matthew Baron & Wei Xiong, 2017. "Credit Expansion and Neglected Crash Risk," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 132(2), pages 713-764.
    23. Bryan Kelly & Seth Pruitt, 2013. "Market Expectations in the Cross-Section of Present Values," Journal of Finance, American Finance Association, vol. 68(5), pages 1721-1756, October.
    24. William A. Brock & Cars H. Hommes, 2001. "A Rational Route to Randomness," Chapters, in: W. D. Dechert (ed.), Growth Theory, Nonlinear Dynamics and Economic Modelling, chapter 16, pages 402-438, Edward Elgar Publishing.
    25. Hodrick, Robert J, 1992. "Dividend Yields and Expected Stock Returns: Alternative Procedures for Inference and Measurement," The Review of Financial Studies, Society for Financial Studies, vol. 5(3), pages 357-386.
    26. Barberis, Nicholas & Shleifer, Andrei & Vishny, Robert, 1998. "A model of investor sentiment," Journal of Financial Economics, Elsevier, vol. 49(3), pages 307-343, September.
    27. Kyle Jurado & Sydney C. Ludvigson & Serena Ng, 2015. "Measuring Uncertainty," American Economic Review, American Economic Association, vol. 105(3), pages 1177-1216, March.
    28. Robert F. Stambaugh & Jianfeng Yu & Yu Yuan, 2015. "Arbitrage Asymmetry and the Idiosyncratic Volatility Puzzle," Journal of Finance, American Finance Association, vol. 70(5), pages 1903-1948, October.
    29. Jacob Boudoukh & Matthew Richardson & Robert F. Whitelaw, 2008. "The Myth of Long-Horizon Predictability," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1577-1605, July.
    30. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    31. John Y. Campbell & Samuel B. Thompson, 2008. "Predicting Excess Stock Returns Out of Sample: Can Anything Beat the Historical Average?," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1509-1531, July.
    32. Stambaugh, Robert F. & Yu, Jianfeng & Yuan, Yu, 2012. "The short of it: Investor sentiment and anomalies," Journal of Financial Economics, Elsevier, vol. 104(2), pages 288-302.
    33. Henkel, Sam James & Martin, J. Spencer & Nardari, Federico, 2011. "Time-varying short-horizon predictability," Journal of Financial Economics, Elsevier, vol. 99(3), pages 560-580, March.
    34. Akbas, Ferhat & Armstrong, Will J. & Sorescu, Sorin & Subrahmanyam, Avanidhar, 2016. "Capital Market Efficiency and Arbitrage Efficacy," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 51(2), pages 387-413, April.
    35. David E. Rapach & Jack K. Strauss & Guofu Zhou, 2010. "Out-of-Sample Equity Premium Prediction: Combination Forecasts and Links to the Real Economy," The Review of Financial Studies, Society for Financial Studies, vol. 23(2), pages 821-862, February.
    36. Diamond, Douglas W. & Verrecchia, Robert E., 1987. "Constraints on short-selling and asset price adjustment to private information," Journal of Financial Economics, Elsevier, vol. 18(2), pages 277-311, June.
    37. Yu, Jianfeng & Yuan, Yu, 2011. "Investor sentiment and the mean-variance relation," Journal of Financial Economics, Elsevier, vol. 100(2), pages 367-381, May.
    38. Smith, David M. & Wang, Na & Wang, Ying & Zychowicz, Edward J., 2016. "Sentiment and the Effectiveness of Technical Analysis: Evidence from the Hedge Fund Industry," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 51(6), pages 1991-2013, December.
    39. Moskowitz, Tobias J. & Ooi, Yao Hua & Pedersen, Lasse Heje, 2012. "Time series momentum," Journal of Financial Economics, Elsevier, vol. 104(2), pages 228-250.
    40. Tano Santos & Pietro Veronesi, 2006. "Labor Income and Predictable Stock Returns," The Review of Financial Studies, Society for Financial Studies, vol. 19(1), pages 1-44.
    41. Brock, William & Lakonishok, Josef & LeBaron, Blake, 1992. "Simple Technical Trading Rules and the Stochastic Properties of Stock Returns," Journal of Finance, American Finance Association, vol. 47(5), pages 1731-1764, December.
    42. Amit Goyal & Narasimhan Jegadeesh, 2018. "Cross-Sectional and Time-Series Tests of Return Predictability: What Is the Difference?," The Review of Financial Studies, Society for Financial Studies, vol. 31(5), pages 1784-1824.
    43. Matthijs Lof, 2015. "Rational Speculators, Contrarians, and Excess Volatility," Management Science, INFORMS, vol. 61(8), pages 1889-1901, August.
    44. Dashan Huang & Fuwei Jiang & Jun Tu & Guofu Zhou, 2015. "Investor Sentiment Aligned: A Powerful Predictor of Stock Returns," The Review of Financial Studies, Society for Financial Studies, vol. 28(3), pages 791-837.
    45. Murray Carlson & David A. Chapman & Ron Kaniel & Hong Yan, 2015. "Asset Return Predictability in a Heterogeneous Agent Equilibrium Model," Quarterly Journal of Finance (QJF), World Scientific Publishing Co. Pte. Ltd., vol. 5(02), pages 1-45.
    46. Carhart, Mark M, 1997. "On Persistence in Mutual Fund Performance," Journal of Finance, American Finance Association, vol. 52(1), pages 57-82, March.
    47. Dangl, Thomas & Halling, Michael, 2012. "Predictive regressions with time-varying coefficients," Journal of Financial Economics, Elsevier, vol. 106(1), pages 157-181.
    48. George P. Gao & Xiaomeng Lu & Zhaogang Song, 2019. "Tail Risk Concerns Everywhere," Management Science, INFORMS, vol. 65(7), pages 3111-3130, July.
    49. Ling Cen & K. C. John Wei & Liyan Yang, 2017. "Disagreement, Underreaction, and Stock Returns," Management Science, INFORMS, vol. 63(4), pages 1214-1231, April.
    50. Cars Hommes & Joep Sonnemans & Jan Tuinstra & Henk van de Velden, 2005. "Coordination of Expectations in Asset Pricing Experiments," The Review of Financial Studies, Society for Financial Studies, vol. 18(3), pages 955-980.
    51. Li, Jun & Yu, Jianfeng, 2012. "Investor attention, psychological anchors, and stock return predictability," Journal of Financial Economics, Elsevier, vol. 104(2), pages 401-419.
    52. Kelly, Bryan & Pruitt, Seth, 2015. "The three-pass regression filter: A new approach to forecasting using many predictors," Journal of Econometrics, Elsevier, vol. 186(2), pages 294-316.
    53. Jose A. Scheinkman & Wei Xiong, 2003. "Overconfidence and Speculative Bubbles," Journal of Political Economy, University of Chicago Press, vol. 111(6), pages 1183-1219, December.
    54. Harrison Hong & Jeremy C. Stein, 1999. "A Unified Theory of Underreaction, Momentum Trading, and Overreaction in Asset Markets," Journal of Finance, American Finance Association, vol. 54(6), pages 2143-2184, December.
    55. Robert Novy-Marx & Mihail Velikov, 2016. "A Taxonomy of Anomalies and Their Trading Costs," The Review of Financial Studies, Society for Financial Studies, vol. 29(1), pages 104-147.
    56. J. Michael Harrison & David M. Kreps, 1978. "Speculative Investor Behavior in a Stock Market with Heterogeneous Expectations," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 92(2), pages 323-336.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Seok, Sangik & Cho, Hoon & Ryu, Doojin, 2024. "Dual effects of investor sentiment and uncertainty in financial markets," The Quarterly Review of Economics and Finance, Elsevier, vol. 95(C), pages 300-315.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jiang, Fuwei & Lee, Joshua & Martin, Xiumin & Zhou, Guofu, 2019. "Manager sentiment and stock returns," Journal of Financial Economics, Elsevier, vol. 132(1), pages 126-149.
    2. Chen, Yong & Da, Zhi & Huang, Dayong, 2022. "Short selling efficiency," Journal of Financial Economics, Elsevier, vol. 145(2), pages 387-408.
    3. Guofu Zhou, 2018. "Measuring Investor Sentiment," Annual Review of Financial Economics, Annual Reviews, vol. 10(1), pages 239-259, November.
    4. Liya Chu & Xue-Zhong He & Kai Li & Jun Tu, 2015. "Market Sentiment and Paradigm Shifts," Research Paper Series 356, Quantitative Finance Research Centre, University of Technology, Sydney.
    5. Christopher J. Neely & David E. Rapach & Jun Tu & Guofu Zhou, 2014. "Forecasting the Equity Risk Premium: The Role of Technical Indicators," Management Science, INFORMS, vol. 60(7), pages 1772-1791, July.
    6. Bennett, Donyetta & Mekelburg, Erik & Strauss, Jack & Williams, T.H., 2024. "Unlocking the black box of sentiment and cryptocurrency: What, which, why, when and how?," Global Finance Journal, Elsevier, vol. 60(C).
    7. Stein, Tobias, 2024. "Forecasting the equity premium with frequency-decomposed technical indicators," International Journal of Forecasting, Elsevier, vol. 40(1), pages 6-28.
    8. Andrew Detzel & Hong Liu & Jack Strauss & Guofu Zhou & Yingzi Zhu, 2021. "Learning and predictability via technical analysis: Evidence from bitcoin and stocks with hard‐to‐value fundamentals," Financial Management, Financial Management Association International, vol. 50(1), pages 107-137, March.
    9. Lansing, Kevin J. & LeRoy, Stephen F. & Ma, Jun, 2022. "Examining the sources of excess return predictability: Stochastic volatility or market inefficiency?," Journal of Economic Behavior & Organization, Elsevier, vol. 197(C), pages 50-72.
    10. Jiang, Fuwei & Liu, Hongkui & Yu, Jiasheng & Zhang, Huajing, 2023. "International stock return predictability: The role of U.S. uncertainty spillover," Pacific-Basin Finance Journal, Elsevier, vol. 82(C).
    11. Lin, Qi & Lin, Xi, 2021. "Cash conversion cycle and aggregate stock returns," Journal of Financial Markets, Elsevier, vol. 52(C).
    12. Rapach, David & Zhou, Guofu, 2013. "Forecasting Stock Returns," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 328-383, Elsevier.
    13. Shen, Junyan & Yu, Jianfeng & Zhao, Shen, 2017. "Investor sentiment and economic forces," Journal of Monetary Economics, Elsevier, vol. 86(C), pages 1-21.
    14. Chen, Jian & Tang, Guohao & Yao, Jiaquan & Zhou, Guofu, 2023. "Employee sentiment and stock returns," Journal of Economic Dynamics and Control, Elsevier, vol. 149(C).
    15. Wang, Yudong & Pan, Zhiyuan & Liu, Li & Wu, Chongfeng, 2019. "Oil price increases and the predictability of equity premium," Journal of Banking & Finance, Elsevier, vol. 102(C), pages 43-58.
    16. Leland E. Farmer & Lawrence Schmidt & Allan Timmermann, 2023. "Pockets of Predictability," Journal of Finance, American Finance Association, vol. 78(3), pages 1279-1341, June.
    17. Souropanis, Ioannis & Vivian, Andrew, 2023. "Forecasting realized volatility with wavelet decomposition," Journal of Empirical Finance, Elsevier, vol. 74(C).
    18. Stefano Cassella & Huseyin Gulen, 2018. "Extrapolation Bias and the Predictability of Stock Returns by Price-Scaled Variables," The Review of Financial Studies, Society for Financial Studies, vol. 31(11), pages 4345-4397.
    19. Zhao, Dongxu & Li, Kai, 2022. "Bounded rationality, adaptive behaviour, and asset prices," International Review of Financial Analysis, Elsevier, vol. 80(C).
    20. Gong, Xue & Zhang, Weiguo & Wang, Junbo & Wang, Chao, 2022. "Investor sentiment and stock volatility: New evidence," International Review of Financial Analysis, Elsevier, vol. 80(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:68:y:2022:i:6:p:4301-4325. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.