IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v68y2022i6p4301-4325.html
   My bibliography  Save this article

Investor Sentiment and Paradigm Shifts in Equity Return Forecasting

Author

Listed:
  • Liya Chu

    (East China University of Science and Technology, Shanghai 200231, China)

  • Xue-Zhong He

    (Xi’an Jiaotong-Liverpool University, Suzhou 215123, China)

  • Kai Li

    (Southwestern University of Finance and Economics, Chengdu 611130, China; Macquarie University, Sydney, New South Wales 2109, Australia)

  • Jun Tu

    (Singapore Management University, Singapore, Singapore 188065)

Abstract

This study investigates the impact of investor sentiment on excess equity return forecasting. A high (low) investor sentiment may weaken the connection between fundamental economic (behavioral-based nonfundamental) predictors and market returns. We find that although fundamental variables can be strong predictors when sentiment is low, they tend to lose their predictive power when investor sentiment is high. Nonfundamental predictors perform well during high-sentiment periods while their predictive ability deteriorates when investor sentiment is low. These paradigm shifts in equity return forecasting provide a key to understanding and resolving the lack of predictive power for both fundamental and nonfundamental variables debated in recent studies.

Suggested Citation

  • Liya Chu & Xue-Zhong He & Kai Li & Jun Tu, 2022. "Investor Sentiment and Paradigm Shifts in Equity Return Forecasting," Management Science, INFORMS, vol. 68(6), pages 4301-4325, June.
  • Handle: RePEc:inm:ormnsc:v:68:y:2022:i:6:p:4301-4325
    DOI: 10.1287/mnsc.2020.3834
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mnsc.2020.3834
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mnsc.2020.3834?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
    2. Matthijs Lof, 2015. "Rational Speculators, Contrarians, and Excess Volatility," Management Science, INFORMS, vol. 61(8), pages 1889-1901, August.
    3. Jun Tu, 2010. "Is Regime Switching in Stock Returns Important in Portfolio Decisions?," Management Science, INFORMS, vol. 56(7), pages 1198-1215, July.
    4. Harrison Hong & Jeremy C. Stein, 2003. "Differences of Opinion, Short-Sales Constraints, and Market Crashes," Review of Financial Studies, Society for Financial Studies, vol. 16(2), pages 487-525.
    5. Kyle Jurado & Sydney C. Ludvigson & Serena Ng, 2015. "Measuring Uncertainty," American Economic Review, American Economic Association, vol. 105(3), pages 1177-1216, March.
    6. Dashan Huang & Fuwei Jiang & Jun Tu & Guofu Zhou, 2015. "Investor Sentiment Aligned: A Powerful Predictor of Stock Returns," Review of Financial Studies, Society for Financial Studies, vol. 28(3), pages 791-837.
    7. Bryan Kelly & Hao Jiang, 2014. "Editor's Choice Tail Risk and Asset Prices," Review of Financial Studies, Society for Financial Studies, vol. 27(10), pages 2841-2871.
    8. Malcolm Baker & Jeffrey Wurgler, 2006. "Investor Sentiment and the Cross‐Section of Stock Returns," Journal of Finance, American Finance Association, vol. 61(4), pages 1645-1680, August.
    9. Stefano Cassella & Huseyin Gulen, 2018. "Extrapolation Bias and the Predictability of Stock Returns by Price-Scaled Variables," Review of Financial Studies, Society for Financial Studies, vol. 31(11), pages 4345-4397.
    10. Zhi Da & Joseph Engelberg & Pengjie Gao, 2015. "Editor's Choice The Sum of All FEARS Investor Sentiment and Asset Prices," Review of Financial Studies, Society for Financial Studies, vol. 28(1), pages 1-32.
    11. John Y. Campbell & John Cochrane, 1999. "Force of Habit: A Consumption-Based Explanation of Aggregate Stock Market Behavior," Journal of Political Economy, University of Chicago Press, vol. 107(2), pages 205-251, April.
    12. John Y. Campbell, Robert J. Shiller, 1988. "The Dividend-Price Ratio and Expectations of Future Dividends and Discount Factors," Review of Financial Studies, Society for Financial Studies, vol. 1(3), pages 195-228.
    13. Murray Carlson & David A. Chapman & Ron Kaniel & Hong Yan, 2015. "Asset Return Predictability in a Heterogeneous Agent Equilibrium Model," Quarterly Journal of Finance (QJF), World Scientific Publishing Co. Pte. Ltd., vol. 5(02), pages 1-45.
    14. Diego Comin & Mark Gertler, 2006. "Medium-Term Business Cycles," American Economic Review, American Economic Association, vol. 96(3), pages 523-551, June.
    15. Malcolm Baker & Jeffrey Wurgler, 2007. "Investor Sentiment in the Stock Market," Journal of Economic Perspectives, American Economic Association, vol. 21(2), pages 129-152, Spring.
    16. Stambaugh, Robert F. & Yu, Jianfeng & Yuan, Yu, 2012. "The short of it: Investor sentiment and anomalies," Journal of Financial Economics, Elsevier, vol. 104(2), pages 288-302.
    17. Carhart, Mark M, 1997. "On Persistence in Mutual Fund Performance," Journal of Finance, American Finance Association, vol. 52(1), pages 57-82, March.
    18. Dangl, Thomas & Halling, Michael, 2012. "Predictive regressions with time-varying coefficients," Journal of Financial Economics, Elsevier, vol. 106(1), pages 157-181.
    19. De Long, J Bradford & Andrei Shleifer & Lawrence H. Summers & Robert J. Waldmann, 1990. "Noise Trader Risk in Financial Markets," Journal of Political Economy, University of Chicago Press, vol. 98(4), pages 703-738, August.
    20. George P. Gao & Xiaomeng Lu & Zhaogang Song, 2019. "Tail Risk Concerns Everywhere," Management Science, INFORMS, vol. 65(7), pages 3111-3130, July.
    21. Ling Cen & K. C. John Wei & Liyan Yang, 2017. "Disagreement, Underreaction, and Stock Returns," Management Science, INFORMS, vol. 63(4), pages 1214-1231, April.
    22. Clark, Todd E. & West, Kenneth D., 2007. "Approximately normal tests for equal predictive accuracy in nested models," Journal of Econometrics, Elsevier, vol. 138(1), pages 291-311, May.
    23. William A. Brock & Cars H. Hommes, 1997. "A Rational Route to Randomness," Econometrica, Econometric Society, vol. 65(5), pages 1059-1096, September.
    24. Cars Hommes & Joep Sonnemans & Jan Tuinstra & Henk van de Velden, 2005. "Coordination of Expectations in Asset Pricing Experiments," Review of Financial Studies, Society for Financial Studies, vol. 18(3), pages 955-980.
    25. Yu, Jialin, 2011. "Disagreement and return predictability of stock portfolios," Journal of Financial Economics, Elsevier, vol. 99(1), pages 162-183, January.
    26. Christopher J. Neely & David E. Rapach & Jun Tu & Guofu Zhou, 2014. "Forecasting the Equity Risk Premium: The Role of Technical Indicators," Management Science, INFORMS, vol. 60(7), pages 1772-1791, July.
    27. Li, Jun & Yu, Jianfeng, 2012. "Investor attention, psychological anchors, and stock return predictability," Journal of Financial Economics, Elsevier, vol. 104(2), pages 401-419.
    28. Shen, Junyan & Yu, Jianfeng & Zhao, Shen, 2017. "Investor sentiment and economic forces," Journal of Monetary Economics, Elsevier, vol. 86(C), pages 1-21.
    29. John H. Cochrane, 2008. "The Dog That Did Not Bark: A Defense of Return Predictability," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1533-1575, July.
    30. Barberis, Nicholas & Shleifer, Andrei & Vishny, Robert, 1998. "A model of investor sentiment," Journal of Financial Economics, Elsevier, vol. 49(3), pages 307-343, September.
    31. Stambaugh, Robert F., 1999. "Predictive regressions," Journal of Financial Economics, Elsevier, vol. 54(3), pages 375-421, December.
    32. Kelly, Bryan & Pruitt, Seth, 2015. "The three-pass regression filter: A new approach to forecasting using many predictors," Journal of Econometrics, Elsevier, vol. 186(2), pages 294-316.
    33. Ling Cen & Hai Lu & Liyan Yang, 2013. "Investor Sentiment, Disagreement, and the Breadth--Return Relationship," Management Science, INFORMS, vol. 59(5), pages 1076-1091, May.
    34. George P Gao & Pengjie Gao & Zhaogang Song, 2018. "Do Hedge Funds Exploit Rare Disaster Concerns?," Review of Financial Studies, Society for Financial Studies, vol. 31(7), pages 2650-2692.
    35. Jose A. Scheinkman & Wei Xiong, 2003. "Overconfidence and Speculative Bubbles," Journal of Political Economy, University of Chicago Press, vol. 111(6), pages 1183-1219, December.
    36. Harrison Hong & Jeremy C. Stein, 1999. "A Unified Theory of Underreaction, Momentum Trading, and Overreaction in Asset Markets," Journal of Finance, American Finance Association, vol. 54(6), pages 2143-2184, December.
    37. Matthew Baron & Wei Xiong, 2017. "Credit Expansion and Neglected Crash Risk," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 132(2), pages 713-764.
    38. Bryan Kelly & Seth Pruitt, 2013. "Market Expectations in the Cross-Section of Present Values," Journal of Finance, American Finance Association, vol. 68(5), pages 1721-1756, October.
    39. William A. Brock & Cars H. Hommes, 2001. "A Rational Route to Randomness," Chapters, in: W. D. Dechert (ed.), Growth Theory, Nonlinear Dynamics and Economic Modelling, chapter 16, pages 402-438, Edward Elgar Publishing.
    40. Hodrick, Robert J, 1992. "Dividend Yields and Expected Stock Returns: Alternative Procedures for Inference and Measurement," Review of Financial Studies, Society for Financial Studies, vol. 5(3), pages 357-386.
    41. John Y. Campbell & Samuel B. Thompson, 2008. "Predicting Excess Stock Returns Out of Sample: Can Anything Beat the Historical Average?," Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1509-1531, July.
    42. Robert Novy-Marx & Mihail Velikov, 2016. "A Taxonomy of Anomalies and Their Trading Costs," Review of Financial Studies, Society for Financial Studies, vol. 29(1), pages 104-147.
    43. Robert F. Stambaugh & Jianfeng Yu & Yu Yuan, 2015. "Arbitrage Asymmetry and the Idiosyncratic Volatility Puzzle," Journal of Finance, American Finance Association, vol. 70(5), pages 1903-1948, October.
    44. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    45. Jacob Boudoukh & Matthew Richardson & Robert F. Whitelaw, 2008. "The Myth of Long-Horizon Predictability," Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1577-1605, July.
    46. Henkel, Sam James & Martin, J. Spencer & Nardari, Federico, 2011. "Time-varying short-horizon predictability," Journal of Financial Economics, Elsevier, vol. 99(3), pages 560-580, March.
    47. Akbas, Ferhat & Armstrong, Will J. & Sorescu, Sorin & Subrahmanyam, Avanidhar, 2016. "Capital Market Efficiency and Arbitrage Efficacy," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 51(2), pages 387-413, April.
    48. David E. Rapach & Jack K. Strauss & Guofu Zhou, 2010. "Out-of-Sample Equity Premium Prediction: Combination Forecasts and Links to the Real Economy," Review of Financial Studies, Society for Financial Studies, vol. 23(2), pages 821-862, February.
    49. Diamond, Douglas W. & Verrecchia, Robert E., 1987. "Constraints on short-selling and asset price adjustment to private information," Journal of Financial Economics, Elsevier, vol. 18(2), pages 277-311, June.
    50. Yu, Jianfeng & Yuan, Yu, 2011. "Investor sentiment and the mean-variance relation," Journal of Financial Economics, Elsevier, vol. 100(2), pages 367-381, May.
    51. Smith, David M. & Wang, Na & Wang, Ying & Zychowicz, Edward J., 2016. "Sentiment and the Effectiveness of Technical Analysis: Evidence from the Hedge Fund Industry," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 51(6), pages 1991-2013, December.
    52. Moskowitz, Tobias J. & Ooi, Yao Hua & Pedersen, Lasse Heje, 2012. "Time series momentum," Journal of Financial Economics, Elsevier, vol. 104(2), pages 228-250.
    53. Tano Santos & Pietro Veronesi, 2006. "Labor Income and Predictable Stock Returns," Review of Financial Studies, Society for Financial Studies, vol. 19(1), pages 1-44.
    54. Brock, William & Lakonishok, Josef & LeBaron, Blake, 1992. "Simple Technical Trading Rules and the Stochastic Properties of Stock Returns," Journal of Finance, American Finance Association, vol. 47(5), pages 1731-1764, December.
    55. J. Michael Harrison & David M. Kreps, 1978. "Speculative Investor Behavior in a Stock Market with Heterogeneous Expectations," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 92(2), pages 323-336.
    56. Amit Goyal & Narasimhan Jegadeesh, 2018. "Cross-Sectional and Time-Series Tests of Return Predictability: What Is the Difference?," Review of Financial Studies, Society for Financial Studies, vol. 31(5), pages 1784-1824.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jiang, Fuwei & Lee, Joshua & Martin, Xiumin & Zhou, Guofu, 2019. "Manager sentiment and stock returns," Journal of Financial Economics, Elsevier, vol. 132(1), pages 126-149.
    2. Chen, Yong & Da, Zhi & Huang, Dayong, 2022. "Short selling efficiency," Journal of Financial Economics, Elsevier, vol. 145(2), pages 387-408.
    3. Guofu Zhou, 2018. "Measuring Investor Sentiment," Annual Review of Financial Economics, Annual Reviews, vol. 10(1), pages 239-259, November.
    4. Liya Chu & Xue-Zhong He & Kai Li & Jun Tu, 2015. "Market Sentiment and Paradigm Shifts," Research Paper Series 356, Quantitative Finance Research Centre, University of Technology, Sydney.
    5. Christopher J. Neely & David E. Rapach & Jun Tu & Guofu Zhou, 2014. "Forecasting the Equity Risk Premium: The Role of Technical Indicators," Management Science, INFORMS, vol. 60(7), pages 1772-1791, July.
    6. Lansing, Kevin J. & LeRoy, Stephen F. & Ma, Jun, 2022. "Examining the sources of excess return predictability: Stochastic volatility or market inefficiency?," Journal of Economic Behavior & Organization, Elsevier, vol. 197(C), pages 50-72.
    7. Lin, Qi & Lin, Xi, 2021. "Cash conversion cycle and aggregate stock returns," Journal of Financial Markets, Elsevier, vol. 52(C).
    8. Rapach, David & Zhou, Guofu, 2013. "Forecasting Stock Returns," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 328-383, Elsevier.
    9. Leland E. Farmer & Lawrence Schmidt & Allan Timmermann, 2023. "Pockets of Predictability," Journal of Finance, American Finance Association, vol. 78(3), pages 1279-1341, June.
    10. Andrew Detzel & Hong Liu & Jack Strauss & Guofu Zhou & Yingzi Zhu, 2021. "Learning and predictability via technical analysis: Evidence from bitcoin and stocks with hard‐to‐value fundamentals," Financial Management, Financial Management Association International, vol. 50(1), pages 107-137, March.
    11. Stefano Cassella & Huseyin Gulen, 2018. "Extrapolation Bias and the Predictability of Stock Returns by Price-Scaled Variables," Review of Financial Studies, Society for Financial Studies, vol. 31(11), pages 4345-4397.
    12. Shen, Junyan & Yu, Jianfeng & Zhao, Shen, 2017. "Investor sentiment and economic forces," Journal of Monetary Economics, Elsevier, vol. 86(C), pages 1-21.
    13. Zhao, Dongxu & Li, Kai, 2022. "Bounded rationality, adaptive behaviour, and asset prices," International Review of Financial Analysis, Elsevier, vol. 80(C).
    14. Gong, Xue & Zhang, Weiguo & Wang, Junbo & Wang, Chao, 2022. "Investor sentiment and stock volatility: New evidence," International Review of Financial Analysis, Elsevier, vol. 80(C).
    15. Chen, Jian & Tang, Guohao & Yao, Jiaquan & Zhou, Guofu, 2023. "Employee sentiment and stock returns," Journal of Economic Dynamics and Control, Elsevier, vol. 149(C).
    16. Wang, Yudong & Pan, Zhiyuan & Liu, Li & Wu, Chongfeng, 2019. "Oil price increases and the predictability of equity premium," Journal of Banking & Finance, Elsevier, vol. 102(C), pages 43-58.
    17. Yu, Deshui & Huang, Difang, 2023. "Cross-sectional uncertainty and expected stock returns," Journal of Empirical Finance, Elsevier, vol. 72(C), pages 321-340.
    18. Atanasov, Victoria, 2018. "World output gap and global stock returns," Journal of Empirical Finance, Elsevier, vol. 48(C), pages 181-197.
    19. Mykola Babiak & Jozef Barunik, 2020. "Deep Learning, Predictability, and Optimal Portfolio Returns," CERGE-EI Working Papers wp677, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
    20. Kim, Jun Sik & Ryu, Doojin & Seo, Sung Won, 2014. "Investor sentiment and return predictability of disagreement," Journal of Banking & Finance, Elsevier, vol. 42(C), pages 166-178.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:68:y:2022:i:6:p:4301-4325. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.