IDEAS home Printed from https://ideas.repec.org/a/eee/finana/v82y2022ics1057521922001338.html
   My bibliography  Save this article

Whether dimensionality reduction techniques can improve the ability of sentiment proxies to predict stock market returns

Author

Listed:
  • Liang, Chao
  • Xu, Yongan
  • Wang, Jianqiong
  • Yang, Mo

Abstract

In this study, we construct China's aggregate sentiment indicator (SsPCA) based on the method of Huang et al. (2021a), which employs a new dimension reduction method of scaled principal component analysis (PCA), to aggregate useful information from individual sentiment proxies, and further examine its return predictability for the Chinese stock market. The empirical evidence suggests that SsPCA significantly improves the prediction accuracy for stock market returns both in and out of the sample, and also obtains considerable economic gain for a mean-variance investor. Additionally, the forecasting effect of SsPCA is superior to that of SPCA and SPLS, evaluated using the traditional PCA and partial least square methods, respectively. Moreover, relative to the period of the bull market, SsPCA exhibits better ability in forecasting stock market returns during the bear market. Finally, special events, such as the outbreak of coronavirus disease 2019 (COVID-19), also affect the predictive performance of the sentiment indicator.

Suggested Citation

  • Liang, Chao & Xu, Yongan & Wang, Jianqiong & Yang, Mo, 2022. "Whether dimensionality reduction techniques can improve the ability of sentiment proxies to predict stock market returns," International Review of Financial Analysis, Elsevier, vol. 82(C).
  • Handle: RePEc:eee:finana:v:82:y:2022:i:c:s1057521922001338
    DOI: 10.1016/j.irfa.2022.102169
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1057521922001338
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.irfa.2022.102169?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
    2. Baker, Malcolm & Stein, Jeremy C., 2004. "Market liquidity as a sentiment indicator," Journal of Financial Markets, Elsevier, vol. 7(3), pages 271-299, June.
    3. Malcolm Baker & Jeffrey Wurgler, 2006. "Investor Sentiment and the Cross‐Section of Stock Returns," Journal of Finance, American Finance Association, vol. 61(4), pages 1645-1680, August.
    4. Qadan, Mahmoud & Nama, Hazar, 2018. "Investor sentiment and the price of oil," Energy Economics, Elsevier, vol. 69(C), pages 42-58.
    5. Zhi Da & Joseph Engelberg & Pengjie Gao, 2015. "Editor's Choice The Sum of All FEARS Investor Sentiment and Asset Prices," The Review of Financial Studies, Society for Financial Studies, vol. 28(1), pages 1-32.
    6. Can Gao & Ian W. R. Martin, 2021. "Volatility, Valuation Ratios, and Bubbles: An Empirical Measure of Market Sentiment," Journal of Finance, American Finance Association, vol. 76(6), pages 3211-3254, December.
    7. Christiane Baumeister & Lutz Kilian, 2015. "Forecasting the Real Price of Oil in a Changing World: A Forecast Combination Approach," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(3), pages 338-351, July.
    8. Malcolm Baker & Jeffrey Wurgler, 2007. "Investor Sentiment in the Stock Market," Journal of Economic Perspectives, American Economic Association, vol. 21(2), pages 129-152, Spring.
    9. Amaya, Diego & Christoffersen, Peter & Jacobs, Kris & Vasquez, Aurelio, 2015. "Does realized skewness predict the cross-section of equity returns?," Journal of Financial Economics, Elsevier, vol. 118(1), pages 135-167.
    10. Lee, Charles M C & Shleifer, Andrei & Thaler, Richard H, 1991. "Investor Sentiment and the Closed-End Fund Puzzle," Journal of Finance, American Finance Association, vol. 46(1), pages 75-109, March.
    11. Maheu, John M. & McCurdy, Thomas H. & Song, Yong, 2021. "Bull and bear markets during the COVID-19 pandemic," Finance Research Letters, Elsevier, vol. 42(C).
    12. Haiqiang Chen & Terence Tai Leung Chong & Yingni She, 2014. "A principal component approach to measuring investor sentiment in China," Quantitative Finance, Taylor & Francis Journals, vol. 14(4), pages 573-579, April.
    13. Scott R. Baker & Nicholas Bloom & Steven J. Davis, 2016. "Measuring Economic Policy Uncertainty," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(4), pages 1593-1636.
    14. Clark, Todd E. & West, Kenneth D., 2007. "Approximately normal tests for equal predictive accuracy in nested models," Journal of Econometrics, Elsevier, vol. 138(1), pages 291-311, May.
    15. Pan, Zhiyuan & Pettenuzzo, Davide & Wang, Yudong, 2020. "Forecasting stock returns: A predictor-constrained approach," Journal of Empirical Finance, Elsevier, vol. 55(C), pages 200-217.
    16. Gupta, Rangan & Hammoudeh, Shawkat & Modise, Mampho P. & Nguyen, Duc Khuong, 2014. "Can economic uncertainty, financial stress and consumer sentiments predict U.S. equity premium?," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 33(C), pages 367-378.
    17. Fama, Eugene F. & French, Kenneth R., 1988. "Dividend yields and expected stock returns," Journal of Financial Economics, Elsevier, vol. 22(1), pages 3-25, October.
    18. Zhang, Yaojie & Wei, Yu & Ma, Feng & Yi, Yongsheng, 2019. "Economic constraints and stock return predictability: A new approach," International Review of Financial Analysis, Elsevier, vol. 63(C), pages 1-9.
    19. Han, Xing & Li, Youwei, 2017. "Can investor sentiment be a momentum time-series predictor? Evidence from China," Journal of Empirical Finance, Elsevier, vol. 42(C), pages 212-239.
    20. Dragouni, Mina & Filis, George & Gavriilidis, Konstantinos & Santamaria, Daniel, 2016. "Sentiment, mood and outbound tourism demand," Annals of Tourism Research, Elsevier, vol. 60(C), pages 80-96.
    21. Lixu Chi & Xintian Zhuang & Dalei Song, 2012. "Investor sentiment in the Chinese stock market: an empirical analysis," Applied Economics Letters, Taylor & Francis Journals, vol. 19(4), pages 345-348, March.
    22. Pettenuzzo, Davide & Timmermann, Allan & Valkanov, Rossen, 2014. "Forecasting stock returns under economic constraints," Journal of Financial Economics, Elsevier, vol. 114(3), pages 517-553.
    23. Neal, Robert & Wheatley, Simon M., 1998. "Do Measures of Investor Sentiment Predict Returns?," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 33(4), pages 523-547, December.
    24. Park, Cyn-Young & Mercado, Rogelio V., 2014. "Determinants of financial stress in emerging market economies," Journal of Banking & Finance, Elsevier, vol. 45(C), pages 199-224.
    25. Ma, Feng & Wang, Ruoxin & Lu, Xinjie & Wahab, M.I.M., 2021. "A comprehensive look at stock return predictability by oil prices using economic constraint approaches," International Review of Financial Analysis, Elsevier, vol. 78(C).
    26. Zweig, Martin E, 1973. "An Investor Expectations Stock Price Predictive Model Using Closed-End Fund Premiums," Journal of Finance, American Finance Association, vol. 28(1), pages 67-78, March.
    27. Qadan, Mahmoud & Aharon, David Y., 2019. "Can investor sentiment predict the size premium?," International Review of Financial Analysis, Elsevier, vol. 63(C), pages 10-26.
    28. Xu, Yongan & Wang, Jianqiong & Chen, Zhonglu & Liang, Chao, 2021. "Economic policy uncertainty and stock market returns: New evidence," The North American Journal of Economics and Finance, Elsevier, vol. 58(C).
    29. John Y. Campbell & Samuel B. Thompson, 2008. "Predicting Excess Stock Returns Out of Sample: Can Anything Beat the Historical Average?," Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1509-1531, July.
    30. Shapiro, Adam Hale & Sudhof, Moritz & Wilson, Daniel J., 2022. "Measuring news sentiment," Journal of Econometrics, Elsevier, vol. 228(2), pages 221-243.
    31. Ritter, Jay R, 1991. "The Long-run Performance of Initial Public Offerings," Journal of Finance, American Finance Association, vol. 46(1), pages 3-27, March.
    32. David E. Rapach & Jack K. Strauss & Guofu Zhou, 2010. "Out-of-Sample Equity Premium Prediction: Combination Forecasts and Links to the Real Economy," The Review of Financial Studies, Society for Financial Studies, vol. 23(2), pages 821-862, February.
    33. Michael Lemmon & Evgenia Portniaguina, 2006. "Consumer Confidence and Asset Prices: Some Empirical Evidence," The Review of Financial Studies, Society for Financial Studies, vol. 19(4), pages 1499-1529.
    34. Wang, Yudong & Liu, Li & Wu, Chongfeng, 2017. "Forecasting the real prices of crude oil using forecast combinations over time-varying parameter models," Energy Economics, Elsevier, vol. 66(C), pages 337-348.
    35. Zhang, Yaojie & Ma, Feng & Wang, Yudong, 2019. "Forecasting crude oil prices with a large set of predictors: Can LASSO select powerful predictors?," Journal of Empirical Finance, Elsevier, vol. 54(C), pages 97-117.
    36. Dashan Huang & Fuwei Jiang & Jun Tu & Guofu Zhou, 2015. "Investor Sentiment Aligned: A Powerful Predictor of Stock Returns," The Review of Financial Studies, Society for Financial Studies, vol. 28(3), pages 791-837.
    37. He, Mengxi & Zhang, Yaojie & Wen, Danyan & Wang, Yudong, 2021. "Forecasting crude oil prices: A scaled PCA approach," Energy Economics, Elsevier, vol. 97(C).
    38. Yi, Yongsheng & Ma, Feng & Zhang, Yaojie & Huang, Dengshi, 2019. "Forecasting stock returns with cycle-decomposed predictors," International Review of Financial Analysis, Elsevier, vol. 64(C), pages 250-261.
    39. Huynh, Toan Luu Duc & Foglia, Matteo & Nasir, Muhammad Ali & Angelini, Eliana, 2021. "Feverish sentiment and global equity markets during the COVID-19 pandemic," Journal of Economic Behavior & Organization, Elsevier, vol. 188(C), pages 1088-1108.
    40. Adrian R. Pagan & Kirill A. Sossounov, 2003. "A simple framework for analysing bull and bear markets," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 18(1), pages 23-46.
    41. Jiang, Fuwei & Lee, Joshua & Martin, Xiumin & Zhou, Guofu, 2019. "Manager sentiment and stock returns," Journal of Financial Economics, Elsevier, vol. 132(1), pages 126-149.
    42. Liang, Chao & Li, Yan & Ma, Feng & Wei, Yu, 2021. "Global equity market volatilities forecasting: A comparison of leverage effects, jumps, and overnight information," International Review of Financial Analysis, Elsevier, vol. 75(C).
    43. Liang, Chao & Tang, Linchun & Li, Yan & Wei, Yu, 2020. "Which sentiment index is more informative to forecast stock market volatility? Evidence from China," International Review of Financial Analysis, Elsevier, vol. 71(C).
    44. Michael Firth & Kailong (Philip) Wang & Sonia ML Wong, 2015. "Corporate Transparency and the Impact of Investor Sentiment on Stock Prices," Management Science, INFORMS, vol. 61(7), pages 1630-1647, July.
    45. Brown, Gregory W. & Cliff, Michael T., 2004. "Investor sentiment and the near-term stock market," Journal of Empirical Finance, Elsevier, vol. 11(1), pages 1-27, January.
    46. Huang, Dashan & Li, Jiangyuan & Wang, Liyao, 2021. "Are disagreements agreeable? Evidence from information aggregation," Journal of Financial Economics, Elsevier, vol. 141(1), pages 83-101.
    47. Bethke, Sebastian & Gehde-Trapp, Monika & Kempf, Alexander, 2017. "Investor sentiment, flight-to-quality, and corporate bond comovement," Journal of Banking & Finance, Elsevier, vol. 82(C), pages 112-132.
    48. Wang, Yudong & Wei, Yu & Wu, Chongfeng & Yin, Libo, 2018. "Oil and the short-term predictability of stock return volatility," Journal of Empirical Finance, Elsevier, vol. 47(C), pages 90-104.
    49. Obaid, Khaled & Pukthuanthong, Kuntara, 2022. "A picture is worth a thousand words: Measuring investor sentiment by combining machine learning and photos from news," Journal of Financial Economics, Elsevier, vol. 144(1), pages 273-297.
    50. Hui Zou & Trevor Hastie, 2005. "Addendum: Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(5), pages 768-768, November.
    51. Hui Zou & Trevor Hastie, 2005. "Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(2), pages 301-320, April.
    52. Alan J. Hanna & John D. Turner & Clive B. Walker, 2020. "News media and investor sentiment during bull and bear markets," The European Journal of Finance, Taylor & Francis Journals, vol. 26(14), pages 1377-1395, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Xu, Yongan & Liang, Chao & Wang, Jianqiong, 2023. "Financial stress and returns predictability: Fresh evidence from China," Pacific-Basin Finance Journal, Elsevier, vol. 78(C).
    2. Zhang, Dan & Li, Biangxiang, 2022. "What can we learn from financial stress indicator?," Finance Research Letters, Elsevier, vol. 50(C).
    3. Xu, Yongan & Duong, Duy & Xu, Hualong, 2023. "Attention! Predicting crude oil prices from the perspective of extreme weather," Finance Research Letters, Elsevier, vol. 57(C).
    4. Li, Houjian & Zhou, Deheng & Hu, Jiayu & Li, Junwen & Su, Mengying & Guo, Lili, 2023. "Forecasting the realized volatility of Energy Stock Market: A multimodel comparison," The North American Journal of Economics and Finance, Elsevier, vol. 66(C).
    5. Xu, Yongan & Li, Ming & Yan, Wen & Bai, Jiancheng, 2022. "Predictability of the renewable energy market returns: The informational gains from the climate policy uncertainty," Resources Policy, Elsevier, vol. 79(C).
    6. Xu, Yongan & Liang, Chao & Li, Yan & Huynh, Toan L.D., 2022. "News sentiment and stock return: Evidence from managers’ news coverages," Finance Research Letters, Elsevier, vol. 48(C).
    7. Wang, Lu & Ruan, Hang & Hong, Yanran & Luo, Keyu, 2023. "Detecting the hidden asymmetric relationship between crude oil and the US dollar: A novel neural Granger causality method," Research in International Business and Finance, Elsevier, vol. 64(C).
    8. Feng, Haoyuan & Liu, Yue & Wu, Jie & Guo, Kun, 2023. "Financial market spillovers and macroeconomic shocks: Evidence from China," Research in International Business and Finance, Elsevier, vol. 65(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yongan Xu & Jianqiong Wang & Zhonglu Chen & Chao Liang, 2023. "Sentiment indices and stock returns: Evidence from China," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 28(1), pages 1063-1080, January.
    2. Xu, Yongan & Liang, Chao & Wang, Jianqiong, 2023. "Financial stress and returns predictability: Fresh evidence from China," Pacific-Basin Finance Journal, Elsevier, vol. 78(C).
    3. Xing, Li-Min & Zhang, Yue-Jun, 2022. "Forecasting crude oil prices with shrinkage methods: Can nonconvex penalty and Huber loss help?," Energy Economics, Elsevier, vol. 110(C).
    4. Xu, Yongan & Liang, Chao & Li, Yan & Huynh, Toan L.D., 2022. "News sentiment and stock return: Evidence from managers’ news coverages," Finance Research Letters, Elsevier, vol. 48(C).
    5. Song, Ziyu & Gong, Xiaomin & Zhang, Cheng & Yu, Changrui, 2023. "Investor sentiment based on scaled PCA method: A powerful predictor of realized volatility in the Chinese stock market," International Review of Economics & Finance, Elsevier, vol. 83(C), pages 528-545.
    6. Gong, Xue & Zhang, Weiguo & Wang, Junbo & Wang, Chao, 2022. "Investor sentiment and stock volatility: New evidence," International Review of Financial Analysis, Elsevier, vol. 80(C).
    7. He, Mengxi & Zhang, Yaojie & Wen, Danyan & Wang, Yudong, 2021. "Forecasting crude oil prices: A scaled PCA approach," Energy Economics, Elsevier, vol. 97(C).
    8. He, Mengxi & Zhang, Yaojie, 2022. "Climate policy uncertainty and the stock return predictability of the oil industry," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 81(C).
    9. Han, Xing & Li, Youwei, 2017. "Can investor sentiment be a momentum time-series predictor? Evidence from China," Journal of Empirical Finance, Elsevier, vol. 42(C), pages 212-239.
    10. Zhang, Zhikai & He, Mengxi & Zhang, Yaojie & Wang, Yudong, 2022. "Geopolitical risk trends and crude oil price predictability," Energy, Elsevier, vol. 258(C).
    11. Zhang, Yaojie & Ma, Feng & Wang, Yudong, 2019. "Forecasting crude oil prices with a large set of predictors: Can LASSO select powerful predictors?," Journal of Empirical Finance, Elsevier, vol. 54(C), pages 97-117.
    12. Kim Kaivanto & Peng Zhang, 2019. "Investor Sentiment as a Predictor of Market Returns," Working Papers 268005798, Lancaster University Management School, Economics Department.
    13. Xu, Yongan & Wang, Jianqiong & Chen, Zhonglu & Liang, Chao, 2021. "Economic policy uncertainty and stock market returns: New evidence," The North American Journal of Economics and Finance, Elsevier, vol. 58(C).
    14. Alexandridis, Antonios K. & Apergis, Iraklis & Panopoulou, Ekaterini & Voukelatos, Nikolaos, 2023. "Equity premium prediction: The role of information from the options market," Journal of Financial Markets, Elsevier, vol. 64(C).
    15. Yuan Li, 2022. "Mood Beta, Sentiment and Stock Returns in China," SAGE Open, , vol. 12(1), pages 21582440221, February.
    16. Zhang, Yaojie & Wang, Yudong, 2023. "Forecasting crude oil futures market returns: A principal component analysis combination approach," International Journal of Forecasting, Elsevier, vol. 39(2), pages 659-673.
    17. Hou, Yang & Meng, Jiayin, 2018. "The momentum effect in the Chinese market and its relationship with the simultaneous and the lagged investor sentiment," MPRA Paper 94838, University Library of Munich, Germany.
    18. Liu, Guangqiang & Guo, Xiaozhu, 2022. "Forecasting stock market volatility using commodity futures volatility information," Resources Policy, Elsevier, vol. 75(C).
    19. Ma, Feng & Wang, Ruoxin & Lu, Xinjie & Wahab, M.I.M., 2021. "A comprehensive look at stock return predictability by oil prices using economic constraint approaches," International Review of Financial Analysis, Elsevier, vol. 78(C).
    20. Qiu, Rui & Liu, Jing & Li, Yan, 2023. "Long-term adjusted volatility: Powerful capability in forecasting stock market returns," International Review of Financial Analysis, Elsevier, vol. 86(C).

    More about this item

    Keywords

    Scaled PCA; Sentiment; Forecasting; Chinese stock market; COVID-19;
    All these keywords.

    JEL classification:

    • G11 - Financial Economics - - General Financial Markets - - - Portfolio Choice; Investment Decisions
    • G12 - Financial Economics - - General Financial Markets - - - Asset Pricing; Trading Volume; Bond Interest Rates
    • G17 - Financial Economics - - General Financial Markets - - - Financial Forecasting and Simulation

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:finana:v:82:y:2022:i:c:s1057521922001338. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/620166 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.