IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2308.04947.html
   My bibliography  Save this paper

Methods for Acquiring and Incorporating Knowledge into Stock Price Prediction: A Survey

Author

Listed:
  • Liping Wang
  • Jiawei Li
  • Lifan Zhao
  • Zhizhuo Kou
  • Xiaohan Wang
  • Xinyi Zhu
  • Hao Wang
  • Yanyan Shen
  • Lei Chen

Abstract

Predicting stock prices presents a challenging research problem due to the inherent volatility and non-linear nature of the stock market. In recent years, knowledge-enhanced stock price prediction methods have shown groundbreaking results by utilizing external knowledge to understand the stock market. Despite the importance of these methods, there is a scarcity of scholarly works that systematically synthesize previous studies from the perspective of external knowledge types. Specifically, the external knowledge can be modeled in different data structures, which we group into non-graph-based formats and graph-based formats: 1) non-graph-based knowledge captures contextual information and multimedia descriptions specifically associated with an individual stock; 2) graph-based knowledge captures interconnected and interdependent information in the stock market. This survey paper aims to provide a systematic and comprehensive description of methods for acquiring external knowledge from various unstructured data sources and then incorporating it into stock price prediction models. We also explore fusion methods for combining external knowledge with historical price features. Moreover, this paper includes a compilation of relevant datasets and delves into potential future research directions in this domain.

Suggested Citation

  • Liping Wang & Jiawei Li & Lifan Zhao & Zhizhuo Kou & Xiaohan Wang & Xinyi Zhu & Hao Wang & Yanyan Shen & Lei Chen, 2023. "Methods for Acquiring and Incorporating Knowledge into Stock Price Prediction: A Survey," Papers 2308.04947, arXiv.org.
    • Handle: RePEc:arx:papers:2308.04947
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2308.04947
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Wendi Li & Xiao Yang & Weiqing Liu & Yingce Xia & Jiang Bian, 2022. "DDG-DA: Data Distribution Generation for Predictable Concept Drift Adaptation," Papers 2201.04038, arXiv.org, revised Jun 2022.
    2. Hyejung Chung & Kyung-shik Shin, 2018. "Genetic Algorithm-Optimized Long Short-Term Memory Network for Stock Market Prediction," Sustainability, MDPI, vol. 10(10), pages 1-18, October.
    3. R. Mantegna, 1999. "Hierarchical structure in financial markets," The European Physical Journal B: Condensed Matter and Complex Systems, Springer;EDP Sciences, vol. 11(1), pages 193-197, September.
    4. Hyun Sik Sim & Hae In Kim & Jae Joon Ahn, 2019. "Is Deep Learning for Image Recognition Applicable to Stock Market Prediction?," Complexity, Hindawi, vol. 2019, pages 1-10, February.
    5. Zihan Chen & Lei Nico Zheng & Cheng Lu & Jialu Yuan & Di Zhu, 2023. "ChatGPT Informed Graph Neural Network for Stock Movement Prediction," Papers 2306.03763, arXiv.org, revised Sep 2023.
    6. Lifan Zhao & Shuming Kong & Yanyan Shen, 2023. "DoubleAdapt: A Meta-learning Approach to Incremental Learning for Stock Trend Forecasting," Papers 2306.09862, arXiv.org, revised Apr 2024.
    7. Tse, Chi K. & Liu, Jing & Lau, Francis C.M., 2010. "A network perspective of the stock market," Journal of Empirical Finance, Elsevier, vol. 17(4), pages 659-667, September.
    8. Zhu, Yingzi & Zhou, Guofu, 2009. "Technical analysis: An asset allocation perspective on the use of moving averages," Journal of Financial Economics, Elsevier, vol. 92(3), pages 519-544, June.
    9. Haohan Zhang & Fengrui Hua & Chengjin Xu & Jian Guo & Hao Kong & Ruiting Zuo, 2023. "Unveiling the Potential of Sentiment: Can Large Language Models Predict Chinese Stock Price Movements?," Papers 2306.14222, arXiv.org.
    10. Fama, Eugene F, 1970. "Efficient Capital Markets: A Review of Theory and Empirical Work," Journal of Finance, American Finance Association, vol. 25(2), pages 383-417, May.
    11. Jianian Wang & Sheng Zhang & Yanghua Xiao & Rui Song, 2021. "A Review on Graph Neural Network Methods in Financial Applications," Papers 2111.15367, arXiv.org, revised Apr 2022.
    12. Alejandro Lopez-Lira & Yuehua Tang, 2023. "Can ChatGPT Forecast Stock Price Movements? Return Predictability and Large Language Models," Papers 2304.07619, arXiv.org, revised Sep 2023.
    13. Bhaskarjit Sarmah & Nayana Nair & Dhagash Mehta & Stefano Pasquali, 2022. "Learning Embedded Representation of the Stock Correlation Matrix using Graph Machine Learning," Papers 2207.07183, arXiv.org.
    14. Priyank Sonkiya & Vikas Bajpai & Anukriti Bansal, 2021. "Stock price prediction using BERT and GAN," Papers 2107.09055, arXiv.org.
    15. Zexin Hu & Yiqi Zhao & Matloob Khushi, 2021. "A Survey of Forex and Stock Price Prediction Using Deep Learning," Papers 2103.09750, arXiv.org.
    16. Fuli Feng & Xiangnan He & Xiang Wang & Cheng Luo & Yiqun Liu & Tat-Seng Chua, 2018. "Temporal Relational Ranking for Stock Prediction," Papers 1809.09441, arXiv.org, revised Jan 2019.
    17. Ronny Luss & Alexandre D'Aspremont, 2015. "Predicting abnormal returns from news using text classification," Quantitative Finance, Taylor & Francis Journals, vol. 15(6), pages 999-1012, June.
    18. Qianqian Xie & Weiguang Han & Yanzhao Lai & Min Peng & Jimin Huang, 2023. "The Wall Street Neophyte: A Zero-Shot Analysis of ChatGPT Over MultiModal Stock Movement Prediction Challenges," Papers 2304.05351, arXiv.org, revised Apr 2023.
    19. Qinkai Chen, 2021. "Stock Movement Prediction with Financial News using Contextualized Embedding from BERT," Papers 2107.08721, arXiv.org.
    20. Sourav Medya & Mohammad Rasoolinejad & Yang Yang & Brian Uzzi, 2022. "An Exploratory Study of Stock Price Movements from Earnings Calls," Papers 2203.12460, arXiv.org.
    21. Yu Zhao & Huaming Du & Ying Liu & Shaopeng Wei & Xingyan Chen & Fuzhen Zhuang & Qing Li & Ji Liu & Gang Kou, 2022. "Stock Movement Prediction Based on Bi-typed Hybrid-relational Market Knowledge Graph via Dual Attention Networks," Papers 2201.04965, arXiv.org, revised Jan 2022.
    22. Shan Lu & Jichang Zhao & Huiwen Wang & Ruoen Ren, 2017. "Herding boosts too-connected-to-fail risk in stock market of China," Papers 1705.08240, arXiv.org, revised Apr 2018.
    23. Tim Loughran & Bill Mcdonald, 2011. "When Is a Liability Not a Liability? Textual Analysis, Dictionaries, and 10‐Ks," Journal of Finance, American Finance Association, vol. 66(1), pages 35-65, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kelvin J. L. Koa & Yunshan Ma & Ritchie Ng & Tat-Seng Chua, 2024. "Learning to Generate Explainable Stock Predictions using Self-Reflective Large Language Models," Papers 2402.03659, arXiv.org, revised Feb 2024.
    2. Wai Khuen Cheng & Khean Thye Bea & Steven Mun Hong Leow & Jireh Yi-Le Chan & Zeng-Wei Hong & Yen-Lin Chen, 2022. "A Review of Sentiment, Semantic and Event-Extraction-Based Approaches in Stock Forecasting," Mathematics, MDPI, vol. 10(14), pages 1-20, July.
    3. Jean-Baptiste Hasse, 2022. "Systemic risk: a network approach," Empirical Economics, Springer, vol. 63(1), pages 313-344, July.
    4. Ummara Mumtaz & Summaya Mumtaz, 2023. "Potential of ChatGPT in predicting stock market trends based on Twitter Sentiment Analysis," Papers 2311.06273, arXiv.org.
    5. Jean-Baptiste Hasse, 2020. "Systemic Risk: a Network Approach," Working Papers halshs-02893780, HAL.
    6. Rick Steinert & Saskia Altmann, 2023. "Linking microblogging sentiments to stock price movement: An application of GPT-4," Papers 2308.16771, arXiv.org.
    7. Jinan Zou & Qingying Zhao & Yang Jiao & Haiyao Cao & Yanxi Liu & Qingsen Yan & Ehsan Abbasnejad & Lingqiao Liu & Javen Qinfeng Shi, 2022. "Stock Market Prediction via Deep Learning Techniques: A Survey," Papers 2212.12717, arXiv.org, revised Feb 2023.
    8. Peng Yue & Qing Cai & Wanfeng Yan & Wei-Xing Zhou, 2020. "Information flow networks of Chinese stock market sectors," Papers 2004.08759, arXiv.org.
    9. Erdemlioglu, Deniz & Petitjean, Mikael & Vargas, Nicolas, 2021. "Market instability and technical trading at high frequency: Evidence from NASDAQ stocks," Economic Modelling, Elsevier, vol. 102(C).
    10. Peralta, Gustavo & Zareei, Abalfazl, 2016. "A network approach to portfolio selection," Journal of Empirical Finance, Elsevier, vol. 38(PA), pages 157-180.
    11. Výrost, Tomáš, 2012. "Country effects in CEE3 stock market networks: a preliminary study," MPRA Paper 43481, University Library of Munich, Germany.
    12. Jian Guo & Saizhuo Wang & Lionel M. Ni & Heung-Yeung Shum, 2022. "Quant 4.0: Engineering Quantitative Investment with Automated, Explainable and Knowledge-driven Artificial Intelligence," Papers 2301.04020, arXiv.org.
    13. Georgios Antonios Sarantitis & Theophilos Papadimitriou & Periklis Gogas, 2018. "A Network Analysis of the United Kingdom’s Consumer Price Index," Computational Economics, Springer;Society for Computational Economics, vol. 51(2), pages 173-193, February.
    14. Thanos Konstantinidis & Giorgos Iacovides & Mingxue Xu & Tony G. Constantinides & Danilo Mandic, 2024. "FinLlama: Financial Sentiment Classification for Algorithmic Trading Applications," Papers 2403.12285, arXiv.org.
    15. Li, Da-Ye & Nishimura, Yusaku & Men, Ming, 2014. "Fractal markets: Liquidity and investors on different time horizons," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 407(C), pages 144-151.
    16. Sun, Andrew & Lachanski, Michael & Fabozzi, Frank J., 2016. "Trade the tweet: Social media text mining and sparse matrix factorization for stock market prediction," International Review of Financial Analysis, Elsevier, vol. 48(C), pages 272-281.
    17. An, Suwei, 2023. "Essays on incentive contracts, M&As, and firm risk," Other publications TiSEM dd97d2f5-1c9d-47c5-ba62-f, Tilburg University, School of Economics and Management.
    18. Yuze Lu & Hailong Zhang & Qiwen Guo, 2023. "Stock and market index prediction using Informer network," Papers 2305.14382, arXiv.org.
    19. Jin, Xiaoye, 2021. "What do we know about the popularity of technical analysis in foreign exchange markets? A skewness preference perspective," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 71(C).
    20. Výrost, Tomáš & Lyócsa, Štefan & Baumöhl, Eduard, 2015. "Granger causality stock market networks: Temporal proximity and preferential attachment," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 427(C), pages 262-276.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2308.04947. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.