IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2009.07947.html
   My bibliography  Save this paper

Using Machine Learning and Alternative Data to Predict Movements in Market Risk

Author

Listed:
  • Thomas Dierckx
  • Jesse Davis
  • Wim Schoutens

Abstract

Using machine learning and alternative data for the prediction of financial markets has been a popular topic in recent years. Many financial variables such as stock price, historical volatility and trade volume have already been through extensive investigation. Remarkably, we found no existing research on the prediction of an asset's market implied volatility within this context. This forward-looking measure gauges the sentiment on the future volatility of an asset, and is deemed one of the most important parameters in the world of derivatives. The ability to predict this statistic may therefore provide a competitive edge to practitioners of market making and asset management alike. Consequently, in this paper we investigate Google News statistics and Wikipedia site traffic as alternative data sources to quantitative market data and consider Logistic Regression, Support Vector Machines and AdaBoost as machine learning models. We show that movements in market implied volatility can indeed be predicted through the help of machine learning techniques. Although the employed alternative data appears to not enhance predictive accuracy, we reveal preliminary evidence of non-linear relationships between features obtained from Wikipedia page traffic and movements in market implied volatility.

Suggested Citation

  • Thomas Dierckx & Jesse Davis & Wim Schoutens, 2020. "Using Machine Learning and Alternative Data to Predict Movements in Market Risk," Papers 2009.07947, arXiv.org.
  • Handle: RePEc:arx:papers:2009.07947
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2009.07947
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Heba Ali, 2018. "Twitter, Investor Sentiment and Capital Markets: What Do We Know?," International Journal of Economics and Finance, Canadian Center of Science and Education, vol. 10(8), pages 158-158, August.
    2. Malcolm Baker & Jeffrey Wurgler, 2006. "Investor Sentiment and the Cross‐Section of Stock Returns," Journal of Finance, American Finance Association, vol. 61(4), pages 1645-1680, August.
    3. Chang, Eric C. & Cheng, Joseph W. & Khorana, Ajay, 2000. "An examination of herd behavior in equity markets: An international perspective," Journal of Banking & Finance, Elsevier, vol. 24(10), pages 1651-1679, October.
    4. Sanjiv R. Das & Mike Y. Chen, 2007. "Yahoo! for Amazon: Sentiment Extraction from Small Talk on the Web," Management Science, INFORMS, vol. 53(9), pages 1375-1388, September.
    5. Zoran Ivkovi & Scott Weisbenner, 2007. "Information Diffusion Effects in Individual Investors' Common Stock Purchases: Covet Thy Neighbors' Investment Choices," The Review of Financial Studies, Society for Financial Studies, vol. 20(4), pages 1327-1357.
    6. Xi Zhang & Yixuan Li & Senzhang Wang & Binxing Fang & Philip S. Yu, 2018. "Enhancing Stock Market Prediction with Extended Coupled Hidden Markov Model over Multi-Sourced Data," Papers 1809.00306, arXiv.org.
    7. Panagiotis Papaioannnou & Lucia Russo & George Papaioannou & Constantinos Siettos, 2013. "Can social microblogging be used to forecast intraday exchange rates?," Papers 1310.5306, arXiv.org.
    8. Lily Fang & Joel Peress, 2009. "Media Coverage and the Cross‐section of Stock Returns," Journal of Finance, American Finance Association, vol. 64(5), pages 2023-2052, October.
    9. Scharfstein, David S & Stein, Jeremy C, 1990. "Herd Behavior and Investment," American Economic Review, American Economic Association, vol. 80(3), pages 465-479, June.
    10. Panagiotis Papaioannou & Lucia Russo & George Papaioannou & Constantinos Siettos, 2013. "Can social microblogging be used to forecast intraday exchange rates?," Netnomics, Springer, vol. 14(1), pages 47-68, November.
    11. Gabriele Ranco & Darko Aleksovski & Guido Caldarelli & Miha Grčar & Igor Mozetič, 2015. "The Effects of Twitter Sentiment on Stock Price Returns," PLOS ONE, Public Library of Science, vol. 10(9), pages 1-21, September.
    12. Hailiang Chen & Prabuddha De & Yu (Jeffrey) Hu & Byoung-Hyoun Hwang, 2014. "Wisdom of Crowds: The Value of Stock Opinions Transmitted Through Social Media," The Review of Financial Studies, Society for Financial Studies, vol. 27(5), pages 1367-1403.
    13. Ehsan Hoseinzade & Saman Haratizadeh, 2018. "CNNPred: CNN-based stock market prediction using several data sources," Papers 1810.08923, arXiv.org.
    14. Francesco Corea & Enrico Maria Cervellati, 2015. "The Power of Micro-Blogging: How to Use Twitter for Predicting the Stock Market," Eurasian Journal of Economics and Finance, Eurasian Publications, vol. 3(4), pages 1-7.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Matthew F. Dixon & Nicholas G. Polson & Kemen Goicoechea, 2022. "Deep Partial Least Squares for Empirical Asset Pricing," Papers 2206.10014, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Agarwal, Shweta & Kumar, Shailendra & Goel, Utkarsh, 2019. "Stock market response to information diffusion through internet sources: A literature review," International Journal of Information Management, Elsevier, vol. 45(C), pages 118-131.
    2. Renault, Thomas, 2017. "Intraday online investor sentiment and return patterns in the U.S. stock market," Journal of Banking & Finance, Elsevier, vol. 84(C), pages 25-40.
    3. Michael S. Drake & Jacob R. Thornock & Brady J. Twedt, 2017. "The internet as an information intermediary," Review of Accounting Studies, Springer, vol. 22(2), pages 543-576, June.
    4. Enwei Zhu & Jing Wu & Hongyu Liu & Keyang Li, 2023. "A Sentiment Index of the Housing Market in China: Text Mining of Narratives on Social Media," The Journal of Real Estate Finance and Economics, Springer, vol. 66(1), pages 77-118, January.
    5. Rui Fan & Oleksandr Talavera & Vu Tran, 2020. "Social media bots and stock markets," European Financial Management, European Financial Management Association, vol. 26(3), pages 753-777, June.
    6. Zhang, Yongjie & An, Yahui & Feng, Xu & Jin, Xi, 2017. "Celebrities and ordinaries in social networks: Who knows more information?," Finance Research Letters, Elsevier, vol. 20(C), pages 153-161.
    7. Fang, Hao & Chung, Chien-Ping & Lu, Yang-Cheng & Lee, Yen-Hsien & Wang, Wen-Hao, 2021. "The impacts of investors' sentiments on stock returns using fintech approaches," International Review of Financial Analysis, Elsevier, vol. 77(C).
    8. Chen, Cathy Yi-Hsuan & Fengler, Matthias R. & Härdle, Wolfgang Karl & Liu, Yanchu, 2022. "Media-expressed tone, option characteristics, and stock return predictability," Journal of Economic Dynamics and Control, Elsevier, vol. 134(C).
    9. He, Xue-Zhong & Li, Kai & Santi, Caterina & Shi, Lei, 2022. "Social interaction, volatility clustering, and momentum," Journal of Economic Behavior & Organization, Elsevier, vol. 203(C), pages 125-149.
    10. Marlene Amstad & Leonardo Gambacorta & Chao He & Dora Xia, 2021. "Trade sentiment and the stock market: new evidence based on big data textual analysis of Chinese media," BIS Working Papers 917, Bank for International Settlements.
    11. Klein, Arne C., 2013. "Time-variations in herding behavior: Evidence from a Markov switching SUR model," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 26(C), pages 291-304.
    12. Lixing Mei & Yulei Rao & Mei Wang & Jianxin Wang, 2019. "Do investors post messages differently from mobile devices? The correlation between mobile Internet messages posting and stock returns," International Review of Economics, Springer;Happiness Economics and Interpersonal Relations (HEIRS), vol. 66(4), pages 423-452, December.
    13. Ahmad, Khurshid & Han, JingGuang & Hutson, Elaine & Kearney, Colm & Liu, Sha, 2016. "Media-expressed negative tone and firm-level stock returns," Journal of Corporate Finance, Elsevier, vol. 37(C), pages 152-172.
    14. Li, Wei & Rhee, Ghon & Wang, Steven Shuye, 2017. "Differences in herding: Individual vs. institutional investors," Pacific-Basin Finance Journal, Elsevier, vol. 45(C), pages 174-185.
    15. Abdi, Farshid & Kormanyos, Emily & Pelizzon, Loriana & Getmansky, Mila & Simon, Zorka, 2021. "Market impact of government communication: The case of presidential tweets," SAFE Working Paper Series 314, Leibniz Institute for Financial Research SAFE, revised 2021.
    16. Arjoon, Vaalmikki & Bhatnagar, Chandra Shekhar, 2017. "Dynamic herding analysis in a frontier market," Research in International Business and Finance, Elsevier, vol. 42(C), pages 496-508.
    17. Jia, Boxiang & Shen, Dehua & Zhang, Wei, 2022. "Extreme sentiment and herding: Evidence from the cryptocurrency market," Research in International Business and Finance, Elsevier, vol. 63(C).
    18. Mahmoudi, Nader & Docherty, Paul & Melia, Adrian, 2022. "Firm-level investor sentiment and corporate announcement returns," Journal of Banking & Finance, Elsevier, vol. 144(C).
    19. Klaus, Jürgen & Koser, Christoph, 2021. "Measuring Trump: The Volfefe Index and its impact on European financial markets," Finance Research Letters, Elsevier, vol. 38(C).
    20. Bekiros, Stelios & Jlassi, Mouna & Lucey, Brian & Naoui, Kamel & Uddin, Gazi Salah, 2017. "Herding behavior, market sentiment and volatility: Will the bubble resume?," The North American Journal of Economics and Finance, Elsevier, vol. 42(C), pages 107-131.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2009.07947. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.