IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1212.1037.html
   My bibliography  Save this paper

Modeling Movements in Oil, Gold, Forex and Market Indices using Search Volume Index and Twitter Sentiments

Author

Listed:
  • Tushar Rao

    (NSIT-Delhi)

  • Saket Srivastava

    (IIIT-Delhi)

Abstract

Study of the forecasting models using large scale microblog discussions and the search behavior data can provide a good insight for better understanding the market movements. In this work we collected a dataset of 2 million tweets and search volume index (SVI from Google) for a period of June 2010 to September 2011. We perform a study over a set of comprehensive causative relationships and developed a unified approach to a model for various market securities like equity (Dow Jones Industrial Average-DJIA and NASDAQ-100), commodity markets (oil and gold) and Euro Forex rates. We also investigate the lagged and statistically causative relations of Twitter sentiments developed during active trading days and market inactive days in combination with the search behavior of public before any change in the prices/ indices. Our results show extent of lagged significance with high correlation value upto 0.82 between search volumes and gold price in USD. We find weekly accuracy in direction (up and down prediction) uptil 94.3% for DJIA and 90% for NASDAQ-100 with significant reduction in mean average percentage error for all the forecasting models.

Suggested Citation

  • Tushar Rao & Saket Srivastava, 2012. "Modeling Movements in Oil, Gold, Forex and Market Indices using Search Volume Index and Twitter Sentiments," Papers 1212.1037, arXiv.org.
    • Handle: RePEc:arx:papers:1212.1037
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/1212.1037
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Huina Mao & Scott Counts & Johan Bollen, 2011. "Predicting Financial Markets: Comparing Survey, News, Twitter and Search Engine Data," Papers 1112.1051, arXiv.org.
    2. Daniel Kahneman & Amos Tversky, 2013. "Prospect Theory: An Analysis of Decision Under Risk," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 6, pages 99-127, World Scientific Publishing Co. Pte. Ltd..
    3. Garman, Mark B & Klass, Michael J, 1980. "On the Estimation of Security Price Volatilities from Historical Data," The Journal of Business, University of Chicago Press, vol. 53(1), pages 67-78, January.
    4. Garth P. McCormick, 1969. "Communications to the Editor--Exponential Forecasting: Some New Variations," Management Science, INFORMS, vol. 15(5), pages 311-320, January.
    5. Paul C. Tetlock, 2007. "Giving Content to Investor Sentiment: The Role of Media in the Stock Market," Journal of Finance, American Finance Association, vol. 62(3), pages 1139-1168, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ji, Qiang & Guo, Jian-Feng, 2015. "Oil price volatility and oil-related events: An Internet concern study perspective," Applied Energy, Elsevier, vol. 137(C), pages 256-264.
    2. Leighton Vaughan Williams & J. James Reade, 2016. "Prediction Markets, Social Media and Information Efficiency," Kyklos, Wiley Blackwell, vol. 69(3), pages 518-556, August.
    3. Leighton Vaughan Williams & James Reade, 2014. "Prediction Markets, Twitter and Bigotgate," Economics Discussion Papers em-dp2014-09, Department of Economics, University of Reading.
    4. Ji, Qiang & Guo, Jian-Feng, 2015. "Market interdependence among commodity prices based on information transmission on the Internet," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 426(C), pages 35-44.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dirk Ulbricht & Konstantin A. Kholodilin & Tobias Thomas, 2017. "Do Media Data Help to Predict German Industrial Production?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 36(5), pages 483-496, August.
    2. Sapkota, Niranjan, 2022. "News-based sentiment and bitcoin volatility," International Review of Financial Analysis, Elsevier, vol. 82(C).
    3. Baur, Dirk G. & Smales, Lee A., 2020. "Hedging geopolitical risk with precious metals," Journal of Banking & Finance, Elsevier, vol. 117(C).
    4. Gric, Zuzana & Ehrenbergerova, Dominika & Hodula, Martin, 2022. "The power of sentiment: Irrational beliefs of households and consumer loan dynamics," Journal of Financial Stability, Elsevier, vol. 59(C).
    5. Shubhankar Mohapatra & Nauman Ahmed & Paulo Alencar, 2020. "KryptoOracle: A Real-Time Cryptocurrency Price Prediction Platform Using Twitter Sentiments," Papers 2003.04967, arXiv.org.
    6. Bianconi, Marcelo & Hua, Xiaxin & Tan, Chih Ming, 2015. "Determinants of systemic risk and information dissemination," International Review of Economics & Finance, Elsevier, vol. 38(C), pages 352-368.
    7. Ding, Rong & Hou, Wenxuan & Liu, Yue (Lucy) & Zhang, John Ziyang, 2018. "Media censorship and stock price: Evidence from the foreign share discount in China," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 55(C), pages 112-133.
    8. Abudy, Menachem (Meni) & Mugerman, Yevgeny & Shust, Efrat, 2022. "The Winner Takes It All: Investor Sentiment and the Eurovision Song Contest," Journal of Banking & Finance, Elsevier, vol. 137(C).
    9. Ben Sita, Bernard, 2017. "Volatility patterns of the constituents of FTSE100 in the aftermath of the U.K. Brexit referendum," Finance Research Letters, Elsevier, vol. 23(C), pages 137-146.
    10. Beattie, Vivien, 2014. "Accounting narratives and the narrative turn in accounting research: Issues, theory, methodology, methods and a research framework," The British Accounting Review, Elsevier, vol. 46(2), pages 111-134.
    11. Thierry Chauveau & Sylvain Friederich & Jérôme Héricourt & Emmanuel Jurczenko & Catherine Lubochinsky & Bertrand Maillet & Christophe Moussu & Bogdan Négréa & Hélène Raymond-Feingold, 2004. "La volatilité des marchés augmente-t-elle ?," Revue d'Économie Financière, Programme National Persée, vol. 74(1), pages 17-44.
    12. Gabriele Ranco & Darko Aleksovski & Guido Caldarelli & Miha Grčar & Igor Mozetič, 2015. "The Effects of Twitter Sentiment on Stock Price Returns," PLOS ONE, Public Library of Science, vol. 10(9), pages 1-21, September.
    13. Eric. W. K. See-To & Yang Yang, 2017. "Market sentiment dispersion and its effects on stock return and volatility," Electronic Markets, Springer;IIM University of St. Gallen, vol. 27(3), pages 283-296, August.
    14. Victor Chernozhukov & Wolfgang Härdle & Chen Huang & Weining Wang, 2018. "LASSO-driven inference in time and space," CeMMAP working papers CWP36/18, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    15. Ferreruela, Sandra & Mallor, Tania, 2021. "Herding in the bad times: The 2008 and COVID-19 crises," The North American Journal of Economics and Finance, Elsevier, vol. 58(C).
    16. Sushant Chari & Purva Hegde Desai & Nilesh Borde & Babu George, 2023. "Aggregate News Sentiment and Stock Market Returns in India," JRFM, MDPI, vol. 16(8), pages 1-18, August.
    17. Arcuri, Maria Cristina & Gandolfi, Gino & Russo, Ivan, 2023. "Does fake news impact stock returns? Evidence from US and EU stock markets," Journal of Economics and Business, Elsevier, vol. 125.
    18. Di, Li & Shaiban, Mohammed Sharaf & Hasanov, Akram Shavkatovich, 2021. "The power of investor sentiment in explaining bank stock performance: Listed conventional vs. Islamic banks," Pacific-Basin Finance Journal, Elsevier, vol. 66(C).
    19. Fernandez-Perez, Adrian & Fuertes, Ana-Maria & Gonzalez-Fernandez, Marcos & Miffre, Joelle, 2020. "Fear of hazards in commodity futures markets," Journal of Banking & Finance, Elsevier, vol. 119(C).
    20. Gabriele Ranco & Ilaria Bordino & Giacomo Bormetti & Guido Caldarelli & Fabrizio Lillo & Michele Treccani, 2014. "Coupling news sentiment with web browsing data improves prediction of intra-day price dynamics," Papers 1412.3948, arXiv.org, revised Dec 2015.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1212.1037. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.