IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2003.08137.html
   My bibliography  Save this paper

A Novel Twitter Sentiment Analysis Model with Baseline Correlation for Financial Market Prediction with Improved Efficiency

Author

Listed:
  • Xinyi Guo
  • Jinfeng Li

Abstract

A novel social networks sentiment analysis model is proposed based on Twitter sentiment score (TSS) for real-time prediction of the future stock market price FTSE 100, as compared with conventional econometric models of investor sentiment based on closed-end fund discount (CEFD). The proposed TSS model features a new baseline correlation approach, which not only exhibits a decent prediction accuracy, but also reduces the computation burden and enables a fast decision making without the knowledge of historical data. Polynomial regression, classification modelling and lexicon-based sentiment analysis are performed using R. The obtained TSS predicts the future stock market trend in advance by 15 time samples (30 working hours) with an accuracy of 67.22% using the proposed baseline criterion without referring to historical TSS or market data. Specifically, TSS's prediction performance of an upward market is found far better than that of a downward market. Under the logistic regression and linear discriminant analysis, the accuracy of TSS in predicting the upward trend of the future market achieves 97.87%.

Suggested Citation

  • Xinyi Guo & Jinfeng Li, 2020. "A Novel Twitter Sentiment Analysis Model with Baseline Correlation for Financial Market Prediction with Improved Efficiency," Papers 2003.08137, arXiv.org, revised Apr 2020.
  • Handle: RePEc:arx:papers:2003.08137
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2003.08137
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Gordon Gemmill & Dylan C. Thomas, 2002. "Noise Trading, Costly Arbitrage, and Asset Prices: Evidence from Closed‐end Funds," Journal of Finance, American Finance Association, vol. 57(6), pages 2571-2594, December.
    2. Chopra, Navin, et al, 1993. "Yes, Discounts on Closed-End Funds Are a Sentiment Index," Journal of Finance, American Finance Association, vol. 48(2), pages 801-808, June.
    3. Zweig, Martin E, 1973. "An Investor Expectations Stock Price Predictive Model Using Closed-End Fund Premiums," Journal of Finance, American Finance Association, vol. 28(1), pages 67-78, March.
    4. Lee, Charles M C & Shleifer, Andrei & Thaler, Richard H, 1991. "Investor Sentiment and the Closed-End Fund Puzzle," Journal of Finance, American Finance Association, vol. 46(1), pages 75-109, March.
    5. Lee, Charles & Shleifer, Andrei & Thaler, Richard H, 1990. "Anomalies: Closed-End Mutual Funds," Scholarly Articles 33077904, Harvard University Department of Economics.
    6. Lee, Charles M C & Shleifer, Andrei & Thaler, Richard H, 1990. "Closed-End Mutual Funds," Journal of Economic Perspectives, American Economic Association, vol. 4(4), pages 153-164, Fall.
    7. Chopra, Navin, et al,, 1993. "Yes, Discounts on Closed-End Funds Are a Sentiment Index: Summing Up," Journal of Finance, American Finance Association, vol. 48(2), pages 811-812, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gao, Lin & Süss, Stephan, 2015. "Market sentiment in commodity futures returns," Journal of Empirical Finance, Elsevier, vol. 33(C), pages 84-103.
    2. Stylianos X. Koufadakis, 2015. "Asymmetries on Closed End Country Funds Premium and Monetary Policy Announcements: An Approach Trough the Perspective of Foreign Countries," SPOUDAI Journal of Economics and Business, SPOUDAI Journal of Economics and Business, University of Piraeus, vol. 65(3-4), pages 29-65, july-Dece.
    3. Seth Anderson & T. Randolph Beard & Hyeongwoo Kim & Liliana V. Stern, 2016. "The Short-Run Pricing Behavior of Closed-End Funds: Bond vs. Equity Funds," Journal of Financial Services Research, Springer;Western Finance Association, vol. 50(3), pages 363-386, December.
    4. Nazif Durmaz & Hyeongwoo Kim & Hyejin Lee & Yanfei Sun, 2023. "Trend Breaks and the Persistence of Closed-End Fund Discounts," Auburn Economics Working Paper Series auwp2023-08, Department of Economics, Auburn University.
    5. Nazif Durmaz & Hyeongwoo Kim & Hyejin Lee & Yanfei Sun, 2023. "Trend Breaks and the Persistence of Closed-End Mutual Fund Discounts," Auburn Economics Working Paper Series auwp2023-03, Department of Economics, Auburn University.
    6. Lenkey, Stephen L., 2015. "The closed-end fund puzzle: Management fees and private information," Journal of Financial Intermediation, Elsevier, vol. 24(1), pages 112-129.
    7. Tarun Ramadorai, 2012. "The Secondary Market for Hedge Funds and the Closed Hedge Fund Premium," Journal of Finance, American Finance Association, vol. 67(2), pages 479-512, April.
    8. Halkos, George, 2005. "Determining empirically behavioral and fundamental factors of discounts on closed end funds," MPRA Paper 49280, University Library of Munich, Germany.
    9. Stylianos X. Koufadakis, 2016. "Mispricing Explanations of Closed-End Funds: A Survey Review," SPOUDAI Journal of Economics and Business, SPOUDAI Journal of Economics and Business, University of Piraeus, vol. 66(1-2), pages 108-135, January-J.
    10. Flynn, Sean Masaki, 2012. "Noise-trading, costly arbitrage, and asset prices: Evidence from US closed-end funds," Journal of Financial Markets, Elsevier, vol. 15(1), pages 108-125.
    11. Jonathan Berk & Richard Stanton, 2004. "A Rational Model of the Closed-End Fund Discount," NBER Working Papers 10412, National Bureau of Economic Research, Inc.
    12. Frankel, Jeffrey A & Schmukler, Sergio L, 2000. "Country Funds and Asymmetric Information," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 5(3), pages 177-195, July.
    13. Delcoure, Natalya & Zhong, Maosen, 2007. "On the premiums of iShares," Journal of Empirical Finance, Elsevier, vol. 14(2), pages 168-195, March.
    14. Elton, Edwin J. & Gruber, Martin J., 2013. "Mutual Funds," Handbook of the Economics of Finance, in: G.M. Constantinides & M. Harris & R. M. Stulz (ed.), Handbook of the Economics of Finance, volume 2, chapter 0, pages 1011-1061, Elsevier.
    15. Flynn, Sean Masaki, 2004. "Arbitrage in Closed-end Funds: New Evidence," Vassar College Department of Economics Working Paper Series 57, Vassar College Department of Economics.
    16. Wermers, Russ & Wu, Youchang & Zechner, Josef, 2006. "Portfolio performance, discount dynamics, and the turnover of closed-end fund managers," CFR Working Papers 06-12, University of Cologne, Centre for Financial Research (CFR).
    17. Deven Bathia & Don Bredin, 2013. "An examination of investor sentiment effect on G7 stock market returns," The European Journal of Finance, Taylor & Francis Journals, vol. 19(9), pages 909-937, October.
    18. Jullavut Kittiakarasakun & Lalatendu Misra & Sinan Yildirim, 2018. "An analysis of closed-end funds discounts viewed from a lack of redemption perspective," Review of Quantitative Finance and Accounting, Springer, vol. 50(2), pages 415-440, February.
    19. Ming-Shiun Pan & Kam C. Chan & David J. Wright, 2001. "Divergent Expectations And The Asian Financial Crisis Of 1997," Journal of Financial Research, Southern Finance Association;Southwestern Finance Association, vol. 24(2), pages 219-238, June.
    20. Karan Bhanot & Valeria Martinez & Lalatendu Misra & Jullavut Kittiakaraskun & Sinan Yildirim, 2008. "The behavior of discounts of closed-end funds undergoing open-ending," Working Papers 0092, College of Business, University of Texas at San Antonio.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2003.08137. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.