IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2405.11730.html

Degree of Irrationality: Sentiment and Implied Volatility Surface

Author

Listed:
  • Jiahao Weng
  • Yan Xie

Abstract

In this study, we constructed daily high-frequency sentiment data and used the VAR method to attempt to predict the next day's implied volatility surface. We utilized 630,000 text data entries from the East Money Stock Forum from 2014 to 2023 and employed deep learning methods such as BERT and LSTM to build daily market sentiment indicators. By applying FFT and EMD methods for sentiment decomposition, we found that high-frequency sentiment had a stronger correlation with at-the-money (ATM) options' implied volatility, while low-frequency sentiment was more strongly correlated with deep out-of-the-money (DOTM) options' implied volatility. Further analysis revealed that the shape of the implied volatility surface contains richer market sentiment information beyond just market panic. We demonstrated that incorporating this sentiment information can improve the accuracy of implied volatility surface predictions.

Suggested Citation

  • Jiahao Weng & Yan Xie, 2024. "Degree of Irrationality: Sentiment and Implied Volatility Surface," Papers 2405.11730, arXiv.org.
    • Handle: RePEc:arx:papers:2405.11730
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2405.11730
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Malcolm Baker & Jeffrey Wurgler, 2007. "Investor Sentiment in the Stock Market," Journal of Economic Perspectives, American Economic Association, vol. 21(2), pages 129-152, Spring.
    2. Thomas Dierckx & Jesse Davis & Wim Schoutens, 2020. "Using Machine Learning and Alternative Data to Predict Movements in Market Risk," Papers 2009.07947, arXiv.org.
    3. Fulvio Corsi, 2009. "A Simple Approximate Long-Memory Model of Realized Volatility," Journal of Financial Econometrics, Oxford University Press, vol. 7(2), pages 174-196, Spring.
    4. Rama Cont & Jose da Fonseca, 2002. "Dynamics of implied volatility surfaces," Quantitative Finance, Taylor & Francis Journals, vol. 2(1), pages 45-60.
    5. Seo, Sung Won & Kim, Jun Sik, 2015. "The information content of option-implied information for volatility forecasting with investor sentiment," Journal of Banking & Finance, Elsevier, vol. 50(C), pages 106-120.
    6. Black, Fischer & Scholes, Myron S, 1972. "The Valuation of Option Contracts and a Test of Market Efficiency," Journal of Finance, American Finance Association, vol. 27(2), pages 399-417, May.
    7. Pan, Jun, 2002. "The jump-risk premia implicit in options: evidence from an integrated time-series study," Journal of Financial Economics, Elsevier, vol. 63(1), pages 3-50, January.
    8. Byun, Suk Joon & Kim, Jun Sik, 2013. "The information content of risk-neutral skewness for volatility forecasting," Journal of Empirical Finance, Elsevier, vol. 23(C), pages 142-161.
    9. Yan, Shu, 2011. "Jump risk, stock returns, and slope of implied volatility smile," Journal of Financial Economics, Elsevier, vol. 99(1), pages 216-233, January.
    10. Tim Loughran & Bill Mcdonald, 2011. "When Is a Liability Not a Liability? Textual Analysis, Dictionaries, and 10‐Ks," Journal of Finance, American Finance Association, vol. 66(1), pages 35-65, February.
    11. Sílvia Gonçalves & Massimo Guidolin, 2006. "Predictable Dynamics in the S&P 500 Index Options Implied Volatility Surface," The Journal of Business, University of Chicago Press, vol. 79(3), pages 1591-1636, May.
    12. Malcolm Baker & Jeffrey Wurgler, 2006. "Investor Sentiment and the Cross‐Section of Stock Returns," Journal of Finance, American Finance Association, vol. 61(4), pages 1645-1680, August.
    13. Chen, Ding & Guo, Biao & Zhou, Guofu, 2023. "Firm fundamentals and the cross-section of implied volatility shapes," Journal of Financial Markets, Elsevier, vol. 63(C).
    14. Latane, Henry A & Rendleman, Richard J, Jr, 1976. "Standard Deviations of Stock Price Ratios Implied in Option Prices," Journal of Finance, American Finance Association, vol. 31(2), pages 369-381, May.
    15. Bing Han, 2008. "Investor Sentiment and Option Prices," The Review of Financial Studies, Society for Financial Studies, vol. 21(1), pages 387-414, January.
    16. repec:bla:jfinan:v:53:y:1998:i:6:p:2059-2106 is not listed on IDEAS
    17. Bing Han & Gang Li, 2021. "Information Content of Aggregate Implied Volatility Spread," Management Science, INFORMS, vol. 67(2), pages 1249-1269, February.
    18. Nikita Medvedev & Zhiguang Wang, 2022. "Multistep forecast of the implied volatility surface using deep learning," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 42(4), pages 645-667, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Seo, Sung Won & Kim, Jun Sik, 2015. "The information content of option-implied information for volatility forecasting with investor sentiment," Journal of Banking & Finance, Elsevier, vol. 50(C), pages 106-120.
    2. Sapkota, Niranjan, 2022. "News-based sentiment and bitcoin volatility," International Review of Financial Analysis, Elsevier, vol. 82(C).
    3. Maung, Kenwin & Swanson, Norman R., 2025. "A survey of models and methods used for forecasting when investing in financial markets," International Journal of Forecasting, Elsevier, vol. 41(4), pages 1355-1382.
    4. D. Schneller & S. Heiden & M. Heiden & A. Hamid, 2018. "Home is Where You Know Your Volatility – Local Investor Sentiment and Stock Market Volatility," German Economic Review, Verein für Socialpolitik, vol. 19(2), pages 209-236, May.
    5. Ma, Feng & Wahab, M.I.M. & Zhang, Yaojie, 2019. "Forecasting the U.S. stock volatility: An aligned jump index from G7 stock markets," Pacific-Basin Finance Journal, Elsevier, vol. 54(C), pages 132-146.
    6. Liu, Qing & Wang, Shouyang & Sui, Cong, 2023. "Risk appetite and option prices: Evidence from the Chinese SSE50 options market," International Review of Financial Analysis, Elsevier, vol. 86(C).
    7. Dutta, Anupam & Sihvonen, Jukka & Park, Donghyun & Lucey, Brian & Uddin, Gazi Salah, 2025. "Impact of news and social media sentiments on rare earth investments," Resources Policy, Elsevier, vol. 107(C).
    8. Yu, Junhong & Ruan, Xinfeng & Fan, Zheqi, 2025. "Merton (1976) implied jump," Journal of Economic Dynamics and Control, Elsevier, vol. 180(C).
    9. Nader Mahmoudi & Łukasz P. Olech & Paul Docherty, 2022. "A comprehensive study of domain-specific emoji meanings in sentiment classification," Computational Management Science, Springer, vol. 19(2), pages 159-197, June.
    10. Gao, Xiang & Koedijk, Kees & Walther, Thomas & Wang, Zhan, 2022. "Relative Investor Sentiment Measurement," CEPR Discussion Papers 17370, C.E.P.R. Discussion Papers.
    11. Michael Lemmon & Sophie Xiaoyan Ni, 2014. "Differences in Trading and Pricing Between Stock and Index Options," Management Science, INFORMS, vol. 60(8), pages 1985-2001, August.
    12. Aït-Sahalia, Yacine & Li, Chenxu & Li, Chen Xu, 2021. "Closed-form implied volatility surfaces for stochastic volatility models with jumps," Journal of Econometrics, Elsevier, vol. 222(1), pages 364-392.
    13. Chen, Cathy Yi-Hsuan & Fengler, Matthias R. & Härdle, Wolfgang Karl & Liu, Yanchu, 2022. "Media-expressed tone, option characteristics, and stock return predictability," Journal of Economic Dynamics and Control, Elsevier, vol. 134(C).
    14. Lachana, Ioanna & Schröder, David, 2025. "Investor sentiment and stock returns: Wisdom of crowds or power of words? Evidence from Seeking Alpha and Wall Street Journal," Journal of Financial Markets, Elsevier, vol. 74(C).
    15. Yao Zheng & Eric Osmer, 2018. "The Relationship between Hedge Fund Performance and Stock Market Sentiment," Review of Pacific Basin Financial Markets and Policies (RPBFMP), World Scientific Publishing Co. Pte. Ltd., vol. 21(03), pages 1-29, September.
    16. Gao, Lin & Süss, Stephan, 2015. "Market sentiment in commodity futures returns," Journal of Empirical Finance, Elsevier, vol. 33(C), pages 84-103.
    17. Wei-han Liu, 2019. "National culture effects on stock market volatility level," Empirical Economics, Springer, vol. 57(4), pages 1229-1253, October.
    18. John Garcia, 2024. "Herding the crowds: how sentiment affects crowdsourced earnings estimates," Financial Markets and Portfolio Management, Springer;Swiss Society for Financial Market Research, vol. 38(3), pages 331-370, September.
    19. Al-Nasseri, Alya & Menla Ali, Faek & Tucker, Allan, 2021. "Investor sentiment and the dispersion of stock returns: Evidence based on the social network of investors," International Review of Financial Analysis, Elsevier, vol. 78(C).
    20. Wang, Wenzhao & Duxbury, Darren, 2021. "Institutional investor sentiment and the mean-variance relationship: Global evidence," Journal of Economic Behavior & Organization, Elsevier, vol. 191(C), pages 415-441.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2405.11730. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.