IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2405.11730.html

Degree of Irrationality: Sentiment and Implied Volatility Surface

Author

Listed:
  • Jiahao Weng
  • Yan Xie

Abstract

In this study, we constructed daily high-frequency sentiment data and used the VAR method to attempt to predict the next day's implied volatility surface. We utilized 630,000 text data entries from the East Money Stock Forum from 2014 to 2023 and employed deep learning methods such as BERT and LSTM to build daily market sentiment indicators. By applying FFT and EMD methods for sentiment decomposition, we found that high-frequency sentiment had a stronger correlation with at-the-money (ATM) options' implied volatility, while low-frequency sentiment was more strongly correlated with deep out-of-the-money (DOTM) options' implied volatility. Further analysis revealed that the shape of the implied volatility surface contains richer market sentiment information beyond just market panic. We demonstrated that incorporating this sentiment information can improve the accuracy of implied volatility surface predictions.

Suggested Citation

  • Jiahao Weng & Yan Xie, 2024. "Degree of Irrationality: Sentiment and Implied Volatility Surface," Papers 2405.11730, arXiv.org.
    • Handle: RePEc:arx:papers:2405.11730
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2405.11730
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Malcolm Baker & Jeffrey Wurgler, 2007. "Investor Sentiment in the Stock Market," Journal of Economic Perspectives, American Economic Association, vol. 21(2), pages 129-152, Spring.
    2. Thomas Dierckx & Jesse Davis & Wim Schoutens, 2020. "Using Machine Learning and Alternative Data to Predict Movements in Market Risk," Papers 2009.07947, arXiv.org.
    3. Fulvio Corsi, 2009. "A Simple Approximate Long-Memory Model of Realized Volatility," Journal of Financial Econometrics, Oxford University Press, vol. 7(2), pages 174-196, Spring.
    4. Rama Cont & Jose da Fonseca, 2002. "Dynamics of implied volatility surfaces," Quantitative Finance, Taylor & Francis Journals, vol. 2(1), pages 45-60.
    5. Bates, David S, 1991. "The Crash of '87: Was It Expected? The Evidence from Options Markets," Journal of Finance, American Finance Association, vol. 46(3), pages 1009-1044, July.
    6. Seo, Sung Won & Kim, Jun Sik, 2015. "The information content of option-implied information for volatility forecasting with investor sentiment," Journal of Banking & Finance, Elsevier, vol. 50(C), pages 106-120.
    7. Black, Fischer & Scholes, Myron S, 1972. "The Valuation of Option Contracts and a Test of Market Efficiency," Journal of Finance, American Finance Association, vol. 27(2), pages 399-417, May.
    8. Pan, Jun, 2002. "The jump-risk premia implicit in options: evidence from an integrated time-series study," Journal of Financial Economics, Elsevier, vol. 63(1), pages 3-50, January.
    9. Byun, Suk Joon & Kim, Jun Sik, 2013. "The information content of risk-neutral skewness for volatility forecasting," Journal of Empirical Finance, Elsevier, vol. 23(C), pages 142-161.
    10. Rubinstein, Mark, 1985. "Nonparametric Tests of Alternative Option Pricing Models Using All Reported Trades and Quotes on the 30 Most Active CBOE Option Classes from August 23, 1976 through August 31, 1978," Journal of Finance, American Finance Association, vol. 40(2), pages 455-480, June.
    11. Yan, Shu, 2011. "Jump risk, stock returns, and slope of implied volatility smile," Journal of Financial Economics, Elsevier, vol. 99(1), pages 216-233, January.
    12. Tim Loughran & Bill Mcdonald, 2011. "When Is a Liability Not a Liability? Textual Analysis, Dictionaries, and 10‐Ks," Journal of Finance, American Finance Association, vol. 66(1), pages 35-65, February.
    13. Sílvia Gonçalves & Massimo Guidolin, 2006. "Predictable Dynamics in the S&P 500 Index Options Implied Volatility Surface," The Journal of Business, University of Chicago Press, vol. 79(3), pages 1591-1636, May.
    14. Malcolm Baker & Jeffrey Wurgler, 2006. "Investor Sentiment and the Cross‐Section of Stock Returns," Journal of Finance, American Finance Association, vol. 61(4), pages 1645-1680, August.
    15. Chen, Ding & Guo, Biao & Zhou, Guofu, 2023. "Firm fundamentals and the cross-section of implied volatility shapes," Journal of Financial Markets, Elsevier, vol. 63(C).
    16. Latane, Henry A & Rendleman, Richard J, Jr, 1976. "Standard Deviations of Stock Price Ratios Implied in Option Prices," Journal of Finance, American Finance Association, vol. 31(2), pages 369-381, May.
    17. Bing Han, 2008. "Investor Sentiment and Option Prices," The Review of Financial Studies, Society for Financial Studies, vol. 21(1), pages 387-414, January.
    18. repec:bla:jfinan:v:53:y:1998:i:6:p:2059-2106 is not listed on IDEAS
    19. Bing Han & Gang Li, 2021. "Information Content of Aggregate Implied Volatility Spread," Management Science, INFORMS, vol. 67(2), pages 1249-1269, February.
    20. Nikita Medvedev & Zhiguang Wang, 2022. "Multistep forecast of the implied volatility surface using deep learning," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 42(4), pages 645-667, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Seo, Sung Won & Kim, Jun Sik, 2015. "The information content of option-implied information for volatility forecasting with investor sentiment," Journal of Banking & Finance, Elsevier, vol. 50(C), pages 106-120.
    2. Yue, Tian & Li, Lu-Lu & Ruan, Xinfeng & Zhang, Jin E., 2024. "Smirking in the energy market: Evidence from the Chinese crude oil options market," International Review of Financial Analysis, Elsevier, vol. 96(PA).
    3. Andreou, Panayiotis C. & Charalambous, Chris & Martzoukos, Spiros H., 2008. "Pricing and trading European options by combining artificial neural networks and parametric models with implied parameters," European Journal of Operational Research, Elsevier, vol. 185(3), pages 1415-1433, March.
    4. Yu, Junhong & Ruan, Xinfeng & Fan, Zheqi, 2025. "Merton (1976) implied jump," Journal of Economic Dynamics and Control, Elsevier, vol. 180(C).
    5. Michael Lemmon & Sophie Xiaoyan Ni, 2014. "Differences in Trading and Pricing Between Stock and Index Options," Management Science, INFORMS, vol. 60(8), pages 1985-2001, August.
    6. Sapkota, Niranjan, 2022. "News-based sentiment and bitcoin volatility," International Review of Financial Analysis, Elsevier, vol. 82(C).
    7. Maung, Kenwin & Swanson, Norman R., 2025. "A survey of models and methods used for forecasting when investing in financial markets," International Journal of Forecasting, Elsevier, vol. 41(4), pages 1355-1382.
    8. Yue, Tian & Gehricke, Sebastian A. & Zhang, Jin E. & Pan, Zheyao, 2021. "The implied volatility smirk in the Chinese equity options market," Pacific-Basin Finance Journal, Elsevier, vol. 69(C).
    9. David S. Bates, 1995. "Testing Option Pricing Models," NBER Working Papers 5129, National Bureau of Economic Research, Inc.
    10. D. Schneller & S. Heiden & M. Heiden & A. Hamid, 2018. "Home is Where You Know Your Volatility – Local Investor Sentiment and Stock Market Volatility," German Economic Review, Verein für Socialpolitik, vol. 19(2), pages 209-236, May.
    11. Chin‐Ho Chen, 2021. "Investor sentiment, misreaction, and the skewness‐return relationship," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 41(9), pages 1427-1455, September.
    12. Enmao Liu & Cong Sui, 2026. "Does Sentiment Measured Through Language Models Encompass a Broader Expanse of Information From the Options Market?," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 46(3), pages 489-510, March.
    13. Ma, Feng & Wahab, M.I.M. & Zhang, Yaojie, 2019. "Forecasting the U.S. stock volatility: An aligned jump index from G7 stock markets," Pacific-Basin Finance Journal, Elsevier, vol. 54(C), pages 132-146.
    14. Ging-Ginq Pan & Yung-Ming Shiu & Tu-Cheng Wu, 2025. "Time-varying predictability of TAIEX volatility," Review of Derivatives Research, Springer, vol. 28(2), pages 1-28, July.
    15. Liu, Qing & Wang, Shouyang & Sui, Cong, 2023. "Risk appetite and option prices: Evidence from the Chinese SSE50 options market," International Review of Financial Analysis, Elsevier, vol. 86(C).
    16. Dutta, Anupam & Sihvonen, Jukka & Park, Donghyun & Lucey, Brian & Uddin, Gazi Salah, 2025. "Impact of news and social media sentiments on rare earth investments," Resources Policy, Elsevier, vol. 107(C).
    17. Nader Mahmoudi & Łukasz P. Olech & Paul Docherty, 2022. "A comprehensive study of domain-specific emoji meanings in sentiment classification," Computational Management Science, Springer, vol. 19(2), pages 159-197, June.
    18. Panayiotis Andreou & Chris Charalambous & Spiros Martzoukos, 2006. "Robust Artificial Neural Networks for Pricing of European Options," Computational Economics, Springer;Society for Computational Economics, vol. 27(2), pages 329-351, May.
    19. Gao, Xiang & Koedijk, Kees & Walther, Thomas & Wang, Zhan, 2022. "Relative Investor Sentiment Measurement," CEPR Discussion Papers 17370, Centre for Economic Policy Research.
    20. Christoffersen, Peter & Jacobs, Kris & Chang, Bo Young, 2013. "Forecasting with Option-Implied Information," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 581-656, Elsevier.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2405.11730. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.