IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2506.07928.html

Predicting Realized Variance Out of Sample: Can Anything Beat The Benchmark?

Author

Listed:
  • Austin Pollok

Abstract

The discrepancy between realized volatility and the market's view of volatility has been known to predict individual equity options at the monthly horizon. It is not clear how this predictability depends on a forecast's ability to predict firm-level volatility. We consider this phenomenon at the daily frequency using high-dimensional machine learning models, as well as low-dimensional factor models. We find that marginal improvements to standard forecast error measurements can lead to economically significant gains in portfolio performance. This makes a case for re-imagining the way we train models that are used to construct portfolios.

Suggested Citation

  • Austin Pollok, 2025. "Predicting Realized Variance Out of Sample: Can Anything Beat The Benchmark?," Papers 2506.07928, arXiv.org.
    • Handle: RePEc:arx:papers:2506.07928
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2506.07928
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Ait-Sahalia, Yacine & Wang, Yubo & Yared, Francis, 2001. "Do option markets correctly price the probabilities of movement of the underlying asset?," Journal of Econometrics, Elsevier, vol. 102(1), pages 67-110, May.
    2. Parkinson, Michael, 1980. "The Extreme Value Method for Estimating the Variance of the Rate of Return," The Journal of Business, University of Chicago Press, vol. 53(1), pages 61-65, January.
    3. Diebold, Francis X. & Shin, Minchul, 2019. "Machine learning for regularized survey forecast combination: Partially-egalitarian LASSO and its derivatives," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1679-1691.
    4. Mark Broadie & Mikhail Chernov & Michael Johannes, 2009. "Understanding Index Option Returns," The Review of Financial Studies, Society for Financial Studies, vol. 22(11), pages 4493-4529, November.
    5. Cao, Jie & Han, Bing, 2013. "Cross section of option returns and idiosyncratic stock volatility," Journal of Financial Economics, Elsevier, vol. 108(1), pages 231-249.
    6. Alex Chinco & Adam D. Clark‐Joseph & Mao Ye, 2019. "Sparse Signals in the Cross‐Section of Returns," Journal of Finance, American Finance Association, vol. 74(1), pages 449-492, February.
    7. Tarun Chordia & Amit Goyal & Alessio Saretto & Andrew KarolyiEditor, 2020. "Anomalies and False Rejections," Review of Finance, European Finance Association, vol. 33(5), pages 2134-2179.
    8. Fulvio Corsi, 2009. "A Simple Approximate Long-Memory Model of Realized Volatility," Journal of Financial Econometrics, Oxford University Press, vol. 7(2), pages 174-196, Spring.
    9. Tim Bollerslev & George Tauchen & Hao Zhou, 2009. "Expected Stock Returns and Variance Risk Premia," The Review of Financial Studies, Society for Financial Studies, vol. 22(11), pages 4463-4492, November.
    10. Brandt, Michael W. & Jones, Christopher S., 2006. "Volatility Forecasting With Range-Based EGARCH Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 24, pages 470-486, October.
    11. Nour Meddahi, 2002. "A theoretical comparison between integrated and realized volatility," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 17(5), pages 479-508.
    12. Tarun Chordia & Amit Goyal & Alessio Saretto, 2020. "Anomalies and False Rejections," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2134-2179.
    13. Andersen, Torben G & Bollerslev, Tim, 1998. "Answering the Skeptics: Yes, Standard Volatility Models Do Provide Accurate Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 885-905, November.
    14. Yang, Dennis & Zhang, Qiang, 2000. "Drift-Independent Volatility Estimation Based on High, Low, Open, and Close Prices," The Journal of Business, University of Chicago Press, vol. 73(3), pages 477-491, July.
    15. Dmitriy Muravyev, 2016. "Order Flow and Expected Option Returns," Journal of Finance, American Finance Association, vol. 71(2), pages 673-708, April.
    16. Carr, Peter & Wu, Liuren, 2017. "Leverage Effect, Volatility Feedback, and Self-Exciting Market Disruptions," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 52(5), pages 2119-2156, October.
    17. Peter Carr & Roger Lee, 2009. "Volatility Derivatives," Annual Review of Financial Economics, Annual Reviews, vol. 1(1), pages 319-339, November.
    18. Andersen, Torben G. & Bollerslev, Tim & Diebold, Francis X. & Ebens, Heiko, 2001. "The distribution of realized stock return volatility," Journal of Financial Economics, Elsevier, vol. 61(1), pages 43-76, July.
    19. Goyal, Amit & Saretto, Alessio, 2009. "Cross-section of option returns and volatility," Journal of Financial Economics, Elsevier, vol. 94(2), pages 310-326, November.
    20. repec:bla:jfinan:v:44:y:1989:i:5:p:1115-53 is not listed on IDEAS
    21. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    22. Matias D. Cattaneo & Richard K. Crump & Max H. Farrell & Ernst Schaumburg, 2020. "Characteristic-Sorted Portfolios: Estimation and Inference," The Review of Economics and Statistics, MIT Press, vol. 102(3), pages 531-551, July.
    23. Benoit Mandelbrot, 2015. "The Variation of Certain Speculative Prices," World Scientific Book Chapters, in: Anastasios G Malliaris & William T Ziemba (ed.), THE WORLD SCIENTIFIC HANDBOOK OF FUTURES MARKETS, chapter 3, pages 39-78, World Scientific Publishing Co. Pte. Ltd..
    24. Robert C. Merton, 2005. "Theory of rational option pricing," World Scientific Book Chapters, in: Sudipto Bhattacharya & George M Constantinides (ed.), Theory Of Valuation, chapter 8, pages 229-288, World Scientific Publishing Co. Pte. Ltd..
    25. R. Cont, 2001. "Empirical properties of asset returns: stylized facts and statistical issues," Quantitative Finance, Taylor & Francis Journals, vol. 1(2), pages 223-236.
    26. Yacine Aït-Sahalia & Jean Jacod, 2014. "High-Frequency Financial Econometrics," Economics Books, Princeton University Press, edition 1, number 10261.
    27. Black, Fischer & Scholes, Myron S, 1973. "The Pricing of Options and Corporate Liabilities," Journal of Political Economy, University of Chicago Press, vol. 81(3), pages 637-654, May-June.
    28. Joshua D. Coval & Tyler Shumway, 2001. "Expected Option Returns," Journal of Finance, American Finance Association, vol. 56(3), pages 983-1009, June.
    29. Bollerslev, Tim & Osterrieder, Daniela & Sizova, Natalia & Tauchen, George, 2013. "Risk and return: Long-run relations, fractional cointegration, and return predictability," Journal of Financial Economics, Elsevier, vol. 108(2), pages 409-424.
    30. R. F. Engle & A. J. Patton, 2001. "What good is a volatility model?," Quantitative Finance, Taylor & Francis Journals, vol. 1(2), pages 237-245.
    31. Christopher S. Jones, 2006. "A Nonlinear Factor Analysis of S&P 500 Index Option Returns," Journal of Finance, American Finance Association, vol. 61(5), pages 2325-2363, October.
    32. Liu, Lily Y. & Patton, Andrew J. & Sheppard, Kevin, 2015. "Does anything beat 5-minute RV? A comparison of realized measures across multiple asset classes," Journal of Econometrics, Elsevier, vol. 187(1), pages 293-311.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    2. Byun, Suk Joon & Jeon, Byoung Hyun & Min, Byungsun & Yoon, Sun-Joong, 2015. "The role of the variance premium in Jump-GARCH option pricing models," Journal of Banking & Finance, Elsevier, vol. 59(C), pages 38-56.
    3. Chun, Dohyun & Cho, Hoon & Ryu, Doojin, 2023. "Discovering the drivers of stock market volatility in a data-rich world," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 82(C).
    4. Robert Ślepaczuk & Grzegorz Zakrzewski, 2009. "High-Frequency and Model-Free Volatility Estimators," Working Papers 2009-13, Faculty of Economic Sciences, University of Warsaw.
    5. Amit Goyal & Alessio Saretto, 2022. "Are Equity Option Returns Abnormal? IPCA Says No," Working Papers 2214, Federal Reserve Bank of Dallas.
    6. Christensen, Kim & Podolski, Mark, 2005. "Asymptotic theory for range-based estimation of integrated variance of a continuous semi-martingale," Technical Reports 2005,18, Technische Universität Dortmund, Sonderforschungsbereich 475: Komplexitätsreduktion in multivariaten Datenstrukturen.
    7. Andersen, Torben G. & Bollerslev, Tim & Christoffersen, Peter F. & Diebold, Francis X., 2013. "Financial Risk Measurement for Financial Risk Management," Handbook of the Economics of Finance, in: G.M. Constantinides & M. Harris & R. M. Stulz (ed.), Handbook of the Economics of Finance, volume 2, chapter 0, pages 1127-1220, Elsevier.
    8. Torben G. Andersen & Luca Benzoni, 2008. "Realized volatility," Working Paper Series WP-08-14, Federal Reserve Bank of Chicago.
    9. Giulia Di Nunno & Kk{e}stutis Kubilius & Yuliya Mishura & Anton Yurchenko-Tytarenko, 2023. "From constant to rough: A survey of continuous volatility modeling," Papers 2309.01033, arXiv.org, revised Aug 2025.
    10. Lyócsa, Štefan & Todorova, Neda & Výrost, Tomáš, 2021. "Predicting risk in energy markets: Low-frequency data still matter," Applied Energy, Elsevier, vol. 282(PA).
    11. Alessio Brini & Jimmie Lenz, 2024. "A comparison of cryptocurrency volatility-benchmarking new and mature asset classes," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 10(1), pages 1-38, December.
    12. Vogel, Harold L. & Werner, Richard A., 2015. "An analytical review of volatility metrics for bubbles and crashes," International Review of Financial Analysis, Elsevier, vol. 38(C), pages 15-28.
    13. Mi‐Hsiu Chiang & Hsin‐Yu Chiu & Robin K. Chou, 2021. "Relevance of the disposition effect on the options market: New evidence," Financial Management, Financial Management Association International, vol. 50(1), pages 75-106, March.
    14. Ramachandran, Lakshmi Shankar & Tayal, Jitendra, 2021. "Mispricing, short-sale constraints, and the cross-section of option returns," Journal of Financial Economics, Elsevier, vol. 141(1), pages 297-321.
    15. Eom, Cheoljun & Kaizoji, Taisei & Scalas, Enrico, 2019. "Fat tails in financial return distributions revisited: Evidence from the Korean stock market," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 526(C).
    16. Biao Guo & Hai Lin, 2020. "Volatility and jump risk in option returns," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 40(11), pages 1767-1792, November.
    17. Lyócsa, Štefan & Molnár, Peter & Výrost, Tomáš, 2021. "Stock market volatility forecasting: Do we need high-frequency data?," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1092-1110.
    18. Saad Mouti, 2023. "Rough volatility: evidence from range volatility estimators," Papers 2312.01426, arXiv.org, revised Sep 2024.
    19. Sankar, Ganesh & Ramachandran, Shankar & Lukose P J, Jijo, 2020. "Dynamics of variance risk premium: Evidence from India," International Review of Economics & Finance, Elsevier, vol. 70(C), pages 321-334.
    20. Yueh-Neng Lin & Ken Hung, 2008. "Is Volatility Priced?," Annals of Economics and Finance, Society for AEF, vol. 9(1), pages 39-75, May.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2506.07928. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.