IDEAS home Printed from https://ideas.repec.org/p/pre/wpaper/202518.html

Machine Learning and the Forecastability of Cross-Sectional Realized Variance: The Role of Realized Moments

Author

Listed:
  • Vasilios Plakandaras

    (Department of Economics, Democritus University of Thrace, Komotini, Greece)

  • Matteo Bonato

    (Department of Economics and Econometrics, University of Johannesburg, Auckland Park, South Africa; IPAG Business School, 184 Boulevard Saint-Germain, 75006 Paris, France)

  • Rangan Gupta

    (Department of Economics, University of Pretoria, Private Bag X20, Hatfield 0028, South Africa)

  • Oguzhan Cepni

    (Ostim Technical University, Ankara, Turkiye; University of Edinburgh Business School, Centre for Business, Climate Change, and Sustainability; Department of Economics, Copenhagen Business School, Denmark)

Abstract

This paper forecasts monthly cross-sectional realized variance (RV) for U.S. equities across 49 industries and all 50 states. We exploit information in both own-market and cross-market (oil) realized moments (semi-variance, leverage, skewness, kurtosis, and upside and downside tail risk) as predictors. To accommodate cross-sectional dependence, we compare standard econometric panel models with machine-learning approaches and introduce a new machine-learning technique tailored specifically to panel data. Using observations from April 1994 through April 2023, the panel-dedicated machine-learning model consistently outperforms all other methods, while oil-related moments add little incremental predictive power beyond own-market moments. Short-horizon forecasts successfully capture immediate shocks, whereas longer-horizon forecasts reflect broader structural economic changes. These results carry important implications for portfolio allocation and risk management.

Suggested Citation

  • Vasilios Plakandaras & Matteo Bonato & Rangan Gupta & Oguzhan Cepni, 2025. "Machine Learning and the Forecastability of Cross-Sectional Realized Variance: The Role of Realized Moments," Working Papers 202518, University of Pretoria, Department of Economics.
    • Handle: RePEc:pre:wpaper:202518
    as

    Download full text from publisher

    File URL: https://drupalwebprod-files.up.ac.za/Public/media/83/documents/inline/39875/wp_2025_18.zp264601.pdf?VersionId=4wUrGsjwZtHdxz49R7kV2XMeemOe.k7a
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Hong, Harrison & Torous, Walter & Valkanov, Rossen, 2007. "Do industries lead stock markets?," Journal of Financial Economics, Elsevier, vol. 83(2), pages 367-396, February.
    2. Riza Demirer & Rangan Gupta & Zhihui Lv & Wing-Keung Wong, 2019. "Equity Return Dispersion and Stock Market Volatility: Evidence from Multivariate Linear and Nonlinear Causality Tests," Sustainability, MDPI, vol. 11(2), pages 1-15, January.
    3. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," Review of Finance, European Finance Association, vol. 33(5), pages 2223-2273.
    4. Matteo Bonato & Oguzhan Cepni & Rangan Gupta & Christian Pierdzioch, 2024. "Forecasting the realized volatility of agricultural commodity prices: Does sentiment matter?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 43(6), pages 2088-2125, September.
    5. Niu, Zibo & Demirer, Riza & Suleman, Muhammad Tahir & Zhang, Hongwei & Zhu, Xuehong, 2024. "Do industries predict stock market volatility? Evidence from machine learning models," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 90(C).
    6. Angelidis, Timotheos & Sakkas, Athanasios & Tessaromatis, Nikolaos, 2015. "Stock market dispersion, the business cycle and expected factor returns," Journal of Banking & Finance, Elsevier, vol. 59(C), pages 265-279.
    7. Souropanis, Ioannis & Vivian, Andrew, 2023. "Forecasting realized volatility with wavelet decomposition," Journal of Empirical Finance, Elsevier, vol. 74(C).
    8. Amaya, Diego & Christoffersen, Peter & Jacobs, Kris & Vasquez, Aurelio, 2015. "Does realized skewness predict the cross-section of equity returns?," Journal of Financial Economics, Elsevier, vol. 118(1), pages 135-167.
    9. Rangan Gupta & Christian Pierdzioch, 2024. "Multi-Task Forecasting of the Realized Volatilities of Agricultural Commodity Prices," Mathematics, MDPI, vol. 12(18), pages 1-26, September.
    10. Andersen, Torben G & Bollerslev, Tim, 1998. "Answering the Skeptics: Yes, Standard Volatility Models Do Provide Accurate Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 885-905, November.
    11. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    12. Andrew Detzel & Jefferson Duarte & Avraham Kamara & Stephan Siegel & Celine Sun, 2023. "The Cross-Section of Volatility and Expected Returns: Then and Now," Critical Finance Review, now publishers, vol. 12(1-4), pages 9-56, August.
    13. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2223-2273.
    14. Ser-Huang Poon & Clive W.J. Granger, 2003. "Forecasting Volatility in Financial Markets: A Review," Journal of Economic Literature, American Economic Association, vol. 41(2), pages 478-539, June.
    15. Vasilios Plakandaras & Ioannis Pragidis & Paris Karypidis, 2024. "Deciphering the U.S. metropolitan house price dynamics," Real Estate Economics, American Real Estate and Urban Economics Association, vol. 52(2), pages 434-485, March.
    16. Chikashi Tsuji, 2012. "Do industries contain predictive information for the Fama--French factors?," Quantitative Finance, Taylor & Francis Journals, vol. 12(6), pages 969-991, March.
    17. Andrew Ang & Robert J. Hodrick & Yuhang Xing & Xiaoyan Zhang, 2006. "The Cross‐Section of Volatility and Expected Returns," Journal of Finance, American Finance Association, vol. 61(1), pages 259-299, February.
    18. Lu, Fei & Ma, Feng, 2023. "Cross-sectional uncertainty and stock market volatility: New evidence," Finance Research Letters, Elsevier, vol. 57(C).
    19. Soosung Hwang & Steve Satchell, 2005. "GARCH model with cross-sectional volatility: GARCHX models," Applied Financial Economics, Taylor & Francis Journals, vol. 15(3), pages 203-216.
    20. Byun, Sung Je, 2016. "The usefulness of cross-sectional dispersion for forecasting aggregate stock price volatility," Journal of Empirical Finance, Elsevier, vol. 36(C), pages 162-180.
    21. Rangan Gupta & Jacobus Nel & Christian Pierdzioch, 2023. "Investor Confidence and Forecastability of US Stock Market Realized Volatility: Evidence from Machine Learning," Journal of Behavioral Finance, Taylor & Francis Journals, vol. 24(1), pages 111-122, January.
    22. Matteo Bonato & Oguzhan Cepni & Rangan Gupta & Christian Pierdzioch, 2022. "Forecasting realized volatility of international REITs: The role of realized skewness and realized kurtosis," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(2), pages 303-315, March.
    23. Afees A. Salisu & Rangan Gupta & Ahamuefula E. Ogbonna, 2022. "A moving average heterogeneous autoregressive model for forecasting the realized volatility of the US stock market: Evidence from over a century of data," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 27(1), pages 384-400, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Matteo Bonato & Rangan Gupta & Christian Pierdzioch, 2024. "Do Shortages Forecast Aggregate and Sectoral U.S. Stock Market Realized Variance? Evidence from a Century of Data," Working Papers 202450, University of Pretoria, Department of Economics.
    2. Oguzhan Cepni & Riza Demirer & Rangan Gupta & Christian Pierdzioch, 2024. "Political Geography and Stock Market Volatility: The Role of Political Alignment across Sentiment Regimes," Working Papers 202414, University of Pretoria, Department of Economics.
    3. Zhang, Hongwei & Zhao, Xinyi & Gao, Wang & Niu, Zibo, 2023. "The role of higher moments in predicting China's oil futures volatility: Evidence from machine learning models," Journal of Commodity Markets, Elsevier, vol. 32(C).
    4. Fei, Tianlun & Liu, Xiaoquan & Wen, Conghua, 2019. "Cross-sectional return dispersion and volatility prediction," Pacific-Basin Finance Journal, Elsevier, vol. 58(C).
    5. Matteo Bonato & Oguzhan Cepni & Rangan Gupta & Christian Pierdzioch, 2024. "Business applications and state‐level stock market realized volatility: A forecasting experiment," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 43(2), pages 456-472, March.
    6. Bonato, Matteo & Cepni, Oguzhan & Gupta, Rangan & Pierdzioch, Christian, 2023. "Climate risks and state-level stock market realized volatility," Journal of Financial Markets, Elsevier, vol. 66(C).
    7. Matteo Bonato & Oguzhan Cepni & Rangan Gupta & Christian Pierdzioch, 2025. "Electricity Sales and Forecasting of Stock Market Realized Volatility: A State-Level Analysis of the United States," Working Papers 202540, University of Pretoria, Department of Economics.
    8. Zhang, Hongwei & Wang, Wentao & Niu, Zibo, 2024. "Geopolitical risks and crude oil futures volatility: Evidence from machine learning," Resources Policy, Elsevier, vol. 98(C).
    9. Rangan Gupta & Jacobus Nel & Christian Pierdzioch, 2023. "Investor Confidence and Forecastability of US Stock Market Realized Volatility: Evidence from Machine Learning," Journal of Behavioral Finance, Taylor & Francis Journals, vol. 24(1), pages 111-122, January.
    10. Li, Xiaodan & Gong, Xue & Ge, Futing & Huang, Jingjing, 2024. "Forecasting stock volatility using pseudo-out-of-sample information," International Review of Economics & Finance, Elsevier, vol. 90(C), pages 123-135.
    11. Avramov, D. & Ge, S. & Li, S. & Linton, O. B., 2025. "Dual Industry Effects and Cross-Stock Predictability," Janeway Institute Working Papers 2506, Faculty of Economics, University of Cambridge.
    12. Salisu, Afees A. & Demirer, Riza & Gupta, Rangan, 2022. "Financial turbulence, systemic risk and the predictability of stock market volatility," Global Finance Journal, Elsevier, vol. 52(C).
    13. Smith, Simon C., 2021. "International stock return predictability," International Review of Financial Analysis, Elsevier, vol. 78(C).
    14. Zeng, Qing & Lu, Xinjie & Xu, Jin & Lin, Yu, 2024. "Macro-Driven Stock Market Volatility Prediction: Insights from a New Hybrid Machine Learning Approach," International Review of Financial Analysis, Elsevier, vol. 96(PB).
    15. Riza Demirer & Rangan Gupta & He Li & Yu You, 2021. "Financial Vulnerability and Volatility in Emerging Stock Markets: Evidence from GARCH-MIDAS Models," Working Papers 202112, University of Pretoria, Department of Economics.
    16. Xue Gong & Weiguo Zhang & Yuan Zhao & Xin Ye, 2023. "Forecasting stock volatility with a large set of predictors: A new forecast combination method," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(7), pages 1622-1647, November.
    17. Elie Bouri & Konstantinos Gkillas & Rangan Gupta & Christian Pierdzioch, 2021. "Forecasting Realized Volatility of Bitcoin: The Role of the Trade War," Computational Economics, Springer;Society for Computational Economics, vol. 57(1), pages 29-53, January.
    18. Bollerslev, Tim & Medeiros, Marcelo C. & Patton, Andrew J. & Quaedvlieg, Rogier, 2022. "From zero to hero: Realized partial (co)variances," Journal of Econometrics, Elsevier, vol. 231(2), pages 348-360.
    19. Victor Bello Accioly & Beatriz Vaz de Melo Mendes, 2016. "Assessing the Impact of the Realized Range on the (E)GARCH Volatility: Evidence from Brazil," Brazilian Business Review, Fucape Business School, vol. 13(2), pages 1-26, March.
    20. Bo Yu & Dayong Zhang & Qiang Ji, 2025. "Forecasting portfolio variance: a new decomposition approach," Annals of Operations Research, Springer, vol. 348(1), pages 543-578, May.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    JEL classification:

    • C33 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Models with Panel Data; Spatio-temporal Models
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • G10 - Financial Economics - - General Financial Markets - - - General (includes Measurement and Data)
    • G17 - Financial Economics - - General Financial Markets - - - Financial Forecasting and Simulation

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pre:wpaper:202518. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Rangan Gupta (email available below). General contact details of provider: https://edirc.repec.org/data/decupza.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.