IDEAS home Printed from https://ideas.repec.org/a/eee/empfin/v62y2021icp46-61.html
   My bibliography  Save this article

Forecasting volatility using double shrinkage methods

Author

Listed:
  • Cheng, Mingmian
  • Swanson, Norman R.
  • Yang, Xiye

Abstract

In this paper, we propose and evaluate a shrinkage based methodology that is designed to improve the accuracy of volatility forecasts. Our approach is based on a two-step procedure for extracting latent common volatility factors from a large dimensional and high-frequency dataset. In the first step, we apply either least absolute shrinkage operator (LASSO) or the elastic net (EN) shrinkage on estimated integrated volatilities, in order to select a subset of assets that are informative about the target asset. In the second step, we utilize (sparse) principal component analysis on the selected assets, in order to estimate latent return factors, which are in turn used to construct latent volatility factors. Our two-step method is found to yield more accurate volatility predictions than a variety of alternative models based on approaches such as direct application of (S)PCA and direct application of LASSO or EN shrinkage, when comparing out-of-sampleR2s and mean absolute forecasting errors, and when implementing predictive accuracy tests. Additionally model confidence sets are found to contain models solely based on our two-step approach. These forecasting gains are found to be robust to the use of original or log-scale realized volatility models, different data sampling frequencies, and different forecasting sub-periods.

Suggested Citation

  • Cheng, Mingmian & Swanson, Norman R. & Yang, Xiye, 2021. "Forecasting volatility using double shrinkage methods," Journal of Empirical Finance, Elsevier, vol. 62(C), pages 46-61.
  • Handle: RePEc:eee:empfin:v:62:y:2021:i:c:p:46-61
    DOI: 10.1016/j.jempfin.2021.01.007
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0927539821000074
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jempfin.2021.01.007?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Andersen T. G & Bollerslev T. & Diebold F. X & Labys P., 2001. "The Distribution of Realized Exchange Rate Volatility," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 42-55, March.
    2. Marine Carrasco & Barbara Rossi, 2016. "In-Sample Inference and Forecasting in Misspecified Factor Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(3), pages 313-338, July.
    3. Asger Lunde & Peter R. Hansen, 2005. "A forecast comparison of volatility models: does anything beat a GARCH(1,1)?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(7), pages 873-889.
    4. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
    5. Fernandes, Marcelo & Medeiros, Marcelo C. & Scharth, Marcel, 2014. "Modeling and predicting the CBOE market volatility index," Journal of Banking & Finance, Elsevier, vol. 40(C), pages 1-10.
    6. Valentina Corradi & Norman Swanson & Walter Distaso, 2006. "Predictive Inference for Integrated Volatility," Departmental Working Papers 200616, Rutgers University, Department of Economics.
    7. Corsi, Fulvio & Pirino, Davide & Renò, Roberto, 2010. "Threshold bipower variation and the impact of jumps on volatility forecasting," Journal of Econometrics, Elsevier, vol. 159(2), pages 276-288, December.
    8. Barndorff-Nielsen, Ole E. & Graversen, Svend Erik & Jacod, Jean & Shephard, Neil, 2006. "Limit Theorems For Bipower Variation In Financial Econometrics," Econometric Theory, Cambridge University Press, vol. 22(4), pages 677-719, August.
    9. MEDDAHI, Nour, 2001. "An Eigenfunction Approach for Volatility Modeling," Cahiers de recherche 2001-29, Universite de Montreal, Departement de sciences economiques.
    10. Jushan Bai & Serena Ng, 2002. "Determining the Number of Factors in Approximate Factor Models," Econometrica, Econometric Society, vol. 70(1), pages 191-221, January.
    11. Andrew J. Patton & Kevin Sheppard, 2015. "Good Volatility, Bad Volatility: Signed Jumps and The Persistence of Volatility," The Review of Economics and Statistics, MIT Press, vol. 97(3), pages 683-697, July.
    12. Torben G. Andersen & Tim Bollerslev & Francis X. Diebold, 2007. "Roughing It Up: Including Jump Components in the Measurement, Modeling, and Forecasting of Return Volatility," The Review of Economics and Statistics, MIT Press, vol. 89(4), pages 701-720, November.
    13. Brownlees, C.T. & Gallo, G.M., 2006. "Financial econometric analysis at ultra-high frequency: Data handling concerns," Computational Statistics & Data Analysis, Elsevier, vol. 51(4), pages 2232-2245, December.
    14. Jacod, Jean & Li, Yingying & Mykland, Per A. & Podolskij, Mark & Vetter, Mathias, 2009. "Microstructure noise in the continuous case: The pre-averaging approach," Stochastic Processes and their Applications, Elsevier, vol. 119(7), pages 2249-2276, July.
    15. Francesco Audrino & Yujia Hu, 2016. "Volatility Forecasting: Downside Risk, Jumps and Leverage Effect," Econometrics, MDPI, vol. 4(1), pages 1-24, February.
    16. Yacine Aït-Sahalia & Jean Jacod, 2012. "Analyzing the Spectrum of Asset Returns: Jump and Volatility Components in High Frequency Data," Journal of Economic Literature, American Economic Association, vol. 50(4), pages 1007-1050, December.
    17. repec:hal:journl:peer-00741630 is not listed on IDEAS
    18. Norman R. Swanson & Weiqi Xiong, 2018. "Big data analytics in economics: What have we learned so far, and where should we go from here?," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 51(3), pages 695-746, August.
    19. Peter R. Hansen & Asger Lunde & James M. Nason, 2011. "The Model Confidence Set," Econometrica, Econometric Society, vol. 79(2), pages 453-497, March.
    20. Jianqing Fan & Yuan Ke & Qiang Sun & Wen-Xin Zhou, 2019. "FarmTest: Factor-Adjusted Robust Multiple Testing With Approximate False Discovery Control," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(528), pages 1880-1893, October.
    21. Corradi, Valentina & Distaso, Walter & Swanson, Norman R., 2009. "Predictive density estimators for daily volatility based on the use of realized measures," Journal of Econometrics, Elsevier, vol. 150(2), pages 119-138, June.
    22. Andersen, Torben G. & Bollerslev, Tim & Meddahi, Nour, 2011. "Realized volatility forecasting and market microstructure noise," Journal of Econometrics, Elsevier, vol. 160(1), pages 220-234, January.
    23. Bai, Jushan & Ng, Serena, 2008. "Forecasting economic time series using targeted predictors," Journal of Econometrics, Elsevier, vol. 146(2), pages 304-317, October.
    24. Stock, James H. & Watson, Mark W., 2006. "Forecasting with Many Predictors," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 10, pages 515-554, Elsevier.
    25. Aït-Sahalia, Yacine & Mykland, Per A. & Zhang, Lan, 2011. "Ultra high frequency volatility estimation with dependent microstructure noise," Journal of Econometrics, Elsevier, vol. 160(1), pages 160-175, January.
    26. Fulvio Corsi, 2009. "A Simple Approximate Long-Memory Model of Realized Volatility," The Journal of Financial Econometrics, Society for Financial Econometrics, vol. 7(2), pages 174-196, Spring.
    27. Aït-Sahalia, Yacine & Xiu, Dacheng, 2017. "Using principal component analysis to estimate a high dimensional factor model with high-frequency data," Journal of Econometrics, Elsevier, vol. 201(2), pages 384-399.
    28. Jean Jacod, 2018. "Limit of Random Measures Associated with the Increments of a Brownian Semimartingale," The Journal of Financial Econometrics, Society for Financial Econometrics, vol. 16(4), pages 526-569.
    29. Julieta Fuentes & Pilar Poncela & Julio Rodríguez, 2015. "Sparse Partial Least Squares in Time Series for Macroeconomic Forecasting," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(4), pages 576-595, June.
    30. Ghysels, Eric & Santa-Clara, Pedro & Valkanov, Rossen, 2006. "Predicting volatility: getting the most out of return data sampled at different frequencies," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 59-95.
    31. Yacine Aït-Sahalia & Jean Jacod, 2014. "High-Frequency Financial Econometrics," Economics Books, Princeton University Press, edition 1, number 10261.
    32. Ole E. Barndorff-Nielsen, 2004. "Power and Bipower Variation with Stochastic Volatility and Jumps," The Journal of Financial Econometrics, Society for Financial Econometrics, vol. 2(1), pages 1-37.
    33. Jushan Bai & Serena Ng, 2006. "Confidence Intervals for Diffusion Index Forecasts and Inference for Factor-Augmented Regressions," Econometrica, Econometric Society, vol. 74(4), pages 1133-1150, July.
    34. Groen, Jan J.J. & Kapetanios, George, 2016. "Revisiting useful approaches to data-rich macroeconomic forecasting," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 221-239.
    35. Torben G. Andersen & Tim Bollerslev & Francis X. Diebold & Paul Labys, 2003. "Modeling and Forecasting Realized Volatility," Econometrica, Econometric Society, vol. 71(2), pages 579-625, March.
    36. John Y. Campbell & Samuel B. Thompson, 2008. "Predicting Excess Stock Returns Out of Sample: Can Anything Beat the Historical Average?," Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1509-1531, July.
    37. Brandt, Michael W. & Jones, Christopher S., 2006. "Volatility Forecasting With Range-Based EGARCH Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 24, pages 470-486, October.
    38. Bollerslev, Tim & Patton, Andrew J. & Quaedvlieg, Rogier, 2016. "Exploiting the errors: A simple approach for improved volatility forecasting," Journal of Econometrics, Elsevier, vol. 192(1), pages 1-18.
    39. Bai, Jushan & Ng, Serena, 2006. "Evaluating latent and observed factors in macroeconomics and finance," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 507-537.
    40. Cecilia Mancini, 2009. "Non‐parametric Threshold Estimation for Models with Stochastic Diffusion Coefficient and Jumps," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 36(2), pages 270-296, June.
    41. Stock, James H & Watson, Mark W, 2002. "Macroeconomic Forecasting Using Diffusion Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 147-162, April.
    42. Duong, Diep & Swanson, Norman R., 2015. "Empirical evidence on the importance of aggregation, asymmetry, and jumps for volatility prediction," Journal of Econometrics, Elsevier, vol. 187(2), pages 606-621.
    43. Torben G. Andersen & Tim Bollerslev & Nour Meddahi, 2004. "Analytical Evaluation Of Volatility Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 45(4), pages 1079-1110, November.
    44. Racine, Jeff, 2000. "Consistent cross-validatory model-selection for dependent data: hv-block cross-validation," Journal of Econometrics, Elsevier, vol. 99(1), pages 39-61, November.
    45. Hui Zou & Trevor Hastie, 2005. "Addendum: Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(5), pages 768-768, November.
    46. Stock J.H. & Watson M.W., 2002. "Forecasting Using Principal Components From a Large Number of Predictors," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 1167-1179, December.
    47. Hui Zou & Trevor Hastie, 2005. "Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(2), pages 301-320, April.
    48. Yacine Aït-Sahalia & Dacheng Xiu, 2019. "Principal Component Analysis of High-Frequency Data," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(525), pages 287-303, January.
    49. M. Podolskij & D. Ziggel, 2010. "New tests for jumps in semimartingale models," Statistical Inference for Stochastic Processes, Springer, vol. 13(1), pages 15-41, April.
    50. Ghysels, Eric & Sinko, Arthur, 2011. "Volatility forecasting and microstructure noise," Journal of Econometrics, Elsevier, vol. 160(1), pages 257-271, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Guo, Xiaozhu & Huang, Dengshi & Li, Xiafei & Liang, Chao, 2023. "Are categorical EPU indices predictable for carbon futures volatility? Evidence from the machine learning method," International Review of Economics & Finance, Elsevier, vol. 83(C), pages 672-693.
    2. Ma, Feng & Wang, Jiqian & Wahab, M.I.M. & Ma, Yuanhui, 2023. "Stock market volatility predictability in a data-rich world: A new insight," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1804-1819.
    3. Jiqian Wang & Feng Ma & Elie Bouri & Yangli Guo, 2023. "Which factors drive Bitcoin volatility: Macroeconomic, technical, or both?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(4), pages 970-988, July.
    4. Li, Xiafei & Liang, Chao & Chen, Zhonglu & Umar, Muhammad, 2022. "Forecasting crude oil volatility with uncertainty indicators: New evidence," Energy Economics, Elsevier, vol. 108(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bu, Ruijun & Hizmeri, Rodrigo & Izzeldin, Marwan & Murphy, Anthony & Tsionas, Mike, 2023. "The contribution of jump signs and activity to forecasting stock price volatility," Journal of Empirical Finance, Elsevier, vol. 70(C), pages 144-164.
    2. Liu, Lily Y. & Patton, Andrew J. & Sheppard, Kevin, 2015. "Does anything beat 5-minute RV? A comparison of realized measures across multiple asset classes," Journal of Econometrics, Elsevier, vol. 187(1), pages 293-311.
    3. Andersen, Torben G. & Bollerslev, Tim & Christoffersen, Peter F. & Diebold, Francis X., 2013. "Financial Risk Measurement for Financial Risk Management," Handbook of the Economics of Finance, in: G.M. Constantinides & M. Harris & R. M. Stulz (ed.), Handbook of the Economics of Finance, volume 2, chapter 0, pages 1127-1220, Elsevier.
    4. Yaojie Zhang & Yudong Wang & Feng Ma & Yu Wei, 2022. "To jump or not to jump: momentum of jumps in crude oil price volatility prediction," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 8(1), pages 1-31, December.
    5. Vortelinos, Dimitrios I., 2017. "Forecasting realized volatility: HAR against Principal Components Combining, neural networks and GARCH," Research in International Business and Finance, Elsevier, vol. 39(PB), pages 824-839.
    6. Tim Bollerslev & Benjamin Hood & John Huss & Lasse Heje Pedersen, 2018. "Risk Everywhere: Modeling and Managing Volatility," Review of Financial Studies, Society for Financial Studies, vol. 31(7), pages 2729-2773.
    7. Tian, Fengping & Yang, Ke & Chen, Langnan, 2017. "Realized volatility forecasting of agricultural commodity futures using the HAR model with time-varying sparsity," International Journal of Forecasting, Elsevier, vol. 33(1), pages 132-152.
    8. Bollerslev, Tim & Patton, Andrew J. & Quaedvlieg, Rogier, 2016. "Exploiting the errors: A simple approach for improved volatility forecasting," Journal of Econometrics, Elsevier, vol. 192(1), pages 1-18.
    9. Danyan Wen & Mengxi He & Yaojie Zhang & Yudong Wang, 2022. "Forecasting realized volatility of Chinese stock market: A simple but efficient truncated approach," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(2), pages 230-251, March.
    10. Chen, Yixiang & Ma, Feng & Zhang, Yaojie, 2019. "Good, bad cojumps and volatility forecasting: New evidence from crude oil and the U.S. stock markets," Energy Economics, Elsevier, vol. 81(C), pages 52-62.
    11. Chorro, Christophe & Ielpo, Florian & Sévi, Benoît, 2020. "The contribution of intraday jumps to forecasting the density of returns," Journal of Economic Dynamics and Control, Elsevier, vol. 113(C).
    12. Ma, Feng & Wahab, M.I.M. & Zhang, Yaojie, 2019. "Forecasting the U.S. stock volatility: An aligned jump index from G7 stock markets," Pacific-Basin Finance Journal, Elsevier, vol. 54(C), pages 132-146.
    13. Patton, Andrew J., 2011. "Data-based ranking of realised volatility estimators," Journal of Econometrics, Elsevier, vol. 161(2), pages 284-303, April.
    14. Ma, Feng & Wahab, M.I.M. & Huang, Dengshi & Xu, Weiju, 2017. "Forecasting the realized volatility of the oil futures market: A regime switching approach," Energy Economics, Elsevier, vol. 67(C), pages 136-145.
    15. Liu, Jing & Ma, Feng & Yang, Ke & Zhang, Yaojie, 2018. "Forecasting the oil futures price volatility: Large jumps and small jumps," Energy Economics, Elsevier, vol. 72(C), pages 321-330.
    16. Ma, Feng & Li, Yu & Liu, Li & Zhang, Yaojie, 2018. "Are low-frequency data really uninformative? A forecasting combination perspective," The North American Journal of Economics and Finance, Elsevier, vol. 44(C), pages 92-108.
    17. Christophe Chorro & Florian Ielpo & Benoît Sévi, 2017. "The contribution of jumps to forecasting the density of returns," Post-Print halshs-01442618, HAL.
    18. Kim, Hyun Hak & Swanson, Norman R., 2018. "Mining big data using parsimonious factor, machine learning, variable selection and shrinkage methods," International Journal of Forecasting, Elsevier, vol. 34(2), pages 339-354.
    19. Papantonis, Ioannis & Rompolis, Leonidas & Tzavalis, Elias, 2023. "Improving variance forecasts: The role of Realized Variance features," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1221-1237.
    20. Martin Magris, 2019. "A Vine-copula extension for the HAR model," Papers 1907.08522, arXiv.org.

    More about this item

    Keywords

    Forecasting; Latent volatility factor; Shrinkage; High-frequency and large dimensional data;
    All these keywords.

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • C58 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Financial Econometrics

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:empfin:v:62:y:2021:i:c:p:46-61. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jempfin .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.