IDEAS home Printed from https://ideas.repec.org/a/eee/econom/v173y2013i1p1-10.html
   My bibliography  Save this article

On loss functions and ranking forecasting performances of multivariate volatility models

Author

Listed:
  • Laurent, Sébastien
  • Rombouts, Jeroen V.K.
  • Violante, Francesco

Abstract

The ranking of multivariate volatility models is inherently problematic because when the unobservable volatility is substituted by a proxy, the ordering implied by a loss function may be biased with respect to the intended one. We point out that the size of the distortion is strictly tied to the level of the accuracy of the volatility proxy. We propose a generalized necessary and sufficient functional form for a class of non-metric distance measures of the Bregman type which ensure consistency of the ordering when the target is observed with noise. An application to three foreign exchange rates is provided.

Suggested Citation

  • Laurent, Sébastien & Rombouts, Jeroen V.K. & Violante, Francesco, 2013. "On loss functions and ranking forecasting performances of multivariate volatility models," Journal of Econometrics, Elsevier, vol. 173(1), pages 1-10.
  • Handle: RePEc:eee:econom:v:173:y:2013:i:1:p:1-10
    DOI: 10.1016/j.jeconom.2012.08.004
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304407612001777
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jeconom.2012.08.004?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Andersen T. G & Bollerslev T. & Diebold F. X & Labys P., 2001. "The Distribution of Realized Exchange Rate Volatility," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 42-55, March.
    2. Gourieroux, Christian & Monfort, Alain & Trognon, Alain, 1984. "Pseudo Maximum Likelihood Methods: Theory," Econometrica, Econometric Society, vol. 52(3), pages 681-700, May.
    3. Meddahi, N., 2001. "A Theoretical Comparison Between Integrated and Realized Volatilies," Cahiers de recherche 2001-26, Centre interuniversitaire de recherche en économie quantitative, CIREQ.
    4. Barndorff-Nielsen, Ole E. & Hansen, Peter Reinhard & Lunde, Asger & Shephard, Neil, 2011. "Multivariate realised kernels: Consistent positive semi-definite estimators of the covariation of equity prices with noise and non-synchronous trading," Journal of Econometrics, Elsevier, vol. 162(2), pages 149-169, June.
    5. Asger Lunde & Peter R. Hansen, 2005. "A forecast comparison of volatility models: does anything beat a GARCH(1,1)?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(7), pages 873-889.
    6. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
    7. Roy van der Weide, 2002. "GO-GARCH: a multivariate generalized orthogonal GARCH model," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 17(5), pages 549-564.
    8. Engle, Robert F. & Kroner, Kenneth F., 1995. "Multivariate Simultaneous Generalized ARCH," Econometric Theory, Cambridge University Press, vol. 11(1), pages 122-150, February.
    9. Torben G. Andersen & Tim Bollerslev & Francis X. Diebold & Paul Labys, 2003. "Modeling and Forecasting Realized Volatility," Econometrica, Econometric Society, vol. 71(2), pages 579-625, March.
    10. Nelson, Daniel B, 1991. "Conditional Heteroskedasticity in Asset Returns: A New Approach," Econometrica, Econometric Society, vol. 59(2), pages 347-370, March.
    11. Carol Alexander, 2000. "Orthogonal Methods for Generating Large Positive Semi-Definite Covariance Matrices," ICMA Centre Discussion Papers in Finance icma-dp2000-06, Henley Business School, University of Reading.
    12. Clark, Todd E. & McCracken, Michael W., 2001. "Tests of equal forecast accuracy and encompassing for nested models," Journal of Econometrics, Elsevier, vol. 105(1), pages 85-110, November.
    13. Gourieroux,Christian & Monfort,Alain, 1995. "Statistics and Econometric Models," Cambridge Books, Cambridge University Press, number 9780521477444, July.
    14. Nour Meddahi, 2002. "A theoretical comparison between integrated and realized volatility," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 17(5), pages 479-508.
    15. Diebold, Francis X & Nerlove, Marc, 1989. "The Dynamics of Exchange Rate Volatility: A Multivariate Latent Factor Arch Model," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 4(1), pages 1-21, Jan.-Mar..
    16. Andersen, Torben G. & Bollerslev, Tim & Christoffersen, Peter F. & Diebold, Francis X., 2006. "Volatility and Correlation Forecasting," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 15, pages 777-878, Elsevier.
    17. Ding, Zhuanxin & Granger, Clive W. J. & Engle, Robert F., 1993. "A long memory property of stock market returns and a new model," Journal of Empirical Finance, Elsevier, vol. 1(1), pages 83-106, June.
    18. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-1084, September.
    19. Ledoit, Olivier & Wolf, Michael, 2003. "Improved estimation of the covariance matrix of stock returns with an application to portfolio selection," Journal of Empirical Finance, Elsevier, vol. 10(5), pages 603-621, December.
    20. Michael W. Brandt & Francis X. Diebold, 2006. "A No-Arbitrage Approach to Range-Based Estimation of Return Covariances and Correlations," The Journal of Business, University of Chicago Press, vol. 79(1), pages 61-74, January.
    21. repec:oxf:wpaper:264 is not listed on IDEAS
    22. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    23. Colacito, Riccardo & Engle, Robert F. & Ghysels, Eric, 2011. "A component model for dynamic correlations," Journal of Econometrics, Elsevier, vol. 164(1), pages 45-59, September.
    24. Luc Bauwens & Sébastien Laurent & Jeroen V. K. Rombouts, 2006. "Multivariate GARCH models: a survey," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(1), pages 79-109, January.
    25. Hansen, Peter Reinhard & Lunde, Asger, 2006. "Consistent ranking of volatility models," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 97-121.
    26. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    27. Jeffrey R. Russell & Federico M. Bandi, 2004. "Microstructure noise, realized volatility, and optimal sampling," Econometric Society 2004 Latin American Meetings 220, Econometric Society.
    28. Graham Elliott & Allan Timmermann, 2016. "Economic Forecasting," Economics Books, Princeton University Press, edition 1, number 10740, April.
    29. Valeri Voev & Asger Lunde, 2007. "Integrated Covariance Estimation using High-frequency Data in the Presence of Noise," Journal of Financial Econometrics, Society for Financial Econometrics, vol. 5(1), pages 68-104.
    30. Patton, Andrew J., 2011. "Volatility forecast comparison using imperfect volatility proxies," Journal of Econometrics, Elsevier, vol. 160(1), pages 246-256, January.
    31. Peter R. Hansen & Asger Lunde & James M. Nason, 2011. "The Model Confidence Set," Econometrica, Econometric Society, vol. 79(2), pages 453-497, March.
    32. Davidson, James, 2004. "Moment and Memory Properties of Linear Conditional Heteroscedasticity Models, and a New Model," Journal of Business & Economic Statistics, American Statistical Association, vol. 22(1), pages 16-29, January.
    33. Ole E. Barndorff-Nielsen & Peter Reinhard Hansen & Asger Lunde & Neil Shephard, 2008. "Designing Realized Kernels to Measure the ex post Variation of Equity Prices in the Presence of Noise," Econometrica, Econometric Society, vol. 76(6), pages 1481-1536, November.
    34. Zhou, Bin, 1996. "High-Frequency Data and Volatility in Foreign-Exchange Rates," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(1), pages 45-52, January.
    35. Bollerslev, Tim, 1990. "Modelling the Coherence in Short-run Nominal Exchange Rates: A Multivariate Generalized ARCH Model," The Review of Economics and Statistics, MIT Press, vol. 72(3), pages 498-505, August.
    36. Andersen, Torben G & Bollerslev, Tim, 1998. "Answering the Skeptics: Yes, Standard Volatility Models Do Provide Accurate Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 885-905, November.
    37. Hansen, Peter R. & Lunde, Asger, 2006. "Realized Variance and Market Microstructure Noise," Journal of Business & Economic Statistics, American Statistical Association, vol. 24, pages 127-161, April.
    38. Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
    39. Bauwens, Luc & Lubrano, Michel & Richard, Jean-Francois, 2000. "Bayesian Inference in Dynamic Econometric Models," OUP Catalogue, Oxford University Press, number 9780198773139.
    40. Barone-Adesi, Giovanni & Rasmussen, Henrik & Ravanelli, Claudia, 2005. "An option pricing formula for the GARCH diffusion model," Computational Statistics & Data Analysis, Elsevier, vol. 49(2), pages 287-310, April.
    41. Engle, Robert, 2002. "Dynamic Conditional Correlation: A Simple Class of Multivariate Generalized Autoregressive Conditional Heteroskedasticity Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(3), pages 339-350, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sébastien Laurent & Jeroen V. K. Rombouts & Francesco Violante, 2012. "On the forecasting accuracy of multivariate GARCH models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(6), pages 934-955, September.
    2. Andersen, Torben G. & Bollerslev, Tim & Christoffersen, Peter F. & Diebold, Francis X., 2006. "Volatility and Correlation Forecasting," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 15, pages 777-878, Elsevier.
    3. Andersen, Torben G. & Bollerslev, Tim & Christoffersen, Peter F. & Diebold, Francis X., 2013. "Financial Risk Measurement for Financial Risk Management," Handbook of the Economics of Finance, in: G.M. Constantinides & M. Harris & R. M. Stulz (ed.), Handbook of the Economics of Finance, volume 2, chapter 0, pages 1127-1220, Elsevier.
    4. repec:zbw:cfswop:wp200508 is not listed on IDEAS
    5. Massimiliano Caporin & Michael McAleer, 2011. "Ranking Multivariate GARCH Models by Problem Dimension: An Empirical Evaluation," Working Papers in Economics 11/23, University of Canterbury, Department of Economics and Finance.
    6. Torben G. Andersen & Tim Bollerslev & Peter F. Christoffersen & Francis X. Diebold, 2005. "Volatility Forecasting," CFS Working Paper Series 2005/08, Center for Financial Studies.
    7. Caporin, Massimiliano & McAleer, Michael, 2014. "Robust ranking of multivariate GARCH models by problem dimension," Computational Statistics & Data Analysis, Elsevier, vol. 76(C), pages 172-185.
    8. Patton, Andrew J., 2011. "Data-based ranking of realised volatility estimators," Journal of Econometrics, Elsevier, vol. 161(2), pages 284-303, April.
    9. Liu, Lily Y. & Patton, Andrew J. & Sheppard, Kevin, 2015. "Does anything beat 5-minute RV? A comparison of realized measures across multiple asset classes," Journal of Econometrics, Elsevier, vol. 187(1), pages 293-311.
    10. Li, Jia & Patton, Andrew J., 2018. "Asymptotic inference about predictive accuracy using high frequency data," Journal of Econometrics, Elsevier, vol. 203(2), pages 223-240.
    11. Hansen, Peter Reinhard & Lunde, Asger, 2006. "Consistent ranking of volatility models," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 97-121.
    12. Roxana Halbleib & Valeri Voev, 2016. "Forecasting Covariance Matrices: A Mixed Approach," Journal of Financial Econometrics, Society for Financial Econometrics, vol. 14(2), pages 383-417.
    13. Roxana Halbleib & Valeri Voev, 2011. "Forecasting Covariance Matrices: A Mixed Frequency Approach," CREATES Research Papers 2011-03, Department of Economics and Business Economics, Aarhus University.
    14. Patton, Andrew J., 2011. "Volatility forecast comparison using imperfect volatility proxies," Journal of Econometrics, Elsevier, vol. 160(1), pages 246-256, January.
    15. Wang Pu & Yixiang Chen & Feng Ma, 2016. "Forecasting the realized volatility in the Chinese stock market: further evidence," Applied Economics, Taylor & Francis Journals, vol. 48(33), pages 3116-3130, July.
    16. , 2019. "The Contribution of Jump Activity and Sign to Forecasting Stock Price Volatility," Working Papers 1902, Federal Reserve Bank of Dallas, revised 17 Nov 2020.
    17. Hua, Jian & Manzan, Sebastiano, 2013. "Forecasting the return distribution using high-frequency volatility measures," Journal of Banking & Finance, Elsevier, vol. 37(11), pages 4381-4403.
    18. Sucarrat, Genaro, 2009. "Forecast Evaluation of Explanatory Models of Financial Variability," Economics - The Open-Access, Open-Assessment E-Journal, Kiel Institute for the World Economy (IfW), vol. 3, pages 1-33.
    19. Bollerslev, Tim & Patton, Andrew J. & Quaedvlieg, Rogier, 2018. "Modeling and forecasting (un)reliable realized covariances for more reliable financial decisions," Journal of Econometrics, Elsevier, vol. 207(1), pages 71-91.
    20. Becker, R. & Clements, A.E. & Doolan, M.B. & Hurn, A.S., 2015. "Selecting volatility forecasting models for portfolio allocation purposes," International Journal of Forecasting, Elsevier, vol. 31(3), pages 849-861.
    21. Ma, Feng & Wei, Yu & Huang, Dengshi & Chen, Yixiang, 2014. "Which is the better forecasting model? A comparison between HAR-RV and multifractality volatility," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 405(C), pages 171-180.

    More about this item

    Keywords

    Volatility; Multivariate GARCH; Matrix norm; Loss function; Model confidence set;
    All these keywords.

    JEL classification:

    • C10 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - General
    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • G10 - Financial Economics - - General Financial Markets - - - General (includes Measurement and Data)

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:econom:v:173:y:2013:i:1:p:1-10. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: http://www.elsevier.com/locate/jeconom .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jeconom .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.