IDEAS home Printed from https://ideas.repec.org/a/eee/econom/v160y2011i1p246-256.html
   My bibliography  Save this article

Volatility forecast comparison using imperfect volatility proxies

Author

Listed:
  • Patton, Andrew J.

Abstract

The use of a conditionally unbiased, but imperfect, volatility proxy can lead to undesirable outcomes in standard methods for comparing conditional variance forecasts. We motivate our study with analytical results on the distortions caused by some widely used loss functions, when used with standard volatility proxies such as squared returns, the intra-daily range or realised volatility. We then derive necessary and sufficient conditions on the functional form of the loss function for the ranking of competing volatility forecasts to be robust to the presence of noise in the volatility proxy, and derive some useful special cases of this class of "robust"Â loss functions. The methods are illustrated with an application to the volatility of returns on IBM over the period 1993 to 2003.

Suggested Citation

  • Patton, Andrew J., 2011. "Volatility forecast comparison using imperfect volatility proxies," Journal of Econometrics, Elsevier, vol. 160(1), pages 246-256, January.
  • Handle: RePEc:eee:econom:v:160:y:2011:i:1:p:246-256
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304-4076(10)00076-X
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Andersen T. G & Bollerslev T. & Diebold F. X & Labys P., 2001. "The Distribution of Realized Exchange Rate Volatility," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 42-55, March.
    2. Jacob A. Mincer & Victor Zarnowitz, 1969. "The Evaluation of Economic Forecasts," NBER Chapters, in: Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance, pages 3-46, National Bureau of Economic Research, Inc.
    3. Asger Lunde & Peter R. Hansen, 2005. "A forecast comparison of volatility models: does anything beat a GARCH(1,1)?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(7), pages 873-889.
    4. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
    5. Timmermann, Allan & Patton, Andrew, 2003. "Properties of Optimal Forecasts," CEPR Discussion Papers 4037, C.E.P.R. Discussion Papers.
    6. Garman, Mark B & Klass, Michael J, 1980. "On the Estimation of Security Price Volatilities from Historical Data," The Journal of Business, University of Chicago Press, vol. 53(1), pages 67-78, January.
    7. Andersen, Torben G. & Bollerslev, Tim & Christoffersen, Peter F. & Diebold, Francis X., 2005. "Volatility forecasting," CFS Working Paper Series 2005/08, Center for Financial Studies (CFS).
    8. Ghysels, E. & Harvey, A. & Renault, E., 1995. "Stochastic Volatility," Papers 95.400, Toulouse - GREMAQ.
    9. Martens, Martin & van Dijk, Dick, 2007. "Measuring volatility with the realized range," Journal of Econometrics, Elsevier, vol. 138(1), pages 181-207, May.
    10. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-1084, September.
    11. Ole E. Barndorff-Nielsen & Neil Shephard, 2004. "Econometric Analysis of Realized Covariation: High Frequency Based Covariance, Regression, and Correlation in Financial Economics," Econometrica, Econometric Society, vol. 72(3), pages 885-925, May.
    12. Bollerslev, Tim & Ghysels, Eric, 1996. "Periodic Autoregressive Conditional Heteroscedasticity," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(2), pages 139-151, April.
    13. Torben G. Andersen & Luca Benzoni & Jesper Lund, 2002. "An Empirical Investigation of Continuous‐Time Equity Return Models," Journal of Finance, American Finance Association, vol. 57(3), pages 1239-1284, June.
    14. Pagan, Adrian R. & Schwert, G. William, 1990. "Alternative models for conditional stock volatility," Journal of Econometrics, Elsevier, vol. 45(1-2), pages 267-290.
    15. Torben G. Andersen & Tim Bollerslev & Nour Meddahi, 2005. "Correcting the Errors: Volatility Forecast Evaluation Using High-Frequency Data and Realized Volatilities," Econometrica, Econometric Society, vol. 73(1), pages 279-296, January.
    16. Torben G. Andersen & Tim Bollerslev & Francis X. Diebold, 2002. "Parametric and Nonparametric Volatility Measurement," Center for Financial Institutions Working Papers 02-27, Wharton School Center for Financial Institutions, University of Pennsylvania.
    17. White,Halbert, 1996. "Estimation, Inference and Specification Analysis," Cambridge Books, Cambridge University Press, number 9780521574464, January.
    18. West, Kenneth D. & Edison, Hali J. & Cho, Dongchul, 1993. "A utility-based comparison of some models of exchange rate volatility," Journal of International Economics, Elsevier, vol. 35(1-2), pages 23-45, August.
    19. Hansen, Peter Reinhard & Lunde, Asger, 2006. "Consistent ranking of volatility models," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 97-121.
    20. West, Kenneth D., 2006. "Forecast Evaluation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 3, pages 99-134, Elsevier.
    21. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    22. repec:cup:etheor:v:13:y:1997:i:6:p:808-17 is not listed on IDEAS
    23. Nour Meddahi, 2002. "A theoretical comparison between integrated and realized volatility," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 17(5), pages 479-508.
    24. Christoffersen, Peter F. & Diebold, Francis X., 1997. "Optimal Prediction Under Asymmetric Loss," Econometric Theory, Cambridge University Press, vol. 13(6), pages 808-817, December.
    25. Tim Bollerslev & Jonathan H. Wright, 2001. "High-Frequency Data, Frequency Domain Inference, And Volatility Forecasting," The Review of Economics and Statistics, MIT Press, vol. 83(4), pages 596-602, November.
    26. Christensen, Kim & Podolski, Mark, 2005. "Asymptotic theory for range-based estimation of integrated variance of a continuous semi-martingale," Technical Reports 2005,18, Technische Universität Dortmund, Sonderforschungsbereich 475: Komplexitätsreduktion in multivariaten Datenstrukturen.
    27. Christensen, Kim & Podolskij, Mark, 2006. "Range-Based Estimation of Quadratic Variation," Technical Reports 2006,37, Technische Universität Dortmund, Sonderforschungsbereich 475: Komplexitätsreduktion in multivariaten Datenstrukturen.
    28. Christoffersen, Peter & Jacobs, Kris, 2004. "The importance of the loss function in option valuation," Journal of Financial Economics, Elsevier, vol. 72(2), pages 291-318, May.
    29. Sílvia Gonçalves & Nour Meddahi, 2009. "Bootstrapping Realized Volatility," Econometrica, Econometric Society, vol. 77(1), pages 283-306, January.
    30. Andersen, Torben G & Bollerslev, Tim, 1998. "Answering the Skeptics: Yes, Standard Volatility Models Do Provide Accurate Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 885-905, November.
    31. Ole E. Barndorff‐Nielsen & Neil Shephard, 2002. "Econometric analysis of realized volatility and its use in estimating stochastic volatility models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(2), pages 253-280, May.
    32. Gourieroux, Christian & Monfort, Alain & Trognon, Alain, 1984. "Pseudo Maximum Likelihood Methods: Theory," Econometrica, Econometric Society, vol. 52(3), pages 681-700, May.
    33. Parkinson, Michael, 1980. "The Extreme Value Method for Estimating the Variance of the Rate of Return," The Journal of Business, University of Chicago Press, vol. 53(1), pages 61-65, January.
    34. Ball, Clifford A & Torous, Walter N, 1984. "The Maximum Likelihood Estimation of Security Price Volatility: Theory, Evidence, and Application to Option Pricing," The Journal of Business, University of Chicago Press, vol. 57(1), pages 97-112, January.
    35. Neil Shephard, 2005. "Stochastic Volatility," Economics Papers 2005-W17, Economics Group, Nuffield College, University of Oxford.
    36. Torben G. Andersen & Tim Bollerslev & Francis X. Diebold & Paul Labys, 2003. "Modeling and Forecasting Realized Volatility," Econometrica, Econometric Society, vol. 71(2), pages 579-625, March.
    37. Ser-Huang Poon & Clive W.J. Granger, 2003. "Forecasting Volatility in Financial Markets: A Review," Journal of Economic Literature, American Economic Association, vol. 41(2), pages 478-539, June.
    38. Andersen, Torben G. & Bollerslev, Tim & Christoffersen, Peter F. & Diebold, Francis X., 2006. "Volatility and Correlation Forecasting," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 15, pages 777-878, Elsevier.
    39. Andersen, Torben G. & Bollerslev, Tim & Lange, Steve, 1999. "Forecasting financial market volatility: Sample frequency vis-a-vis forecast horizon," Journal of Empirical Finance, Elsevier, vol. 6(5), pages 457-477, December.
    40. Patton, Andrew J. & Timmermann, Allan, 2007. "Properties of optimal forecasts under asymmetric loss and nonlinearity," Journal of Econometrics, Elsevier, vol. 140(2), pages 884-918, October.
    41. Andersen, Torben G. & Bollerslev, Tim & Diebold, Francis X. & Ebens, Heiko, 2001. "The distribution of realized stock return volatility," Journal of Financial Economics, Elsevier, vol. 61(1), pages 43-76, July.
    42. Francis X. Diebold & Jose A. Lopez, 1995. "Forecast evaluation and combination," Research Paper 9525, Federal Reserve Bank of New York.
    43. Sassan Alizadeh & Michael W. Brandt & Francis X. Diebold, 2002. "Range‐Based Estimation of Stochastic Volatility Models," Journal of Finance, American Finance Association, vol. 57(3), pages 1047-1091, June.
    44. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    45. Robert F. Engle & Che-Hsiung Hong & Alex Kane, 1990. "Valuation of Variance Forecast with Simulated Option Markets," NBER Working Papers 3350, National Bureau of Economic Research, Inc.
    46. Lamoureux, Christopher G & Lastrapes, William D, 1993. "Forecasting Stock-Return Variance: Toward an Understanding of Stochastic Implied Volatilities," Review of Financial Studies, Society for Financial Studies, vol. 6(2), pages 293-326.
    47. Patton, Andrew J., 2011. "Volatility forecast comparison using imperfect volatility proxies," Journal of Econometrics, Elsevier, vol. 160(1), pages 246-256, January.
    48. Torben G. Andersen & Tim Bollerslev & Nour Meddahi, 2004. "Analytical Evaluation Of Volatility Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 45(4), pages 1079-1110, November.
    49. Gourieroux Christian & Monfort Alain & Renault Eric, 1987. "Consistent m-estimators in a semi-parametric model," CEPREMAP Working Papers (Couverture Orange) 8720, CEPREMAP.
    50. Hamilton, James D. & Susmel, Raul, 1994. "Autoregressive conditional heteroskedasticity and changes in regime," Journal of Econometrics, Elsevier, vol. 64(1-2), pages 307-333.
    51. Komunjer, Ivana & Vuong, Quang, 2006. "Efficientt Conditional Quantile Estimation: The Time Series Case," University of California at San Diego, Economics Working Paper Series qt78842570, Department of Economics, UC San Diego.
    52. Christensen, Kim & Podolskij, Mark, 2007. "Realized range-based estimation of integrated variance," Journal of Econometrics, Elsevier, vol. 141(2), pages 323-349, December.
    53. Shephard, Neil (ed.), 2005. "Stochastic Volatility: Selected Readings," OUP Catalogue, Oxford University Press, number 9780199257201, Decembrie.
    54. Engle, Robert F, 1982. "Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation," Econometrica, Econometric Society, vol. 50(4), pages 987-1007, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Patton, Andrew J., 2011. "Data-based ranking of realised volatility estimators," Journal of Econometrics, Elsevier, vol. 161(2), pages 284-303, April.
    2. Andrew J. Patton & Kevin Sheppard, 2008. "Evaluating Volatility and Correlation Forecasts," OFRC Working Papers Series 2008fe22, Oxford Financial Research Centre.
    3. Andersen, Torben G. & Bollerslev, Tim & Christoffersen, Peter F. & Diebold, Francis X., 2005. "Volatility forecasting," CFS Working Paper Series 2005/08, Center for Financial Studies (CFS).
    4. Andersen, Torben G. & Bollerslev, Tim & Christoffersen, Peter F. & Diebold, Francis X., 2006. "Volatility and Correlation Forecasting," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 15, pages 777-878, Elsevier.
    5. Ole E. Barndorff-Nielsen & Neil Shephard, 2005. "Variation, jumps, market frictions and high frequency data in financial econometrics," OFRC Working Papers Series 2005fe08, Oxford Financial Research Centre.
    6. Matei, Marius, 2011. "Non-Linear Volatility Modeling of Economic and Financial Time Series Using High Frequency Data," Journal for Economic Forecasting, Institute for Economic Forecasting, vol. 0(2), pages 116-141, June.
    7. Bauwens, Luc & Sucarrat, Genaro, 2010. "General-to-specific modelling of exchange rate volatility: A forecast evaluation," International Journal of Forecasting, Elsevier, vol. 26(4), pages 885-907, October.
    8. Michael McAleer & Marcelo Medeiros, 2008. "Realized Volatility: A Review," Econometric Reviews, Taylor & Francis Journals, vol. 27(1-3), pages 10-45.
    9. Liu, Lily Y. & Patton, Andrew J. & Sheppard, Kevin, 2015. "Does anything beat 5-minute RV? A comparison of realized measures across multiple asset classes," Journal of Econometrics, Elsevier, vol. 187(1), pages 293-311.
    10. Patton, Andrew J. & Sheppard, Kevin, 2009. "Optimal combinations of realised volatility estimators," International Journal of Forecasting, Elsevier, vol. 25(2), pages 218-238.
    11. Robert Ślepaczuk & Grzegorz Zakrzewski, 2009. "High-Frequency and Model-Free Volatility Estimators," Working Papers 2009-13, Faculty of Economic Sciences, University of Warsaw.
    12. Hansen, Peter Reinhard & Lunde, Asger, 2006. "Consistent ranking of volatility models," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 97-121.
    13. Sucarrat, Genaro, 2009. "Forecast Evaluation of Explanatory Models of Financial Variability," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 3, pages 1-33.
    14. Andersen, Torben G. & Bollerslev, Tim & Huang, Xin, 2011. "A reduced form framework for modeling volatility of speculative prices based on realized variation measures," Journal of Econometrics, Elsevier, vol. 160(1), pages 176-189, January.
    15. Laurent, Sébastien & Rombouts, Jeroen V.K. & Violante, Francesco, 2013. "On loss functions and ranking forecasting performances of multivariate volatility models," Journal of Econometrics, Elsevier, vol. 173(1), pages 1-10.
    16. Prateek Sharma & Vipul _, 2015. "Forecasting stock index volatility with GARCH models: international evidence," Studies in Economics and Finance, Emerald Group Publishing Limited, vol. 32(4), pages 445-463, October.
    17. Li, Jia & Patton, Andrew J., 2018. "Asymptotic inference about predictive accuracy using high frequency data," Journal of Econometrics, Elsevier, vol. 203(2), pages 223-240.
    18. Henning Fischer & Ángela Blanco‐FERNÁndez & Peter Winker, 2016. "Predicting Stock Return Volatility: Can We Benefit from Regression Models for Return Intervals?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 35(2), pages 113-146, March.
    19. Torben G. Andersen & Luca Benzoni, 2008. "Realized volatility," Working Paper Series WP-08-14, Federal Reserve Bank of Chicago.
    20. Bali, Turan G. & Weinbaum, David, 2007. "A conditional extreme value volatility estimator based on high-frequency returns," Journal of Economic Dynamics and Control, Elsevier, vol. 31(2), pages 361-397, February.

    More about this item

    Keywords

    Forecast evaluation Forecast comparison Loss functions Realised variance Range;

    JEL classification:

    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:econom:v:160:y:2011:i:1:p:246-256. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jeconom .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.