IDEAS home Printed from https://ideas.repec.org/a/jof/jforec/v20y2001i2p87-109.html
   My bibliography  Save this article

Evaluating the Predictive Accuracy of Volatility Models

Author

Listed:
  • Lopez, Jose A

Abstract

Standard statistical loss functions, such as mean-squared error, are commonly used for evaluating financial volatility forecasts. In this paper, an alternative evaluation framework, based on probability scoring rules that can be more closely tailored to a forecast user's decision problem, is proposed. According to the decision at hand, the user specifies the economic events to be forecast, the scoring rule with which to evaluate these probability forecasts, and the subsets of the forecasts of particular interest. The volatility forecasts from a model are then transformed into probability forecasts of the relevant events and evaluated using the selected scoring rule and calibration tests. An empirical example using exchange rate data illustrates the framework and confirms that the choice of loss function directly affects the forecast evaluation results. Copyright © 2001 by John Wiley & Sons, Ltd.

Suggested Citation

  • Lopez, Jose A, 2001. "Evaluating the Predictive Accuracy of Volatility Models," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 20(2), pages 87-109, March.
  • Handle: RePEc:jof:jforec:v:20:y:2001:i:2:p:87-109
    as

    Download full text from publisher

    To our knowledge, this item is not available for download. To find whether it is available, there are three options:
    1. Check below whether another version of this item is available online.
    2. Check on the provider's web page whether it is in fact available.
    3. Perform a search for a similarly titled item that would be available.

    Other versions of this item:

    References listed on IDEAS

    as
    1. John F. Geweke, 1994. "Bayesian comparison of econometric models," Working Papers 532, Federal Reserve Bank of Minneapolis.
    2. Jacquier, Eric & Polson, Nicholas G & Rossi, Peter E, 2002. "Bayesian Analysis of Stochastic Volatility Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 69-87, January.
    3. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-1084, September.
    4. Diebold & Lopez, "undated". "Modeling Volatility Dynamics," Home Pages _062, University of Pennsylvania.
    5. Kim, Kiwhan & Schmidt, Peter, 1993. "Unit root tests with conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 59(3), pages 287-300, October.
    6. Granger, C. W. J. & White, Halbert & Kamstra, Mark, 1989. "Interval forecasting : An analysis based upon ARCH-quantile estimators," Journal of Econometrics, Elsevier, vol. 40(1), pages 87-96, January.
    7. Bollerslev, Tim & Ghysels, Eric, 1996. "Periodic Autoregressive Conditional Heteroscedasticity," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(2), pages 139-151, April.
    8. Pagan, Adrian R. & Schwert, G. William, 1990. "Alternative models for conditional stock volatility," Journal of Econometrics, Elsevier, vol. 45(1-2), pages 267-290.
    9. West, Kenneth D. & Cho, Dongchul, 1995. "The predictive ability of several models of exchange rate volatility," Journal of Econometrics, Elsevier, vol. 69(2), pages 367-391, October.
    10. West, Kenneth D. & Edison, Hali J. & Cho, Dongchul, 1993. "A utility-based comparison of some models of exchange rate volatility," Journal of International Economics, Elsevier, vol. 35(1-2), pages 23-45, August.
    11. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    12. Bollerslev, Tim & Engle, Robert F. & Nelson, Daniel B., 1986. "Arch models," Handbook of Econometrics, in: R. F. Engle & D. McFadden (ed.), Handbook of Econometrics, edition 1, volume 4, chapter 49, pages 2959-3038, Elsevier.
    13. Stockman, Alan C., 1987. "Economic theory and exchange rate forecasts," International Journal of Forecasting, Elsevier, vol. 3(1), pages 3-15.
    14. Andrew Harvey & Esther Ruiz & Neil Shephard, 1994. "Multivariate Stochastic Variance Models," Review of Economic Studies, Oxford University Press, vol. 61(2), pages 247-264.
    15. Robert F. Engle & Alex Kane & Jaesun Noh, 1993. "Index-Option Pricing with Stochastic Volatility and the Value of Accurate Variance Forecasts," NBER Working Papers 4519, National Bureau of Economic Research, Inc.
    16. Diebold, Francis X & Rudebusch, Glenn D, 1989. "Scoring the Leading Indicators," The Journal of Business, University of Chicago Press, vol. 62(3), pages 369-391, July.
    17. Donaldson, R.G. & Kim, K.H.Y., 1993. "Evaluating Alternative Models for Conditional Stock Volatility : Evidence from International Data," Discussion Papers dp93-06, Department of Economics, Simon Fraser University.
    18. Schwert, G William, 1989. " Why Does Stock Market Volatility Change over Time?," Journal of Finance, American Finance Association, vol. 44(5), pages 1115-1153, December.
    19. Engle, Robert F & Ng, Victor K, 1993. "Measuring and Testing the Impact of News on Volatility," Journal of Finance, American Finance Association, vol. 48(5), pages 1749-1778, December.
    20. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    21. James H. Stock & Mark W. Watson, 1993. "Business Cycles, Indicators, and Forecasting," NBER Books, National Bureau of Economic Research, Inc, number stoc93-1.
    22. Friedman, Benjamin M & Kuttner, Kenneth N, 1992. "Time-Varying Risk Perceptions and the Pricing of Risky Assets," Oxford Economic Papers, Oxford University Press, vol. 44(4), pages 566-598, October.
    23. Lee, Keun Yeong, 1991. "Are the GARCH models best in out-of-sample performance?," Economics Letters, Elsevier, vol. 37(3), pages 305-308, November.
    24. Ray C. Fair, 1991. "Estimating Event Probabilities from Macroeconomic Models Using Stochastic Simulation," NBER Technical Working Papers 0111, National Bureau of Economic Research, Inc.
    25. Stock, James H. & Watson, Mark W. (ed.), 1993. "Business Cycles, Indicators, and Forecasting," National Bureau of Economic Research Books, University of Chicago Press, edition 1, number 9780226774886, March.
    26. Robert F. Engle & Che-Hsiung Hong & Alex Kane, 1990. "Valuation of Variance Forecast with Simulated Option Markets," NBER Working Papers 3350, National Bureau of Economic Research, Inc.
    27. Ray C. Fair, 1993. "Estimating Event Probabilities from Macroeconometric Models Using Stochastic Simulation," NBER Chapters, in: Business Cycles, Indicators, and Forecasting, pages 157-178, National Bureau of Economic Research, Inc.
    28. Taylor, Stephen J., 1987. "Forecasting the volatility of currency exchange rates," International Journal of Forecasting, Elsevier, vol. 3(1), pages 159-170.
    29. Akgiray, Vedat, 1989. "Conditional Heteroscedasticity in Time Series of Stock Returns: Evidence and Forecasts," The Journal of Business, University of Chicago Press, vol. 62(1), pages 55-80, January.
    30. Kroner, Kenneth F. & Kneafsey, Devin P. & Claessens, Stijn & DEC, 1993. "Forecasting volatility in commodity markets," Policy Research Working Paper Series 1226, The World Bank.
    31. Benoit Mandelbrot, 2015. "The Variation of Certain Speculative Prices," World Scientific Book Chapters, in: Anastasios G Malliaris & William T Ziemba (ed.), THE WORLD SCIENTIFIC HANDBOOK OF FUTURES MARKETS, chapter 3, pages 39-78, World Scientific Publishing Co. Pte. Ltd..
    32. Engle, Robert F & Gonzalez-Rivera, Gloria, 1991. "Semiparametric ARCH Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 9(4), pages 345-359, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Franses,Philip Hans & Dijk,Dick van, 2000. "Non-Linear Time Series Models in Empirical Finance," Cambridge Books, Cambridge University Press, number 9780521779654.
    2. LeBaron, Blake, 2003. "Non-Linear Time Series Models in Empirical Finance,: Philip Hans Franses and Dick van Dijk, Cambridge University Press, Cambridge, 2000, 296 pp., Paperback, ISBN 0-521-77965-0, $33, [UK pound]22.95, [," International Journal of Forecasting, Elsevier, vol. 19(4), pages 751-752.
    3. Torben G. Andersen & Tim Bollerslev, 1997. "Answering the Critics: Yes, ARCH Models Do Provide Good Volatility Forecasts," NBER Working Papers 6023, National Bureau of Economic Research, Inc.
    4. Andersen, Torben G. & Bollerslev, Tim & Christoffersen, Peter F. & Diebold, Francis X., 2006. "Volatility and Correlation Forecasting," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 15, pages 777-878, Elsevier.
    5. repec:zbw:cfswop:wp200508 is not listed on IDEAS
    6. Torben G. Andersen & Tim Bollerslev & Peter F. Christoffersen & Francis X. Diebold, 2005. "Volatility Forecasting," CFS Working Paper Series 2005/08, Center for Financial Studies.
    7. Francis X. Diebold & Jose A. Lopez, 1995. "Measuring Volatility Dynamics," NBER Technical Working Papers 0173, National Bureau of Economic Research, Inc.
    8. Meddahi, Nour & Renault, Eric, 2004. "Temporal aggregation of volatility models," Journal of Econometrics, Elsevier, vol. 119(2), pages 355-379, April.
    9. Tim Bollerslev & Ray Y. Chou & Narayanan Jayaraman & Kenneth F. Kroner - L, 1991. "es modéles ARCH en finance : un point sur la théorie et les résultats empiriques," Annals of Economics and Statistics, GENES, issue 24, pages 1-59.
    10. Francis X. Diebold & Jose A. Lopez, 1995. "Forecast evaluation and combination," Research Paper 9525, Federal Reserve Bank of New York.
    11. Pagan, Adrian, 1996. "The econometrics of financial markets," Journal of Empirical Finance, Elsevier, vol. 3(1), pages 15-102, May.
    12. McCracken,M.W. & West,K.D., 2001. "Inference about predictive ability," Working papers 14, Wisconsin Madison - Social Systems.
    13. Eric Ghysels & Andrew Harvey & Eric Renault, 1995. "Stochastic Volatility," CIRANO Working Papers 95s-49, CIRANO.
    14. Tim Bollerslev, 2008. "Glossary to ARCH (GARCH)," CREATES Research Papers 2008-49, Department of Economics and Business Economics, Aarhus University.
    15. Font, Begoña, 1998. "Modelización de series temporales financieras. Una recopilación," DES - Documentos de Trabajo. Estadística y Econometría. DS 3664, Universidad Carlos III de Madrid. Departamento de Estadística.
    16. Xekalaki, Evdokia & Degiannakis, Stavros, 2005. "Evaluating volatility forecasts in option pricing in the context of a simulated options market," Computational Statistics & Data Analysis, Elsevier, vol. 49(2), pages 611-629, April.
    17. repec:zbw:cfswop:wp200411 is not listed on IDEAS
    18. Franses,Philip Hans & Dijk,Dick van & Opschoor,Anne, 2014. "Time Series Models for Business and Economic Forecasting," Cambridge Books, Cambridge University Press, number 9780521520911, May.
    19. Alfonso Dufour & Robert F Engle, 2000. "The ACD Model: Predictability of the Time Between Concecutive Trades," ICMA Centre Discussion Papers in Finance icma-dp2000-05, Henley Business School, University of Reading.
    20. Francis X. Diebold, 2004. "The Nobel Memorial Prize for Robert F. Engle," Scandinavian Journal of Economics, Wiley Blackwell, vol. 106(2), pages 165-185, June.
    21. Geoffrey F. Loudon & Wing H. Watt & Pradeep K. Yadav, 2000. "An empirical analysis of alternative parametric ARCH models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(2), pages 117-136.
    22. Degiannakis, Stavros & Xekalaki, Evdokia, 2004. "Autoregressive Conditional Heteroskedasticity (ARCH) Models: A Review," MPRA Paper 80487, University Library of Munich, Germany.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jof:jforec:v:20:y:2001:i:2:p:87-109. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: http://www3.interscience.wiley.com/cgi-bin/jhome/2966 .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley-Blackwell Digital Licensing or Christopher F. Baum (email available below). General contact details of provider: http://www3.interscience.wiley.com/cgi-bin/jhome/2966 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.