IDEAS home Printed from https://ideas.repec.org/a/jof/jforec/v20y2001i2p87-109.html
   My bibliography  Save this article

Evaluating the Predictive Accuracy of Volatility Models

Author

Listed:
  • Lopez, Jose A

Abstract

Standard statistical loss functions, such as mean-squared error, are commonly used for evaluating financial volatility forecasts. In this paper, an alternative evaluation framework, based on probability scoring rules that can be more closely tailored to a forecast user's decision problem, is proposed. According to the decision at hand, the user specifies the economic events to be forecast, the scoring rule with which to evaluate these probability forecasts, and the subsets of the forecasts of particular interest. The volatility forecasts from a model are then transformed into probability forecasts of the relevant events and evaluated using the selected scoring rule and calibration tests. An empirical example using exchange rate data illustrates the framework and confirms that the choice of loss function directly affects the forecast evaluation results. Copyright © 2001 by John Wiley & Sons, Ltd.

Suggested Citation

  • Lopez, Jose A, 2001. "Evaluating the Predictive Accuracy of Volatility Models," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 20(2), pages 87-109, March.
  • Handle: RePEc:jof:jforec:v:20:y:2001:i:2:p:87-109
    as

    Download full text from publisher

    To our knowledge, this item is not available for download. To find whether it is available, there are three options:
    1. Check below whether another version of this item is available online.
    2. Check on the provider's web page whether it is in fact available.
    3. Perform a search for a similarly titled item that would be available.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Friedman, Benjamin M & Kuttner, Kenneth N, 1992. "Time-Varying Risk Perceptions and the Pricing of Risky Assets," Oxford Economic Papers, Oxford University Press, vol. 44(4), pages 566-598, October.
    2. John F. Geweke, 1994. "Bayesian comparison of econometric models," Working Papers 532, Federal Reserve Bank of Minneapolis.
    3. Lee, Keun Yeong, 1991. "Are the GARCH models best in out-of-sample performance?," Economics Letters, Elsevier, vol. 37(3), pages 305-308, November.
    4. Jacquier, Eric & Polson, Nicholas G & Rossi, Peter E, 2002. "Bayesian Analysis of Stochastic Volatility Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 69-87, January.
    5. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-1084, September.
    6. Diebold & Lopez, "undated". "Modeling Volatility Dynamics," Home Pages _062, University of Pennsylvania.
    7. Kim, Kiwhan & Schmidt, Peter, 1993. "Unit root tests with conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 59(3), pages 287-300, October.
    8. Granger, C. W. J. & White, Halbert & Kamstra, Mark, 1989. "Interval forecasting : An analysis based upon ARCH-quantile estimators," Journal of Econometrics, Elsevier, vol. 40(1), pages 87-96, January.
    9. Bollerslev, Tim & Ghysels, Eric, 1996. "Periodic Autoregressive Conditional Heteroscedasticity," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(2), pages 139-151, April.
    10. Pagan, Adrian R. & Schwert, G. William, 1990. "Alternative models for conditional stock volatility," Journal of Econometrics, Elsevier, vol. 45(1-2), pages 267-290.
    11. West, Kenneth D. & Cho, Dongchul, 1995. "The predictive ability of several models of exchange rate volatility," Journal of Econometrics, Elsevier, vol. 69(2), pages 367-391, October.
    12. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    13. West, Kenneth D. & Edison, Hali J. & Cho, Dongchul, 1993. "A utility-based comparison of some models of exchange rate volatility," Journal of International Economics, Elsevier, vol. 35(1-2), pages 23-45, August.
    14. Ray C. Fair, 1991. "Estimating Event Probabilities from Macroeconomic Models Using Stochastic Simulation," NBER Technical Working Papers 0111, National Bureau of Economic Research, Inc.
    15. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    16. Bollerslev, Tim & Engle, Robert F. & Nelson, Daniel B., 1986. "Arch models," Handbook of Econometrics, in: R. F. Engle & D. McFadden (ed.), Handbook of Econometrics, edition 1, volume 4, chapter 49, pages 2959-3038, Elsevier.
    17. Robert F. Engle & Che-Hsiung Hong & Alex Kane, 1990. "Valuation of Variance Forecast with Simulated Option Markets," NBER Working Papers 3350, National Bureau of Economic Research, Inc.
    18. Stockman, Alan C., 1987. "Economic theory and exchange rate forecasts," International Journal of Forecasting, Elsevier, vol. 3(1), pages 3-15.
    19. Ray C. Fair, 1993. "Estimating Event Probabilities from Macroeconometric Models Using Stochastic Simulation," NBER Chapters, in: Business Cycles, Indicators, and Forecasting, pages 157-178, National Bureau of Economic Research, Inc.
    20. Engle, Robert F & Ng, Victor K, 1993. "Measuring and Testing the Impact of News on Volatility," Journal of Finance, American Finance Association, vol. 48(5), pages 1749-1778, December.
    21. Andrew Harvey & Esther Ruiz & Neil Shephard, 1994. "Multivariate Stochastic Variance Models," Review of Economic Studies, Oxford University Press, vol. 61(2), pages 247-264.
    22. Taylor, Stephen J., 1987. "Forecasting the volatility of currency exchange rates," International Journal of Forecasting, Elsevier, vol. 3(1), pages 159-170.
    23. Robert F. Engle & Alex Kane & Jaesun Noh, 1993. "Index-Option Pricing with Stochastic Volatility and the Value of Accurate Variance Forecasts," NBER Working Papers 4519, National Bureau of Economic Research, Inc.
    24. Diebold, Francis X & Rudebusch, Glenn D, 1989. "Scoring the Leading Indicators," The Journal of Business, University of Chicago Press, vol. 62(3), pages 369-391, July.
    25. Kroner, Kenneth F. & Kneafsey, Devin P. & Claessens, Stijn & DEC, 1993. "Forecasting volatility in commodity markets," Policy Research Working Paper Series 1226, The World Bank.
    26. Benoit Mandelbrot, 2015. "The Variation of Certain Speculative Prices," World Scientific Book Chapters, in: Anastasios G Malliaris & William T Ziemba (ed.), THE WORLD SCIENTIFIC HANDBOOK OF FUTURES MARKETS, chapter 3, pages 39-78, World Scientific Publishing Co. Pte. Ltd..
    27. Engle, Robert F & Gonzalez-Rivera, Gloria, 1991. "Semiparametric ARCH Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 9(4), pages 345-359, October.
    28. Schwert, G William, 1989. " Why Does Stock Market Volatility Change over Time?," Journal of Finance, American Finance Association, vol. 44(5), pages 1115-1153, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Franses,Philip Hans & Dijk,Dick van, 2000. "Non-Linear Time Series Models in Empirical Finance," Cambridge Books, Cambridge University Press, number 9780521779654, Fall.
    2. LeBaron, Blake, 2003. "Non-Linear Time Series Models in Empirical Finance,: Philip Hans Franses and Dick van Dijk, Cambridge University Press, Cambridge, 2000, 296 pp., Paperback, ISBN 0-521-77965-0, $33, [UK pound]22.95, [," International Journal of Forecasting, Elsevier, vol. 19(4), pages 751-752.
    3. Torben G. Andersen & Tim Bollerslev, 1997. "Answering the Critics: Yes, ARCH Models Do Provide Good Volatility Forecasts," NBER Working Papers 6023, National Bureau of Economic Research, Inc.
    4. Andersen, Torben G. & Bollerslev, Tim & Christoffersen, Peter F. & Diebold, Francis X., 2006. "Volatility and Correlation Forecasting," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 15, pages 777-878, Elsevier.
    5. repec:zbw:cfswop:wp200508 is not listed on IDEAS
    6. Torben G. Andersen & Tim Bollerslev & Peter F. Christoffersen & Francis X. Diebold, 2005. "Volatility Forecasting," PIER Working Paper Archive 05-011, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    7. Francis X. Diebold & Jose A. Lopez, 1995. "Measuring Volatility Dynamics," NBER Technical Working Papers 0173, National Bureau of Economic Research, Inc.
    8. Meddahi, Nour & Renault, Eric, 2004. "Temporal aggregation of volatility models," Journal of Econometrics, Elsevier, vol. 119(2), pages 355-379, April.
    9. Francis X. Diebold & Jose A. Lopez, 1995. "Forecast evaluation and combination," Research Paper 9525, Federal Reserve Bank of New York.
    10. Pagan, Adrian, 1996. "The econometrics of financial markets," Journal of Empirical Finance, Elsevier, vol. 3(1), pages 15-102, May.
    11. Eric Ghysels & Andrew Harvey & Eric Renault, 1995. "Stochastic Volatility," CIRANO Working Papers 95s-49, CIRANO.
    12. Tim Bollerslev, 2008. "Glossary to ARCH (GARCH)," CREATES Research Papers 2008-49, Department of Economics and Business Economics, Aarhus University.
    13. Tim Bollerslev & Ray Y. Chou & Narayanan Jayaraman & Kenneth F. Kroner - L, 1991. "es modéles ARCH en finance : un point sur la théorie et les résultats empiriques," Annals of Economics and Statistics, GENES, issue 24, pages 1-59.
    14. Font, Begoña, 1998. "Modelización de series temporales financieras. Una recopilación," DES - Documentos de Trabajo. Estadística y Econometría. DS 3664, Universidad Carlos III de Madrid. Departamento de Estadística.
    15. Xekalaki, Evdokia & Degiannakis, Stavros, 2005. "Evaluating volatility forecasts in option pricing in the context of a simulated options market," Computational Statistics & Data Analysis, Elsevier, vol. 49(2), pages 611-629, April.
    16. Franses,Philip Hans & Dijk,Dick van & Opschoor,Anne, 2014. "Time Series Models for Business and Economic Forecasting," Cambridge Books, Cambridge University Press, number 9780521520911, May.
    17. Degiannakis, Stavros & Xekalaki, Evdokia, 2004. "Autoregressive Conditional Heteroskedasticity (ARCH) Models: A Review," MPRA Paper 80487, University Library of Munich, Germany.
    18. Siem Jan Koopman & Eugenie Hol Uspensky, 2002. "The stochastic volatility in mean model: empirical evidence from international stock markets," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 17(6), pages 667-689.
    19. Issler, João Victor, 1999. "Estimating and forecasting the volatility of Brazilian finance series using arch models (Preliminary Version)," FGV EPGE Economics Working Papers (Ensaios Economicos da EPGE) 347, EPGE Brazilian School of Economics and Finance - FGV EPGE (Brazil).
    20. Stavros Degiannakis & Evdokia Xekalaki, 2007. "Assessing the performance of a prediction error criterion model selection algorithm in the context of ARCH models," Applied Financial Economics, Taylor & Francis Journals, vol. 17(2), pages 149-171.
    21. repec:zbw:cfswop:wp200411 is not listed on IDEAS
    22. Byun, Sung Je, 2016. "The usefulness of cross-sectional dispersion for forecasting aggregate stock price volatility," Journal of Empirical Finance, Elsevier, vol. 36(C), pages 162-180.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jof:jforec:v:20:y:2001:i:2:p:87-109. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Wiley-Blackwell Digital Licensing) or (Christopher F. Baum). General contact details of provider: http://www3.interscience.wiley.com/cgi-bin/jhome/2966 .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.