IDEAS home Printed from https://ideas.repec.org/a/jof/jforec/v20y2001i2p87-109.html
   My bibliography  Save this article

Evaluating the Predictive Accuracy of Volatility Models

Author

Listed:
  • Lopez, Jose A

Abstract

Standard statistical loss functions, such as mean-squared error, are commonly used for evaluating financial volatility forecasts. In this paper, an alternative evaluation framework, based on probability scoring rules that can be more closely tailored to a forecast user's decision problem, is proposed. According to the decision at hand, the user specifies the economic events to be forecast, the scoring rule with which to evaluate these probability forecasts, and the subsets of the forecasts of particular interest. The volatility forecasts from a model are then transformed into probability forecasts of the relevant events and evaluated using the selected scoring rule and calibration tests. An empirical example using exchange rate data illustrates the framework and confirms that the choice of loss function directly affects the forecast evaluation results. Copyright © 2001 by John Wiley & Sons, Ltd.

Suggested Citation

  • Lopez, Jose A, 2001. "Evaluating the Predictive Accuracy of Volatility Models," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 20(2), pages 87-109, March.
  • Handle: RePEc:jof:jforec:v:20:y:2001:i:2:p:87-109
    as

    Download full text from publisher

    To our knowledge, this item is not available for download. To find whether it is available, there are three options:
    1. Check below whether another version of this item is available online.
    2. Check on the provider's web page whether it is in fact available.
    3. Perform a search for a similarly titled item that would be available.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Friedman, Benjamin M & Kuttner, Kenneth N, 1992. "Time-Varying Risk Perceptions and the Pricing of Risky Assets," Oxford Economic Papers, Oxford University Press, vol. 44(4), pages 566-598, October.
    2. John F. Geweke, 1994. "Bayesian comparison of econometric models," Working Papers 532, Federal Reserve Bank of Minneapolis.
    3. Lee, Keun Yeong, 1991. "Are the GARCH models best in out-of-sample performance?," Economics Letters, Elsevier, vol. 37(3), pages 305-308, November.
    4. Jacquier, Eric & Polson, Nicholas G & Rossi, Peter E, 2002. "Bayesian Analysis of Stochastic Volatility Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 69-87, January.
    5. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-1084, September.
    6. Diebold & Lopez, "undated". "Modeling Volatility Dynamics," Home Pages _062, University of Pennsylvania.
    7. Kim, Kiwhan & Schmidt, Peter, 1993. "Unit root tests with conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 59(3), pages 287-300, October.
    8. Granger, C. W. J. & White, Halbert & Kamstra, Mark, 1989. "Interval forecasting : An analysis based upon ARCH-quantile estimators," Journal of Econometrics, Elsevier, vol. 40(1), pages 87-96, January.
    9. repec:bla:restud:v:65:y:1998:i:3:p:361-93 is not listed on IDEAS
    10. Bollerslev, Tim & Ghysels, Eric, 1996. "Periodic Autoregressive Conditional Heteroscedasticity," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(2), pages 139-151, April.
    11. Pagan, Adrian R. & Schwert, G. William, 1990. "Alternative models for conditional stock volatility," Journal of Econometrics, Elsevier, vol. 45(1-2), pages 267-290.
    12. West, Kenneth D. & Cho, Dongchul, 1995. "The predictive ability of several models of exchange rate volatility," Journal of Econometrics, Elsevier, vol. 69(2), pages 367-391, October.
    13. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    14. West, Kenneth D. & Edison, Hali J. & Cho, Dongchul, 1993. "A utility-based comparison of some models of exchange rate volatility," Journal of International Economics, Elsevier, vol. 35(1-2), pages 23-45, August.
    15. Ray C. Fair, 1991. "Estimating Event Probabilities from Macroeconomic Models Using Stochastic Simulation," NBER Technical Working Papers 0111, National Bureau of Economic Research, Inc.
    16. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    17. Bollerslev, Tim & Engle, Robert F. & Nelson, Daniel B., 1986. "Arch models," Handbook of Econometrics,in: R. F. Engle & D. McFadden (ed.), Handbook of Econometrics, edition 1, volume 4, chapter 49, pages 2959-3038 Elsevier.
    18. Robert F. Engle & Che-Hsiung Hong & Alex Kane, 1990. "Valuation of Variance Forecast with Simulated Option Markets," NBER Working Papers 3350, National Bureau of Economic Research, Inc.
    19. Schwert, G William, 1989. " Why Does Stock Market Volatility Change over Time?," Journal of Finance, American Finance Association, vol. 44(5), pages 1115-1153, December.
    20. Stockman, Alan C., 1987. "Economic theory and exchange rate forecasts," International Journal of Forecasting, Elsevier, vol. 3(1), pages 3-15.
    21. Ray C. Fair, 1993. "Estimating Event Probabilities from Macroeconometric Models Using Stochastic Simulation," NBER Chapters,in: Business Cycles, Indicators and Forecasting, pages 157-178 National Bureau of Economic Research, Inc.
    22. Engle, Robert F & Ng, Victor K, 1993. " Measuring and Testing the Impact of News on Volatility," Journal of Finance, American Finance Association, vol. 48(5), pages 1749-1778, December.
    23. Andrew Harvey & Esther Ruiz & Neil Shephard, 1994. "Multivariate Stochastic Variance Models," Review of Economic Studies, Oxford University Press, vol. 61(2), pages 247-264.
    24. Taylor, Stephen J., 1987. "Forecasting the volatility of currency exchange rates," International Journal of Forecasting, Elsevier, vol. 3(1), pages 159-170.
    25. Robert F. Engle & Alex Kane & Jaesun Noh, 1993. "Index-Option Pricing with Stochastic Volatility and the Value of Accurate Variance Forecasts," NBER Working Papers 4519, National Bureau of Economic Research, Inc.
    26. Diebold, Francis X & Rudebusch, Glenn D, 1989. "Scoring the Leading Indicators," The Journal of Business, University of Chicago Press, vol. 62(3), pages 369-391, July.
    27. Kroner, Kenneth F. & Kneafsey, Devin P. & Claessens, Stijn & DEC, 1993. "Forecasting volatility in commodity markets," Policy Research Working Paper Series 1226, The World Bank.
    28. Benoit Mandelbrot, 2015. "The Variation of Certain Speculative Prices," World Scientific Book Chapters,in: THE WORLD SCIENTIFIC HANDBOOK OF FUTURES MARKETS, chapter 3, pages 39-78 World Scientific Publishing Co. Pte. Ltd..
    29. Engle, Robert F & Gonzalez-Rivera, Gloria, 1991. "Semiparametric ARCH Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 9(4), pages 345-359, October.
    Full references (including those not matched with items on IDEAS)

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jof:jforec:v:20:y:2001:i:2:p:87-109. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Wiley-Blackwell Digital Licensing) or (Christopher F. Baum). General contact details of provider: http://www3.interscience.wiley.com/cgi-bin/jhome/2966 .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.