IDEAS home Printed from https://ideas.repec.org/p/fip/fednrp/9524.html
   My bibliography  Save this paper

Evaluating the predictive accuracy of volatility models

Author

Listed:
  • Jose A. Lopez

Abstract

The volatility forecast evaluations most meaningful to forecast users are those conducted under economically relevant loss functions. Although several such loss functions are proposed in the literature, their implied economic costs are of interest only to specific types of volatility forecast users. A forecast evaluation framework that incorporates a more general class of economic loss functions is proposed. A user's loss function specifies the three key elements of the evaluation framework: the economic events to be forecast, the criterion with which to evaluate these forecasts, and the subsets of the forecasts of particular interest. Volatility forecasts are transformed into probability forecasts of the specified events, and the probability forecasts are evaluated using statistical criteria, such as probability scoring rules, tailored to the user's interests. An empirical example using exchange rates illustrates the procedure and confirms that the choice of loss function directly affects the forecast evaluation results.

Suggested Citation

  • Jose A. Lopez, 1995. "Evaluating the predictive accuracy of volatility models," Research Paper 9524, Federal Reserve Bank of New York.
  • Handle: RePEc:fip:fednrp:9524
    as

    Download full text from publisher

    File URL: https://www.newyorkfed.org/medialibrary/media/research/staff_reports/research_papers/9524.html
    Download Restriction: no

    File URL: https://www.newyorkfed.org/medialibrary/media/research/staff_reports/research_papers/9524.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. John F. Geweke, 1994. "Bayesian comparison of econometric models," Working Papers 532, Federal Reserve Bank of Minneapolis.
    2. Jacquier, Eric & Polson, Nicholas G & Rossi, Peter E, 2002. "Bayesian Analysis of Stochastic Volatility Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 69-87, January.
    3. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-1084, September.
    4. Diebold & Lopez, "undated". "Modeling Volatility Dynamics," Home Pages _062, University of Pennsylvania.
    5. Kim, Kiwhan & Schmidt, Peter, 1993. "Unit root tests with conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 59(3), pages 287-300, October.
    6. Granger, C. W. J. & White, Halbert & Kamstra, Mark, 1989. "Interval forecasting : An analysis based upon ARCH-quantile estimators," Journal of Econometrics, Elsevier, vol. 40(1), pages 87-96, January.
    7. Bollerslev, Tim & Ghysels, Eric, 1996. "Periodic Autoregressive Conditional Heteroscedasticity," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(2), pages 139-151, April.
    8. Pagan, Adrian R. & Schwert, G. William, 1990. "Alternative models for conditional stock volatility," Journal of Econometrics, Elsevier, vol. 45(1-2), pages 267-290.
    9. West, Kenneth D. & Cho, Dongchul, 1995. "The predictive ability of several models of exchange rate volatility," Journal of Econometrics, Elsevier, vol. 69(2), pages 367-391, October.
    10. West, Kenneth D. & Edison, Hali J. & Cho, Dongchul, 1993. "A utility-based comparison of some models of exchange rate volatility," Journal of International Economics, Elsevier, vol. 35(1-2), pages 23-45, August.
    11. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    12. Bollerslev, Tim & Engle, Robert F. & Nelson, Daniel B., 1986. "Arch models," Handbook of Econometrics, in: R. F. Engle & D. McFadden (ed.), Handbook of Econometrics, edition 1, volume 4, chapter 49, pages 2959-3038, Elsevier.
    13. Stockman, Alan C., 1987. "Economic theory and exchange rate forecasts," International Journal of Forecasting, Elsevier, vol. 3(1), pages 3-15.
    14. Andrew Harvey & Esther Ruiz & Neil Shephard, 1994. "Multivariate Stochastic Variance Models," Review of Economic Studies, Oxford University Press, vol. 61(2), pages 247-264.
    15. Robert F. Engle & Alex Kane & Jaesun Noh, 1993. "Index-Option Pricing with Stochastic Volatility and the Value of Accurate Variance Forecasts," NBER Working Papers 4519, National Bureau of Economic Research, Inc.
    16. Diebold, Francis X & Rudebusch, Glenn D, 1989. "Scoring the Leading Indicators," The Journal of Business, University of Chicago Press, vol. 62(3), pages 369-391, July.
    17. Schwert, G William, 1989. " Why Does Stock Market Volatility Change over Time?," Journal of Finance, American Finance Association, vol. 44(5), pages 1115-1153, December.
    18. Engle, Robert F & Ng, Victor K, 1993. "Measuring and Testing the Impact of News on Volatility," Journal of Finance, American Finance Association, vol. 48(5), pages 1749-1778, December.
    19. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    20. Friedman, Benjamin M & Kuttner, Kenneth N, 1992. "Time-Varying Risk Perceptions and the Pricing of Risky Assets," Oxford Economic Papers, Oxford University Press, vol. 44(4), pages 566-598, October.
    21. Lee, Keun Yeong, 1991. "Are the GARCH models best in out-of-sample performance?," Economics Letters, Elsevier, vol. 37(3), pages 305-308, November.
    22. Ray C. Fair, 1991. "Estimating Event Probabilities from Macroeconomic Models Using Stochastic Simulation," NBER Technical Working Papers 0111, National Bureau of Economic Research, Inc.
    23. Robert F. Engle & Che-Hsiung Hong & Alex Kane, 1990. "Valuation of Variance Forecast with Simulated Option Markets," NBER Working Papers 3350, National Bureau of Economic Research, Inc.
    24. Ray C. Fair, 1993. "Estimating Event Probabilities from Macroeconometric Models Using Stochastic Simulation," NBER Chapters, in: Business Cycles, Indicators, and Forecasting, pages 157-178, National Bureau of Economic Research, Inc.
    25. Taylor, Stephen J., 1987. "Forecasting the volatility of currency exchange rates," International Journal of Forecasting, Elsevier, vol. 3(1), pages 159-170.
    26. Kroner, Kenneth F. & Kneafsey, Devin P. & Claessens, Stijn & DEC, 1993. "Forecasting volatility in commodity markets," Policy Research Working Paper Series 1226, The World Bank.
    27. Benoit Mandelbrot, 2015. "The Variation of Certain Speculative Prices," World Scientific Book Chapters, in: Anastasios G Malliaris & William T Ziemba (ed.), THE WORLD SCIENTIFIC HANDBOOK OF FUTURES MARKETS, chapter 3, pages 39-78, World Scientific Publishing Co. Pte. Ltd..
    28. Engle, Robert F & Gonzalez-Rivera, Gloria, 1991. "Semiparametric ARCH Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 9(4), pages 345-359, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Franses,Philip Hans & Dijk,Dick van, 2000. "Non-Linear Time Series Models in Empirical Finance," Cambridge Books, Cambridge University Press, number 9780521779654, July.
    2. LeBaron, Blake, 2003. "Non-Linear Time Series Models in Empirical Finance,: Philip Hans Franses and Dick van Dijk, Cambridge University Press, Cambridge, 2000, 296 pp., Paperback, ISBN 0-521-77965-0, $33, [UK pound]22.95, [," International Journal of Forecasting, Elsevier, vol. 19(4), pages 751-752.
    3. Torben G. Andersen & Tim Bollerslev, 1997. "Answering the Critics: Yes, ARCH Models Do Provide Good Volatility Forecasts," NBER Working Papers 6023, National Bureau of Economic Research, Inc.
    4. Andersen, Torben G. & Bollerslev, Tim & Christoffersen, Peter F. & Diebold, Francis X., 2006. "Volatility and Correlation Forecasting," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 15, pages 777-878, Elsevier.
    5. repec:zbw:cfswop:wp200508 is not listed on IDEAS
    6. Torben G. Andersen & Tim Bollerslev & Peter F. Christoffersen & Francis X. Diebold, 2005. "Volatility Forecasting," CFS Working Paper Series 2005/08, Center for Financial Studies.
    7. Francis X. Diebold & Jose A. Lopez, 1995. "Measuring Volatility Dynamics," NBER Technical Working Papers 0173, National Bureau of Economic Research, Inc.
    8. Meddahi, Nour & Renault, Eric, 2004. "Temporal aggregation of volatility models," Journal of Econometrics, Elsevier, vol. 119(2), pages 355-379, April.
    9. Francis X. Diebold & Jose A. Lopez, 1995. "Forecast evaluation and combination," Research Paper 9525, Federal Reserve Bank of New York.
    10. Pagan, Adrian, 1996. "The econometrics of financial markets," Journal of Empirical Finance, Elsevier, vol. 3(1), pages 15-102, May.
    11. Eric Ghysels & Andrew Harvey & Eric Renault, 1995. "Stochastic Volatility," CIRANO Working Papers 95s-49, CIRANO.
    12. Tim Bollerslev, 2008. "Glossary to ARCH (GARCH)," CREATES Research Papers 2008-49, Department of Economics and Business Economics, Aarhus University.
    13. Tim Bollerslev & Ray Y. Chou & Narayanan Jayaraman & Kenneth F. Kroner - L, 1991. "es modéles ARCH en finance : un point sur la théorie et les résultats empiriques," Annals of Economics and Statistics, GENES, issue 24, pages 1-59.
    14. Font, Begoña, 1998. "Modelización de series temporales financieras. Una recopilación," DES - Documentos de Trabajo. Estadística y Econometría. DS 3664, Universidad Carlos III de Madrid. Departamento de Estadística.
    15. Xekalaki, Evdokia & Degiannakis, Stavros, 2005. "Evaluating volatility forecasts in option pricing in the context of a simulated options market," Computational Statistics & Data Analysis, Elsevier, vol. 49(2), pages 611-629, April.
    16. Franses,Philip Hans & Dijk,Dick van & Opschoor,Anne, 2014. "Time Series Models for Business and Economic Forecasting," Cambridge Books, Cambridge University Press, number 9780521520911, December.
    17. Degiannakis, Stavros & Xekalaki, Evdokia, 2004. "Autoregressive Conditional Heteroskedasticity (ARCH) Models: A Review," MPRA Paper 80487, University Library of Munich, Germany.
    18. Siem Jan Koopman & Eugenie Hol Uspensky, 2002. "The stochastic volatility in mean model: empirical evidence from international stock markets," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 17(6), pages 667-689.
    19. Issler, João Victor, 1999. "Estimating and forecasting the volatility of Brazilian finance series using arch models (Preliminary Version)," FGV EPGE Economics Working Papers (Ensaios Economicos da EPGE) 347, EPGE Brazilian School of Economics and Finance - FGV EPGE (Brazil).
    20. Stavros Degiannakis & Evdokia Xekalaki, 2007. "Assessing the performance of a prediction error criterion model selection algorithm in the context of ARCH models," Applied Financial Economics, Taylor & Francis Journals, vol. 17(2), pages 149-171.
    21. repec:zbw:cfswop:wp200411 is not listed on IDEAS
    22. Byun, Sung Je, 2016. "The usefulness of cross-sectional dispersion for forecasting aggregate stock price volatility," Journal of Empirical Finance, Elsevier, vol. 36(C), pages 162-180.

    More about this item

    Keywords

    Forecasting; Time-series analysis;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fednrp:9524. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://edirc.repec.org/data/frbnyus.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (email available below). General contact details of provider: https://edirc.repec.org/data/frbnyus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.