IDEAS home Printed from https://ideas.repec.org/a/zbw/ifweej/7594.html
   My bibliography  Save this article

Forecast Evaluation of Explanatory Models of Financial Variability

Author

Listed:
  • Sucarrat, Genaro

Abstract

A practice that has become widespread and widely endorsed is that of evaluating forecasts of financial variability obtained from discrete time models by comparing them with high-frequency ex post estimates (e.g. realised volatility) based on continuous time theory. In explanatory financial variability modelling this raises several methodological and practical issues, which suggests an alternative approach is needed. The contribution of this study is twofold. First, the finite sample properties of operational and practical procedures for the forecast evaluation of explanatory discrete time models of financial variability are studied. Second, based on the simulation results a simple but general framework is proposed and illustrated. The illustration provides an example of where an explanatory model outperforms realised volatility ex post.

Suggested Citation

  • Sucarrat, Genaro, 2009. "Forecast Evaluation of Explanatory Models of Financial Variability," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 3, pages 1-33.
    • Handle: RePEc:zbw:ifweej:7594
    DOI: 10.5018/economics-ejournal.ja.2009-8
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.5018/economics-ejournal.ja.2009-8
    Download Restriction: no
    File URL: https://www.econstor.eu/bitstream/10419/27528/1/economics_2009-8.pdf
    Download Restriction: no
    File URL: https://libkey.io/10.5018/economics-ejournal.ja.2009-8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Martin D.D. Evans & Richard K. Lyons, 2017. "Order Flow and Exchange Rate Dynamics," World Scientific Book Chapters, in: Studies in Foreign Exchange Economics, chapter 6, pages 247-290, World Scientific Publishing Co. Pte. Ltd..
    2. Engle, Robert F. & Patton, Andrew J., 2004. "Impacts of trades in an error-correction model of quote prices," Journal of Financial Markets, Elsevier, vol. 7(1), pages 1-25, January.
    3. Hasbrouck, Joel, 1991. "Measuring the Information Content of Stock Trades," Journal of Finance, American Finance Association, vol. 46(1), pages 179-207, March.
    4. Nour Meddahi, 2002. "A theoretical comparison between integrated and realized volatility," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 17(5), pages 479-508.
    5. Torben G. Andersen & Tim Bollerslev & Nour Meddahi, 2005. "Correcting the Errors: Volatility Forecast Evaluation Using High-Frequency Data and Realized Volatilities," Econometrica, Econometric Society, vol. 73(1), pages 279-296, January.
    6. Hansen, Peter Reinhard & Lunde, Asger, 2006. "Consistent ranking of volatility models," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 97-121.
    7. Bauwens, Luc & Sucarrat, Genaro, 2010. "General-to-specific modelling of exchange rate volatility: A forecast evaluation," International Journal of Forecasting, Elsevier, vol. 26(4), pages 885-907, October.
    8. Yacine Ait--Sahalia & Per A. Mykland, 2003. "The Effects of Random and Discrete Sampling when Estimating Continuous--Time Diffusions," Econometrica, Econometric Society, vol. 71(2), pages 483-549, March.
    9. Yacine Aït-Sahalia, 2005. "How Often to Sample a Continuous-Time Process in the Presence of Market Microstructure Noise," The Review of Financial Studies, Society for Financial Studies, vol. 18(2), pages 351-416.
    10. Blundell,Richard & Newey,Whitney & Persson,Torsten (ed.), 2007. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521692106.
    11. Andersen, Torben G & Bollerslev, Tim, 1998. "Answering the Skeptics: Yes, Standard Volatility Models Do Provide Accurate Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 885-905, November.
    12. Dimitris Bertsimas & Leonid Kogan & Andrew W. Lo, 2001. "When Is Time Continuous?," World Scientific Book Chapters, in: Marco Avellaneda (ed.), Quantitative Analysis In Financial Markets Collected Papers of the New York University Mathematical Finance Seminar(Volume II), chapter 3, pages 71-102, World Scientific Publishing Co. Pte. Ltd..
    13. Chordia, Tarun & Roll, Richard & Subrahmanyam, Avanidhar, 2002. "Order imbalance, liquidity, and market returns," Journal of Financial Economics, Elsevier, vol. 65(1), pages 111-130, July.
    14. Hendry, David F. & Richard, Jean-Francois, 1982. "On the formulation of empirical models in dynamic econometrics," Journal of Econometrics, Elsevier, vol. 20(1), pages 3-33, October.
    15. Alvaro Escribano & Roberto Pascual, 2008. "Asymmetries in bid and ask responses to innovations in the trading process," Studies in Empirical Economics, in: Luc Bauwens & Winfried Pohlmeier & David Veredas (ed.), High Frequency Financial Econometrics, pages 49-82, Springer.
    16. Lee, Charles M C & Ready, Mark J, 1991. "Inferring Trade Direction from Intraday Data," Journal of Finance, American Finance Association, vol. 46(2), pages 733-746, June.
    17. Romano, Joseph P. & Shaikh, Azeem M. & Wolf, Michael, 2008. "Formalized Data Snooping Based On Generalized Error Rates," Econometric Theory, Cambridge University Press, vol. 24(2), pages 404-447, April.
    18. Torben G. Andersen & Tim Bollerslev & Francis X. Diebold & Paul Labys, 2003. "Modeling and Forecasting Realized Volatility," Econometrica, Econometric Society, vol. 71(2), pages 579-625, March.
    19. Spanos,Aris, 1999. "Probability Theory and Statistical Inference," Cambridge Books, Cambridge University Press, number 9780521424080.
    20. Andersen, Torben G. & Bollerslev, Tim & Christoffersen, Peter F. & Diebold, Francis X., 2006. "Volatility and Correlation Forecasting," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 15, pages 777-878, Elsevier.
    21. White, Halbert, 1980. "A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity," Econometrica, Econometric Society, vol. 48(4), pages 817-838, May.
    22. Andersen, Torben G. & Bollerslev, Tim & Lange, Steve, 1999. "Forecasting financial market volatility: Sample frequency vis-a-vis forecast horizon," Journal of Empirical Finance, Elsevier, vol. 6(5), pages 457-477, December.
    23. Asger Lunde & Peter R. Hansen, 2005. "A forecast comparison of volatility models: does anything beat a GARCH(1,1)?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(7), pages 873-889.
    24. Genaro Sucarrat, 2010. "Econometric reduction theory and philosophy," Journal of Economic Methodology, Taylor & Francis Journals, vol. 17(1), pages 53-75.
    25. Patton, Andrew J., 2011. "Volatility forecast comparison using imperfect volatility proxies," Journal of Econometrics, Elsevier, vol. 160(1), pages 246-256, January.
    26. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    27. Blundell,Richard & Newey,Whitney & Persson,Torsten (ed.), 2007. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521871549.
    28. Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
    29. Andersen T. G & Bollerslev T. & Diebold F. X & Labys P., 2001. "The Distribution of Realized Exchange Rate Volatility," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 42-55, March.
    30. Jacob A. Mincer & Victor Zarnowitz, 1969. "The Evaluation of Economic Forecasts," NBER Chapters, in: Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance, pages 3-46, National Bureau of Economic Research, Inc.
    31. Ole E. Barndorff-Nielsen & Neil Shephard, 2002. "Estimating quadratic variation using realized variance," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 17(5), pages 457-477.
    32. Hansen, Peter Reinhard, 2005. "A Test for Superior Predictive Ability," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 365-380, October.
    33. Blundell,Richard & Newey,Whitney K. & Persson,Torsten (ed.), 2007. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521871532.
    34. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    35. Blundell,Richard & Newey,Whitney K. & Persson,Torsten (ed.), 2007. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521692090.
    36. Meddahi, N., 2001. "A Theoretical Comparison Between Integrated and Realized Volatilies," Cahiers de recherche 2001-26, Centre interuniversitaire de recherche en économie quantitative, CIREQ.
    37. Taylor, Stephen J. & Xu, Xinzhong, 1997. "The incremental volatility information in one million foreign exchange quotations," Journal of Empirical Finance, Elsevier, vol. 4(4), pages 317-340, December.
    38. Harvey, David & Leybourne, Stephen & Newbold, Paul, 1997. "Testing the equality of prediction mean squared errors," International Journal of Forecasting, Elsevier, vol. 13(2), pages 281-291, June.
    39. Julia Campos & Neil R. Ericsson & David F. Hendry, 2005. "General-to-specific modeling: an overview and selected bibliography," International Finance Discussion Papers 838, Board of Governors of the Federal Reserve System (U.S.).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bauwens, Luc & Sucarrat, Genaro, 2010. "General-to-specific modelling of exchange rate volatility: A forecast evaluation," International Journal of Forecasting, Elsevier, vol. 26(4), pages 885-907, October.
    2. Sucarrat, Genaro, 2020. "Identification of Volatility Proxies as Expectations of Squared Financial Return," MPRA Paper 101953, University Library of Munich, Germany.
    3. Alvaro Escribano & Genaro Sucarrat, 2011. "Automated model selection in finance: General-to-speci c modelling of the mean and volatility speci cations," Working Papers 2011-09, Instituto Madrileño de Estudios Avanzados (IMDEA) Ciencias Sociales.
    4. Genaro Sucarrat & Alvaro Escribano, 2012. "Automated Model Selection in Finance: General-to-Specific Modelling of the Mean and Volatility Specifications," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 74(5), pages 716-735, October.
    5. Sucarrat, Genaro & Escribano, Álvaro, 2009. "Automated financial multi-path GETS modelling," UC3M Working papers. Economics we093620, Universidad Carlos III de Madrid. Departamento de Economía.
    6. Sucarrat, Genaro, 2021. "Identification of volatility proxies as expectations of squared financial returns," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1677-1690.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bauwens, Luc & Sucarrat, Genaro, 2010. "General-to-specific modelling of exchange rate volatility: A forecast evaluation," International Journal of Forecasting, Elsevier, vol. 26(4), pages 885-907, October.
    2. Patton, Andrew J., 2011. "Data-based ranking of realised volatility estimators," Journal of Econometrics, Elsevier, vol. 161(2), pages 284-303, April.
    3. Liu, Lily Y. & Patton, Andrew J. & Sheppard, Kevin, 2015. "Does anything beat 5-minute RV? A comparison of realized measures across multiple asset classes," Journal of Econometrics, Elsevier, vol. 187(1), pages 293-311.
    4. Michael McAleer & Marcelo Medeiros, 2008. "Realized Volatility: A Review," Econometric Reviews, Taylor & Francis Journals, vol. 27(1-3), pages 10-45.
    5. Matei, Marius, 2011. "Non-Linear Volatility Modeling of Economic and Financial Time Series Using High Frequency Data," Journal for Economic Forecasting, Institute for Economic Forecasting, vol. 0(2), pages 116-141, June.
    6. Patton, Andrew J., 2011. "Volatility forecast comparison using imperfect volatility proxies," Journal of Econometrics, Elsevier, vol. 160(1), pages 246-256, January.
    7. Maheu, John M. & McCurdy, Thomas H., 2011. "Do high-frequency measures of volatility improve forecasts of return distributions?," Journal of Econometrics, Elsevier, vol. 160(1), pages 69-76, January.
    8. Andrew J. Patton & Kevin Sheppard, 2008. "Evaluating Volatility and Correlation Forecasts," OFRC Working Papers Series 2008fe22, Oxford Financial Research Centre.
    9. Laurent, Sébastien & Rombouts, Jeroen V.K. & Violante, Francesco, 2013. "On loss functions and ranking forecasting performances of multivariate volatility models," Journal of Econometrics, Elsevier, vol. 173(1), pages 1-10.
    10. Bu, Ruijun & Hizmeri, Rodrigo & Izzeldin, Marwan & Murphy, Anthony & Tsionas, Mike, 2023. "The contribution of jump signs and activity to forecasting stock price volatility," Journal of Empirical Finance, Elsevier, vol. 70(C), pages 144-164.
    11. Patton, Andrew J. & Sheppard, Kevin, 2009. "Optimal combinations of realised volatility estimators," International Journal of Forecasting, Elsevier, vol. 25(2), pages 218-238.
    12. Li, Jia & Patton, Andrew J., 2018. "Asymptotic inference about predictive accuracy using high frequency data," Journal of Econometrics, Elsevier, vol. 203(2), pages 223-240.
    13. Francis X. Diebold & Georg H. Strasser, 2008. "On the Correlation Structure of Microstructure Noise in Theory and Practice," PIER Working Paper Archive 08-038, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    14. Hansen, Peter R. & Lunde, Asger, 2006. "Realized Variance and Market Microstructure Noise," Journal of Business & Economic Statistics, American Statistical Association, vol. 24, pages 127-161, April.
    15. Francis X. Diebold & Georg Strasser, 2013. "On the Correlation Structure of Microstructure Noise: A Financial Economic Approach," Review of Economic Studies, Oxford University Press, vol. 80(4), pages 1304-1337.
    16. Bali, Turan G. & Weinbaum, David, 2007. "A conditional extreme value volatility estimator based on high-frequency returns," Journal of Economic Dynamics and Control, Elsevier, vol. 31(2), pages 361-397, February.
    17. Chaboud, Alain P. & Chiquoine, Benjamin & Hjalmarsson, Erik & Loretan, Mico, 2010. "Frequency of observation and the estimation of integrated volatility in deep and liquid financial markets," Journal of Empirical Finance, Elsevier, vol. 17(2), pages 212-240, March.
    18. Andersen, Torben G. & Bollerslev, Tim & Meddahi, Nour, 2011. "Realized volatility forecasting and market microstructure noise," Journal of Econometrics, Elsevier, vol. 160(1), pages 220-234, January.
    19. Degiannakis, Stavros & Filis, George, 2017. "Forecasting oil price realized volatility using information channels from other asset classes," Journal of International Money and Finance, Elsevier, vol. 76(C), pages 28-49.
    20. Degiannakis, Stavros & Floros, Christos, 2013. "Modeling CAC40 volatility using ultra-high frequency data," Research in International Business and Finance, Elsevier, vol. 28(C), pages 68-81.

    More about this item

    Keywords

    Financial variability; financial volatility; forecasting; explanatory modelling; exchange rates;
    All these keywords.

    JEL classification:

    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • F31 - International Economics - - International Finance - - - Foreign Exchange
    • F37 - International Economics - - International Finance - - - International Finance Forecasting and Simulation: Models and Applications
    • F47 - International Economics - - Macroeconomic Aspects of International Trade and Finance - - - Forecasting and Simulation: Models and Applications

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:ifweej:7594. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/iwkiede.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.