IDEAS home Printed from https://ideas.repec.org/p/sce/scecf2/223.html
   My bibliography  Save this paper

Comparing the Accuracy of Density Forecasts from Competing Models

Author

Listed:
  • Sarno, Lucio
  • Valente, Giorgio

Abstract

A rapidly growing literature emphasizes the importance of evaluating the forecast accuracy of empirical models on the basis of density (as opposed to point) forecasting performance. We propose a test statistic for the null hypothesis that two competing models have equal density forecast accuracy. Monte Carlo simulations suggest that the test, which has a known limiting distribution, displays satisfactory size and power properties. The use of the test is illustrated with an application to exchange rate forecasting. Copyright © 2004 John Wiley & Sons, Ltd.
(This abstract was borrowed from another version of this item.)

Suggested Citation

  • Sarno, Lucio & Valente, Giorgio, 2002. "Comparing the Accuracy of Density Forecasts from Competing Models," Computing in Economics and Finance 2002 223, Society for Computational Economics.
  • Handle: RePEc:sce:scecf2:223
    as

    Download full text from publisher

    To our knowledge, this item is not available for download. To find whether it is available, there are three options:
    1. Check below whether another version of this item is available online.
    2. Check on the provider's web page whether it is in fact available.
    3. Perform a search for a similarly titled item that would be available.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Kenneth Rogoff, 1996. "The Purchasing Power Parity Puzzle," Journal of Economic Literature, American Economic Association, vol. 34(2), pages 647-668, June.
    2. Berkowitz, Jeremy, 2001. "Testing Density Forecasts, with Applications to Risk Management," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(4), pages 465-474, October.
    3. Clarida, Richard H. & Sarno, Lucio & Taylor, Mark P. & Valente, Giorgio, 2003. "The out-of-sample success of term structure models as exchange rate predictors: a step beyond," Journal of International Economics, Elsevier, vol. 60(1), pages 61-83, May.
    4. Sarno, Lucio & Valente, Giorgio, 2005. "Empirical exchange rate models and currency risk: some evidence from density forecasts," Journal of International Money and Finance, Elsevier, vol. 24(2), pages 363-385, March.
    5. Wallis, Kenneth F., 2003. "Chi-squared tests of interval and density forecasts, and the Bank of England's fan charts," International Journal of Forecasting, Elsevier, vol. 19(2), pages 165-175.
    6. Anthony Tay & Kenneth F. Wallis, 2000. "Density Forecasting: A Survey," Econometric Society World Congress 2000 Contributed Papers 0370, Econometric Society.
    7. Fuchun Li & Greg Tkacz, 2001. "A Consistent Bootstrap Test for Conditional Density Functions with Time-Dependent Data," Staff Working Papers 01-21, Bank of Canada.
    8. Lucio Sarno & Mark P. Taylor, 2002. "Purchasing Power Parity and the Real Exchange Rate," IMF Staff Papers, Palgrave Macmillan, vol. 49(1), pages 1-5.
    9. Corker, R. J. & Holly, S. & Ellis, R. G., 1986. "Uncertainty and forecast precision," International Journal of Forecasting, Elsevier, vol. 2(1), pages 53-53.
    10. Lopez, Jose A, 2001. "Evaluating the Predictive Accuracy of Volatility Models," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 20(2), pages 87-109, March.
    11. Anderson, N. H. & Hall, P. & Titterington, D. M., 1994. "Two-Sample Test Statistics for Measuring Discrepancies Between Two Multivariate Probability Density Functions Using Kernel-Based Density Estimates," Journal of Multivariate Analysis, Elsevier, vol. 50(1), pages 41-54, July.
    12. Richard H. Clarida & Mark P. Taylor, 1997. "The Term Structure Of Forward Exchange Premiums And The Forecastability Of Spot Exchange Rates: Correcting The Errors," The Review of Economics and Statistics, MIT Press, vol. 79(3), pages 353-361, August.
    13. Pagan,Adrian & Ullah,Aman, 1999. "Nonparametric Econometrics," Cambridge Books, Cambridge University Press, number 9780521355643, May.
    14. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    15. Diebold, Francis X & Gunther, Todd A & Tay, Anthony S, 1998. "Evaluating Density Forecasts with Applications to Financial Risk Management," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 863-883, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hua, Zhongsheng & Zhang, Bin, 2008. "Improving density forecast by modeling asymmetric features: An application to S&P500 returns," European Journal of Operational Research, Elsevier, vol. 185(2), pages 716-725, March.
    2. repec:wly:japmet:v:32:y:2017:i:1:p:120-139 is not listed on IDEAS
    3. Andreas Lindemann & Christian Dunis & Paulo Lisboa, 2005. "Probability distributions and leveraged trading strategies: an application of Gaussian mixture models to the Morgan Stanley Technology Index Tracking Fund," Quantitative Finance, Taylor & Francis Journals, vol. 5(5), pages 459-474.
    4. Mouratidis, Kostas, 2008. "Evaluating currency crises: A Bayesian Markov switching approach," Journal of Macroeconomics, Elsevier, vol. 30(4), pages 1688-1711, December.
    5. Cees Diks & Valentyn Panchenko & Dick van Dijk, 2008. "Partial Likelihood-Based Scoring Rules for Evaluating Density Forecasts in Tails," Tinbergen Institute Discussion Papers 08-050/4, Tinbergen Institute.
    6. Giorgio Valente & Lucio Sarno, 2005. "Modelling and forecasting stock returns: exploiting the futures market, regime shifts and international spillovers," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(3), pages 345-376.
    7. John Stachurski & Vance Martin, 2008. "Computing the Distributions of Economic Models via Simulation," Econometrica, Econometric Society, vol. 76(2), pages 443-450, March.
    8. Sarno, Lucio & Valente, Giorgio, 2005. "Empirical exchange rate models and currency risk: some evidence from density forecasts," Journal of International Money and Finance, Elsevier, vol. 24(2), pages 363-385, March.
    9. Lucio Sarno, 2003. "Nonlinear Exchange Rate Models: A Selective Overview," Rivista di Politica Economica, SIPI Spa, vol. 93(4), pages 3-46, July-Augu.
    10. Erik Kole & Dick Dijk, 2017. "How to Identify and Forecast Bull and Bear Markets?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(1), pages 120-139, January.
    11. Clarida, Richard H. & Sarno, Lucio & Taylor, Mark P. & Valente, Giorgio, 2003. "The out-of-sample success of term structure models as exchange rate predictors: a step beyond," Journal of International Economics, Elsevier, vol. 60(1), pages 61-83, May.
    12. Diks, Cees & Panchenko, Valentyn & van Dijk, Dick, 2011. "Likelihood-based scoring rules for comparing density forecasts in tails," Journal of Econometrics, Elsevier, vol. 163(2), pages 215-230, August.
    13. Tsyplakov, Alexander, 2014. "Theoretical guidelines for a partially informed forecast examiner," MPRA Paper 55017, University Library of Munich, Germany.
    14. repec:hal:journl:peer-00834423 is not listed on IDEAS
    15. Tae-Hwy Lee & Yong Bao & Burak Saltoğlu, 2007. "Comparing density forecast models Previous versions of this paper have been circulated with the title, 'A Test for Density Forecast Comparison with Applications to Risk Management' since October 2003;," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 26(3), pages 203-225.
    16. Andrea Cipollini & Bassam Fattouh & Kostas Mouratidis, 2009. "Fiscal Readjustments In The United States: A Nonlinear Time-Series Analysis," Economic Inquiry, Western Economic Association International, vol. 47(1), pages 34-54, January.
    17. Shamiri, Ahmed & Shaari, Abu Hassan & Isa, Zaidi, 2008. "Comparing the accuracy of density forecasts from competing GARCH models," MPRA Paper 13662, University Library of Munich, Germany.
    18. John W. Galbraith & Greg Tkacz, 2007. "How Far Can Forecasting Models Forecast? Forecast Content Horizons for Some Important Macroeconomic Variables," Staff Working Papers 07-1, Bank of Canada.
    19. Anthony Garratt & Kevin Lee, 2006. "Investing Under Model Uncertainty: Decision Based Evaluation of Exchange Rate and Interest Rate Forecasts in the US, UK and Japan," Birkbeck Working Papers in Economics and Finance 0616, Birkbeck, Department of Economics, Mathematics & Statistics.

    More about this item

    Keywords

    exchange rates; forecasting; forecast evaluation; density forecast.;

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • F31 - International Economics - - International Finance - - - Foreign Exchange

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sce:scecf2:223. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Christopher F. Baum). General contact details of provider: http://edirc.repec.org/data/sceeeea.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.