IDEAS home Printed from https://ideas.repec.org/a/bes/jnlbes/v13y1995i3p253-63.html
   My bibliography  Save this article

Comparing Predictive Accuracy

Author

Listed:
  • Diebold, Francis X
  • Mariano, Roberto S

Abstract

The authors propose and evaluate explicit tests of the null hypothesis of no difference in the accuracy of two competing forecasts. In contrast to previously developed tests, a wide variety of accuracy measures can be used (in particular, the loss function need not be quadratic and need not even be symmetric) and forecast errors can be non-Gaussian, nonzero mean, serially correlated, and contemporaneously correlated. Asymptotic and exact finite sample tests are proposed, evaluated, and illustrated.

Suggested Citation

  • Diebold, Francis X & Mariano, Roberto S, 1995. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(3), pages 253-263, July.
    • Handle: RePEc:bes:jnlbes:v:13:y:1995:i:3:p:253-63
    as

    Download full text from publisher

    To our knowledge, this item is not available for download. To find whether it is available, there are three options:
    1. Check below whether another version of this item is available online.
    2. Check on the provider's web page whether it is in fact available.
    3. Perform a search for a similarly titled item that would be available.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Toda, Hiro Y & Phillips, Peter C B, 1993. "Vector Autoregressions and Causality," Econometrica, Econometric Society, vol. 61(6), pages 1367-1393, November.
    2. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-1084, September.
    3. Yock Y. Chong & David F. Hendry, 1986. "Econometric Evaluation of Linear Macro-Economic Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 53(4), pages 671-690.
    4. Christoffersen, Peter F. & Diebold, Francis X., 1997. "Optimal Prediction Under Asymmetric Loss," Econometric Theory, Cambridge University Press, vol. 13(6), pages 808-817, December.
    5. Christiano, Lawrence J. & Eichenbaum, Martin, 1990. "Unit roots in real GNP: Do we know, and do we care?," Carnegie-Rochester Conference Series on Public Policy, Elsevier, vol. 32(1), pages 7-61, January.
    6. Engle, Robert F & Kozicki, Sharon, 1993. "Testing for Common Features," Journal of Business & Economic Statistics, American Statistical Association, vol. 11(4), pages 369-380, October.
    7. Hamilton, James D, 1989. "A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle," Econometrica, Econometric Society, vol. 57(2), pages 357-384, March.
    8. Engle, Robert F & Kozicki, Sharon, 1993. "Testing for Common Features: Reply," Journal of Business & Economic Statistics, American Statistical Association, vol. 11(4), pages 393-395, October.
    9. Weiss, Andrew A., 1991. "Multi-step estimation and forecasting in dynamic models," Journal of Econometrics, Elsevier, vol. 48(1-2), pages 135-149.
    10. Fair, Ray C & Shiller, Robert J, 1990. "Comparing Information in Forecasts from Econometric Models," American Economic Review, American Economic Association, vol. 80(3), pages 375-389, June.
    11. Cumby, Robert E. & Modest, David M., 1987. "Testing for market timing ability : A framework for forecast evaluation," Journal of Financial Economics, Elsevier, vol. 19(1), pages 169-189, September.
    12. Campbell, B. & Ghysels, E., 1992. "Is the Outcome of the Federal Budget Process Unbaised and Efficient? a NonParametric Assessment," Cahiers de recherche 9217, Universite de Montreal, Departement de sciences economiques.
    13. Ashley, R & Granger, C W J & Schmalensee, R, 1980. "Advertising and Aggregate Consumption: An Analysis of Causality," Econometrica, Econometric Society, vol. 48(5), pages 1149-1167, July.
    14. Meese, Richard A & Rogoff, Kenneth, 1988. "Was It Real? The Exchange Rate-Interest Differential Relation over the Modern Floating-Rate Period," Journal of Finance, American Finance Association, vol. 43(4), pages 933-948, September.
    15. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    16. Stock, James H. & Watson, Mark W., 1989. "Interpreting the evidence on money-income causality," Journal of Econometrics, Elsevier, vol. 40(1), pages 161-181, January.
    17. Engel, Charles, 1994. "Can the Markov switching model forecast exchange rates?," Journal of International Economics, Elsevier, vol. 36(1-2), pages 151-165, February.
    18. West, Kenneth D. & Edison, Hali J. & Cho, Dongchul, 1993. "A utility-based comparison of some models of exchange rate volatility," Journal of International Economics, Elsevier, vol. 35(1-2), pages 23-45, August.
    19. Phoebus J. Dhrymes & E. Philip Howrey & Saul H. Hymans & Jan Kmenta & Edward E. Leamer & Richard E. Quandt & James B. Ramsey & Harold T. Shapiro & Victor Zarnowitz, 1972. "Criteria for Evaluation of Econometric Models," NBER Chapters, in: Annals of Economic and Social Measurement, Volume 1, number 3, pages 291-324, National Bureau of Economic Research, Inc.
    20. Meese, R. & Rogoff, K., 1988. "Was It Real? The Exchange Rate-Interest Differential Ralation Over The Modern Floating-Rate Period," Working papers 368, Wisconsin Madison - Social Systems.
    21. Mark, Nelson C, 1995. "Exchange Rates and Fundamentals: Evidence on Long-Horizon Predictability," American Economic Review, American Economic Association, vol. 85(1), pages 201-218, March.
    22. Vuong, Quang H, 1989. "Likelihood Ratio Tests for Model Selection and Non-nested Hypotheses," Econometrica, Econometric Society, vol. 57(2), pages 307-333, March.
    23. Andrews, Donald W K, 1991. "Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation," Econometrica, Econometric Society, vol. 59(3), pages 817-858, May.
    24. McCulloch, Robert & Rossi, Peter E., 1990. "Posterior, predictive, and utility-based approaches to testing the arbitrage pricing theory," Journal of Financial Economics, Elsevier, vol. 28(1-2), pages 7-38.
    25. Rudebusch, Glenn D, 1993. "The Uncertain Unit Root in Real GNP," American Economic Review, American Economic Association, vol. 83(1), pages 264-272, March.
    26. Clemen, Robert T., 1989. "Combining forecasts: A review and annotated bibliography," International Journal of Forecasting, Elsevier, vol. 5(4), pages 559-583.
    27. Howrey, E Philip & Klein, Lawrence R & McCarthy, Michael D, 1974. "Notes on Testing the Predictive Performance of Econometric Models," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 15(2), pages 366-383, June.
    28. Bruce Mizrach, 1996. "Forecast Comparison in L2," Departmental Working Papers 199524, Rutgers University, Department of Economics.
    29. Francis X. Diebold & Glenn D. Rudebusch, 1989. "Forecasting output with the composite leading index: an ex ante analysis," Finance and Economics Discussion Series 90, Board of Governors of the Federal Reserve System (U.S.).
    30. Leitch, Gordon & Tanner, J Ernest, 1991. "Economic Forecast Evaluation: Profits versus the Conventional Error Measures," American Economic Review, American Economic Association, vol. 81(3), pages 580-590, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Francis X. Diebold & Jose A. Lopez, 1995. "Forecast evaluation and combination," Research Paper 9525, Federal Reserve Bank of New York.
    2. McCracken,M.W. & West,K.D., 2001. "Inference about predictive ability," Working papers 14, Wisconsin Madison - Social Systems.
    3. Francis X. Diebold & Roberto S. Mariano, 1991. "Comparing predictive accuracy I: an asymptotic test," Discussion Paper / Institute for Empirical Macroeconomics 52, Federal Reserve Bank of Minneapolis.
    4. West, Kenneth D., 2006. "Forecast Evaluation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 3, pages 99-134, Elsevier.
    5. Clark, Todd & McCracken, Michael, 2013. "Advances in Forecast Evaluation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1107-1201, Elsevier.
    6. Clarida, Richard H. & Sarno, Lucio & Taylor, Mark P. & Valente, Giorgio, 2003. "The out-of-sample success of term structure models as exchange rate predictors: a step beyond," Journal of International Economics, Elsevier, vol. 60(1), pages 61-83, May.
    7. Clark, Todd E. & McCracken, Michael W., 2001. "Tests of equal forecast accuracy and encompassing for nested models," Journal of Econometrics, Elsevier, vol. 105(1), pages 85-110, November.
    8. Todd E. Clark & Kenneth D. West, 2005. "Using Out-of-Sample Mean Squared Prediction Errors to Test the Martingale Difference," NBER Technical Working Papers 0305, National Bureau of Economic Research, Inc.
    9. Cheung, Yin-Wong & Chinn, Menzie D. & Pascual, Antonio Garcia, 2005. "Empirical exchange rate models of the nineties: Are any fit to survive?," Journal of International Money and Finance, Elsevier, vol. 24(7), pages 1150-1175, November.
    10. Clark, Todd E. & West, Kenneth D., 2006. "Using out-of-sample mean squared prediction errors to test the martingale difference hypothesis," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 155-186.
    11. Cheung, Yin-Wong & Chinn, Menzie & Garcia Pascual, Antonio, 2003. "Empirical Exchange Rate Models of the Nineties: Are Any Fit to Survive?," Santa Cruz Center for International Economics, Working Paper Series qt5fc508pt, Center for International Economics, UC Santa Cruz.
    12. Cheung, Yin-Wong & Chinn, Menzie & Garcia Pascual, Antonio, 2003. "Empirical Exchange Rate Models of the Nineties: Are Any Fit to Survive?," Santa Cruz Department of Economics, Working Paper Series qt5fc508pt, Department of Economics, UC Santa Cruz.
    13. Cheung, Yin-Wong & Chinn, Menzie David & Garcia Pascual, Antonio, 2003. "Empirical Exchange Rate Models of the Nineties: Are Any Fit to Survive?," Santa Cruz Department of Economics, Working Paper Series qt12z9x4c5, Department of Economics, UC Santa Cruz.
    14. Barbara Rossi, 2013. "Exchange Rate Predictability," Journal of Economic Literature, American Economic Association, vol. 51(4), pages 1063-1119, December.
    15. West, Kenneth D & McCracken, Michael W, 1998. "Regression-Based Tests of Predictive Ability," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 817-840, November.
    16. Yuan, Chunming, 2011. "The exchange rate and macroeconomic determinants: Time-varying transitional dynamics," The North American Journal of Economics and Finance, Elsevier, vol. 22(2), pages 197-220, August.
    17. Moosa, Imad & Burns, Kelly, 2014. "The unbeatable random walk in exchange rate forecasting: Reality or myth?," Journal of Macroeconomics, Elsevier, vol. 40(C), pages 69-81.
    18. Norman R. Swanson & Halbert White, 1997. "A Model Selection Approach To Real-Time Macroeconomic Forecasting Using Linear Models And Artificial Neural Networks," The Review of Economics and Statistics, MIT Press, vol. 79(4), pages 540-550, November.
    19. McCracken, Michael W., 2007. "Asymptotics for out of sample tests of Granger causality," Journal of Econometrics, Elsevier, vol. 140(2), pages 719-752, October.
    20. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.

    More about this item

    JEL classification:

    • C1 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bes:jnlbes:v:13:y:1995:i:3:p:253-63. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Christopher F. Baum (email available below). General contact details of provider: http://www.amstat.org/publications/jbes/index.cfm?fuseaction=main .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.