This file is part of IDEAS, which uses RePEc data


[ Papers | Articles | Software | Books | Chapters | Authors | Institutions | JEL Classification | NEP reports | Search | New papers by email | Author registration | Rankings | Volunteers | FAQ | Blog | Help! ]

Forecast Evaluation and Combination

Author info | Abstract | Publisher info | Download info | Related research | Statistics
Author Info
Francis X. Diebold
Jose A. Lopez

Additional information is available for the following registered author(s):

Abstract

It is obvious that forecasts are of great importance and widely used in economics and finance. Quite simply, good forecasts lead to good decisions. The importance of forecast evaluation and combination techniques follows immediately -- forecast users naturally have a keen interest in monitoring and improving forecast performance. More generally, forecast evaluation figures prominently in many questions in empirical economics and finance. We provide selective account of forecast evaluation and combination methods. First we discuss evaluation of a single forecast, and in particular, evaluation of whether and how it may be improved. Second, we discuss the evaluation and comparison of the accuracy of competing forecasts. Third, we discuss whether and how a set of forecasts may be combined to produce a superior composite forecast. Fourth, we describe a number of forecast evaluation topics of particular relevance in economics and finance, including methods for evaluating direction-of-change forecasts, probability forecasts and volatility forecasts.

Download Info
To download:

If you experience problems downloading a file, check if you have the proper application to view it first. Information about this may be contained in the File-Format links below. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://www.nber.org/papers/t0192.pdf
File Format: application/pdf
File Function:
Download Restriction: Access to the full text is generally limited to series subscribers, however if the top level domain of the client browser is in a developing country or transition economy free access is provided. More information about subscriptions and free access is available at http://www.nber.org/wwphelp.html.

As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.

Publisher Info
Paper provided by National Bureau of Economic Research, Inc in its series NBER Technical Working Papers with number 0192.

Download reference. The following formats are available: HTML (with abstract), plain text (with abstract), BibTeX, RIS (EndNote, RefMan, ProCite), ReDIF
Length:
Date of creation: Mar 1996
Date of revision:
Handle: RePEc:nbr:nberte:0192

Note: EFG
Contact details of provider:
Postal: National Bureau of Economic Research, 1050 Massachusetts Avenue Cambridge, MA 02138, U.S.A.
Phone: 617-868-3900
Email:
Web page: http://www.nber.org
More information through EDIRC

For technical questions regarding this item, or to correct its listing, contact: ().

Related research
Keywords:

Other versions of this item:

Find related papers by JEL classification:
C5 - Mathematical and Quantitative Methods - - Econometric Modeling

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

  1. Jose A. Lopez, 1995. "Evaluating the predictive accuracy of volatility models," Research Paper 9524, Federal Reserve Bank of New York. [Downloadable!]
    Other versions:
  2. Engle, Robert F & Kozicki, Sharon, 1993. "Testing for Common Features," Journal of Business & Economic Statistics, American Statistical Association, vol. 11(4), pages 369-80, October.
    Other versions:
  3. Pesaran, M Hashem & Timmermann, Allan, 1992. "A Simple Nonparametric Test of Predictive Performance," Journal of Business & Economic Statistics, American Statistical Association, vol. 10(4), pages 561-65, October.
    Other versions:
  4. Pagan, Adrian R. & Schwert, G. William, 1990. "Alternative models for conditional stock volatility," Journal of Econometrics, Elsevier, vol. 45(1-2), pages 267-290. [Downloadable!] (restricted)
    Other versions:
  5. Ray C. Fair & Robert J. Shiller, 1989. "The Informational Content of Ex Ante Forecasts," NBER Working Papers 2503, National Bureau of Economic Research, Inc. [Downloadable!] (restricted)
    Other versions:
  6. Fama, Eugene F, 1970. "Efficient Capital Markets: A Review of Theory and Empirical Work," Journal of Finance, American Finance Association, vol. 25(2), pages 383-417, May. [Downloadable!] (restricted)
  7. Coulson, N.E. & Robins, R.P., 1989. "Forecast Combination In A Dynamic Setting," Papers 8-88-4, Pennsylvania State - Department of Economics.
  8. Steve Satchell & Allan Timmermann, 1995. "An Assessment of the Economic Value of Nonlinear Foreign Exchange Rate Forecasts," University of California at San Diego, Economics Working Paper Series 95-16, Department of Economics, UC San Diego.
  9. West, Kenneth D. & Edison, Hali J. & Cho, Dongchul, 1993. "A utility-based comparison of some models of exchange rate volatility," Journal of International Economics, Elsevier, vol. 35(1-2), pages 23-45, August. [Downloadable!] (restricted)
    Other versions:
  10. Brown, Bryan W & Maital, Shlomo, 1981. "What Do Economists Know? An Empirical Study of Experts' Expectations," Econometrica, Econometric Society, vol. 49(2), pages 491-504, March. [Downloadable!] (restricted)
  11. Campbell, John Y & Mankiw, N Gregory, 1987. "Are Output Fluctuations Transitory?," The Quarterly Journal of Economics, MIT Press, vol. 102(4), pages 857-80, November. [Downloadable!] (restricted)
    Other versions:
  12. Campbell, B. & Dufour, J.M., 1991. "Over-Rejections in Rational Expectations Models: a Nonparametric Approach to the Mankiw-Shapiro Problem," Cahiers de recherche 9116, Universite de Montreal, Departement de sciences economiques.
    Other versions:
  13. Diebold, Francis X. & Pauly, Peter, 1990. "The use of prior information in forecast combination," International Journal of Forecasting, Elsevier, vol. 6(4), pages 503-508, December. [Downloadable!] (restricted)
    Other versions:
  14. Hendry, David F & Mizon, Grayham E, 1978. "Serial Correlation as a Convenient Simplification, not a Nuisance: A Comment on a Study of the Demand for Money by the Bank of England," Economic Journal, Royal Economic Society, vol. 88(351), pages 549-63, September. [Downloadable!] (restricted)
  15. Leitch, Gordon & Tanner, J Ernest, 1991. "Economic Forecast Evaluation: Profits versus the Conventional Error Measures," American Economic Review, American Economic Association, vol. 81(3), pages 580-90, June. [Downloadable!] (restricted)
  16. Nelson, Charles R & Schwert, G William, 1977. "Short-Term Interest Rates as Predictors of Inflation: On Testing the Hypothesis That the Real Rate of Interest is Constant," American Economic Review, American Economic Association, vol. 67(3), pages 478-86, June. [Downloadable!] (restricted)
  17. Murphy, Allan H. & Winkler, Robert L., 1992. "Diagnostic verification of probability forecasts," International Journal of Forecasting, Elsevier, vol. 7(4), pages 435-455, March. [Downloadable!] (restricted)
  18. Cumby, Robert E & Huizinga, John, 1992. "Testing the Autocorrelation Structure of Disturbances in Ordinary Least Squares and Instrumental Variables Regressions," Econometrica, Econometric Society, vol. 60(1), pages 185-95, January. [Downloadable!] (restricted)
  19. Schnader, M H & Stekler, H O, 1990. "Evaluating Predictions of Change," Journal of Business, University of Chicago Press, vol. 63(1), pages 99-107, January. [Downloadable!] (restricted)
  20. Hansen, Lars Peter & Hodrick, Robert J, 1980. "Forward Exchange Rates as Optimal Predictors of Future Spot Rates: An Econometric Analysis," Journal of Political Economy, University of Chicago Press, vol. 88(5), pages 829-53, October. [Downloadable!] (restricted)
  21. Pesaran, M H, 1974. "On the General Problem of Model Selection," Review of Economic Studies, Blackwell Publishing, vol. 41(2), pages 153-71, April. [Downloadable!] (restricted)
  22. Fama, Eugene F & French, Kenneth R, 1988. "Permanent and Temporary Components of Stock Prices," Journal of Political Economy, University of Chicago Press, vol. 96(2), pages 246-73, April. [Downloadable!] (restricted)
  23. Chong, Yock Y & Hendry, David F, 1986. "Econometric Evaluation of Linear Macro-Economic Models," Review of Economic Studies, Blackwell Publishing, vol. 53(4), pages 671-90, August. [Downloadable!] (restricted)
  24. Diebold, Francis X, 1988. "Serial Correlation and the Combination of Forecasts," Journal of Business & Economic Statistics, American Statistical Association, vol. 6(1), pages 105-11, January.
  25. Engle, Robert F & Kozicki, Sharon, 1993. "Testing for Common Features: Reply," Journal of Business & Economic Statistics, American Statistical Association, vol. 11(4), pages 393-95, October.
  26. Merton, Robert C, 1981. "On Market Timing and Investment Performance. I. An Equilibrium Theory of Value for Market Forecasts," Journal of Business, University of Chicago Press, vol. 54(3), pages 363-406, July. [Downloadable!] (restricted)
  27. Fair, Ray C & Shiller, Robert J, 1990. "Comparing Information in Forecasts from Econometric Models," American Economic Review, American Economic Association, vol. 80(3), pages 375-89, June. [Downloadable!] (restricted)
  28. LeRoy, Stephen F & Porter, Richard D, 1981. "The Present-Value Relation: Tests Based on Implied Variance Bounds," Econometrica, Econometric Society, vol. 49(3), pages 555-74, May. [Downloadable!] (restricted)
  29. Bollerslev, T. & Ghysels, E., 1994. "Periodic Autoregressive Conditional Heteroskedasticity," Cahiers de recherche 9408, Universite de Montreal, Departement de sciences economiques. [Downloadable!]
    Other versions:
  30. Deutsch, Melinda & Granger, Clive W. J. & Terasvirta, Timo, 1994. "The combination of forecasts using changing weights," International Journal of Forecasting, Elsevier, vol. 10(1), pages 47-57, June. [Downloadable!] (restricted)
  31. Cumby, Robert E. & Modest, David M., 1987. "Testing for market timing ability : A framework for forecast evaluation," Journal of Financial Economics, Elsevier, vol. 19(1), pages 169-189, September. [Downloadable!] (restricted)
  32. Christoffersen, Peter F & Diebold, Francis X, 1996. "Further Results on Forecasting and Model Selection under Asymmetric Loss," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 11(5), pages 561-71, Sept.-Oct. [Downloadable!] (restricted)
    Other versions:
  33. Shiller, Robert J, 1979. "The Volatility of Long-Term Interest Rates and Expectations Models of the Term Structure," Journal of Political Economy, University of Chicago Press, vol. 87(6), pages 1190-1219, December. [Downloadable!] (restricted)
  34. Kenneth D. West, 1994. "Asymptotic Inference About Predictive Ability," Macroeconomics 9410002, EconWPA. [Downloadable!]
    Other versions:
  35. Diebold, Francis X & Rudebusch, Glenn D, 1989. "Scoring the Leading Indicators," Journal of Business, University of Chicago Press, vol. 62(3), pages 369-91, July. [Downloadable!] (restricted)
    Other versions:
  36. McCulloch, Robert & Rossi, Peter E., 1990. "Posterior, predictive, and utility-based approaches to testing the arbitrage pricing theory," Journal of Financial Economics, Elsevier, vol. 28(1-2), pages 7-38. [Downloadable!] (restricted)
  37. Meese, R. & Rogoff, K., 1988. "Was It Real? The Exchange Rate-Interest Differential Ralation Over The Modern Floating-Rate Period," Working papers 368, Wisconsin Madison - Social Systems.
    Other versions:
  38. Granger, C W J & Newbold, P, 1973. "Some Comments on the Evaluation of Economic Forecasts," Applied Economics, Taylor and Francis Journals, vol. 5(1), pages 35-47, March.
  39. Fama, Eugene F, 1975. "Short-Term Interest Rates as Predictors of Inflation," American Economic Review, American Economic Association, vol. 65(3), pages 269-82, June. [Downloadable!] (restricted)
  40. Francis X. Diebold & Lee E. Ohanian & Jeremy Berkowitz, 1995. "Dynamic Equilibrium Economies: A Framework for Comparing Models and Data," NBER Technical Working Papers 0174, National Bureau of Economic Research, Inc. [Downloadable!] (restricted)
    Other versions:
  41. Mark, Nelson C, 1995. "Exchange Rates and Fundamentals: Evidence on Long-Horizon Predictability," American Economic Review, American Economic Association, vol. 85(1), pages 201-18, March.
  42. Clements, M.P. & Hendry, D., 1992. "On the Limitations of Comparing Mean Square Forecast Errors," Economics Series Working Papers 99138, University of Oxford, Department of Economics.
  43. Francis X. Diebold & Peter Pauly, 1986. "Structural change and the combination of forecasts," Special Studies Papers 201, Board of Governors of the Federal Reserve System (U.S.).
  44. Bonham, Carl & Cohen, Richard, 1995. "Testing the Rationality of Price Forecasts: Comment," American Economic Review, American Economic Association, vol. 85(1), pages 284-89, March. [Downloadable!] (restricted)
  45. Christoffersen, Peter F, 1998. "Evaluating Interval Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 841-62, November.
  46. Clemon, Robert T & Winkler, Robert L, 1986. "Combining Economic Forecasts," Journal of Business & Economic Statistics, American Statistical Association, vol. 4(1), pages 39-46, January.
  47. Diebold, Francis X. & Lindner, Peter, 1996. "Fractional integration and interval prediction," Economics Letters, Elsevier, vol. 50(3), pages 305-313, March. [Downloadable!] (restricted)
  48. repec:att:wimass:199417 is not listed on IDEAS
  49. Peter F. Christoffersen & Francis X. Diebold, 1994. "Optimal Prediction Under Asymmetric Loss," NBER Technical Working Papers 0167, National Bureau of Economic Research, Inc. [Downloadable!] (restricted)
    Other versions:
  50. Dufour, J.M., 1981. "Rank Tests for Serial Dependence," Cahiers de recherche 8127, Universite de Montreal, Departement de sciences economiques.
    Other versions:
  51. Clemen, Robert T., 1989. "Combining forecasts: A review and annotated bibliography," International Journal of Forecasting, Elsevier, vol. 5(4), pages 559-583. [Downloadable!] (restricted)
  52. Campbell, Bryan & Ghysels, Eric, 1995. "Federal Budget Projections: A Nonparametric Assessment of Bias and Efficiency," The Review of Economics and Statistics, MIT Press, vol. 77(1), pages 17-31, February. [Downloadable!] (restricted)
  53. Cochrane, John H, 1988. "How Big Is the Random Walk in GNP?," Journal of Political Economy, University of Chicago Press, vol. 96(5), pages 893-920, October. [Downloadable!] (restricted)
  54. Diebold, Francis X & Mariano, Roberto S, 1995. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(3), pages 253-63, July.
    Other versions:
  55. Dufour, J.M. & Campbell, B., 1993. "Exact Nonparametric Orthogonality and Random Walk Tests," Cahiers de recherche 9326, Centre interuniversitaire de recherche en économie quantitative, CIREQ.
    Other versions:
Full references

Cited by:
(explanations, Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.)
This item has more than 25 citations. To prevent cluttering this page, these citations are listed on a separate page.
Statistics
Access and download statistics

Did you know? There is a FAQ (frequently asked questions).

This page was last updated on 2009-11-19.


This information is provided to you by IDEAS at the Department of Economics, College of Liberal Arts and Sciences, University of Connecticut using RePEc data on a server sponsored by the Society for Economic Dynamics.