Optimality Tests for Multi-Horizon Forecasts
Abstract
This paper develops and analyzes a series of tests to evaluate the optimality of forecasts when forecasts for more than one horizon are available. The tests are based on the property that the unconditional expected loss of optimal forecasts should not decrease with the forecast horizon (e.g., under quadratic loss the variance of optimal forecast errors should not decrease with the horizon). The tests complement existing methods of forecast evaluation, such as Mincer-Zarnowitz-type tests, by using an implication of optimality that directly concerns forecasts made at different horizons. The finite sample performance of the tests is analyzed and an illustration using the Survey of Professional Forecasters is provided.Download Info
If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.Bibliographic Info
Paper provided by Banco de México in its series Working Papers with number 2007-14.Length:
Date of creation: Dec 2007
Date of revision:
Handle: RePEc:bdm:wpaper:2007-14
Contact details of provider:
Web page: http://www.banxico.org.mx
More information through EDIRC
Related research
Keywords: Forecast Evaluation; Composite Hypothesis;Find related papers by JEL classification:
- C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
- C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
- E27 - Macroeconomics and Monetary Economics - - Macroeconomics: Consumption, Saving, Production, Employment, and Investment - - - Forecasting and Simulation: Models and Applications
References
References listed on IDEASPlease report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Capistran, Carlos, 2006. "On comparing multi-horizon forecasts," Economics Letters, Elsevier, vol. 93(2), pages 176-181, November.
- David F. Hendry & Michael P. Clements, 2001.
"Economic forecasting: some lessons from recent research,"
Working Paper Series
082, European Central Bank.
- Hendry, David F. & Clements, Michael P., 2003. "Economic forecasting: some lessons from recent research," Economic Modelling, Elsevier, vol. 20(2), pages 301-329, March.
- David Hendry & Michael P. Clements, 2001. "Economic Forecasting: Some Lessons from Recent Research," Economics Series Working Papers 78, University of Oxford, Department of Economics.
- Hendry, David F & Michael P. Clements, 2002. "Economic Forecasting: Some Lessons from Recent Research," Royal Economic Society Annual Conference 2002 99, Royal Economic Society.
- David Hendry & Michael P. Clements, 2001. "Economic Forecasting: Some Lessons from Recent Research," Economics Papers 2002-W11, Economics Group, Nuffield College, University of Oxford.
- Hasan Bakhshi & George Kapetanios & Anthony Yates, 2003.
"Rational expectations and fixed-event forecasts: an application to UK inflation,"
Bank of England working papers
176, Bank of England.
- H. Bakhshi & G. Kapetanios & T. Yates, 2005. "Rational expectations and fixed-event forecasts: An application to UK inflation," Empirical Economics, Springer, vol. 30(3), pages 539-553, October.
- Andrews, Donald W K, 1991.
"Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation,"
Econometrica,
Econometric Society, vol. 59(3), pages 817-58, May.
- Donald W.K. Andrews, 1988. "Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation," Cowles Foundation Discussion Papers 877R, Cowles Foundation for Research in Economics, Yale University, revised Jul 1989.
- Allan Timmermann & Andrew Patton, 2004.
"Properties of Optimal Forecasts under Asymmetric Loss and Nonlinearity,"
Working Papers
wp04-05, Warwick Business School, Financial Econometrics Research Centre.
- Patton, Andrew J. & Timmermann, Allan, 2007. "Properties of optimal forecasts under asymmetric loss and nonlinearity," Journal of Econometrics, Elsevier, vol. 140(2), pages 884-918, October.
- Zellner, Arnold, 1986. "Biased predictors, rationality and the evaluation of forecasts," Economics Letters, Elsevier, vol. 21(1), pages 45-48.
- Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
- Giacomini, Raffaella & White, Halbert, 2003.
"Tests of Conditional Predictive Ability,"
University of California at San Diego, Economics Working Paper Series
qt5jk0j5jh, Department of Economics, UC San Diego.
- Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
- Raffaella Giacomini & Halbert White, 2003. "Tests of Conditional Predictive Ability," Econometrics 0308001, EconWPA.
- Raffaella Giacomini & Halbert White, 2003. "Tests of conditional predictive ability," Boston College Working Papers in Economics 572, Boston College Department of Economics.
- Batchelor, Roy & Dua, Pami, 1991. "Blue Chip Rationality Tests," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 23(4), pages 692-705, November.
- Christoffersen, Peter F. & Diebold, Francis X., 1997.
"Optimal Prediction Under Asymmetric Loss,"
Econometric Theory,
Cambridge University Press, vol. 13(06), pages 808-817, December.
- Peter F. Christoffersen & Francis X. Diebold, 1997. "Optimal prediction under asymmetric loss," Working Papers 97-11, Federal Reserve Bank of Philadelphia.
- Peter F. Christoffersen & Francis X. Diebold, 1994. "Optimal Prediction Under Asymmetric Loss," NBER Technical Working Papers 0167, National Bureau of Economic Research, Inc.
- Christoffersen & Diebold, . "Optimal Prediction Under Asymmetric Loss," Home Pages 167, 1996., University of Pennsylvania.
- Peter F. Christoffersen & Francis X. Diebold, . "Optimal Prediction Under Asymmetric Loss," CARESS Working Papres 97-20, University of Pennsylvania Center for Analytic Research and Economics in the Social Sciences.
- Dean Croushore, 1993. "Introducing: the survey of professional forecasters," Business Review, Federal Reserve Bank of Philadelphia, issue Nov, pages 3-15.
- Elliott, Graham & Timmermann, Allan, 2002.
"Optimal Forecast Combination Under General Loss Functions and Forecast Error Distributions,"
University of California at San Diego, Economics Working Paper Series
qt15r9t2q2, Department of Economics, UC San Diego.
- Elliott, Graham & Timmermann, Allan, 2004. "Optimal forecast combinations under general loss functions and forecast error distributions," Journal of Econometrics, Elsevier, vol. 122(1), pages 47-79, September.
- Mc Cracken, Michael W., 2000. "Robust out-of-sample inference," Journal of Econometrics, Elsevier, vol. 99(2), pages 195-223, December.
- Diebold, Francis X & Mariano, Roberto S, 2002.
"Comparing Predictive Accuracy,"
Journal of Business & Economic Statistics,
American Statistical Association, vol. 20(1), pages 134-44, January.
- Diebold, Francis X & Mariano, Roberto S, 1995. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(3), pages 253-63, July.
- Francis X. Diebold & Robert S. Mariano, 1994. "Comparing Predictive Accuracy," NBER Technical Working Papers 0169, National Bureau of Economic Research, Inc.
- Chong, Yock Y & Hendry, David F, 1986. "Econometric Evaluation of Linear Macro-Economic Models," Review of Economic Studies, Wiley Blackwell, vol. 53(4), pages 671-90, August.
- Clive W.J. Granger, 1999. "Outline of forecast theory using generalized cost functions," Spanish Economic Review, Springer, vol. 1(2), pages 161-173.
- repec:att:wimass:9417 is not listed on IDEAS
- Kenneth D. West, 1994.
"Asymptotic Inference About Predictive Ability,"
Macroeconomics
9410002, EconWPA.
- West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-84, September.
- Victor Zarnowitz & Phillip Braun, 1993.
"Twenty-two Years of the NBER-ASA Quarterly Economic Outlook Surveys: Aspects and Comparisons of Forecasting Performance,"
NBER Chapters,
in: Business Cycles, Indicators and Forecasting, pages 11-94
National Bureau of Economic Research, Inc.
- Victor Zarnowitz & Phillip Braun, 1994. "Twenty-two Years of the NBER-ASA Quarterly Economic Outlook Surveys: Aspects and Comparisons of Forecasting Performance," NBER Working Papers 3965, National Bureau of Economic Research, Inc.
- repec:oxf:wpaper:078 is not listed on IDEAS
- Schmidt, Peter, 1974. "The Asymptotic Distribution of Forecasts in the Dynamic Simulation of an Econometric Model," Econometrica, Econometric Society, vol. 42(2), pages 303-09, March.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.Cited by:
- Patton, Andrew J & Timmermann, Allan G, 2011.
"Forecast Rationality Tests Based on Multi-Horizon Bounds,"
CEPR Discussion Papers
8194, C.E.P.R. Discussion Papers.
- Andrew J. Patton & Allan Timmermann, 2012. "Forecast Rationality Tests Based on Multi-Horizon Bounds," Journal of Business & Economic Statistics, American Statistical Association, vol. 30(1), pages 1-17, January.
Lists
This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.Statistics
Access and download statisticsCorrections
When requesting a correction, please mention this item's handle: RePEc:bdm:wpaper:2007-14For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Dirección de Sistemas).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.

